Meta Question

johnpowell's avatar

So I did some scraping and nerd stuff and came up with data about if we only have 20 active members. Anyone care to see my results?

Asked by johnpowell (9306 points ) April 23rd, 2014

I grabbed the last 500 questions using WGET. For simplicity I counted the times each user responded. But it should give a general idea.

Note that this isn’t perfect. The number next to the name is the number of questions or answers they left in the last 500 questions. This is long…..

johns-Mac-Pro:Desktop johnpowell$ sort users.txt | uniq -c | sort -nr
348 JLeslie
347 GloPro
329 Mimishu1995
303 Coloma
297 Cruiser
286 Adirondackwannabe
263 Symbeline
228 ibstubro
227 Seek
208 KNOWITALL
200 Hypocrisy_Central
188 dappled_leaves
181 janbb
173 ucme
170 rojo
162 Jonesn4burgers
160 gailcalled
157 ragingloli
123 zenvelo
121 Dan_Lyons
112 johnpowell
111 Dutchess_III
109 jerv
102 bolwerk
100 Smitha
98 livelaughlove21
98 hominid
96 ARE_you_kidding_me
92 filmfann
87 Darth_Algar
85 Hawaii_Jake
83 hearkat
82 jca
80 talljasperman
75 cazzie
72 elbanditoroso
71 kritiper
71 Judi
70 SavoirFaire
70 Blondesjon
69 Winter_Pariah
68 LuckyGuy
66 stanleybmanly
66 pleiades
62 Espiritus_Corvus
60 El_Cadejo
59 whitenoise
58 Pachy
55 dxs
54 cookieman
52 Eggie
52 Brian1946
50 SecondHandStoke
48 longgone
47 flip86
47 AshLeigh
46 BeenThereSaidThat
45 syz
42 Juels
41 SQUEEKY2
41 LornaLove
40 downtide
40 Aster
38 PhiNotPi
36 Tropical_Willie
35 Kropotkin
34 CWOTUS
33 jtvoar16
31 Stinley
30 eno
30 FlyingWolf
29 seekingwolf
29 ZEPHYRA
29 DigitalBlue
28 flutherother
27 anniereborn
27 Leanne1986
27 Dog
26 thorninmud
25 Kardamom
25 Bill1939
24 gondwanalon
24 canidmajor
24 Blackberry
23 Yetanotheruser
23 RealEyesRealizeRealLies
23 Jaxk
23 Adagio
21 cheebdragon
21 Paradox25
21 DominicX
21 Buttonstc
20 tedibear
20 jaytkay
20 Wealthadvisor
20 SpatzieLover
20 LostInParadise
18 wildpotato
18 kevbo
17 turtlesandbox
17 chyna
17 XOIIO
17 Lightlyseared
17 BhacSsylan
15 SadieMartinPaul
14 dabbler
14 augustlan
14 RocketGuy
13 trailsillustrated
13 Seaofclouds
13 Pied_Pfeffer
12 yankeetooter
12 poofandmook
12 Smashley
12 Silence04
12 Bluefreedom
11 fluthernutter
11 Inspired_2write
10 josie
10 flo
10 antimatter
10 Cupcake
10 Afos22
9 tinyfaery
9 rexacoracofalipitorius
9 creative1
9 TheRealOldHippie
9 BadWolf
8 zenzen
8 users/cazzie/cazzie/minime_thu
8 shrubbery
8 non_omnis_moriar
8 mazingerz88
8 bomyne
8 GracieT
7 muppetish
7 :/users/RealEyesRealizeRealLie
6 rockfan
6 Pandora
6 Michael_Huntington
6 Dr_Lawrence
6 28lorelei
6 /users/RealEyesRealizeRealLies
5 snowberry
5 redhen4
5 nerevars
5 marksonos
5 marinelife
5 funkdaddy
5 chinchin31
5 bossob
5 WhovianGirl18
5 MarvinPowell
5 2davidc8
4 laura98
4 kimchi
4 debrastaphan
4 bunnywok
4 SnoopyGirl
4 PriceisRightx26
4 Mr_Saturn512
4 GoldieAV16
4 BiZhen
3 users/Hawaii_Jake/hawaii_jake/
3 serenityNOW
3 idk777
3 herculies
3 flutherbrother
3 deni
3 bea2345
3 akhonazulu
3 ahro0703
3 SquirrelEStuff
3 Sheenwills
3 Nullo
3 NobavaMliccreyrary
3 MichaelAndrews
3 LeavesNoTrace
3 FireMadeFlesh
3 DaphneT
3 CocoSmith
3 Aristeia
3 2TFX
3 1TubeGuru
3 /users/Imadethisupwithnoforeth
2 z_malloc
2 users/dappled_leaves/dappled_l
2 users/SpatzieLover/SpatzieLove
2 users/Pied_Pfeffer/Pied_Pfeffe
2 users/JLeslie/JLeslie/snowflak
2 tups
2 tashasudo
2 sunshineluv66
2 skigirl
2 simone54
2 savings45678
2 rory
2 raven860
2 prasad
2 picante
2 ninjacolin
2 ml3269
2 mineown
2 majorrich
2 linguaphile
2 kristi
2 jlk2525
2 fredTOG
2 evajones123
2 ayammy96
2 amujinx
2 Uberwench
2 Stal_girl
2 ScottyMcGeester
2 SSS911
2 RockerChick14
2 Patton
2 Ninasimon
2 LDRSHIP
2 JG0207
2 Incoherency_
2 Gifted_With_Languages
2 Dennisphilips333
2 AstroChuck
1 zitagoodall
1 xTheDreamer
1 whydoimisshim
1 wardcarol
1 victord66
1 users/zenvelo/zenvelo/pepito_t
1 users/stanleybmanly/stanleybma
1 users/rojo/rojo/smaller_thumb.
1 users/metadog/b217364664_7541d
1 users/janbb/janbb/janbbDrJbook
1 users/Seek/Seek_Kolinahr/typic
1 users/SadieMartinPaul/f464895_
1 users/KNOWITALL/KNOWITALL/kent
1 users/Hypocrisy_Central/Hypocr
1 users/Dan_Lyons/f464895_e07fb4
1 users/Cruiser/Cruiser/100_0082
1 users/Aqua/Aqua/water-drop_thu
1 troubleinharlem
1 thatturtle
1 sinscriven
1 sbglobal123
1 sarahjessicax
1 romanc667
1 rhelliker
1 reijinni
1 raj79
1 radiyahawatifkalb6
1 prolificus
1 philosopher
1 pallen123
1 nmguy
1 njaliwebandamalawi
1 moverssingapores
1 metadog
1 maroon
1 marcussherman70
1 mangeons
1 kounoupi
1 hippocratesinst
1 geeky_mama
1 gambitking
1 diamondhead
1 dhwanishdave
1 davieswilliam
1 dangote
1 crushingandreaming
1 chelle21689
1 cartroubles2014
1 birdbaby
1 basstrom188
1 babaji
1 artking27
1 aroyalandarebel
1 anand007
1 XTREMITY666
1 Wine
1 WaylonCongdon
1 TossingSpades
1 Thammuz
1 SwanSwanHummingbird
1 SommerShelor
1 Some_Ghost
1 SalajusLyjidobbie
1 RosauraHeaton
1 Rebel26
1 RareDenver
1 Random1324
1 Payingforcollege
1 Palkobratislava
1 OsbornepumyCorkyie
1 NewportChick
1 MzWitt
1 MickeyB
1 MichalLoch
1 Mat3
1 MarcoDemarco
1 LumuckseGilltyian
1 LemonxiLaybtrewicia
1 Khajuria9
1 KayleighCaddell
1 Juliasmile
1 Jonathan_hodgkins
1 JannetteMinchew
1 JackPatterson
1 Ginaz10
1 Feta
1 Exitor98
1 ErikBailey35
1 DrasticDreamer
1 DonyaBujtiolqedt
1 BosM
1 Blobman
1 AshlynM
1 AnonymousWoman
1 AnnieMiller
1 America
1 Amandabaynes
1 Allie

Observing members: 0 Composing members: 0

48 Answers

kevbo's avatar

Needs moar Astrochuck.

in all seriousness, my initial reaction is that there’s no one I find irreparably annoying (which means there aren’t some names here that used to be), so that’s good.

johnpowell's avatar

No shit.. 2 posts. What a tosser.

kevbo's avatar

They turn seven, and it’s like you never existed.

Hypocrisy_Central's avatar

If the list was started from the top down, taking the top 20 active Flutheronians, you would miss the cut by one member; did you realize that?

ucme's avatar

Nowt like facts to blow random guesswork out the window.
Had a feeling you’d come up with something more concrete, good stuff.

GloPro's avatar

Man, that was the push I needed to go to the doctor about my insomnia.

Mimishu1995's avatar

HA! I’M THE THIRD!

Guess my machine gun did a swell job after all ~

Thanks @johnpowell. You completed the active jellies’ hall-of-fame for me.

LuckyGuy's avatar

You can run this same analysis at other times and plot member life changes. For example, I know one member who was here a lot but just had a child. My participation waxes and wanes depending upon how close I am to a significant delivery deadline. If you see a significant change you can infer something is going on.

This is another example of why I consider you one of the brightest bulbs on the tree.
Thanks!!!

hominid's avatar

Thanks @johnpowell. I’ve always imagined it would be quite satisfying to have direct access (read-only of course) to fluther’s db. The amount of analysis and reports we could generate pretty easily would be interesting (to me).

Mimishu1995's avatar

This board also confirms my hunch too: there are more active female members than males.

PhiNotPi's avatar

In the earlier thread, I estimated the number of active question askers to be 123. Your data includes both askers and answerers, so it is going to be much longer. The 123rd person in the list is Afos22 with 10 answers/comments. So, my estimate does not account for every user, but accounts for 90% of all activity.

ucme's avatar

I don’t recognise half of those names listed, not a clue who they are.

Stinley's avatar

Love a geeky list, thanks JP

PhiNotPi's avatar

Okay, so here is some analysis of this data:

There were 322 users on this list.

The top 20 users are responsible for 48.8% of all posts. This is a pretty huge percentage.

Using the same estimation procedure I used in the previous thread, we can see how “complete” this list is. My sample size was 140, but this sample size is 9163 (and includes answers). With 9163 posts, 322 users, and 98 people who appeared once:

E = 322 / (1 – 98/9163)
E = 325.677

So, this list is pretty much completely inclusive of all active users, since the measured number of users (322) is about the same as the expected number of users (326).

We could take a larger sample, but doing so would involve sampling older and older threads, at which point the word “active” no longer applies. Eventually, the list would include all 30422 users who have ever answered a thread.

Cruiser's avatar

@johnpowell What is this other listing with my name?

1 users/Cruiser/Cruiser/100_0082

I see other Jellies listed again with 2 users and 3 users? Can you explain this?

GloPro's avatar

@Cruiser That was when I logged in and answered for you. Someone has to agree with me every now and again.

PhiNotPi's avatar

@Cruiser There appear to be about 20 or so such errors in the data. I don’t know the exact reason, but I suppose it must be errors in the skimming. I assume that these errors must be fixed by hand.

Mimishu1995's avatar

Poor Mr Some_Ghost…

dappled_leaves's avatar

“Privacy Policy
...
We won’t share your info with any third parties without your explicit permission, unless the law or some imminent harm requires it.”

Just saying.

gailcalled's avatar

Thanks, John. It may not be perfect, but it is fun to see.

It confirms who the blabbermouths are. I fall in at the low end of the top twenty.. #18 and less than half the Q + A of the gold, silver and bronze medalists.

ucme's avatar

^^ #17

Symbeline's avatar

Blabbermouths unite, punk!

Dan_Lyons's avatar

Nice follow up to my question a few days ago, @johnpowell

ucme's avatar

@Symbeline Haha, you outdone me by almost a hundred, always said women have bigger gobs :)

johnpowell's avatar

Where it says things like users/zenvelo/zenvelo/pepito_t that is just anomalies that the regex couldn’t clean up without doing more work than I wanted to.

johnpowell's avatar

@LuckyGuy :: I have a copy of all the questions ever asked, all 170K of them. Since there are timestamps you could graph a users activity over time. But that is way more work than I would want to do. And it would be so very computationally intensive.

I used GREP to basically pull out every instance that a persons avatar shows up. Then a regex to strip it down to just the username. That is why there are some errors. The thing is GREP starts shitting all over itself at about 10,000 files. I could do it in batches but I don’t care enough.

If anyone wants a zipped file of the HTML for all the questions ever asked I could upload it. It is rather large and would take me a few days.

ucme's avatar

I wonder if some of the people at the very top of the list may back off a little, at least for a while.
“Addicted to Fluther, who…me?”

Symbeline's avatar

I refuse. :p

ucme's avatar

@Symbeline I never said anyone should now did I? :)
Nowt wrong with being a hyperactive member no need for viagra but some might feel a little overexposed.

Symbeline's avatar

Yeah, but seriously I drank way too much coffee today. I think I should go for a walk or something haha.

ucme's avatar

Go barefoot, it’s good for the sole…err…

johnpowell's avatar

I don’t think anyone is using the site to much. There is nothing wrong with being at the top of the list. People on the top make solid contributions and are probably responsible for keeping things going.

All I can say is thank god for the three questions a day limit.

ucme's avatar

Already got that covered.

Coloma's avatar

@johnpowell Sooo…do us top 5 blabbermouths get some sort of major award?
I think you need to cough up some tickets to paradise here.

stanleybmanly's avatar

great effort! thanks.

Dan_Lyons's avatar

Fluther T-Shirts all around @Coloma

pleiades's avatar

I still miss SHIPPY! </3

pleiades's avatar

Interesting stuff though jp! I feel like I’m dab stuck right in the middle

Symbeline's avatar

@johnpowell So if I understand how this works, say you redid the whole thing today, and still grabbed the last 500 questions, the numbers would change. (not asking you to redo it) Just curious.

johnpowell's avatar

Correct. When I grabbed the data I pulled in the last 500 questions. It would probably be very different if I redid it now. I know a good chunk of all mine came from only a few questions that might not be in the current last 500.

KNOWITALL's avatar

Good work, I’m trying to reduce my time to enjoy the summer so I should move down soon. ;)

Dog's avatar

WHOAH- I actually made it on the list.

You have all 170k questions? A lot of hidden gems in there…. Some seriously funny too.

Mimishu1995's avatar

@Dog See my power already? ~

dxs's avatar

This is so cool! I’m #49, and at 55 of 500 I still feel like I’m very active. So there’s definitely more than 50 active Jellies.

Haleth's avatar

Aw, I don’t seem to be on there. (Sad trombone.)

Anyway, it’s really cool that you did this! Fluther is like an online version of the neighborhood watering hole. It’s like we’ve just seen everybody’s bar tabs.

johnpowell's avatar

No shame in being a big drunk.

gailcalled's avatar

And everyone knows who is bellying up to the bar regularly without seeing his bar tab.

Answer this question

Login

or

Join

to answer.
Your answer will be saved while you login or join.

Have a question? Ask Fluther!

What do you know more about?
or
Knowledge Networking @ Fluther