|
|
| Author |
Message |
Stata
Group: Members
Joined: 09 Oct 2013
Posts: 1
Gold: 0.60
Status:
Warn: 
Reputation: 0
|
 #1 Posted: 11 Oct 2013 02:59 am Post subject: D2jsp stats and the reason the site was down last week |
 |
|
So I scraped all the profiles on d2jsp Saturday morning. Code was buggy and it managed to crash jsp for a while. Njag suspended for a bit but I was able to continue scraping soon after.
Honestly, I didn't think he gave a shit about me scraping publicly available data. I posted a lot of the stats on d2jsp and the thread was closed. Njag then threatened me and banned me.
Currently, he has upped the security on viewing profiles (apparently after viewing 20, you're blocked from viewing more for 20 minutes or so.
I still have all this data that is about 5 days old. Idk if it's of any interest to anyone here. I collected fg, post count, post per day, warn, trade status, group (members/moderator/etc), join date, and last seen
The total fg on the site (I include fg on banned accounts/validating accounts) is 168 million. The top 1% control about half of this, depending on how you define top 1%.
Edit: Feel free to request any specific type of analysis on the data on any of the stats I mentioned. I can also do user searches by name or join date, w/e. All of the data is in Stata, easily analyzed on the fly. Also have more complex wealth distribution graphs plotted, etc.
| Code: |
Users tabulated by Group
Group | Freq. Percent Cum.
------------------+-----------------------------------
Banned | 78,272 10.95 10.95
Validating | 2,106 0.29 11.25
Members | 633,995 88.73 99.98
Retired Moderator | 91 0.01 99.99
Staff | 46 0.01 100.00
------------------+-----------------------------------
Total | 714,510 100.00
|
Plenty more stats if anyone cares
| Code: |
Top 100 Richest
+------------------------------------------------------------+
| username userid gold groupidg |
|------------------------------------------------------------|
1. | boosbo(bg) 187314 1325117 Validating |
2. | Osking 203897 1023185.8 Members |
3. | Fisherolol 217463 647861.88 Members |
4. | Hownache 726239 539258.29 Members |
5. | Hagos 196866 500019.5 Members |
|------------------------------------------------------------|
6. | eekzie 226463 417451.59 Members |
7. | mangjerk 754093 400000 Members |
8. | AndrewEz 392824 380570 Members |
9. | Imk0tter 237482 359999.99 Members |
10. | Nevada 603646 348080 Members |
|------------------------------------------------------------|
11. | Sicktricks 228586 331145 Members |
12. | JOECOOL66 387084 326404.13 Members |
13. | Plaguelord 952988 323105.69 Members |
14. | BroBro 290008 317700 Members |
15. | bobass 273591 301190.5 Members |
|------------------------------------------------------------|
16. | Orangedub 384137 301069.8 Members |
17. | PerfectRead247 912682 301000.02 Members |
18. | HawkJuice 550301 290416.51 Members |
19. | kdog3682 411254 269740 Members |
20. | sancorro 779682 267500 Members |
|------------------------------------------------------------|
21. | belikeme 219279 265298 Members |
22. | Paput 255932 256068.1 Members |
23. | zackaria_dki 182609 255047 Retired Moderator |
24. | metroid 285276 254355 Members |
25. | Tell 370019 251757.7 Members |
|------------------------------------------------------------|
26. | uF. 168870 246648 Members |
27. | spak 249656 246225 Members |
28. | Slowtoanger 679228 246126 Members |
29. | VisualTactics 281380 244520 Members |
30. | pro_user 109934 230395.03 Members |
|------------------------------------------------------------|
31. | Indent 973986 230096.37 Members |
32. | Kevin 215860 228193 Staff |
33. | Darwing 477919 225841.08 Members |
34. | PlzTryAgain 474301 223478 Members |
35. | Justinian 942732 221304.9 Members |
|------------------------------------------------------------|
36. | rs94bluecam 154931 221175 Members |
37. | Sane 260446 221034.7 Members |
38. | Fervent 880807 212430.01 Members |
39. | Saku 209076 204227 Members |
40. | mpn 899350 201995 Members |
|------------------------------------------------------------|
41. | Swatss 958185 200615 Members |
42. | Charity 243108 198105 Members |
43. | SnoW_Junk33 553004 195060 Members |
44. | MoXeR 514768 194765 Members |
45. | czuTas 230128 193590 Members |
|------------------------------------------------------------|
46. | Derp 650737 192061.01 Members |
47. | alupigus 677199 187708 Members |
48. | Yet_Low 894711 187200 Members |
49. | llo 669028 186840.01 Members |
50. | FantaExotic 640616 185200 Staff |
|------------------------------------------------------------|
51. | Metis 420082 184117.34 Members |
52. | Worseley 575314 183331 Members |
53. | MoooN 451916 182359.5 Members |
54. | frail 276787 181525.62 Members |
55. | dola 443298 180004.83 Members |
|------------------------------------------------------------|
56. | Neuroshima 670963 180000 Members |
57. | Tekals 967236 179168 Members |
58. | JigsawPuzzle 941021 174795.25 Members |
59. | Arkeus 357729 174671.01 Members |
60. | BrunoMars 296326 174182.72 Members |
|------------------------------------------------------------|
61. | thomashou913 179559 172790 Members |
62. | infallibleleo 549309 172271 Members |
63. | FML 786318 172000.69 Members |
64. | PokerExpert 748039 169840 Members |
65. | iridius 516070 162994 Members |
|------------------------------------------------------------|
66. | bluefall 179896 162000 Members |
67. | artemisdz 352409 159836.62 Members |
68. | Sammyray 218122 157310.81 Members |
69. | rlee87 935870 156459.42 Members |
70. | dexa_n00b 102342 155991.09 Members |
|------------------------------------------------------------|
71. | LP_Soldier 279443 153050 Members |
72. | Monze 291476 153004 Members |
73. | luics 520751 152968 Members |
74. | K622 684279 152014.78 Members |
75. | Brenticus 321155 152000 Members |
|------------------------------------------------------------|
76. | Diagnosy-IV 158684 151900 Members |
77. | condenz 382766 150865 Members |
78. | diabloguo 722829 150441.54 Members |
79. | wraithful 647529 144409 Members |
80. | DiamondStarFall 971536 143830.96 Members |
|------------------------------------------------------------|
81. | Beowulf 212773 141923.01 Members |
82. | lyjsp3 462537 140381 Members |
83. | Dom24 556726 140355.22 Members |
84. | Noob_Production 329702 140163.5 Members |
85. | Starfold 1014542 138114 Members |
|------------------------------------------------------------|
86. | zeebee 5492 137788.99 Members |
87. | nickolai 456058 137260.79 Members |
88. | AVEDIS 275369 137111 Members |
89. | spidee 177422 136000.69 Members |
90. | the_nukestah 54387 132605.14 Members |
|------------------------------------------------------------|
91. | Pyroxate 287304 131924 Members |
92. | Sunline 333604 131286.8 Members |
93. | kubus_pl 293767 131201.03 Members |
94. | Wimmer 443119 129385.53 Members |
95. | Chg 867217 129300.11 Members |
|------------------------------------------------------------|
96. | Termn8tin_Cobra 784389 128500 Members |
97. | grvfs 185367 127130.35 Members |
98. | Alkaline 885859 126589.94 Members |
99. | thingislegendary 981189 126224.09 Members |
100. | Qualified 295178 125866.41 Banned |
|
Last edited by Stata on 11 Oct 2013 03:06 am; edited 1 time in total |
|
| Back to top |
|
 |
Nicholas
Group: Scammer
Joined: 06 Dec 2010
Posts: 1246
Gold: Locked
Status:
Warn:
Reputation: 14
|
| #2 Posted: 11 Oct 2013 04:45 am Post subject: |
|
|
| lol |
|
| Back to top |
|
|
Warrior55x
Group: Scammer
Joined: 27 May 2013
Posts: 7822
Gold: Locked
Status:
Warn:
Reputation: 81
|
| #3 Posted: 11 Oct 2013 05:33 am Post subject: |
|
|
wow |
|
| Back to top |
|
|
Nicholas
Group: Scammer
Joined: 06 Dec 2010
Posts: 1246
Gold: Locked
Status:
Warn:
Reputation: 14
|
| #4 Posted: 11 Oct 2013 06:13 am Post subject: |
|
|
| Jeffery mom |
|
| Back to top |
|
|
Cinemax
Group: Members
Joined: 05 Jul 2008
Donor: 
Posts: 8361
Gold: 12885.33
Clan: HoD II
Status:
Warn:
Reputation: 116
|
| #5 Posted: 11 Oct 2013 11:41 am Post subject: |
|
|
Cool
_____________________
|
|
| Back to top |
|
|
Just4Hacks
Group: Members
Joined: 26 Aug 2013
Posts: 615
Gold: 1589.79
Clan: D3JSP
Status:
Warn:
Reputation: 6
|
| #6 Posted: 11 Oct 2013 01:27 pm Post subject: |
|
|
| haha cool i remember seeing this the other day i think in general chat |
|
| Back to top |
|
|
Cory Top Donor
Group: Senior Moderator
Joined: 16 Mar 2011
Donor: 
Posts: 16588
Gold: 6.15
Clan: D3JSP
Status:
Warn:
Reputation: 166
|
| #7 Posted: 11 Oct 2013 01:41 pm Post subject: |
|
|
 |
|
| Back to top |
|
|
Warrior55x
Group: Scammer
Joined: 27 May 2013
Posts: 7822
Gold: Locked
Status:
Warn:
Reputation: 81
|
| #8 Posted: 11 Oct 2013 02:23 pm Post subject: |
|
|
| Cory wrote: | |
 |
|
| Back to top |
|
|
|
|
Nicholas
Group: Scammer
Joined: 06 Dec 2010
Posts: 1246
Gold: Locked
Status:
Warn:
Reputation: 14
|
| #9 Posted: 11 Oct 2013 03:14 pm Post subject: |
|
|
| :O |
|
| Back to top |
|
|
Warrior55x
Group: Scammer
Joined: 27 May 2013
Posts: 7822
Gold: Locked
Status:
Warn:
Reputation: 81
|
| #10 Posted: 11 Oct 2013 04:19 pm Post subject: |
|
|
oh rlly? |
|
| Back to top |
|
|
54bwsv HUE HUE HUE HUE HUE HUE HUE
Group: Members
Joined: 03 Oct 2013
Donor: 
Posts: 335
Gold: 71.90
Clan: Epic Clan Name
Status:
Warn:
Reputation: 8
|
| #11 Posted: 12 Oct 2013 07:15 pm Post subject: |
|
|
boosbo(bg) 187314 1325117 Validating
 |
|
| Back to top |
|
|
Warrior55x
Group: Scammer
Joined: 27 May 2013
Posts: 7822
Gold: Locked
Status:
Warn:
Reputation: 81
|
| #12 Posted: 12 Oct 2013 08:57 pm Post subject: |
|
|
| 54bwsv wrote: | boosbo(bg) 187314 1325117 Validating
|
O_O |
|
| Back to top |
|
|
|
RPG
Arcade
FAQ/Rules
Search
Memberlist
Usergroups
Live Chat
Log in
Register
