Where Stats Go

Elaborate on the merits of specific tournaments or have general theoretical discussion here.
Post Reply
User avatar
heterodyne
Rikku
Posts: 388
Joined: Tue Jun 26, 2012 9:47 am

Where Stats Go

Post by heterodyne » Sun Aug 05, 2018 9:32 pm

Quizbowl players like stats. One might even say they like stats too much. This surfaces every so often in a plague of people asking for stats in the thread of a tournament immediately after - or even during - the tournament happening.

Because of how annoying that kind of pestering can get, we might forget what the duties of tournament hosts are with respect to stats. It has been agreed for some time that keeping accurate stats is one of the things one implicitly agrees to when agreeing to host a tournament. I'd like to propose that those duties should be taken to also cover posting those stats in an easily accessible place that can be searched. Due to the vagaries of current quizbowl digital infrastructure, the only place that fits this description is the hsquizbowl.org database. Thanks to the wonderful work of Harry White, this database is searchable by player and team - an essential feature. While Neg5 and the vanilla hsquizbowl DB allow one to search by tournament name, tournaments often go by different names, and one might not even know what the name of the tournament they are looking for is - they might just want to see all of the tournaments a given person has played.

What does this mean for tournament hosts? Simply, if you are a user of Neg5, or the hosts of the Michigan EFT mirror, or Jonah Greenthal, the existence of semi-accessible stats in some place on the internet does not mean you have discharged your social duties as statskeeper or TD. Part of what you signed up for when you agreed to run a tournament was keeping a record of it. As much as I may like my last place finish at CO 2015 to remain hidden behind the awful search function on these forums, I still want to see the practice of uploading stats to the DB attain ubiquity.
Alston [Montgomery] Boyd
Bloomington High School '15
UChicago '19
UChicago Divinity '21
he/him/his or they/them/their

User avatar
Auks Ran Ova
Forums Staff: Chief Administrator
Posts: 4021
Joined: Sun Apr 30, 2006 10:28 pm
Location: Minneapolis
Contact:

Re: Where Stats Go

Post by Auks Ran Ova » Sun Aug 05, 2018 11:50 pm

I heartily endorse this event or product.
Rob Carson
University of Minnesota '11, MCTC '??
Member, ACF
Member, PACE
Writer and Editor, NAQT

User avatar
Aaron's Rod
Sec. of Cursed Images, Chicago SJW Cabal
Posts: 547
Joined: Wed Nov 27, 2013 7:29 pm

Re: Where Stats Go

Post by Aaron's Rod » Mon Aug 06, 2018 9:17 pm

I could not agree more with this. The quizbowl community is incredibly blessed to have people who are willing to work on very useful projects for free, and for no particular organization, simply because they should be done. (I have Harry White's player search saved on my bookmarks bar and I use it frequently.) Not to put words into Harry's or Matt's mouths, but I think the rest of us can help and show our appreciation by actually using the stats and tournament database these tools draw from. Finding CO stats was super cumbersome and annoying.

(Edited to link another great resource.)
Last edited by Aaron's Rod on Mon Aug 06, 2018 10:42 pm, edited 1 time in total.
Alex D.
Lawrence B.A., B.Mus. '16 // DePaul M.S. '18
Treasurer & Misconduct Form Rep, ACF
http://tinyurl.com/qbmisconduct
Midwest is best.

User avatar
A Very Long Math Tossup
Rikku
Posts: 257
Joined: Mon Dec 19, 2016 10:02 pm
Location: Boulder, CO
Contact:

Re: Where Stats Go

Post by A Very Long Math Tossup » Mon Aug 06, 2018 10:31 pm

Everyone in this thread is extremely correct.

One thing to add: please put your tournaments on the HSQB database as soon as they're announced, not just when you upload stats. Plenty of people use the database to search for upcoming tournaments (some of them indirectly through QBNotify), and those who don't habitually check the forums should still be able to find your tournament announcement easily.

Also, please provide properly formatted addresses for your tournament. It makes parsing a hell of a lot easier.
Matt Mitchell
Colorado '20
Treasure Valley '16
QBNotify creator, Colorado Quiz Bowl founder, PACE member

User avatar
Haaaaaaaarry Whiiiiiiiiiite
Auron
Posts: 1113
Joined: Tue Dec 04, 2007 8:46 pm
Location: Fairfax, VA
Contact:

Re: Where Stats Go

Post by Haaaaaaaarry Whiiiiiiiiiite » Mon Aug 06, 2018 11:24 pm

With regards to Neg5, I'd like to include it in my question database, but as far as I can tell there's no easy way to get a list of every tournament hosted on the site. If there were, I'd certainly be willing to include it.
Harry White
TJHSST '09
Virginia Tech '13
Tournament Database Search by Team
Will run stats for food

User avatar
UlyssesInvictus
Yuna
Posts: 775
Joined: Thu Feb 10, 2011 7:38 pm

Re: Where Stats Go

Post by UlyssesInvictus » Mon Aug 06, 2018 11:40 pm

Haaaaaaaarry Whiiiiiiiiiite wrote:With regards to Neg5, I'd like to include it in my question database, but as far as I can tell there's no easy way to get a list of every tournament hosted on the site. If there were, I'd certainly be willing to include it.
Inspecting the network request, it looks like this url gives you a JSON response of tournament names, dates, and links:

https://stats.neg5.org/api/t/byDateRang ... 00:00.000Z

Where you correspondingly change the startDate and endDate parameters for what you want.

I'm not sure if there's some limit to the time period/# tournaments you get back, but I bet you could try just including a very large date range to start with, and experiment from there.
Raynor Kuang
quizdb.org
Harvard 2017, TJHSST 2013
I wrote GRAPHIC and FILM

User avatar
heterodyne
Rikku
Posts: 388
Joined: Tue Jun 26, 2012 9:47 am

Re: Where Stats Go

Post by heterodyne » Tue Aug 07, 2018 12:17 am

UlyssesInvictus wrote:
Haaaaaaaarry Whiiiiiiiiiite wrote:With regards to Neg5, I'd like to include it in my question database, but as far as I can tell there's no easy way to get a list of every tournament hosted on the site. If there were, I'd certainly be willing to include it.
Inspecting the network request, it looks like this url gives you a JSON response of tournament names, dates, and links:

https://stats.neg5.org/api/t/byDateRang ... 00:00.000Z

Where you correspondingly change the startDate and endDate parameters for what you want.

I'm not sure if there's some limit to the time period/# tournaments you get back, but I bet you could try just including a very large date range to start with, and experiment from there.
While Harry would be very kind indeed if he did the extra work to integrate your database, another solution would be uploading SQBS files onto the DB instead of hoping someone else does the work.
Alston [Montgomery] Boyd
Bloomington High School '15
UChicago '19
UChicago Divinity '21
he/him/his or they/them/their

User avatar
UlyssesInvictus
Yuna
Posts: 775
Joined: Thu Feb 10, 2011 7:38 pm

Re: Where Stats Go

Post by UlyssesInvictus » Tue Aug 07, 2018 12:31 am

heterodyne wrote:
UlyssesInvictus wrote:
Haaaaaaaarry Whiiiiiiiiiite wrote: [...] your database
While I greatly appreciate the work Harry does, and don't feel like the onus should be on him to do any extra work, I feel I ought to clarify that I have no formal relationship to Neg5. It's not "my database," and while I would happily help contribute code to the site (though I haven't to date), I don't want anyone to get any incorrect ideas about my relationship to the site.
Raynor Kuang
quizdb.org
Harvard 2017, TJHSST 2013
I wrote GRAPHIC and FILM

User avatar
Haaaaaaaarry Whiiiiiiiiiite
Auron
Posts: 1113
Joined: Tue Dec 04, 2007 8:46 pm
Location: Fairfax, VA
Contact:

Re: Where Stats Go

Post by Haaaaaaaarry Whiiiiiiiiiite » Tue Aug 07, 2018 12:55 am

UlyssesInvictus wrote:
Haaaaaaaarry Whiiiiiiiiiite wrote:With regards to Neg5, I'd like to include it in my question database, but as far as I can tell there's no easy way to get a list of every tournament hosted on the site. If there were, I'd certainly be willing to include it.
Inspecting the network request, it looks like this url gives you a JSON response of tournament names, dates, and links:

https://stats.neg5.org/api/t/byDateRang ... 00:00.000Z

Where you correspondingly change the startDate and endDate parameters for what you want.

I'm not sure if there's some limit to the time period/# tournaments you get back, but I bet you could try just including a very large date range to start with, and experiment from there.
That's exactly what I was looking for! I really should have thought of that earlier.
Harry White
TJHSST '09
Virginia Tech '13
Tournament Database Search by Team
Will run stats for food

User avatar
Beast Mode
Lulu
Posts: 88
Joined: Sat Sep 29, 2012 12:47 am

Re: Where Stats Go

Post by Beast Mode » Fri Aug 17, 2018 11:33 pm

heterodyne wrote:the hosts of the Michigan EFT mirror
I've done the stats. See my post in that tournament's thread for more on the incompleteness of the stats and what I did about it.
Saul Hankin
Michigan '13, '18
Yiddish Book Center '13-'14, Columbia '16

User avatar
vinteuil
Auron
Posts: 1307
Joined: Sun Oct 23, 2011 12:31 pm

Re: Where Stats Go

Post by vinteuil » Sun Oct 21, 2018 9:20 am

I was reminded this weekend that last year's Penn Bowl Northeast stats are only available on Neg5.

This is inexcusable. We as a community have committed to maintaining the stats repository on hsquizbowl.org precisely because 3rd party/external sources do, and have gone down in the past. (Stats from surprisingly recent ACF nationals are only available through archive.org, and some are just gone, it seems.)
Jacob Reed
Chicago ~'25
Yale '17, '19
East Chapel Hill '13
"...distant bayings from...the musicological mafia"―Denis Stevens

User avatar
AGoodMan
Rikku
Posts: 305
Joined: Sat Dec 20, 2014 10:25 pm
Location: Cambridge, MA or Warrenville, IL

Re: Where Stats Go

Post by AGoodMan » Sun Oct 21, 2018 2:11 pm

vinteuil wrote:
Sun Oct 21, 2018 9:20 am
I was reminded this weekend that last year's Penn Bowl Northeast stats are only available on Neg5.

This is inexcusable. We as a community have committed to maintaining the stats repository on hsquizbowl.org precisely because 3rd party/external sources do, and have gone down in the past. (Stats from surprisingly recent ACF nationals are only available through archive.org, and some are just gone, it seems.)
This will be uploaded by the end of this week.
Jon Suh
Wheaton Warrenville South '16
Harvard '20
PACE

User avatar
AGoodMan
Rikku
Posts: 305
Joined: Sat Dec 20, 2014 10:25 pm
Location: Cambridge, MA or Warrenville, IL

Re: Where Stats Go

Post by AGoodMan » Sun Oct 21, 2018 4:46 pm

AGoodMan wrote:
Sun Oct 21, 2018 2:11 pm
vinteuil wrote:
Sun Oct 21, 2018 9:20 am
I was reminded this weekend that last year's Penn Bowl Northeast stats are only available on Neg5.

This is inexcusable. We as a community have committed to maintaining the stats repository on hsquizbowl.org precisely because 3rd party/external sources do, and have gone down in the past. (Stats from surprisingly recent ACF nationals are only available through archive.org, and some are just gone, it seems.)
This will be uploaded by the end of this week.
By end of this week, I mean today: prelims & combined.
Jon Suh
Wheaton Warrenville South '16
Harvard '20
PACE

User avatar
vinteuil
Auron
Posts: 1307
Joined: Sun Oct 23, 2011 12:31 pm

Re: Where Stats Go

Post by vinteuil » Sun Oct 21, 2018 4:50 pm

AGoodMan wrote:
Sun Oct 21, 2018 4:46 pm
AGoodMan wrote:
Sun Oct 21, 2018 2:11 pm
vinteuil wrote:
Sun Oct 21, 2018 9:20 am
I was reminded this weekend that last year's Penn Bowl Northeast stats are only available on Neg5.

This is inexcusable. We as a community have committed to maintaining the stats repository on hsquizbowl.org precisely because 3rd party/external sources do, and have gone down in the past. (Stats from surprisingly recent ACF nationals are only available through archive.org, and some are just gone, it seems.)
This will be uploaded by the end of this week.
By end of this week, I mean today: prelims & combined.
Thanks for the quick turnaround on this!
Jacob Reed
Chicago ~'25
Yale '17, '19
East Chapel Hill '13
"...distant bayings from...the musicological mafia"―Denis Stevens

Post Reply