Tournament Database Search by Team

The scariest thing of all is Protobowl

Tournament Database Search by Team

Postby Megachile ambigua » Fri Mar 29, 2013 1:23 pm

http://hdwhite.org/qb/stats/
GitHub project page

I made a script that allows one to search the HSQB Tournament Database and NAQT's tournament database for all results for a given team, ordered by date. At the moment, it's fairly bare-bones, but as far as I can tell, it works perfectly fine. It's going to be limited to what is actually listed on the stats page itself, so searching for "Virginia" will return results for "Virginia A", but not "UVA" (and it'll also show results for "Virginia Tech").

Let me know if you have any suggestions or find any errors -- using Regex to parse a webpage isn't exactly the most precise of methods.
Last edited by Megachile ambigua on Thu Jun 05, 2014 10:12 am, edited 4 times in total.
Harry White
TJHSST '09
Virginia Tech '13
Tournament Database Search by Team
Will run stats for food
User avatar
Megachile ambigua
Auron
 
Posts: 1064
Joined: Tue Dec 04, 2007 8:46 pm
Location: Fairfax, VA

Re: Tournament Database Search by Team

Postby Corry » Fri Apr 05, 2013 12:19 pm

Very nice! I hope that a feature like this can eventually be implemented into hsquizbowl.org's own search tool.
Corry Wang
Arcadia High School 2013
Amherst College 2017
NAQT Writer and Subject Editor
User avatar
Corry
Rikku
 
Posts: 317
Joined: Fri Feb 10, 2012 11:54 pm

Re: Tournament Database Search by Team

Postby jonpin » Fri Apr 05, 2013 2:59 pm

I am glad such a thing exists now. For better or for worse, the primary feature of the site up until now has been to input stats for tournaments that have happened, not to post anything about tournaments that have not yet happened. But finding stats after a few days have passed and the "Recent posted" list has cycled is a bit frustrating, especially if the person who submitted the stats didn't fully fill out the tournament information (location, set used, etc.).
Jon Pinyan
Coach, Bergen County Academies (NJ); former player for BCA (2000-03) and WUSTL (2003-07)
HSQB forum mod, PACE member
Stat director for: NSC '13-'15; NHBB '13-'15; ACF '14, '17; NASAT '11

"A [...] wizard who controls the weather" - Jerry Vinokurov
User avatar
jonpin
Forums Staff: Moderator
 
Posts: 1876
Joined: Wed Feb 04, 2004 6:45 pm
Location: BCA NJ / WUSTL MO / Hackensack NJ

Re: Tournament Database Search by Team

Postby Megachile ambigua » Thu Apr 11, 2013 10:23 pm

So me forgetting to close a tag made this site not work for a day. Sorry about that; it has been fixed.
Harry White
TJHSST '09
Virginia Tech '13
Tournament Database Search by Team
Will run stats for food
User avatar
Megachile ambigua
Auron
 
Posts: 1064
Joined: Tue Dec 04, 2007 8:46 pm
Location: Fairfax, VA

Re: Tournament Database Search by Team

Postby AKKOLADE » Wed May 22, 2013 9:29 am

This has been super useful for me; thanks for doing this, Harry.
Fred Morlan
PACE Vice President of Outreach, 2017-18
University of Kentucky CoP, 2017
hsqbrank manager, PACE member (former President and At Large member of Board), NAQT writer (former subject editor), HSAPQ freelance writer, former hsqb Administrator/Chief Administrator, 2012 NASAT Tournament Director
User avatar
AKKOLADE
Sin
 
Posts: 14429
Joined: Thu Apr 24, 2003 8:08 am

Re: Tournament Database Search by Team

Postby Megachile ambigua » Fri Aug 23, 2013 4:44 pm

I've made a few updates to the search. Using apostrophes should no longer break the thing (and naming your team "Ladue'); DROP TABLE teams; --" should no longer make me cry). I've also implemented searching with OR (so you don't have to search for TJ and Thomas Jefferson in two different searches). Let me know if you guys would like me to add in certain features.

Also, is there a way to tell the last time a tournament database entry has been updated?
Harry White
TJHSST '09
Virginia Tech '13
Tournament Database Search by Team
Will run stats for food
User avatar
Megachile ambigua
Auron
 
Posts: 1064
Joined: Tue Dec 04, 2007 8:46 pm
Location: Fairfax, VA

Re: Tournament Database Search by Team

Postby ScoBo » Fri Aug 23, 2013 5:10 pm

huff paste wrote:Also, is there a way to tell the last time a tournament database entry has been updated?

No, I think the only timestamps I keep track of at this point are when a stat report was first uploaded (or created, I'm not sure) and when a question set had packets posted. These are currently just used for the query to populate the "recently posted" sections of the main page - I don't believe they are ever provided in the HTML output.

I do eventually want to integrate team search functionality into the database itself, but in the meantime, is there anything simple I could do to help make your search tool more useful/efficient?
Jeffrey Hill • Missouri Quizbowl Alliance president • UMR/Missouri S&T 2009 • Liberty (MO) 2005
Post your tournaments, SQBS reports, and question sets to the Quizbowl Resource Center Database!
ScoBo
Wakka
 
Posts: 220
Joined: Wed Jan 10, 2007 5:05 pm
Location: Kansas City area

Re: Tournament Database Search by Team

Postby Megachile ambigua » Fri Aug 23, 2013 5:34 pm

ScoBo wrote:I do eventually want to integrate team search functionality into the database itself, but in the meantime, is there anything simple I could do to help make your search tool more useful/efficient?

I think the main help would be being able to know when entries have been updated. Right now I have to rebuild the database when I do an update, and so knowing which tournaments have actually changed would save a lot of time on my part.
Harry White
TJHSST '09
Virginia Tech '13
Tournament Database Search by Team
Will run stats for food
User avatar
Megachile ambigua
Auron
 
Posts: 1064
Joined: Tue Dec 04, 2007 8:46 pm
Location: Fairfax, VA

Re: Tournament Database Search by Team

Postby AKKOLADE » Fri Aug 23, 2013 5:37 pm

Anyway you could implement a search for individual players? That might help with eligibility rules, like with Collegiate Novice.
Fred Morlan
PACE Vice President of Outreach, 2017-18
University of Kentucky CoP, 2017
hsqbrank manager, PACE member (former President and At Large member of Board), NAQT writer (former subject editor), HSAPQ freelance writer, former hsqb Administrator/Chief Administrator, 2012 NASAT Tournament Director
User avatar
AKKOLADE
Sin
 
Posts: 14429
Joined: Thu Apr 24, 2003 8:08 am

Re: Tournament Database Search by Team

Postby Megachile ambigua » Fri Aug 23, 2013 6:54 pm

Grams's Go-Go Boots wrote:Anyway you could implement a search for individual players? That might help with eligibility rules, like with Collegiate Novice.

Done. It might take a bit for all the results to show up, though. It's taking me a while for me to build the database.

EDIT: All 144,449 player entries and 36,797 team entries are now in there.
Harry White
TJHSST '09
Virginia Tech '13
Tournament Database Search by Team
Will run stats for food
User avatar
Megachile ambigua
Auron
 
Posts: 1064
Joined: Tue Dec 04, 2007 8:46 pm
Location: Fairfax, VA

Re: Tournament Database Search by Team

Postby Megachile ambigua » Fri Aug 23, 2013 8:49 pm

huff paste wrote:I've also implemented searching with OR

This should actually work now.
Harry White
TJHSST '09
Virginia Tech '13
Tournament Database Search by Team
Will run stats for food
User avatar
Megachile ambigua
Auron
 
Posts: 1064
Joined: Tue Dec 04, 2007 8:46 pm
Location: Fairfax, VA

Re: Tournament Database Search by Team

Postby Megachile ambigua » Sat Mar 29, 2014 10:06 pm

My hosting provider is having problems, so my site is down for the time being. Unfortunately I have no idea when it will be up again.

EDIT: It's up again.
Harry White
TJHSST '09
Virginia Tech '13
Tournament Database Search by Team
Will run stats for food
User avatar
Megachile ambigua
Auron
 
Posts: 1064
Joined: Tue Dec 04, 2007 8:46 pm
Location: Fairfax, VA

Re: Tournament Database Search by Team

Postby Megachile ambigua » Sun Apr 27, 2014 11:35 pm

It's now on Github! You may now feel free to make fun of my awful programming abilities.
Harry White
TJHSST '09
Virginia Tech '13
Tournament Database Search by Team
Will run stats for food
User avatar
Megachile ambigua
Auron
 
Posts: 1064
Joined: Tue Dec 04, 2007 8:46 pm
Location: Fairfax, VA

Re: Tournament Database Search by Team

Postby Megachile ambigua » Thu Jun 05, 2014 10:12 am

I have now added naqt.com's tournament results to the database. You might notice some duplicates in the search results now, due to NAQT's different method of handling tournament, team, and player names.
Harry White
TJHSST '09
Virginia Tech '13
Tournament Database Search by Team
Will run stats for food
User avatar
Megachile ambigua
Auron
 
Posts: 1064
Joined: Tue Dec 04, 2007 8:46 pm
Location: Fairfax, VA

Re: Tournament Database Search by Team

Postby Beevor Feevor » Tue Jun 10, 2014 11:26 am

I'm getting a bad link when I try to click on the NAQT link for stats for individual players. However, it seems to work fine for teams, so I'm not really sure what the issue is there. Great new function though, it makes it a lot more convenient to look for stats at one centralized location now!
Eric Xu
Western Albemarle High School '15
University of Virginia '19
User avatar
Beevor Feevor
Rikku
 
Posts: 304
Joined: Sun Oct 28, 2012 9:03 am
Location: Charlottesville, Virginia

Re: Tournament Database Search by Team

Postby Megachile ambigua » Tue Jun 10, 2014 6:36 pm

Einhard wrote:I'm getting a bad link when I try to click on the NAQT link for stats for individual players.

Thanks for catching that. It should be working as desired now.
Harry White
TJHSST '09
Virginia Tech '13
Tournament Database Search by Team
Will run stats for food
User avatar
Megachile ambigua
Auron
 
Posts: 1064
Joined: Tue Dec 04, 2007 8:46 pm
Location: Fairfax, VA

Re: Tournament Database Search by Team

Postby AKKOLADE » Fri Jun 20, 2014 10:49 am

I just wanted to thank you for adding that feature. It really is making the season preview work easier.
Fred Morlan
PACE Vice President of Outreach, 2017-18
University of Kentucky CoP, 2017
hsqbrank manager, PACE member (former President and At Large member of Board), NAQT writer (former subject editor), HSAPQ freelance writer, former hsqb Administrator/Chief Administrator, 2012 NASAT Tournament Director
User avatar
AKKOLADE
Sin
 
Posts: 14429
Joined: Thu Apr 24, 2003 8:08 am

Re: Tournament Database Search by Team

Postby AKKOLADE » Mon Nov 03, 2014 3:54 pm

It appears that the site may not have updated over the past month plus?
Fred Morlan
PACE Vice President of Outreach, 2017-18
University of Kentucky CoP, 2017
hsqbrank manager, PACE member (former President and At Large member of Board), NAQT writer (former subject editor), HSAPQ freelance writer, former hsqb Administrator/Chief Administrator, 2012 NASAT Tournament Director
User avatar
AKKOLADE
Sin
 
Posts: 14429
Joined: Thu Apr 24, 2003 8:08 am

Re: Tournament Database Search by Team

Postby Megachile ambigua » Mon Nov 03, 2014 7:53 pm

The script was running into some unexplained errors, but I think I have it fixed now. I'm hoping I'll have things updated tonight.

EDIT: It has been updated!
Harry White
TJHSST '09
Virginia Tech '13
Tournament Database Search by Team
Will run stats for food
User avatar
Megachile ambigua
Auron
 
Posts: 1064
Joined: Tue Dec 04, 2007 8:46 pm
Location: Fairfax, VA

Re: Tournament Database Search by Team

Postby AKKOLADE » Fri Feb 13, 2015 8:10 am

I think you're hitting some errors again - I'm having a hard time finding stats that should be popping up from the HSQB DB.
Fred Morlan
PACE Vice President of Outreach, 2017-18
University of Kentucky CoP, 2017
hsqbrank manager, PACE member (former President and At Large member of Board), NAQT writer (former subject editor), HSAPQ freelance writer, former hsqb Administrator/Chief Administrator, 2012 NASAT Tournament Director
User avatar
AKKOLADE
Sin
 
Posts: 14429
Joined: Thu Apr 24, 2003 8:08 am

Re: Tournament Database Search by Team

Postby Megachile ambigua » Mon Feb 16, 2015 3:27 am

It looks like NAQT changed their page format slightly which caused some trouble. It's fixed now.

In other news, we have passed 5,000 tournaments, 100,000 teams, and 300,000 player stats indexed.
Harry White
TJHSST '09
Virginia Tech '13
Tournament Database Search by Team
Will run stats for food
User avatar
Megachile ambigua
Auron
 
Posts: 1064
Joined: Tue Dec 04, 2007 8:46 pm
Location: Fairfax, VA

Re: Tournament Database Search by Team

Postby Charbroil » Mon Feb 16, 2015 4:03 am

Public safety diving wrote:It looks like NAQT changed their page format slightly which caused some trouble. It's fixed now.

In other news, we have passed 5,000 tournaments, 100,000 teams, and 300,000 player stats indexed.


This is a great tool; thanks for making it.
Charles Hang
Francis Howell Central '09
St. Charles Community College '14
Washington University in St. Louis '1x (President, 2017-18)

Owner, Olympia Academic Competition Questions, LLC
Question Writer, National Academic Quiz Tournaments, LLC and National History Bee and Bowl
Member, Missouri Academic Coaches Association
Charbroil
Auron
 
Posts: 1078
Joined: Fri Jun 09, 2006 11:52 am
Location: St. Charles, MO

Re: Tournament Database Search by Team

Postby dxdtdemon » Wed Feb 18, 2015 1:40 am

The following ACF Fall mirror doesn't appear to be in your database: http://www.hsquizbowl.org/db/tournaments/2335/
Jonathan Graham
Beavercreek HS 1999-2003, Ohio State 2003-2007, Wright State (possibly playing)2012-2015
moderator/scorekeeper at some tournaments in Ohio, and sometimes elsewhere
"Ohio has a somewhat fractured quizbowl circuit, with a few small pockets of intense competition (like in Mahoning County) and with the rest scattered around the state."-Chris Chiego
User avatar
dxdtdemon
Rikku
 
Posts: 380
Joined: Sat Mar 03, 2007 4:46 pm
Location: Beavercreek, OH

Re: Tournament Database Search by Team

Postby Megachile ambigua » Wed Feb 18, 2015 1:51 am

cwRsync wrote:The following ACF Fall mirror doesn't appear to be in your database: http://www.hsquizbowl.org/db/tournaments/2335/

It appears to be there for me.
Harry White
TJHSST '09
Virginia Tech '13
Tournament Database Search by Team
Will run stats for food
User avatar
Megachile ambigua
Auron
 
Posts: 1064
Joined: Tue Dec 04, 2007 8:46 pm
Location: Fairfax, VA

Re: Tournament Database Search by Team

Postby Aaron's Rod » Sun Apr 05, 2015 1:55 pm

I assume you're still working on this, but it keeps timing out for me, just so you're aware.
Alex D.
Lawrence University B.A., B.Mus. '16 // DePaul University M.S. '18
Member, PACE // Writer, NAQT

Midwest is best.
User avatar
Aaron's Rod
42 Franklin St #44, 01840
 
Posts: 189
Joined: Wed Nov 27, 2013 7:29 pm

Re: Tournament Database Search by Team

Postby Megachile ambigua » Sun Apr 05, 2015 3:10 pm

Aaron's Rod wrote:I assume you're still working on this, but it keeps timing out for me, just so you're aware.

It's an issue with my hosting provider. It should hopefully be fixed soon.

EDIT: Things are back to normal.
Harry White
TJHSST '09
Virginia Tech '13
Tournament Database Search by Team
Will run stats for food
User avatar
Megachile ambigua
Auron
 
Posts: 1064
Joined: Tue Dec 04, 2007 8:46 pm
Location: Fairfax, VA

Re: Tournament Database Search by Team

Postby Megachile ambigua » Mon Aug 22, 2016 3:55 pm

I'm in the process of transferring hosting. If things decide to not work all of a sudden, please let me know.
Harry White
TJHSST '09
Virginia Tech '13
Tournament Database Search by Team
Will run stats for food
User avatar
Megachile ambigua
Auron
 
Posts: 1064
Joined: Tue Dec 04, 2007 8:46 pm
Location: Fairfax, VA

Re: Tournament Database Search by Team

Postby Megachile ambigua » Tue Aug 30, 2016 12:35 pm

The main page now shows a list of all tournaments that have uploaded stats since the last database update (which now happens regularly and automatically early on Tuesday mornings). It won't register stat corrections, but it will pick up adding in things like combined stats a week after prelims and playoffs have been uploaded.
Harry White
TJHSST '09
Virginia Tech '13
Tournament Database Search by Team
Will run stats for food
User avatar
Megachile ambigua
Auron
 
Posts: 1064
Joined: Tue Dec 04, 2007 8:46 pm
Location: Fairfax, VA

Re: Tournament Database Search by Team

Postby Megachile ambigua » Wed Feb 15, 2017 1:47 pm

I fixed a bug that was preventing the most recent NAQT tournaments from appearing and fixed the issue where the New Tournaments Added section wasn't properly working.
Harry White
TJHSST '09
Virginia Tech '13
Tournament Database Search by Team
Will run stats for food
User avatar
Megachile ambigua
Auron
 
Posts: 1064
Joined: Tue Dec 04, 2007 8:46 pm
Location: Fairfax, VA


Return to Databases and Quizbowl Software

Who is online

Users browsing this forum: No registered users and 1 guest