Fall 2018 Open Tournament?

Post Reply
User avatar
Mike Bentley
Sin
Posts: 6499
Joined: Fri Mar 31, 2006 11:03 pm
Location: Bellevue, WA
Contact:

Fall 2018 Open Tournament?

Post by Mike Bentley »

As I plan some travel stuff for this fall, I want to make sure I'm not overlooking any already announced (or soon to be announced) open tournaments this season. Is anyone planning on writing one?
Mike Bentley
Treasurer, Partnership for Academic Competition Excellence
Adviser, Quizbowl Team at University of Washington
University of Maryland, Class of 2008
User avatar
vinteuil
Auron
Posts: 1454
Joined: Sun Oct 23, 2011 12:31 pm

Re: Fall 2018 Open Tournament?

Post by vinteuil »

Jacob R., ex-Chicago
User avatar
ezubaric
Rikku
Posts: 370
Joined: Mon Feb 09, 2004 8:02 pm
Location: College Park, MD
Contact:

Re: Fall 2018 Open Tournament?

Post by ezubaric »

We'll be announcing soon an open tournament for December that is open to high school teams, college teams, grizzled veterans, and computers.
Jordan Boyd-Graber
UMD (College Park, MD), Faculty Advisor 2018-present
UC Boulder, Founder / Faculty Advisor 2014-2017
UMD (College Park, MD), Faculty Advisor 2010-2014
Princeton, Player 2004-2009
Caltech (Pasadena, CA), Player / President 2000-2004
Ark Math & Science (Hot Springs, AR), Player 1998-2000
Monticello High School, Player 1997-1998

Human-Computer Question Answering:
http://qanta.org/
User avatar
vinteuil
Auron
Posts: 1454
Joined: Sun Oct 23, 2011 12:31 pm

Re: Fall 2018 Open Tournament?

Post by vinteuil »

ezubaric wrote: Tue Sep 04, 2018 8:25 pm We'll be announcing soon an open tournament for December that is open to high school teams, college teams, grizzled veterans, and computers.
...who is "we"?
Jacob R., ex-Chicago
User avatar
ezubaric
Rikku
Posts: 370
Joined: Mon Feb 09, 2004 8:02 pm
Location: College Park, MD
Contact:

Re: Fall 2018 Open Tournament?

Post by ezubaric »

It'll be hosted at UMD.
Jordan Boyd-Graber
UMD (College Park, MD), Faculty Advisor 2018-present
UC Boulder, Founder / Faculty Advisor 2014-2017
UMD (College Park, MD), Faculty Advisor 2010-2014
Princeton, Player 2004-2009
Caltech (Pasadena, CA), Player / President 2000-2004
Ark Math & Science (Hot Springs, AR), Player 1998-2000
Monticello High School, Player 1997-1998

Human-Computer Question Answering:
http://qanta.org/
User avatar
vinteuil
Auron
Posts: 1454
Joined: Sun Oct 23, 2011 12:31 pm

Re: Fall 2018 Open Tournament?

Post by vinteuil »

Er, who's writing it?
Jacob R., ex-Chicago
User avatar
ezubaric
Rikku
Posts: 370
Joined: Mon Feb 09, 2004 8:02 pm
Location: College Park, MD
Contact:

Re: Fall 2018 Open Tournament?

Post by ezubaric »

It will be packet submission, but with computers helping to write the questions. (Similar to our experimental round at PACE in June.)
Jordan Boyd-Graber
UMD (College Park, MD), Faculty Advisor 2018-present
UC Boulder, Founder / Faculty Advisor 2014-2017
UMD (College Park, MD), Faculty Advisor 2010-2014
Princeton, Player 2004-2009
Caltech (Pasadena, CA), Player / President 2000-2004
Ark Math & Science (Hot Springs, AR), Player 1998-2000
Monticello High School, Player 1997-1998

Human-Computer Question Answering:
http://qanta.org/
User avatar
vinteuil
Auron
Posts: 1454
Joined: Sun Oct 23, 2011 12:31 pm

Re: Fall 2018 Open Tournament?

Post by vinteuil »

ezubaric wrote: Fri Sep 07, 2018 4:58 pm It will be packet submission, but with computers helping to write the questions. (Similar to our experimental round at PACE in June.)
Now I'm curious why you weren't more forthright about what is clearly the animating premise of the set. Instead, you chose to advertize an experimental set that's practically guaranteed to be full of quirks and faults as equivalent to a standard open tournament.
Jacob R., ex-Chicago
User avatar
Victor Prieto
Auron
Posts: 1214
Joined: Tue May 08, 2012 5:15 pm
Location: New York, NY

Re: Fall 2018 Open Tournament?

Post by Victor Prieto »

This isn't exactly fair to Jordan - he didn't misrepresent his thing as equivalent to a standard open tournament, he just said "an announcement is coming soon about an open tournament." You badgered him into revealing information before he wanted to, then condemned the effort as doomed to fail before he's even had a chance to officially announce it. Can't you at least wait until he's ready to announce before making judgements?
Victor Prieto
Rice University '15 | Penn State University '21
Writer: NAQT (2019-present) | Writer, Editor: HSAPQ (2013-2016)
Member (and lots of other stuff): PACE (2015-present)
User avatar
Cheynem
Sin
Posts: 7293
Joined: Tue May 11, 2004 11:19 am
Location: Grand Rapids, Michigan

Re: Fall 2018 Open Tournament?

Post by Cheynem »

Yeah, by "advertise" if you mean one, slightly vague post (which to be fair to Jordan says "computers" right there!).
Mike Cheyne
Formerly U of Minnesota

"You killed HSAPQ"--Matt Bollinger
User avatar
vinteuil
Auron
Posts: 1454
Joined: Sun Oct 23, 2011 12:31 pm

Re: Fall 2018 Open Tournament?

Post by vinteuil »

If I posted in this thread about an "open tournament" and it turned out to be a trash tournament or some vanity set, I think it would be pretty fair to call that misrepresentation, and I think people would reasonably question my motives for withholding such a core element of the set from the get-go.

(EDIT: I do apologize for being so quick to make assertions about the quality of Jordan's project, although I think it's reasonable to expect such information up front, just like it would be reasonable for players to know immediately that some open was being written with/by a bunch of middle schoolers or similar.)
Jacob R., ex-Chicago
User avatar
ezubaric
Rikku
Posts: 370
Joined: Mon Feb 09, 2004 8:02 pm
Location: College Park, MD
Contact:

Re: Fall 2018 Open Tournament?

Post by ezubaric »

Sorry for not responding earlier; I don't read the boards as closely as I used to!
Instead, you chose to advertize an experimental set that's practically guaranteed to be full of quirks and faults as equivalent to a standard open tournament.
Thanks for bringing this up; one of the reasons that we've not formally announced is that we want to make sure we do a good job of framing this to encourage participation.

I want to stress that we want to have high quality questions, and one of the prizes ($250) will be for writing the highest quality questions possible ($100 and $50 for second and third place packets). To the best of my knowledge, this is the first tournament to have monetary prizes (beyond free registration back in the day, which was a trend that sadly has disappeared along with packet sub events) for question writing.

The goal of having computers in the loop is to improve the questions from both a scientific perspective and a quiz bowl perspective. This is a quiz bowl forum, so let me focus on that first. Here's how computers can help you write better questions:
  • Avoid stock clues in the leadin
  • Automatically find similar questions (to find other interesting clues or avoid repetition)
  • Avoid hoses (if the computer thinks the answer might be X, so might a human ... perhaps you can rephrase)
  • Automate tasks like pronunciation guides and alternate answer lines (don't know if this will make it in for this iteration, but it's on our todo list!)
Again, we hope that the resulting questions are high quality from a human perspective. We hope that we'll attract good question writers, and that a reasonable reader will recognize them as good questions. We're not going for gimmicks and quirks in terms of the questions.

The reason that we're doing this is that we're hoping that these questions will also help computer science researchers write better systems that can answer questions automatically by avoiding stock clues and other "triggers" that make quiz bowl questions artificially easy for computers. We believe that this will result in more unique, creative, more engaging questions for a human audience.

Please stay tuned, we'll be officially announcing very soon (today if I can).
Jordan Boyd-Graber
UMD (College Park, MD), Faculty Advisor 2018-present
UC Boulder, Founder / Faculty Advisor 2014-2017
UMD (College Park, MD), Faculty Advisor 2010-2014
Princeton, Player 2004-2009
Caltech (Pasadena, CA), Player / President 2000-2004
Ark Math & Science (Hot Springs, AR), Player 1998-2000
Monticello High School, Player 1997-1998

Human-Computer Question Answering:
http://qanta.org/
User avatar
ezubaric
Rikku
Posts: 370
Joined: Mon Feb 09, 2004 8:02 pm
Location: College Park, MD
Contact:

Re: Fall 2018 Open Tournament?

Post by ezubaric »

vinteuil wrote: Fri Sep 07, 2018 11:31 pm trash tournament or some vanity set
We'll also be using a standard distribution, for what it's worth. The biggest difference will be changes to format (tossup only), eligibility (all human players eligible, computer teams welcome), and prizes for question writers.
Jordan Boyd-Graber
UMD (College Park, MD), Faculty Advisor 2018-present
UC Boulder, Founder / Faculty Advisor 2014-2017
UMD (College Park, MD), Faculty Advisor 2010-2014
Princeton, Player 2004-2009
Caltech (Pasadena, CA), Player / President 2000-2004
Ark Math & Science (Hot Springs, AR), Player 1998-2000
Monticello High School, Player 1997-1998

Human-Computer Question Answering:
http://qanta.org/
User avatar
ezubaric
Rikku
Posts: 370
Joined: Mon Feb 09, 2004 8:02 pm
Location: College Park, MD
Contact:

Re: Fall 2018 Open Tournament?

Post by ezubaric »

You can view the video of our past event here:

https://www.youtube.com/watch?v=wf5GHwDb6Ig

And the official announcement is here:

http://hsquizbowl.org/forums/viewtopic. ... 31#p349431

I'm certainly interested in suggestions for how to best convey that we're interested in soliciting quality questions.
Jordan Boyd-Graber
UMD (College Park, MD), Faculty Advisor 2018-present
UC Boulder, Founder / Faculty Advisor 2014-2017
UMD (College Park, MD), Faculty Advisor 2010-2014
Princeton, Player 2004-2009
Caltech (Pasadena, CA), Player / President 2000-2004
Ark Math & Science (Hot Springs, AR), Player 1998-2000
Monticello High School, Player 1997-1998

Human-Computer Question Answering:
http://qanta.org/
Post Reply