May 15 Spring Novice Mirror (Gimmick Computer Format)

Old college threads.
Locked
User avatar
ezubaric
Rikku
Posts: 369
Joined: Mon Feb 09, 2004 8:02 pm
Location: College Park, MD
Contact:

May 15 Spring Novice Mirror (Gimmick Computer Format)

Post by ezubaric »

Human-AI Cooperative Spring Novice


Hello everyone! We are happy to announce a human-AI cooperative Spring Novice tournament hosted virtually by University of Maryland on Saturday, May 15th (we realize this conflicts with History Bowl, but given research paper deadlines, this is the only date that works). As this is for science, the tournament is free to play. Any individual is welcome to play as long as they have not seen / played in the 2021 Spring Novice tournament. We'll start noon Eastern time to accommodate folks on the West Coast.

While prizes are awarded individually, you’re not playing alone! You have the help of an AI teammate. We hope the game will be fun, and you’ll also be helping us to improve how machines can answer question, convey why they’re answering a question, and to help surface useful information that can help both humans and computers to answer questions.

We are running two interleaved competitions with two different human-AI interactions. You’re welcome (and encouraged) to compete in both, but if you prefer one over the other, you’re welcome to only compete in one. We’ll explain each of the two competitions: centaur bowl and cheater bowl.

Competition 1: Centaur bowl http://play.qanta.org/
In this competition, each human player is paired with an AI teammate which constantly provides suggestions. The AI is competitive but not perfect, so you should not always trust it. To help you make this decision, we “explain” its predictions via several visualizations. Compared to previous centaur competitions, our new AI adapts the visualizations to you as you play. (viewtopic.php?f=123&t=21090)

Depending on participation, we will distribute players to 2-5 rooms based on skill level. A new round starts every 30min (simultaneously in all rooms). And players will go through 6 packets of 24 questions each. To ensure rooms of equivalent strength players, we will promote the top 20% players at the end of each round and demote the bottom 20%.

Competition 2 (NEW!): Cheater bowl http://cbowl.cs.umd.edu/play
Virtual games saw some scandals of players cheating with search engines. This isn’t cool normally, but it’s useful to computer scientists to understand how people can find information. Hopefully this can also still be fun while playing quiz bowl!

We designed an web interface where all players have access to the same search engine and are encouraged to use it to their advantage. Some more detailed rules:
You will have 60 seconds to work on each clue, but you can always choose to reveal the next clue early.
Answering with fewer clues is worth more points. Each unrevealed clue is worth 10 points, so if the question is 5 sentences you’ll get 50 points answering on the first clue, versus 10 points on the last clue.
You are allowed unlimited queries.
You are not allowed to use any help beyond the search engine we provide. For example, you cannot use Google.
There is no buzzer. At the end of each round, the player with most points will be the winner. At the end of all rounds, the player with the most wins will win the competition.

Prizes
Players who complete both competitions enter a raffle for 20 * $25 prizes. The top 3 players in both competitions win an additional bonus of $50, $25, $10, respectively.

Registration
This tournament is open to everyone who has not read / edited the Spring Novice set (no school affiliation is required, former players more than welcome) and the registration is free. Please fill out this google form: https://forms.gle/zx95U7q5hVKVNoQKA

If you have any questions, please post them below or send them to [email protected].

Edit: adding time
Jordan Boyd-Graber
UMD (College Park, MD), Faculty Advisor 2018-present
UC Boulder, Founder / Faculty Advisor 2014-2017
UMD (College Park, MD), Faculty Advisor 2010-2014
Princeton, Player 2004-2009
Caltech (Pasadena, CA), Player / President 2000-2004
Ark Math & Science (Hot Springs, AR), Player 1998-2000
Monticello High School, Player 1997-1998

Human-Computer Question Answering:
http://qanta.org/
User avatar
ezubaric
Rikku
Posts: 369
Joined: Mon Feb 09, 2004 8:02 pm
Location: College Park, MD
Contact:

Re: May 15 Spring Novice Mirror (Gimmick Computer Format)

Post by ezubaric »

Please sign up by Thursday noon (Eastern time) if you'd like to play!
Jordan Boyd-Graber
UMD (College Park, MD), Faculty Advisor 2018-present
UC Boulder, Founder / Faculty Advisor 2014-2017
UMD (College Park, MD), Faculty Advisor 2010-2014
Princeton, Player 2004-2009
Caltech (Pasadena, CA), Player / President 2000-2004
Ark Math & Science (Hot Springs, AR), Player 1998-2000
Monticello High School, Player 1997-1998

Human-Computer Question Answering:
http://qanta.org/
Locked