Page 1 of 1

Question Writing Comp. / Human vs. Computer Expo (@PACE NSC)

Posted: Mon Apr 30, 2018 1:53 pm
by ezubaric
We'll be running an exhibition game between a quiz bowl-playing artificial intelligence and a human team at PACE NSC 2018 in Reston, Virginia on June 2 (more details on venue and time as we get closer to the actual event). Unlike previous matches that used stock quiz bowl questions, we need your help to write questions that are difficult for computers.

Our research group has been working on building computers that can answer quiz bowl questions well. We’ve beat Ken Jennings, we narrowly beat a team of quiz bowl all-stars at HSNCT 2017, and Studio OUSIA soundly defeated the best possible quiz bowl team we could assemble at NIPS last year. You might think that computers are pretty smart, right?

You’d be wrong. Quiz bowl questions are supposed to be written pyramidally: harder clues at the start, easier clues at the end. The problem is that question writers don't write questions pyramidally for computers: they write questions for humans. If humans could write questions pyramidally for computers, computers would be in a whole heap of trouble, and look pretty dumb. Our goal is to offer a true test for how smart computers are.

Visit http://write.qanta.org to write questions that are difficult for computers and submit your questions to the competition!

Introduction video:
https://www.youtube.com/watch?v=DENelwdcqhk

Best Question Winners, Week 1

Posted: Mon Apr 30, 2018 1:53 pm
by ezubaric
Winners for Week #1 (04/23 - 04/30):

Here our the two winners for the first week! Both questions were able to completely trick QANTA. They use similar methods, both describe a real life action that is difficult for the model to solve by matching keywords from past questions. It is especially difficult to recognize phrases like "self-inflicted method of death", where suicide has only been previously described as "ending one's life". It is also difficult to know Cannibalism is taboo in modern society. Looking forward to more great questions in the future!

(We'll post all of the winners at http://qanta.org)

James V. McConnell encouraged flatworms to engage in this behavior in order to test whether doing this affected memory. An atypical morph of the tiger salamander is distinguished at the age of four weeks by physical changes to their jaws which increase their efficiency in this activity. The common name of the Latrodectus genus is a reference to their participation in this behavior as a mating practice, which is speculated as a way for female specimens to acquire additional nutrition. If you do this in Papua New Guinea, you acquire an elevated risk of contracting the prion disease kuru, which is spread through infected brain tissue. For 10 points, name this practice which is taboo in humans, the consumption of the flesh of one's own species.

Answer: Cannibalism

Lily Bart performs this action in The House of Mirth by Edith Wharton and Martha performs this action in The Children’s Hour by Lillian Hellman. The protagonist performs this action at the end of “A Perfect Day for Bananafish,” and Joe Keller and Willy Loman carry out this action in two separate Arthur Miller plays. Two members of the Monzano family perform this action with “ice-nine” in Cat’s Cradle, and Quentin Compson does this in the Charles River after fastening tailor’s weights to his feet. In real life, Sylvia Plath performed this action by placing her head in an oven. For the points, name this self-inflicted method of death.

Answer: Suicide

Re: Question Writing Comp. / Human vs. Computer Expo (@PACE

Posted: Sat May 05, 2018 2:35 pm
by ezubaric
This week's winner uses several phrases to evoke racism that computer systems cannot link to major US cities. While a human might be able to connect Gone with the Wind to Atlanta, this is much more difficult for a computer to figure out.
Opponents of this city’s public transit system have called it a scheme for “moving Africans rapidly through” this city. Oscar winner Hattie McDaniel was unable to attend the gala for the premiere of Gone with the Wind due to racial segregation laws in this city. Booker T. Washington proposed this city’s (*) namesake compromise in a speech given at the Cotton States and International Expo in, for ten points, what home of the world’s busiest airport and capital of Georgia?
Atlanta

Re: Question Writing Comp. / Human vs. Computer Expo (@PACE

Posted: Sun May 06, 2018 2:01 pm
by ezubaric
We've been able to increase the cash value of our prizes. Please keep submitting your questions!

Prizes:
$10 for the best questions submitted every week
$300 for the person with the most selected questions
$200 for the person with the second most selected questions
$100 for the person with the third most selected questions
$10 for every question used in the exhibition match (only for those not eligible for the grand prize winners above)

Re: Question Writing Comp. / Human vs. Computer Expo (@PACE

Posted: Tue May 15, 2018 10:15 am
by ezubaric
Congrats to last week's best question:
An aircraft carrier bearing this man's name hosted the "Mission Accomplished" speech. A city named after this man is the site of the only unicameral state legislature. A tunnel named after this man was the second tunnel built to cross the Hudson River. An organization named for this man fought against Francisco Franco's forces. A building dedicated to him was the site of the "I have a dream" speech. For 10 points, name this subject of the portrait on the penny.
Abraham Lincoln
For this week, we're raising the best question prize to $100. So get your question in before Saturday 16:00 UTC for your chance to win $100 (while still being eligible for the $500 grand prize). Tell your friends!

Note that questions don't have to be blind. You can rewrite existing questions that might have appeared elsewhere.

Re: Question Writing Comp. / Human vs. Computer Expo (@PACE

Posted: Fri May 18, 2018 11:40 am
by ezubaric
We had some brief downtime this morning, but the site is back up. Chance for $100 prize for best question and $500 for best set ends in about 24 hours!

Re: Question Writing Comp. / Human vs. Computer Expo (@PACE

Posted: Wed May 30, 2018 11:51 am
by ezubaric
We're looking for players for the team to take on OUSIA on questions that are designed to be difficult for the computer:

https://docs.google.com/forms/d/e/1FAIp ... sp=sf_link

Re: Question Writing Comp. / Human vs. Computer Expo (@PACE

Posted: Sat Jun 02, 2018 1:35 pm
by ezubaric
We have a strong human team assembled, we have an outstanding set of computer-stumping questions, and we have our uplink with the computer system with the Japanese quiz bowl robot completed. Looking forward to seeing everyone in Regency Ballroom tonight at 8pm in Reston!

Re: Question Writing Comp. / Human vs. Computer Expo (@PACE

Posted: Sat Jun 02, 2018 1:37 pm
by ezubaric
We have a strong human team assembled, we have an outstanding set of computer-stumping questions, and we have our uplink with the computer system with the Japanese quiz bowl robot completed. Looking forward to seeing everyone in Regency Ballroom tonight at 8pm in Reston!

Re: Question Writing Comp. / Human vs. Computer Expo (@PACE

Posted: Sat Jun 02, 2018 5:32 pm
by Galstaff, Sorceror of Light
This event is being moved to Grand Ballroom D. It will still take place at 8 PM.

Re: Question Writing Comp. / Human vs. Computer Expo (@PACE

Posted: Sat Jun 02, 2018 10:23 pm
by ezubaric
Thanks for everyone who helped make tonights event a lot of fun. Not spoiling any results, as I'm hoping to upload video tomorrow morning.

Re: Question Writing Comp. / Human vs. Computer Expo (@PACE

Posted: Wed Jun 13, 2018 11:13 am
by Fuddle Duddle
Was video for this ever uploaded? If so, could you post a link?

Re: Question Writing Comp. / Human vs. Computer Expo (@PACE

Posted: Wed Jun 13, 2018 12:23 pm
by Thiccasso's Guernthicca
An Economic Ignoramus wrote:Was video for this ever uploaded? If so, could you post a link?
This should be it, I think.

https://www.youtube.com/watch?v=oNXN1SlVevc

Re: Question Writing Comp. / Human vs. Computer Expo (@PACE

Posted: Sun Jun 17, 2018 5:11 pm
by ezubaric
We now have a new video (better editing) here:
https://www.youtube.com/watch?v=wf5GHwDb6Ig