## MUT Mirror 4/2 @ NGCSU

### Re: MUT Mirror 4/2 @ NGCSU

NGTech wrote:
While it may seem to be trying to solve a problem that doesn't exist the problem does in fact exist. The round robin format is assumed to be an even format based on the fact that every team faces every other team. The problem is that teams are made of people not computers, as such the strength of a team changes from round to round. The only ways to counteract this is to let each team face each other team multiple times, or use a mathematical method to adjust the field.

ACF rules, which this tournament was supposed to follow, dictate that the teams with the best records play another game or games to determine the winner. Surely, instead of using your so-called mathematical method that has no significant empirical evidence, the solution would be to "let each team face each other team multiple times?" I am dissatisfied with the tournament's handling of the tie-breaking and how I paid to only play a handful of legitimate rounds. I feel that a finals round or even a playoffs would have solved all the problems more accurately than using an arbitrary mathematical system.
Phong Nguyen
Southside High School '09
University of South Carolina '13
gatsby
emerge from subterranean time

Posts: 5
Joined: Fri Dec 25, 2009 1:54 pm

### Re: MUT Mirror 4/2 @ NGCSU

NGTech wrote:
theMoMA wrote:Also, all teams in a round robin play what amounts to the same schedule, so by trying to find the "most difficult schedule" you're "solving" a problem that doesn't even exist in your own format.

While it may seem to be trying to solve a problem that doesn't exist the problem does in fact exist. The round robin format is assumed to be an even format based on the fact that every team faces every other team. The problem is that teams are made of people not computers, as such the strength of a team changes from round to round. The only ways to counteract this is to let each team face each other team multiple times, or use a mathematical method to adjust the field.

Conveniently, there were leftover packets, which would've allowed you to do this, wherein teams that had competed at a similar level during the first round-robin would play an additional game, providing more information to rank the teams. And had the best team still not been certain, you may even have had an extra packet, for them to play a third time to decide who was the winner!

Also, worth noting, your individual "scoring system" sucks. Taking, for instance, the game against empty chairs:
Team A plays the Empty Chairs. Adam answers 5 tossups, Alex answers 5 tossups, Andrew answers 4 tossups, and Abigail answers 3 tossups. The Empty Chairs do not buzz.
Team B plays the Empty Chairs. Ben, playing solo, answers 2 tossups, and then takes a nap (or decides not to buzz anymore on an incorrect belief this will help his tiebreaker score). The Empty Chairs do not buzz.
According to your individual scoring system, Adam gets .294 as does Alex, while Ben gets 1.000.

This is not a hypothetical. Take these two games that actually happened in the same round, on the same questions:
GT 390, NGU 70. GT: Gregory 6, Keith 0, Robert 0, Bradley 8; NGU: Travis 2, DoRinda 0, Matthew 2, Jason 1; Total answered 19.
Berry 180, Snead 90. Berry: Sarah 0, Greg 3, Dylan 6, Anthony 0; Snead: Mark 5; Total answered 14.

All else equal, answering more questions is better, right? Answering more questions against other players who are answering more questions is even better, right? However, this isn't borne out. Gregory (GT) scores 6/19 = .316, while Mark scores 5/14 = .357. Bradley scores 8/19 = .4211, while Dylan scores 6/14 = .4286.
Your intentions may have been grand and noble, but their result was counter-productive and bad. If you'd mentioned your ideas ahead of time, dozens of people with years of experience could have explained to you why they would produce counter-productive and bad results.
Jon Pinyan
FOUR-TIME NATIONAL CHAMPIONSHIP PARTICIPANT
HSQB forum mod, PACE & HSAPQ member

Formerly played for Washington U. in St. Louis and BCA (NJ).

jonpin
Moderator

Posts: 1094
Joined: Wed Feb 04, 2004 6:45 pm
Location: BCA NJ / WUSTL MO / Allendale NJ

### Re: MUT Mirror 4/2 @ NGCSU

jonpin wrote:Conveniently, there were leftover packets, which would've allowed you to do this, wherein teams that had competed at a similar level during the first round-robin would play an additional game, providing more information to rank the teams. And had the best team still not been certain, you may even have had an extra packet, for them to play a third time to decide who was the winner!

As a physicist I always prefer more data, but the schedule was not the area I was in charge of. I was also selfishly wanting to leave as I was fighting off bad sinus problems and some kind of stomach bug. In my opinion a triple round robin would be the best system as it would greatly reduce any tie chances, but that would be a long tournament.

jonpin wrote:Also, worth noting, your individual "scoring system" sucks. Taking, for instance, the game against empty chairs:
Team A plays the Empty Chairs. Adam answers 5 tossups, Alex answers 5 tossups, Andrew answers 4 tossups, and Abigail answers 3 tossups. The Empty Chairs do not buzz.
Team B plays the Empty Chairs. Ben, playing solo, answers 2 tossups, and then takes a nap (or decides not to buzz anymore on an incorrect belief this will help his tiebreaker score). The Empty Chairs do not buzz.
According to your individual scoring system, Adam gets .294 as does Alex, while Ben gets 1.000.

This is not a hypothetical. Take these two games that actually happened in the same round, on the same questions:
GT 390, NGU 70. GT: Gregory 6, Keith 0, Robert 0, Bradley 8; NGU: Travis 2, DoRinda 0, Matthew 2, Jason 1; Total answered 19.
Berry 180, Snead 90. Berry: Sarah 0, Greg 3, Dylan 6, Anthony 0; Snead: Mark 5; Total answered 14.

All else equal, answering more questions is better, right? Answering more questions against other players who are answering more questions is even better, right? However, this isn't borne out. Gregory (GT) scores 6/19 = .316, while Mark scores 5/14 = .357. Bradley scores 8/19 = .4211, while Dylan scores 6/14 = .4286.

I had not noticed that problem. Thanks for pointing it out. After looking at the ranking it appears this error caused 3 places where a person with better PPG was ranked below a lower one. In retrospect I should have realized a term to correct for the total points in the round should have been used.

jonpin wrote:Your intentions may have been grand and noble, but their result was counter-productive and bad. If you'd mentioned your ideas ahead of time, dozens of people with years of experience could have explained to you why they would produce counter-productive and bad results.

While the design of my stat has been drawing condemnation here on the forums it was used in our last tournament where I received quite a few complements on designing a system that attempts to even the field.
Nicolas A. Collins
North Georgia College Academic Team Technical Director
NGTech
potter wasted among his clays

Posts: 13
Joined: Sun Apr 03, 2011 12:30 am

### Re: MUT Mirror 4/2 @ NGCSU

NGTech wrote:While the design of my stat has been drawing condemnation here on the forums it was used in our last tournament where I received quite a few complements on designing a system that attempts to even the field.

What tournament was this? It seems to me that nobody who was in your current field enjoyed this statistic at all based on what they have posted here.
Charlie Dees, North Kansas City HS '08; University of Missouri '12
"I won't say more because I know some of you parse everything I say." - Jeremy Gibbs

"At one TJ tournament the neg prize was the Hampshire College ultimate frisbee team (nude) calender featuring one Evan Silberman. In retrospect that could have been a disaster." - Harry White

Horned Screamer
groom of totemic guanacos

Posts: 5387
Joined: Wed Jul 26, 2006 11:46 pm
Location: Columbia, MO

### Re: MUT Mirror 4/2 @ NGCSU

Jeremy Gibbs Freesy Does It wrote:
NGTech wrote:While the design of my stat has been drawing condemnation here on the forums it was used in our last tournament where I received quite a few complements on designing a system that attempts to even the field.

What tournament was this? It seems to me that nobody who was in your current field enjoyed this statistic at all based on what they have posted here.

The tournament he is referring to is probably this one: http://naqt.com/stats/tournament-teams. ... nt_id=3549
Jake Sundberg
University of Alabama
Archdemon Emeritus

BACK-TO-BACK-TO-BACK 12th place finishes at ICT
2012 ACF Nationals Champion, solo teams
2013 ICT Champion, teams consisting of only players with degrees from four-year institutions, minimum three players
2013 ACF Nationals Champion, same category, minimum two players

The Ununtiable Twine
Amazon of buried jaguars

Posts: 560
Joined: Fri Feb 02, 2007 11:09 pm
Location: Tuscaloosa, AL

### Re: MUT Mirror 4/2 @ NGCSU

Alright, a word to the wise then. Don't assume that a high school field where literally a third of the teams are coached by noted idiot Robin Richards and the rest are of varying degrees of not being active on the national circuit is at all going to be a good way to determine what college quizbowlers want to do. A lot of high school coaches who aren't really active love really stupid ideas about quizbowl, and this seems to be no exception.
Charlie Dees, North Kansas City HS '08; University of Missouri '12
"I won't say more because I know some of you parse everything I say." - Jeremy Gibbs

"At one TJ tournament the neg prize was the Hampshire College ultimate frisbee team (nude) calender featuring one Evan Silberman. In retrospect that could have been a disaster." - Harry White

Horned Screamer
groom of totemic guanacos

Posts: 5387
Joined: Wed Jul 26, 2006 11:46 pm
Location: Columbia, MO

### Re: MUT Mirror 4/2 @ NGCSU

DarkMatter wrote:
Jeremy Gibbs Freesy Does It wrote:
NGTech wrote:While the design of my stat has been drawing condemnation here on the forums it was used in our last tournament where I received quite a few complements on designing a system that attempts to even the field.

What tournament was this? It seems to me that nobody who was in your current field enjoyed this statistic at all based on what they have posted here.

The tournament he is referring to is probably this one: http://naqt.com/stats/tournament-teams. ... nt_id=3549

That high school tournament couldn't have used this stat as a tiebreaker (there were no tiebreakers because it was perfectly-sorted round-robin from 8-0 to 0-8).
Jeff Hoppes
Berkeley Quiz Bowl
VP for Communication and history subject editor, NAQT
Editor emeritus, ACF

"I wish to make some kind of joke about Jeff's love of birds, but I always fear he'll turn them on me Hitchcock-style." -Fred

bt_green_warbler

Posts: 3290
Joined: Thu Aug 28, 2003 3:33 pm
Location: San Francisco Bay Area

### Re: MUT Mirror 4/2 @ NGCSU

bt_green_warbler wrote:
DarkMatter wrote:
Jeremy Gibbs Freesy Does It wrote:
NGTech wrote:While the design of my stat has been drawing condemnation here on the forums it was used in our last tournament where I received quite a few complements on designing a system that attempts to even the field.

What tournament was this? It seems to me that nobody who was in your current field enjoyed this statistic at all based on what they have posted here.

The tournament he is referring to is probably this one: http://naqt.com/stats/tournament-teams. ... nt_id=3549

That high school tournament couldn't have used this stat as a tiebreaker (there were no tiebreakers because it was perfectly-sorted round-robin from 8-0 to 0-8).

Good point. The teams may have known about the tiebreaker in advance though, so they may have had an opinion concerning the tiebreaker even though it wasn't actually applied to the tournament. There seems to be no evidence that they have held another tournament this year, I checked both the NAQT results page and the both the high school tournaments section and the archives.
Jake Sundberg
University of Alabama
Archdemon Emeritus

BACK-TO-BACK-TO-BACK 12th place finishes at ICT
2012 ACF Nationals Champion, solo teams
2013 ICT Champion, teams consisting of only players with degrees from four-year institutions, minimum three players
2013 ACF Nationals Champion, same category, minimum two players

The Ununtiable Twine
Amazon of buried jaguars

Posts: 560
Joined: Fri Feb 02, 2007 11:09 pm
Location: Tuscaloosa, AL

### Re: MUT Mirror 4/2 @ NGCSU

DarkMatter wrote: The teams may have known about the tiebreaker in advance though

This would surprise me somewhat.
Guy Tabachnick
Hunter '09
Brown '13

http://memoryofthisimpertinence.blogspot.com/

Sir Thopas
groom of totemic guanacos

Posts: 1330
Joined: Tue Mar 28, 2006 10:10 pm
Location: Hunter, NYC

### Re: MUT Mirror 4/2 @ NGCSU

Jeremy Gibbs Freesy Does It wrote:Alright, a word to the wise then. Don't assume that a high school field where literally a third of the teams are coached by noted idiot Robin Richards and the rest are of varying degrees of not being active on the national circuit is at all going to be a good way to determine what college quizbowlers want to do. A lot of high school coaches who aren't really active love really stupid ideas about quizbowl, and this seems to be no exception.

High school teams and coaches were not the only ones to compliment the stat, we received some from a few coaches and competitors at this most recent tournament.
Nicolas A. Collins
North Georgia College Academic Team Technical Director
NGTech
potter wasted among his clays

Posts: 13
Joined: Sun Apr 03, 2011 12:30 am

### Re: MUT Mirror 4/2 @ NGCSU

I also count complaints from 4 attendees (half the field, including first place, second place, and statistically third place). Of the four remaining, one "team" was a high school playing solo. If you're trying to defend something which literally half the field protested against, you've got a problem here.
Mike Cheyne
"Intensity Integrity Intelligence"
University of Minnesota

Cheynem
Moderator

Posts: 3609
Joined: Tue May 11, 2004 11:19 am
Location: Minneapolis, Moneysota

### Re: MUT Mirror 4/2 @ NGCSU

NGTech wrote:High school teams and coaches were not the only ones to compliment the stat, we received some from a few coaches and competitors at this most recent tournament.

Of the teams that actually complimented this stat, I'm curious as to how they performed in the tournament.
Matt Hayes
Founder, UL Lafayette Club for Academic Competition
Louisiana-Lafayette '05, '08
Case Western '13

I solved the halting problem, but then I got stuck in an infinite loop.

mhayes
torrent of sunbursts

Posts: 273
Joined: Thu Feb 16, 2006 3:15 pm
Location: Cleveland, OH

### Re: MUT Mirror 4/2 @ NGCSU

What is NAQT's stance on this statistic? Just curious.
Jake Sundberg
University of Alabama
Archdemon Emeritus

BACK-TO-BACK-TO-BACK 12th place finishes at ICT
2012 ACF Nationals Champion, solo teams
2013 ICT Champion, teams consisting of only players with degrees from four-year institutions, minimum three players
2013 ACF Nationals Champion, same category, minimum two players

The Ununtiable Twine
Amazon of buried jaguars

Posts: 560
Joined: Fri Feb 02, 2007 11:09 pm
Location: Tuscaloosa, AL

### Re: MUT Mirror 4/2 @ NGCSU

This is really a response to a PM I got today (and some similar remarks already present in this thread), but I think it's worth saying publicly. I also hope it's not backseat modding, but if it is it's worth a warning/tempban. No matter who you are-- the president of a question provider, a coach, a TD, or just a quizbowl player-- if you come into a forum full of quizbowlers endorsing or defending (or whatever it's called when you're "against it being used before the tournament started") what everybody else thinks is a bad idea, your post is not exempt from criticism. No one cares how much of a say you have in your club's decision-making. When, for example, someone comes on insisting that math comp absolutely must be a part of the distribution, no one checks to see whether he's a set editor or whatever before telling him why he's wrong. When you post something on a forum, it becomes fair game for anyone to respond to as they think is appropriate.
Farrah Bilimoria
MS biology subject editor, NAQT
Georgia Institute of Technology '07-'10
Central High School '07
Eric Mukherjee wrote:The highest honor a quizbowl writer could receive is a tirade from Tom Cruise or a fatwa from Ayatollah Khamenei.

Marble-faced Bristle Tyrant
Amazon of buried jaguars

Posts: 724
Joined: Fri Feb 08, 2008 11:05 pm
Location: Macon, GA

### Re: MUT Mirror 4/2 @ NGCSU

DarkMatter wrote:What is NAQT's stance on this statistic? Just curious.

I'll direct you to NAQT's tiebreaker policy, which among other things states:

If ties must be broken (as is the case in rebracketing or determining the championship, but not necessarily for reporting overall results for lower-finishing teams), they must be played off, at the buzzer.
Jeff Hoppes
Berkeley Quiz Bowl
VP for Communication and history subject editor, NAQT
Editor emeritus, ACF

"I wish to make some kind of joke about Jeff's love of birds, but I always fear he'll turn them on me Hitchcock-style." -Fred

bt_green_warbler

Posts: 3290
Joined: Thu Aug 28, 2003 3:33 pm
Location: San Francisco Bay Area

### Re: MUT Mirror 4/2 @ NGCSU

List of wrestling-based comic books wrote:This is really a response to a PM I got today (and some similar remarks already present in this thread), but I think it's worth saying publicly. I also hope it's not backseat modding, but if it is it's worth a warning/tempban. No matter who you are-- the president of a question provider, a coach, a TD, or just a quizbowl player-- if you come into a forum full of quizbowlers endorsing or defending (or whatever it's called when you're "against it being used before the tournament started") what everybody else thinks is a bad idea, your post is not exempt from criticism. No one cares how much of a say you have in your club's decision-making. When, for example, someone comes on insisting that math comp absolutely must be a part of the distribution, no one checks to see whether he's a set editor or whatever before telling him why he's wrong. When you post something on a forum, it becomes fair game for anyone to respond to as they think is appropriate.

Based on your links, I wonder if the person who sent your PM is the same one who sent one to me today.
Nolan -
UChicago 09
Michigan State Well-wisher

Habitat_Against_Humanity
mason high on your treacherous scaffolding

Posts: 217
Joined: Sun Jan 21, 2007 8:51 pm
Location: New Haven, CT

### Re: MUT Mirror 4/2 @ NGCSU

If anyone has issues with PMs that have been sent, please notify me.
Fred Morlan
University of Kentucky CoP, 20XX
NAQT writer & subject editor, PACE member (former President, current At Large member of Board), hsqbrank manager, HSAPQ freelance writer, former hsqb Administrator/Chief Administrator, 2012 NASAT Tournament Director

Grams's Go-Go Boots
groom of totemic guanacos

Posts: 11775
Joined: Thu Apr 24, 2003 8:08 am

Previous