Our Judging Process for the Thousand-Year Game Design Challenge



My wife and I are halfway done reviewing, playing and judging the entries to the Thousand-Year Game Design Challenge. (Asterisks note games we've judged so far.) It's been an interesting experience to say the least. I'm glad we've had a few months' time for this phase, because we needed every minute with our busy schedules. Here's an explanation of our judging process so far.

1. Read
Naturally, the first step of the process is reading the rules of the game. If we can understand how to play the game from a direct reading of the rules as written by the designer, then we'll proceed to the next step. We really do give it our best effort to read and comprehend the rules text. Sadly, in a very few cases, some entries do get taken out of contention in this first step simply because we can't figure out how to play from the text.

2. Setup
We gather whatever game components are called for by the text. In some cases, this is as simple as a piece of paper and a pencil. In other cases, the components are extremely specific, unique or numerous. As you might imagine, we have a LOT of game components in our house. If an entry calls for components so specific or so numerous that we can't assemble an adequate play set, that's a red flag for us. If a household with as many game-bits as us can't put together a play set, it's not likely many others would be able to either. Perhaps that policy is harsh, but we have so many entries that create elegant, fun experiences without unique components that we really have to grade based on that context.

3. Play
And then, of course, we play the actual game. We'll play as many times as we can, so that we fully get a sense of how the game feels and to make sure we properly understand the rules. If the game actually stays fun each time we play, that gives us a strong feeling that the entry is a good contender to win the challenge. Throughout play, we take notes in our little journal (seen above, handmade by Sara Hindmarch aka Repaper).

4. Analyze
We ask each other a few questions in a very informal way. – Would you play again? Did you find it more fun the first or second time? Were the rules clear enough at first? How does this entry compare to the other entries so far? Is it more accessible than the others? Is it more sustainable to produce than the others? Is it more fun than the others? – I'm the more abstract player of the two of us. My wife has the strongest sense of elegance and accessibility.

So that's how we're proceeding. We're on track to finish judging the rest of the entries over the next two months. A few of them require three or more players, so I'll rope in some of the local Durhamites to do some playing and judging of their own.

Comments

  1. Nick BentleyNovember 7, 2011 at 12:58 PM

    Hey Daniel,

    In response to your call to provide evidence that others are playing and discussing the entries, I've posted a compendium of links to play stats, pictures, and discussion from around the web. I'll update it periodically as I find more stuff, until the contest is over. Here's the post:

    http://nickbentley.posterous.com/ketchup-popularity-tracker

    ReplyDelete
  2. Daniel SolisNovember 7, 2011 at 1:48 PM

    Hi Nick! Thanks for all the raw data. Apologies if it seems like a popularity contest, but there are sooo many games out there that never really leave the designer's house. We wanted to encourage people to make *and* play long-lasting games, y'know? But anyhoo, your entry definitely has the very strong evidence of a developing community.

    ReplyDelete
  3. Nick BentleyNovember 7, 2011 at 1:53 PM

    Thanks. As I say, overall, I love the contest despite that one little niggle. Also, I agree with the general premise. A game never played is like music never heard - there's not much point to it. In any case endless thanks for running the contest. It seems like a ton of work.

    ReplyDelete
  4. Nick BentleyNovember 10, 2011 at 4:15 PM

    One of my game's fans just wrote a very positive review of the game, with lots of pics, in which he compares it to a Bach Fugue. It's apparently not a joke and I swear on my life I didn't bribe him or anything. He also claims to have played the game 60 times in the last few weeks.

    http://ludocracynow.tumblr.com/post/12601409238/ketchup-a-review#disqus_thread

    ReplyDelete

Post a Comment

Popular posts from this blog

5 Graphic Design and Typography Tips for your Card Game

Image
Chris Farrell of Illuminating Games just wrote a thorough critique of card games setting their body text to be so small that they cannot be read at arm's length, let alone across the table. Here's an excerpt, but the whole thing is worth a read for any would-be card game designers out there. (Myself included.) Break out your copy of the base set of Dominion, and look at the Chapel. This has a text box roughly 3.5cm by 4.5cm. It's got a single line of text. That line of text is 1 (one) millimeter high. 1mm! For me, it's only clearly readable at half an arm's length even in the bright light of day. (...) Compare this to a more sane game like Glory to Rome, where the font size is 2-3 times as large (text is 2mm high, keywords 3mm and usually highlighted). I can generally read Glory to Rome cards across the table, and can certainly see the important keywords. To heap insult upon injury, not only does Glory to Rome have far more legible text than Dominion it also has...
Read more

Low-High Dice Game

Image
A dice game inspired by the stock market (and playing lots of Martian Dice). Roll a bunch of dice and choose which sets to keep. Choose your strategy wisely! Stuff You Need Two-to-Six PLAYERS A PENCIL and PAPER to keep score Thirteen standard six-sided DICE How to Play The shortest player takes the first turn. On your turn, first roll all thirteen dice. Several dice will have matching results. These are called SETS. (A single die result is a set, too.) You must choose a set to keep. For example, your first roll results are 111124445555 . The sets are four 1 s, one 2 , three 4 s, and four 5 s. After keeping a set of dice, lock them up in a row. This is called the GOOD TRACK. For example,  you could keep the set of four 1 s, one 2 , three 4 s, or four 5 s . You decide to keep the four 1 s and line them up in your good track. After keeping a set, you may end your turn or re-roll the remaining unlocked dice. When you re-roll, immediately set aside any results tha...
Read more

One Thing to Avoid in Game Design

Image
When game designer Paul Peterson was interviewed for the upcoming Titans Series of games from Calliope Games, there was one segment at 1:55 that really caught my attention (emphasis mine): "A couple years ago I was teaching people how to play Guillotine and I hadn't played in a while. The first thing I did was say, 'The first thing you gonna do when you open your game is you look through this deck and you take this card.' I pulled out the Callous Guards card and threw it over my shoulder. Everybody laughed. I said, ' That's the biggest mistake I ever made as a game designer in my life.'" Oof. Those are strong words. What's the big deal? For context, the game Guillotine is all about collecting the heads of French nobles during the revolution. There is only one guillotine, with a line of nobles waiting for their grim fate. On your turn, you play action cards to change the order of the line, then take the Noble card from the front of the ...
Read more