This Soup is an Awful Cake: 5 Tips for Taking Playtest Feedback, from Game Design Roundtable


In a recent episode of Game Design Roundtable, Dirk Knemeyer, David Heron, and Rob Daviau discuss the nature of all sorts of feedback from playtesters all the way to post-release reviews. The bits specifically relating to playtest feedback were most interesting to me and I thought I'd list them out here for future reference.
Playtesters are usually really poor at self-reporting.
Matt Leacock asks testers to just record sessions on video, no written reports. He'll just watch the video at 1.5x normal speed and look for moments when players check the rulebook, check their phone, or just check out completely.

If you can't record video, be ready to listen.
Rob Daviau lets playtesters talk it out, even if conversation drifts to solutions that he has no intention of implementing. He just lets playtesters keep talking because they'll inevitably talk around the real problem.

Communicate your design goals. 
Watch out for playtesters who evaluate a game against their own preferences rather than your design goals. "This soup is an awful cake," is not the most useful feedback.

Hit the road. 
Finding local playtesters is difficult, so you have to really stretch what you think of as "local." Be prepared to log some miles to find willing playtesters at game stores in neighboring towns throughout the week or month. (I log my own miles for tax purposes, and I can tell you they really add up.)

Be physically prepared to take feedback. 
Make sure you're in the right mental state to hear playtest feedback, otherwise it might blow up. I can tell you from personal experience that by the end of a long playtest day without much of a break, I can get very catty. Rest, hydrate, eat, pace yourself.

You can listen to the rest of that episode here. It's really good!

Comments

Post a Comment

Popular posts from this blog

5 Graphic Design and Typography Tips for your Card Game

Image
Chris Farrell of Illuminating Games just wrote a thorough critique of card games setting their body text to be so small that they cannot be read at arm's length, let alone across the table. Here's an excerpt, but the whole thing is worth a read for any would-be card game designers out there. (Myself included.) Break out your copy of the base set of Dominion, and look at the Chapel. This has a text box roughly 3.5cm by 4.5cm. It's got a single line of text. That line of text is 1 (one) millimeter high. 1mm! For me, it's only clearly readable at half an arm's length even in the bright light of day. (...) Compare this to a more sane game like Glory to Rome, where the font size is 2-3 times as large (text is 2mm high, keywords 3mm and usually highlighted). I can generally read Glory to Rome cards across the table, and can certainly see the important keywords. To heap insult upon injury, not only does Glory to Rome have far more legible text than Dominion it also has
Read more

Low-High Dice Game

Image
A dice game inspired by the stock market (and playing lots of Martian Dice). Roll a bunch of dice and choose which sets to keep. Choose your strategy wisely! Stuff You Need Two-to-Six PLAYERS A PENCIL and PAPER to keep score Thirteen standard six-sided DICE How to Play The shortest player takes the first turn. On your turn, first roll all thirteen dice. Several dice will have matching results. These are called SETS. (A single die result is a set, too.) You must choose a set to keep. For example, your first roll results are 111124445555 . The sets are four 1 s, one 2 , three 4 s, and four 5 s. After keeping a set of dice, lock them up in a row. This is called the GOOD TRACK. For example,  you could keep the set of four 1 s, one 2 , three 4 s, or four 5 s . You decide to keep the four 1 s and line them up in your good track. After keeping a set, you may end your turn or re-roll the remaining unlocked dice. When you re-roll, immediately set aside any results that ar
Read more

The Thousand-Year Game Design Challenge

Image
UPDATE: The submission period has closed and here are the entries. If you're an entrant, continue sending pics or vids of people playing your game. The first step to a game lasting a thousand years is for people to play it today. UPDATE 2: And here's the winner! To support games designed for longevity – that can be learned, played and shared for hundreds of years – we offer this challenge to any game designers, artists and imaginative people who also share this desire. Challenge Create a game. The game can be of any theme or genre you desire, but there is one restriction: You're creating a "new classic," like Chess, Tag or card games. So, create a game to be enjoyed by generations of players for a thousand years. Prize $1,000 to the winning entrant, to be announced and awarded January 1, 2012. Entry Deadline Entries must be submitted before midnight July August 31st, 2011. ( Update ) Entry Guidelines Enter by posting a comment below with a link
Read more