It’s difficult to engineer something to capture the zeitgeist

0

ZeitgeistImage

Some RPGs are more popular than others, and it can be difficult to figure out why. This is not unusual, many “culture industry” products work this way: some movies are hits and others are flops, some songs top the charts and others are ignored, some books hit the best-seller lists and others are never read. It’s reasonable to want an audience for the things you create, but it is difficult to engineer a hit. One notable factor is that social influence plays a role: we humans can use the opinions of the people around us to help us identify good things, since personally investigating each and every song, book, movie, RPG, etc., is an intractable problem.

Recognizing that this is a pattern in multiple contexts, some social scientists have attempted to study it. In one study, the experimenters set up a website in which subjects could listen to, rate, and download songs. However, they arranged the experiment so that different subjects ended up in different “worlds” from each other. In the control group the participants had no idea how well-liked the songs were, but in other worlds people were able to see the “charts” that indicated how good/popular the songs were with their peers. One thing you might expect is that some songs are just better than others, so the best songs would tend to bubble up to the top in a Darwinian fashion. Another thing you might expect is that, due to social influence, a “rich get richer” effect would come into play as people gravitated towards songs that were lucky enough to be identified as good early on. Running in parallel like this let the experimenters compare the how the “worlds” developed. As their abstract summarizes:

Increasing the strength of social influence increased both inequality and unpredictability of success. Success was also only partly determined by quality: The best songs rarely did poorly, and the worst rarely did well, but any other result was possible.

What I think we should take away from this is that there may be things that are in our control and things that are not in our control when we create things that will compete in a cultural market. The quality is under our control: the best songs rare did poorly, and the worst rarely did well. But any other result was possible because in a chaotic social environment we have little ability to predict with certainty how well something will be received: not every flap of a butterfly’s wings causes a hurricane. When we’re designing an RPG we can control things like whether the rules are fully explained, whether we’ve included proper examples, whether the information is presented concisely, and whether people have fun when they play the game properly. We’re far less able to control whether the game will hit the zeitgeist and have whatever combination of features make something the “new hotness”.

Now, some might argue that even though it’s difficult you need to craft your product so that it appeals to an audience. And perhaps you can use testing to see what does or doesn’t appeal. The problem with this approach is that it’s very difficult to extrapolate from thin data. Anyone who follows politics can tell you that asking around among your friends is a terribly unreliable way to judge how the population as a whole feels about an issue. Statisticians and pollsters are very attuned to the issues of sample size and nonrandom samples. The field of statistics is built upon the idea of making inferences about the world from limited data. There are mathematical rules that can tell you how confident you should be that the results of querying a random sampling of a particular size would generalize to the overall population. On the one hand this can be pretty impressive, political pollsters are able to make reasonable predictions about the entire voting population of a country as big as the United States from samples of hundreds or a few thousand. But even though that’s a small number when compared to the population of a country, it’s a big number when compared to the customer reach of independently-published roleplaying games. Furthermore, size isn’t the only thing that matters: it’s common for political bloggers to have “web polls” of their readership but it would be foolish to extrapolate from them no matter how many people responded because the tools of statistical inference only work from a random sample. If your sample is biased it is incredibly difficult to extrapolate from it. So, if you’ve floated your RPG but haven’t gotten a positive response from an audience, should you conclude that no one will like it? No one will stop you from extrapolating from a small, biased sample if you want to, but that’s generally not the way that data-driven decisions are supposed to work (of course there’s also the question of effect size: extremely strong reactions may be easier to detect with smaller samples). Measuring your success at finding playtesters for your game is not a very reliable tool for figuring out if people will want to play a game, but if actual playtesting is done well it can be an excellent too for determining if the game is fun when people do play it.

But the product itself isn’t the only thing that you’re creating. What about things like marketing campaigns, establishing brands or reputations, or building notoriety in related fields? Interestingly, some of the same authors from the study I described above ran a very similar experiment in order to observe what would happen when subjects were exposed to intentionally manipulated market information. What they discovered is that there was indeed a “self-fulfilling prophecy” effect of songs that were presented as popular continuing to be popular (and similarly for those presented as unpopular to remain unpopular), but the effect wasn’t overwhelming. Some element of the songs’ intrinsic properties must have an impact, because the artificially popular/unpopular songs didn’t seem to match the trajectories in conditions where the songs achieved that status “naturally”.

NIHMS503709.html

Interestingly, they observed an overall effect on the manipulated markets:

A final and unexpected consequence of the inversion was a substantial reduction in the overall number of downloads. … [S]ubjects in all social influence worlds tended to listen to the songs that they thought were more popular. In the inverted worlds, however, the songs that appeared to be more popular tended to be of lower appeal; thus, subjects in the inverted world were more exposed to lower appeal songs. For example, in the unchanged world, the 10 highest appeal songs had about twice as many listens as the 10 lowest appeal songs, but in the inverted worlds this pattern was reversed with the 10 lowest appeal songs having twice as many listens. As a consequence, subjects in the inverted worlds left the experiment after listening to fewer songs and were less likely to download the songs to which they did listen. … Together, these effects led to a substantial reduction in downloads: 2,197 and 2,160 in the inverted worlds, compared with 2,898 in the unchanged world.

The combination of increased success for some individual songs … on the one hand, and decreasing overall downloads, on the other hand, suggests that the choice to manipulate market information may resemble a social dilemma, familiar in studies of public goods and common-pool resources … but less evident in market-oriented behavior. [Some of this data] suggests that any individual band could expect to benefit by artificially inflating their perceived popularity, regardless of their true appeal or the strategies of the other bands; thus all bands have a rational incentive to manipulate information. When too many bands employ this strategy, however, the correlation between apparent popularity and appeal is lowered, leading to the unintended consequence of the market as a whole contracting, thereby causing all bands to suffer collectively.

Obviously there are differences between the experimental conditions and real-world markets, but it does suggest that the strategy of intentionally “hyping up” your own product may seem smart in a zero-sum world but can contribute to a “tragedy of the commons” when everybody commits to that strategy. It seems to me that the wiser course would be for everyone to make the best products they can and try to operate in as fair a market as possible so they are most likely to get the results that they deserve (including players getting to play the best games). To the extent that our markets are imperfect, I believe it’s most important to care about removing barriers to entry so that potentially-good games get at least one bite at the apple, and we don’t need to worry so much about “promoting” games/people who are already getting a chance to let their games speak for themselves.

Webcomic 16: With these I can think through anything

0

XRaySpecsComic

Webcomic 15: Dollar-sense Tingling!

0

MonetizerComic

Webcomic 14: It’s goo for you

0

GuruComic

Webcomic 13: Spotlight Hogs

0

RPGControversyComic

Explaining jokes always makes them less funny. In this case, if you don’t get the references in the above comic you’re probably better off, just go about your business. But if you simply must understand...

This comic references several obscure points of controversy or “drama” in the online communities where tabletop RPGs are discussed.

Brain Damage: In the olden days of The Forge, Ron Edwards used the phrase “brain damage” to characterize the effect that playing certain 90s-era RPGs (such as those produced by White Wolf) had on shaping expectations about RPG play and how stories worked. Many people, including many who agreed with Ron’s underlying point, found this to be a crass way to express it. Some people in the Forge/Story-Games community began to casually use the phrase jokingly, as a back-handed dig at what they perceived as Ron’s unnecessarily inflammatory language. Some podcasters from that community put out an episode where they speculated that RPG-blogger Zak S’s D&D-group might have this “brain damage” which prevented them from liking the same games the podcasters liked. Needless to say, Zak and the players in his group took offense (which seems reasonable, since the joke could be considered tasteless even with the context). The relationship between Zak S and the Story-Games community didn’t get much friendlier than this rocky start, and this incident is still affecting opinions in the “5e consultant controversy” where there seems to be a whispering campaign against Zak by some people who had some association with the Story-Games community.

Swine: The RPG Pundit‘s online persona is a firebrand orator opposed to the influence of “the swine” on RPGs. Swine are apparently everyone who doesn’t like mainstream RPGs and/or anyone who advocates a political agenda associated with contemporary Progressivism and/or the ideas taught in many university Race/Ethnic/Gender Studies departments. The swine are apparently both a virulent existential threat to RPGs that requires the extreme vigilance of the Pundit, and also a movement in its death throes thanks to the ceaseless toil of the Pundit. It is unclear at this time whether calling people swine is an intentional joke based on the self-evident over-the-top nature of the accusation, or whether it’s unintentional and merely laughable since many of the people in this group disagree with each other vehemently and many of them have no ill-will toward D&D or mainstream games.

Loving pigs in different ways: Ron Edwards uses a metaphor of different people using the same phrase “we love pigs” to mean radically different things as a way of explaining the idea of incompatible Creative Agendas leading to unfun play.

A different way of “loving” a pig: Zak Smith has taken to ascribing a pig-based metaphor to people engaged in the “5e consultant controversy” that he characterizes as arguing dishonestly, making unfounded accusations, spreading false rumors, lying, etc.

Don’t harsh the zen: The Story-Games community, in an effort to squash arguments and distance itself from the Forge’s reputation for standoffish elitism, attempted to adopt a culture in which all ways of playing, and all games, were equally valid. It was frowned upon to criticize anyone’s game or approach to gaming, finding positive things to say was encouraged. The desire to avoid heated discussions had some unusual effects on the culture.

Webcomic12: Duelling Dualists

0

GhostBotComic

Webcomic 11: Positive Force in the Community

0

PositiveForceComic

Webcomic 10: Shades of Gray

0

UtilitarianStreetlightComic

Webcomic 9: Some Antics

0

SemanticComic

The Meaning of Fun

0

In this blog post I’m going to articulate a theory of what “fun” is. I’m using the word theory in the scientific sense of the word, in that I intend for it to be a useful abstract model grounded in empiricism which makes falsifiable predictions. My hope is that it is also a practical theory, one that we can leverage in game design. All theories are provisional so I make no promises that it’s fully baked, but I believe it conforms to my observations about games and life so far, and I’m not aware of any counterexamples. This blog post isn’t a polemic or manifesto to convince you to buy into this theory, it’s meant to be as full and clear an articulation of it as I can manage as a step to either finding counter-evidence or extrapolating from the theory to find ways to make more and better games.

Here’s the claim:

Fun is when you experience something that feels meaningful from one perspective but is balanced by another perspective where it doesn’t feel meaningful.

Let’s break that down a bit. First, it’s a theory about fun. Not all pleasant experiences that happen during a game are necessarily fun, and fun is not restricted to only games. But fun is the archetypal subjective experience we strongly associate with playing games. Fun is the thing that’s conspicuously absent from a boring game, such as when an adult attempts to play Candyland or Chutes and Ladders. Second, this claim clearly hinges on what meaningful means. I’ll elaborate more below, but for the purposes of this theory I’m claiming that “meaningful” is the name we give to the sensation that we associate with things like “doing meaningful work” or “achieving a meaningful goal”.

The most straightforward example of this formulation in action is children “playing house”, wherein they go through the actions of household chores but, since they do it within the confines of a magic circle of play, it becomes fun. Household chores are necessary and meaningful (although they’re normally un-fun work), but the “magic circle” perspective allows those tasks to be seen as meaningless inside it, so they become fun. Many adults perform similar alchemy of transforming work into fun when they set up businesses inside the virtual world of a MMORPG. Fun occurs in non-game contexts, too: It’s common to experience solving your own personal problems as weighty and difficult, but working on other peoples’ problems (either as a nosy busybody or a charitable soul) can often be fun; the effort matters but you’re not on the hook for the consequences.

What is meaningful?

This theory uses “meaningfulness” to label a low-level psychological perception, in the same category as things like pain, anger, or saltiness. It’s an inwardly focused meta-sensation, in the same category as the feeling of confidence we use to gauge how well we know something, or the kinsesthetic sense that tells us how our body is positioned. As an allegedly foundational concept it can’t be further defined in terms of other things, but we can attempt to characterize the conditions under which it occurs, just like we would use “that feeling you get when…” style formulations to describe something like anger or pain. Much of the work of refining this theory will likely involve figuring out how to reliably produce or avoid feelings of meaningfulness, but I think we have a few good candidates:

  • Goals: Moving toward or achieving goals feels meaningful. Goals are concrete and measurable. “Winning” is the most obvious goal used in games, but things like getting the ball over the net in volleyball, getting to the end of a racecourse, or forming a valid word from your available tiles in Scrabble are all goals. They’re discrete, identifiable chunks that have recognized value to all participants.
  • Self expression: Signaling value judgments about multiple non-aligned dimensions feels meaningful. Choosing whether to hit or stand in Blackjack tells the table things about your stance on risk vs. reward. Choosing to play one class over another in a roleplaying games tells the table things about what sort of activities you want to engage in during play. Choosing a “sounds like…” vs. “act it out” approach to charades signals what you think the best way of communicating a particular idea. Sometimes the dimensions can be clear and discrete, such as how much Science, Food, and Production you assign your city to generate in Civilization, sometimes they’re more abstract, such as the decision between the importance of getting what you want vs. moral complicity in violence when choosing whether to escalate in a Dogs in the Vineyard conflict. Playing a particular card in Cards Against Humanity sends signals about what you think is funny, what you think the judge will find funny, what you think is within the bounds of humor, and what you think the group will find within bounds.
  • Morally relevant: Moral psychology is still a developing field, but it may be the case that humans find things related to moral judgments to be intrinsically meaningful, thus accounting for our consistent interest in gossip about moral transgressions and crime stories being a perennial touchstone in popular fiction. One interesting development in moral psychology to keep an eye on is Moral Foundations Theory, which posits that there are some universal moral “taste buds” that different people might different sensitivities to. It’s also possible that this is merely a special case of the already-described factors, since signaling moral values is important and we may spontaneously generate goals to respond to moral infractions.
  • A social component?: There may be a social component to meaningfulness, especially with regard to sending signals. Having a human observer might justify expressing things even when they don’t have direct consequences, as with an artist’s relationship with an audience. Some boardgames that have a “roleplaying element” to them sometimes play very differently when played solo or in a group, even if the same mechanics apply, since it’s easy to bypass things like “creative description” when playing alone. Humans are social animals, so the perceptions of our peers may be as important as physical reality when it comes to determining how “real” or “meaningful” something is to us.

What isn’t meaningful?

  • Inconsequential: When things are ignored, or can be ignored, they generally don’t feel meaningful. For example, when children play pretend-games like Cops and Robbers they can easily degenerate into “I shot you / no you didn’t” disputes, i.e. what one child is pretending may end up having no consequence on what the other child is pretending. More broadly, the concept of the magic circle keeps the events of a game from impacting the world outside of it and is therefore an important element in making games fun.
  • Not salient: In order for the self-expression meaningfulness described above to work, the relevant dimensions need to be salient. When a person kills an orc in a roleplaying game, if they see the orc as tantamount to a piñata filled with loot then they aren’t sending any signals about their or their character’s values with respect to cruelty or harm, while a person treating the orc as a kind of person might be sending those signals. There are many ways of making things salient, such as by explicitly flagging the relevant factors (such as by associating a game statistic with it) or evoking pre-existing associations in players’ minds.
  • Overdetermined Signals: When there are multiple salient factors but some are overwhelmed by others it feels less meaningful. If there’s a nigh-universally regarded “better choice” then the choice doesn’t seem real or meaningful. Similarly, if factors aren’t sufficiently independent it may be difficult to signal tradeoffs between them, they can collapse together into a single dimension. In playing a party-based roleplaying game with niche protection, sometimes people feel they have “no choice” but to do what their role requires, such as a cleric who uses all of their actions to heal other characters. Several psychology studies have demonstrated that financial incentives can have the effect of crowding out other motivations.

The “balanced by” element of the theory

The theory doesn’t call for maximizing meaningfulness in order to make something fun, it calls for balanced meaningful/meaningless perspectives. Games can become unfun if they’re not meaningful enough, but also if aspects of them are too meaningful. If people expect winning or losing to haunt them for a long time a competitive game may not be fun. Some people find it impossible to engage with Dogs in the Vineyard because they have such intense egalitarian convictions that the gender roles in the setting are repugnant to them. Some people find some of the subject matter in Cards Against Humanity to be beyond the realm of things it’s OK to joke about. The roleplaying game Novanta Minuti/Ninety Minutes deals with the prospect of having or missing a final conversation with a dying parent, and such high emotional stakes could easily be so weighty that it doesn’t register as “fun”. In roleplaying games that have a player associate with a single character for multiple sessions, “character death” is often a tricky issue. Light beer-and-pretzels strategy games tend to focus on just engaging with the game’s mechanics while more hardcore strategic games tend to require a playing-the-player approach, which could extend to making judgments about people that go beyond the game, such as the legends of Dimplomacy ruining friendships.

An avenue for exploration: Minimal Games

One way to explore the predictions of this theory is through the development of games which use as few factors as possible so that we can use an “is it fun?” metric with as few confounding factors as possible. For example, my game Four Panels was constructed with the intention of demonstrating that a purely procedural game with self-expression and consequentiality was enough to produce gamelike fun and that things like an “object of play” or win/loss conditions aren’t necessary. The web game Cookie Clicker is a surprisingly fun game built on little more than a score that increments in response to player action (combined, to a degree, with goal-setting in the form of purchasable power-ups). Simple push-your-luck dice games seem to be reliably fun games where valuing risk and reward seem central to the experience.

We can leverage psychology about non-game topics

By using a definition of meaningfulness that can apply to both work and play we may be able to leverage psychology findings that are focused on work and motivation. For example, in this video Dan Ariely describes several experiments that he associates with work and meaningfulness. Compare the results of the experiment described from 9:55 to 12:40 to this observation by game designer Vincent Baker about the “Okay Cycle” in roleplaying games — it seems to me that they’re both observing something about the impact of social acknowledgment on a feeling of meaningful contribution.

Appendix: Some possible objections
Isn't 'fun' completely subjective? It's all just personal taste!
We all agree that tastes can be subjective, but we can also all agree that “sweetness” is a real phenomenon that humans can perceive via the common sensory receptors we share. Each of us might differ on whether some particular food is “too sweet” or “not sweet enough” due to a variety of factors like differing sensitivity to sweetness or whether the particular combination of sweet and other flavors is pleasing to our idiosyncratic preferences, but we can safely say that there are real-world things like the presence of sugar that are causally connected to the perception of sweetness. Cooking a pleasing dessert may be an art, but knowing that sugar is sweet is science. The subjectivity of experience is a real thing, but not necessarily an insurmountable obstacle to understanding how humans work.

But aren't the things you're calling 'meaningful' just you projecting your own tastes?
Maybe! Introspection has definitely been part of this theory, but so has observation of others playing, accounting for clusters of opinions and “folk wisdom” in commentary about games, experience and observation of people in work situations, folk wisdom from management advice, and trying to synthesize ideas from several psychology papers I’ve read.

There are things I like about games that aren't accounted for in this theory!
First, this theory doesn’t claim to account for every pleasing sensation associated with games. For example, some video games feature beautiful cutscenes that might be pleasing to watch but aren’t necessarily “fun” to watch. That said, if there are things people find fun in games that this theory would put in a box labeled “not fun” then that is evidence that there are issues with the theory, and I’d like to discuss them. Part of the scientific method is that theories should make falsifiable claims so that we can test how well the theory maps to the real world. In science all theories are provisional.

Are you sure meaningfulness works like a basic sense?
Nope! That’s part of the conjecture. Maybe there’s something more basic. Maybe there’s something else that frequently occurs along with meaningfulness and I’ve conflated them.

Appendix: Interesting Asides
Is this theory of any use in analyzing game designs?
I believe so. For example, in this post on Google+ I took a look at the game mechanics of the game Psi*Run based on listening to an Actual Play Podcast recording of a group playing the game. The areas of fun and areas of unease seemed explainable by this theory, at least in my assessment.

Self-created goals AKA 'what about Minecraft?'
Any discussion of goals in games will inevitably turn to the discussion of self-authored goals in games like SimCity or Minecraft. I think this is an interesting area of exploration. It’s clear to me that not just any arbitrary goal will do, because otherwise creating trivially-satisfied goals would be lots of fun, but that isn’t lots of fun. Instead I suspect there’s an element of perception and externalizing involved in these “self-created” goals. In an arcade game with scores people are more likely to choose score-goals based on round numbers or existing entries on a leaderboard than they are to pick some random number. Similarly, certain patterns of goals will naturally emerge in SimCity, e.g. recreating real locales, maximizing certain parameters like covering the entire map, etc. I suspect that the goals that are likely to emerge in a given game are a combination of the structure of the play-space and human psychology, analogous to how the negative space in visual art is a combination of the created object and the way human visual perception works.

Does this theory have anything to say about the Czege Principle?
The Czege Principle is a conjecture put forward by Paul Czege about roleplaying games where he observed that when the same person generates adversity and the resolution to it the result is boring for them. I recently read a psychology paper, Consider it done! Plan making can eliminate the cognitive effects of unfulfilled goals by Masicampo and Baumeister, which appeared to experimentally demonstrate that making a plan to resolve a goal can “deallocate” some cognitive resources that are normally occupied when we have unfulfilled goals. Perhaps we don’t have the subjective “meaningfulness” experience when we accomplish goals that aren’t active in this way. While I’m clearly speculating here I think it’s an interesting avenue to explore.

Appendix: What does this theory of fun have to say about some of the other popular theories?
Raph Koster's Theory of Fun
In his book Theory of Fun, Raph Koster frames play in terms of learning, noting that many animals will “play fight” while young as practice for adulthood. While this account is appealing, it doesn’t address games that continue to be fun even when mastered, such as many tabletop RPGs. I think my meaningfulness account is a superset: learning transferable things can be meaningful, but not everything that is meaningful must be a form of learning.

Sid Meier's aphorism 'A game is a series of interesting choices'
I think this “meaningful contributions” account is a superset of that aphorism: I think interesting choices and meaningful choices can be trivially exchanged in that statement while preserving the meaning, but “contributions” is a superior framing to “choices” because there are components to some games, such as the moment-to-moment physical actions in a sport, that could demand an especially generous reading of “choices”.

Flow and Gamification
The most common teaching of gamification gurus is that games are all about skill and difficulty, and you need to find the not-too-hard not-too-easy sweet spot in order to reach Flow state, which will be fun. This meaningfulness account of fun would frame that observation about some games in terms of psychophysics, the psychological study of human senses like vision or hearing, where we often expect our senses to work via environmental contrasts. If something is “too hard for your skill level” then your small contribution will be below your threshold of noticability in terms of progressing to your goal and will therefore not register as meaningful. If the “challenge” is similarly not large enough to register then accomplishing it will not seem meaningful.

The Forge's Big Model / GNS
In terms of the tabletop roleplaying game theories developed at the Forge, a roleplaying group needs a shared Creative Agenda in order to have satisfying coherent play. In this meaningfulness account, confidence that a constellation of shared dimensions of meaningfulness are “in play” is very important: it primes a participant to evaluate their contributions along those dimensions, it primes the participant to be confident that contributions relevant to those dimensions will be valued, and it primes others to notice and socially acknowledge the contributions along those dimensions because they’ve been primed to be vigilant for them. If there’s significant overlap in the set of “relevant dimensions” for each participant then you’ve got a shared creative agenda. If there’s little overlap you don’t and you have un-fun “incoherent” play (for example, in a horror-themed game a person trying to “win” by being as self-protective as possible may be ruining the fun of someone playing to be “true to the genre”, and vice versa).

Human capacity is limited, so it shouldn’t be surprising that humans can’t operate with an infinite number of salient dimensions simultaneously. The three “modes” identified by GNS theory can map to several sets of dimensions that have been discovered to work well in concert. Story Now play requires elements of human drama and morality to be salient. Step on Up play requires the difficulty of overcoming legitimate challenges to be salient. Right to Dream play requires certain expectations (e.g. genre, iconic characterisation, “realism”) to be salient.


The Forge's Big Model / Currency
In the tabletop RPG theory ideas of The Forge, Currency is the confusingly-named concept that various elements of a game get transformed into other elements. The canonical definition limits it to “things on a character sheet”, although it also incorporates Positioning which might include the notion of “Position” which many games share (both position-in-space as in “where on the soccer field are you standing right now?” and position-on-the-team as in “are you the goalkeeper?” have direct analogs to the RPG-specific things like “fictional positioning”). If we treat Currency as trading off various dimensions of position-in-the-game-state then I believe it’s very similar to the values-signaling meaningfulness account presented above.
Go to Top