PAXsims

Conflict simulation, peacebuilding, and development

Category Archives: methodology

In-stride adjudication (Connections 2018 working group report)

Stephen Downes-Martin has pulled together a 187 page (!) report on in-stride adjudication from the papers and discussion presented at the Connections US 2018 conference. You can download it here.

In-Stride Adjudication Working Group Report 20180908.jpg

Jane’s Intelligence Review on matrix gaming

The September issue of Jane’s Intelligence Review has an excellent article by Neil Ashdown assessing matrix games as an analytical tool.

Key points

  • Matrix games are comparatively simple wargames, emphasising creativity and original thought, which have been used by a range of government agencies and militaries.
  • These games are focused on the participants’ intentions, which makes them better suited for analysing political-military strategy and novel or obscure subjects, such as cyber security.
  • However, this technique is unsuitable for analysing granular tactical scenarios, and the games’ relatively low cost and complexity can reduce their attractiveness.

 

JIR1809_OSINT2

I would like to thank Neil and JIR for making it available (pdf copy at the link above) to PAXsims readers. If you are interested in reading more about the technique, there are many matrix gaming articles available here at PAXsims, the History of Wargaming Project has just published the Matrix Game Handbook, and you can purchase the Matrix Game Construction Kit (MaGCK) User Guide as a downloadable pdf.

How can we avoid risky and dishonesty shifts in seminar wargames?

iss_12137_00953.jpg

Stephen Downes-Martin has written up the discussion from another Connections game lab session, this time on How can we avoid risky and dishonesty shifts in seminar wargames?

The group identified three research questions and identified and discusses nine ways that the risky and (dis)honest shifts could be baselined, measured, controlled or mitigated.

Two Behavior Shifts During Small Group Discussions

The (Dis)honesty Shift

Research indicates “that there is a stronger inclination to behave immorally in groups than individually,” resulting in group decisions that are less honest than the individuals would tolerate on their own. “Dishonest” in the context of the research means the group decisions break or skirt the ethical rules of the organization and societal norms, involve cheating and lying. Furthermore, the group discussions tend to shift the individuals’ post-discussion norms of honest behavior towards dishonest. First the discussion tends to challenge the honesty norm, then inattention to one’s own moral standards (during the actual discussion) and categorization malleability (the range in which dishonesty can occur without triggering self-assessment and self-examination) create the effect that “people can cheat, but their behaviors, which they would usually consider dishonest do not bear negatively on their self-concept (they are not forced to update their self-concept)”. The research indicates that it is the small group communication that causes the shift towards dishonesty that enables group members to coordinate on dishonest actions and change their beliefs about honest behavior”. The group members “establish a new norm regarding (dis)honest behavior”. Appeals to ethics standards seem to be effective in the short term [Mazar et al] but there is little evidence for long term effectiveness.

The Risky Shift

Research into risky or cautious shifts during group discussion looks at whether and when a group decision shifts to be riskier or more cautious than the decision that the individuals would have made on their own. One element driving the shift appears to be who bears the consequences of the decision – the group members, people the group members know (colleagues, friends, family), or people the group members do not know. There is evidence that individuals tend to be myopically risk averse when making decisions for themselves. Research indicates however that “risk preferences are attenuated when making decisions for other people: risk-averse participants take more risk for others whereas risk seeking participants take less.” Whether the group shows a risky shift or a cautious shift depends on the culture from which the group is drawn and the size of the shift seems to depend on the degree of empathy the group feels for those who will bear the consequences and risks of the decision.

Research into leadership shows that “responsibility aversion” is driven by a desire for more “certainty about what constitutes the best choice when others’ welfare is affected”, that individuals “who are less responsibility averse have higher questionnaire-based and real-life leadership scores” and do not seek more certainty when making decisions that are risky for others than they seek when making decisions that are risky for themselves alone. However, this research says nothing about the starting risk-seeking or risk-avoiding preference of the decision making leader.

See the full paper (link above) for further discussion, including the footnotes (which have been removed from the excerpt above).

How can we credibly wargame cyber at an unclassified level?

253020.jpeg

The frighteningly-efficient Stephen Downes-Martin has been kind enough to pass on a game lab report from the recent Connections US 2018 wargaming conference on “How can we credibly wargame cyber at an unclassified level?”  (pdf).

A small minority of cyber experts with wargaming and research experience have security clearances. If cyber operations are researched and gamed only at high levels of classification, then we limit our use of the intellectual capital of the United States and Allies and put at risk our ability to gain edge over our adversaries. We must find ways to wargame cyber[1]at the unclassified level while dealing with information security dangers to best use the skills within academia, business and the gaming community. During the Connections US Wargaming Conference 2018 a small group of interested people gathered for about an hour to discuss the question:

“How can we credibly wargame cyber at an unclassified level?”

The group concluded that it is possible to wargame cyber credibly and usefully at the unclassified level and proposed eight methods for doing so. The group also suggested it is first necessary to demonstrate and socialize this idea by gaming the trade-offs between the classification level and the value gained from wargaming cyber.

[1]“Wargaming cyber” and “gaming cyber” are loose terms which group deliberately left as such to encourage divergent thinking and to avoid becoming too specific.

Experimenting with DIRE STRAITS

As PAXsims readers will know, the recent Connections UK professional wargaming conference featured a large political/military crisis game exploring crisis stability in East and Southeast China: DIRE STRAITS. This is the second time we have held a megagame at Connections UK, and—judging from last year’s survey—they are popular with participants. This year we organized something that addressed a series of near future  (2020) challenges, said against the backdrop of uncertainties in Trump Administration foreign policy and the growing strategic power of China.

Pulp-O-Mizer_Cover_Image.jpg

We also conducted an experiment.

Specifically, we decided to use the game to explore the extent to which different analytical teams would reach similar, or different, conclusions about the methodology and substantive findings of the game. If their findings converged, that would provide some evidence that wargaming can generate solid analytical insights. If their findings diverged a great deal, however, that would suggest that wargaming suffers from a possible “eye of the beholder” problem, whereby the interpretation of game findings might be heavily influenced by the subjective views and idiosyncratic characteristics of the analytical team—whether that be training/background/expertise, preexisting views,  or the particular mix of people and personalities involved. The latter finding could have quite important implications, in that game results might have as much to do with who was assessing them and how, as with the actual outcome of the game.

To do this, we formed three analytical teams: TEAM UK (composed of one British defence analyst and one serving RAF officer), TEAM EURO (composed of analysts from the UK, Finland, Sweden, and the Netherlands), and TEAM USA (composed of three very experienced American wargamers/analysts). Each team were free to move around and act as observers during the games, and had full access to game materials, briefings, player actions and assessments, and could review the record of game events produced during DIRE STRAITS by our media team.

We were well aware at the outset that DIRE STRAITS would be an imperfect analytical game. It was, after all, required to address multiple objectives: to accommodate one hundred or so people, most of whom would not be subject matter experts on the region; to be relatively simple; to be enjoyable; and to make do with the time and physical space assigned to us by the conference organizers. It was also designed on a budget of, well, nothing—the time and materials were all contributed by Jim Wallman and myself. From an experimental perspective, however, the potential shortcomings in the game were actually assets for the experiment, since they represented a number of potential methodological and substantive issues which the analytical teams might focus on. To make it clearer what their major take aways were, we asked each team to provide a list of their top five observations in each or two categories (game methodology, and substantive game findings).

And the results are now in:

All three teams did a very good job, and there is a great deal of insight and useful game design feedback contained within the reports. But what do they suggest about our experimental question? I have a lot more analysis of the findings to undertake, but here is a very quick, initial snapshot.

First, below is a summary of each team’s five main conclusions regarding game methodology. I have coded the results in dark green if there is full agreement across all three teams, light green for substantial agreement, yellow for some agreement, and red for little/no agreement. The latter does not mean that the teams necessarily would disagree on a point, only that it did not appear in the key take-aways of each. I have also summarized each conclusion into a single sentence—in the report, each is a full paragraph or more.

DS method table

A Venn diagram gives a graphic sense of the degree of overlap in the team methodological assessments.

DS method.png

One interesting point of divergence was the teams’ assessment of the White House subgame. TEAM USA had a number of very serious concerns about it. TEAM EURO, on the other hand—while noting the risks of embedding untested subgames in a larger game dynamic—nevertheless concluded that they “found this modelling fairly accurate.” TEAM UK had a somewhat intermediate position: while arguing that the White House subgame should have have been more careful in its depiction of current US political dynamics to avoid the impression of bias, this “obscured the fact that there were actually quite subtle mechanisms in the White House game, and that the results were the effects of political in-fighting and indeed, it could even show the need to “drain the swamp” to get a functional White House.” The various points made by the teams on this issue, and the subtle but important differences between them, will be the subject of a future PAXsims post.

Next, let us compare the three teams’ assessment of the substantive findings of the game. TEAM USA argued that the methodological problems with the game were such that no conclusions could be drawn. TEAM EURO felt that the actions of some teams were unrealistic (largely due to a lack of subject matter expertise and cultural/historical familiarity), but that overall “the overall course of action seemed to stay within reasonable bounds of what can be expected in the multitude of conflicts in the area.” TEAM UK was careful to distinguish between game outcomes that appeared to be intrinsic to the game design, and those that emerged from player interaction and emergent gameplay, and were able to identify several key outcomes among the latter.

DS substantive table.png

As both the table above and the diagram below indicate, there was much greater divergence here (much of it hinging on assessments of game methodology, player behaviour, or plausibility).

DS substance

Again, I want to caution that this is a very quick take on some very rich data and analysis, and I might modify some of my initial impressions upon a deeper dive. However, I do think there is enough here to both underscore the potential value of crisis gaming as an analytical tool, and to sound some fairly loud warning bells about potential interpretive divergence in post-game analysis. At the very least, it suggests the value of using mixed methods to analyze game outcomes, and/or—better yet—a sort of analytical red teaming. If different groups of analysts are asked to draw separate conclusions, and those findings are then compared, convergence can be used as a rough proxy for higher confidence interpretations, while areas of divergence can then be examined in great detail. I am inclined to think, moreover, that producing separate analyses then bringing those together is likely to be more useful than simply combining the groups into a larger analytical team at the outset, since it somewhat reduces the risk that findings are driven by a dominant personality or senior official.

One final point: DIRE STRAITS assigned no fewer than nine analysts to pick apart its methodology, assess the findings in light of those strengths and weaknesses, and we have now published that feedback. Such explicit self-criticism is almost unheard of in think-tank POL/MIL gaming, and far too rare in most professional military wargaming too. Hopefully the willingness of Connections UK to do this will encourage others to as well!

Teaching wargame design at CGSC

us-army-command-and-general-staff-college-office.jpg

Today, James Sterrett made a presentation to the Military Operations Research Society’s wargame community of practice on teaching wargame design at the US Army Command and General Staff College. James is Chief of Simulations and Education in the Directorate of Simulation Education at CGSC, and a periodic PAXsims contributor.

This lecture will feature a discussion of game design within the context of professional military education.  DEPSECDEF Work talked to the need to incorporate wargaming into the formal military education system.  One approach to executing this issue is to offer a course in wargame design to students at multiple levels of professional development.  However, questions on how to implement this approach remain:  At what point(s) within an officer’s career should they be exposed to wargaming?  What aspect of wargaming should be emphasized?  What level of proficiency is desired?  What portions, if any, of the remaining curriculum should be dropped or modified to accommodate this requirement?

While the lecture wasn’t recorded, you’ll find his slides here. For previous discussion on this same topic, see his earlier (January 2017) blogpost.

Dungeons & Dragons as professional development

ADD_Dungeon_Masters_Guide_Old_p1.jpg

In response to one of the final exam questions this year, a student in my upper-level undergraduate course on multilateral peace operations at McGill University commented “I never knew D&D could be so useful until I took POLI 450.” That statement finally provided the impetus I needed to offer some thoughts on role-play games (RPGs) and serious conflict simulation.

In the context of POLI 450, the student concerned was referring to the massive Brynania peacebuilding simulation that we’ve been running for almost two decades. It is a grueling exercise indeed: 125+ players, 5-8 hours of game play per day for a full week, 10,000+ emails sent, and hundreds of hours of real and virtual meetings—all at a time when students are also trying to manage four other courses, plus occasional eating and sleeping. The simulation is designed to highlight a range of issues: political conflict and conflict resolution; insurgency; negotiations; humanitarian crisis and response; the challenges of coordination; stabilization; and longer-term development. Like a good game of D&D, participants face complex situations and even difficult moral choices while having to adjust plans on the fly with limited time, resources, and information. As has been evident from exam answers and course surveys over the years, students learn a lot from it, and it helps a great deal in putting course readings and theory into a practical, operational context.

However, I didn’t want to just comment on the value of RPG-type gaming as an immersive learning environment for students—as important as that is. Above and beyond this, I wanted to offer some thoughts of how role-play gaming can help to develop essential professional game design and facilitation skills. Indeed, in terms of professional wargame facilitation specifically, I would argue that running D&D games is probably a more useful preparation than playing either miniature or board wargames.

Before there’s a backlash from my fellow grognards, let me reiterate I’m talking here about game facilitation. I’m a hobby miniatures/board wargamer too, and I enjoy those a great deal. They’ve been invaluable in learning about military operations and history—indeed, far more useful than the 8+ years I spent studying in university. It is undeniable that hobby wargaming can contribute a great deal to one’s knowledge of how to model time, space, movement, and effects.

However, no one would argue that most hobby wargaming (with the notable exception of megagaming) really contributes a great deal to knowing how to run—as opposed to design—the multi-participant events that are usually characteristic of a serious professional wargame or political-military/crisis simulations.

There’s a certain irony in all this. As it is, professional wargamers already deal with a widespread bias against the gaming element of wargames. It is well-known, for example, that many military officers recoil at the thought of dice or cards determining the outcome of military actions in a wargame, even though they are perfectly happy to have outcomes determined through black-boxed stochastic processes embedded in computer algorithms. That Clausewitz once noted ” the absolute, the mathematical as it is called, nowhere finds any sure basis in the calculations in the art of war; and that from the outset there is a play of possibilities, probabilities, good and bad luck, which spreads about with all the coarse and fine threads of its web, and makes war of all branches of human activity the most like a game of cards” doesn’t change the fact that professional audiences often equate cards, dice, and other common game elements with a glorified version of Snakes-and-Ladders. Given that, suggesting that what they are doing is actually rather more like The Tomb of Horrors would certainly be a gaming system too far. Yet RPGs can develop invaluable skills in terms of scenario design, narrative engagement during game play, subtly keeping players on track for game purposes, and managing groups of people within such a context.

In terms of scenario design, this is very much at the core of role-play gaming—the game, after all, is almost entirely about the scenario and the players’ engagement in it. Good gamemasters are good precisely because they are able to keep players within the universe they have created, facing plausible choices with plausible consequences, and subtly encouraging everyone to internalize appropriate perspectives and motivations. In a well-run campaign the players aren’t simply trying to find treasure and slay beasts, but feel themselves part of it all. They begin to filter their worldview through their (fictional) professional specializations: fighters like to fight; magic-users like to stand back and rain destruction of foes while avoiding injury; clerics provide key support; rogues skulk and deceive; and much-maligned bards (like diplomats everywhere) use silver tongues to gain advantages that cannot be obtained by brute force. As Peter Perla and ED McGrady have argued, this sort of player engagement and immersion is also what makes (serious, professional, potentially life-and-death) wargaming work:

We believe that wargaming’s power and success (as well as its danger) derive from its ability to enable individual participants to transform themselves by making them more open to internalizing their experiences in a game—for good or ill. The particulars of individual wargames are important to their relative success, yet there is an undercurrent of something less tangible than facts or models that affects fundamentally the ability of a wargame to transform its participants.

A dungeonmaster also faces the constant challenge of allowing players to explore their universe, while at the same time keeping the game on-track in terms of general storyline and plot—all without letting players feel railroaded into doing (or not doing) particular things. They do so, moreover in a context of multiple participants with different perspectives and personalities. Take, for example, Phil Sabin‘s comments on a recent professional wargame in the UK (emphasis added):

This week at the UK Defence Academy we ran a two day research wargame with a couple of dozen players and facilitators to investigate nuclear risk dynamics.  I was on the Control team, and our main objective was to get the players first to use conventional force and then to escalate to nuclear strikes, despite their natural reluctance to initiate such dangerous and suicidal actions.  We succeeded, and play ended with wide-ranging conventional conflict, the nuclear devastation of central and eastern Europe, and a grave threat of further escalation, all from an initial spark in the Baltics in which both sides felt they were defending their existing rights and interests.

I remarked in the final plenary that wargame controllers in such games are rather like devils, seeking ways to foster player misperceptions and frustration and to present them with horrible dilemmas in a quest to make them trigger a literal ‘hell on earth’.  We succeeded in this aim, and it was sobering for everyone to realise how such a slide into disaster can occur through a horribly plausible sequence of interacting decisions, despite the initial resolve of each team individually to avoid such an outcome.  At least we can comfort ourselves that nobody really died, and that the whole point of such ‘virtual’ destruction in wargames is to help us to understand crisis dynamics and so make such escalation in the real world even more unlikely….

Replace “nuclear strikes” with “boss fight” or “confronting the dragon in his lair” and you pretty much have every D&D game ever. Phil may be more of a traditional grognard than a RPGer, but it is a gift indeed to be able to nudge participants in such a way that they don’t feel nudged, while giving them the freedom to make real choices.

Similarly, in the Brynania simulation, my task as CONTROL is to facilitate exploration of a plausible path of civil conflict and (hopefully) peacebuilding, while not allowing the game to get distracted or derailed. Doing so requires the subtle use of initial scenario and game injects, but in a way that players are—again—making real choices with real consequences. Certainly the outcomes over the years reveal a sort of bell-curve of results, with some more common than others, but none of them outliers in a way that would undercut the instructional purposes of the simulation.

Brynania outcomes 1

Brynania simulation outcomes and events.

Brynania outcomes 2.jpg

Primary peacebuilding mechanisms used in Brynania simulation.

I’m not the only RPGamer who feels this way. Tom Fisher is a fellow member of my local Montréal gaming group and DM extraordinaire, with an impressive record as a professional game designer and facilitator (he is codeveloper of AFTERSHOCK: A Humanitarian Crisis Game and the forthcoming Matrix Game Construction Kit, and has worked with the World Bank and various international financial intelligence agencies on games addressing financial crimes/corruption and strategic analysis). He had this to say on the topic in a recent email exchange:

I can say, without hesitation, that roleplaying games—particularly D&D—have led to the best jobs I’ve ever had.

There is a natural flow between being a gamer and professionally developing games, that much is obvious. What is less obvious, however, are the lessons derived from playing those games that do not directly impact game development. Role playing games, particularly the gamesmastering (facilitation) thereof engages, develops and encourages a particular way of thinking.

Much has been said about the need for outside the box thinking or lateral thinking. What is less discussed is how to train the mind to think different as some marketing campaigns encourage. Roleplaying games, in their various forms, are a virtual goldmine for the development, testing and experimentation of thought, and ways of thinking.

Roleplay, at its best, teaches through gameplay to account for assumptions, test limits of rules, push the limits of established rules – in short, roleplay is a short course on iterative design: “ design methodology based on a cyclic process of prototyping, testing, analyzing, and refining a product or process. Based on the results of testing the most recent iteration of a design, changes and refinements are made. This process is intended to ultimately improve the quality and functionality of a design. In iterative design, interaction with the designed system is used as a form of research for informing and evolving a project, as successive versions, or iterations of a design are implemented.”

Iterative design thinking is, in my view, the foundation of critical, outside-the-box, and lateral thinking. The process of iterative design faces-off actions based on assumptions against reactions based on real-world rules. Famously demonstrated by Tom Wujec’s Marshmallow Challenge, participants succeed by testing their assumptions against real-world effects (in that case, gravity and the relative strength of dry spaghetti).

The experiential and imaginary nature of roleplaying games requires reflection and forces a role-player to account for their assumptions when addressing a situation. In so many of my experiences delivering intelligence analysis or crime analysis courses, it is the recognition and testing of one’s assumptions that has been the lynchpin in achieving success in the training. Roleplaying games –and by extension immersive simulation exercises– are a crucible for developing the thought processes deemed so necessary and desired by modern institutions.

The experience of the gamesmaster, or facilitator, of roleplaying games adds a further level of complexity to the mix. Adult role-players, by their very nature, are an interesting bunch. Most tend to be well-read, quite intelligent, and universally challenging. As noted above, roleplay encourages the testing of limits, pushing of envelopes, and accounting for assumptions. So, a gamesmaster (GM) is confronted with a number of players –with their unique agendas– who inherently want to push the limits of the GM’s world-rules to achieve goals laid out by said GM designed to engage, thrill and enthrall each of the players. In short: herding cats. There is no more cost-effective short-course on diplomacy and small-team management than being a roleplaying game GM.

The complexity of gamesmastering (GMing) increases exponentially as GMs become involved in world-building. At the pinnacle of GMing is the world-building GM, who shapes world from thought to engage players in a truly immersive experience. Herein, the GM accounts for the cause-and-effect of player actions against the backdrop of an entire living world simulation. At this level, fluidity and iterative design are paramount to successful implementation and player-engagement, and will lead to a level of suspension of disbelief that will engage players not only logically in the gameplay, but emotionally, on a truly immersive level.

It is these skills of engagement, coupled with the role-player’s way of thinking, challenging and testing that have led to the best jobs I’ve ever had.

Much can be said about the nature of play and the strong links between creative play and language, physical, social/emotional, and cognitive development. Roleplaying games take this level of play to its limits, and push outward, not only encouraging growth, but in my opinion, forcing it, as new pathways of thought develop to deal with novel situations.

The elusive and mysterious “Tim Price,” prolific author of matrix game articles and scenarios, has certainly been known to frequently design and play RPGs. A certain former British military officer and gifted professional wargame consultant—let’s call him GLB—actually carries an image of the Advanced Dungeons & Dragons Dungeon Master’s Guide (above) surreptitiously taped to his clipboard to inspire him while facilitating serious games.

As for me, I’ve been playing D&D since the very first boxed three-volume set in the mid 1970s. Like the POLI 450 student quoted above, it’s fair to say that at the outset I too “never knew D&D could be so useful.”

TH25c.png


Have your own experiences of using RPG skills in serious gaming? Post them in the comments section!

What is a megagame?

John Mizon has put together a very useful video on “what is a megagame?,” in which he explores the player interaction, immersion, and emergent gameplay that characterize the genre. It even features a few seconds from our own recent War in Binni game!

You’ll find more of John’s megagame videos here. A great deal of insight into designing and running a megagame can also be found at Jim Wallman’s No Game Survives blog.

Discussion welcome: (war)gaming the US as ally and adversary

eagle

I’ll be giving some thought over the next week to “(war)gaming the US as ally and adversary,” for a piece I hope to write soon. I have always been interested in how we model actors with murky or complex decision-making processes, as well as actors who may at times appear irrational (North Korea for example, or Qaddafi’s Libya). How much of this is simply different worldviews and interests, and how much of it is truly non-rational? How can pol-mil wargames best generate policy responses that reflect ideology, confirmation bias, pride, narcissism, bureaucratic infighting, and other non-realist determinants of strategic or operational behaviour?

In particular, in the coming months and years those of us outside the US who do national security gaming may need to consider:

  • How best to model unpredictable US behaviour (say, wavering alliance commitments) or behaviours that veer between supportive and threatening.
  • How best to model the US as a partial adversary or threat to national interests (for example, on trade policy, or liberal democracy).
enet9tmt71_tvhsae-1.png

No this isn’t a real tweet.

Any ideas are welcome in the comments section.

Wikistrat: Turkey’s Intervention in the Syrian Civil War

In April 2016 Wikistrat completed two role-playing simulations that explored the dynamics of Turkish intervention in the Syrian civil war:

140 analysts from Wikistrat’s global community of 2,200 recently wargamed a scenario in which Turkey invades northern Syria to establish a buffer zone in the country’s Kurdish region.

The analysts were divided across two mirrored groups (Alpha and Bravo) which had seven teams of ten analysts each, playing Russia, Assad loyalists in Syria, Turkey, the Kurds, ISIS, anti-Damascus and Western-backed rebels, as well as Iran and its proxies.

The two groups progressed simultaneously from the same starting scenario. But the divergent courses they took revealed key insights into some of the main actors and dynamics in the Syrian Civil War.

Key Findings

  • In the event of a Turkish intervention in Syria, providing Turkish forces stayed within a ten-kilometer buffer zone and avoided direct confrontation with Russia, they would likely not face significant pressure to withdraw — and could even gain international support if they were able to stabilize the border and slow the flow of refugees to Europe.
  • Assad has an interest in encouraging Russian and Kurdish coordination in Kurdish-held areas in order to free resources to fight anti-Assad rebels in the north.
  • Anti-Assad rebels are likely to suffer greatly in the face of escalating tensions, as their backers (e.g., the U.S. and Turkey) will be hesitant to increase the risk of hostilities with Russia by providing them with significant support.
  • The potential for NATO involvement in Syria will likely constrain Turkish, U.S. and European actors far more than Russia.
  • If Russia manages to keep its focus on ISIS while checking Turkey, it could gain significant international public opinion support which could be leveraged on behalf of Assad.
  • ISIS aggression was a major determinant regarding the direction and intensity of both games. However, ISIS aggression was more likely to result in sustained victory if the focus was on insurgent warfare in Syria (e.g., an attack on Russian forces within Syria) rather than terrorist attacks abroad (e.g., an attack against Russia itself).

The findings are interesting to compare with actual developments since the analysis was undertaken, notably the launching of Operation Euphrates Shield in August against ISIS and even more so the PYD/YPG (Syrian Kurds, and their allies in the Syrian Democratic Forces), and recent Russian-Turkish-Iranian cooperation on a ceasefire and proposed Syrian peace negotiations.

You’ll find the full report at the Wikistrat website. For more on their role-play methodologies, see here.

h/t Shay Hershkovitz

Reflections on the wargame spectrum

Colin Marston (Dstl) passed on to me some slides (public domain identifier PUB098428) presented at the recent MORS wargaming special meeting which address the range of wargaming approaches and methodology. Given the growing interest in wargaming—what it is, what it can do, and how it might do it—I thought they would be of interest to PAXsim readers. I’ve also inserted a few thoughts of my own.

You’ll find the full set of slides here here (ppt) and here (pdf).

20161018_MORS UK Allies panel briefing v1.0 (PUB098428)_O_PAXsims.jpg

The first set of slide suggests that wargames can be differentiated by the level of analysis (strategic vs operational, vs tactical), by the nature of the problem (bounded and clear, or wicked and messy), and by the type of adjudication used (open/free versus rigid and rules-based). I would have probably listed the adjudication issue last, because the choice of appropriate methodology can really only be made once you are clear on what sorts of question(s) you are trying to answer.

The slides don’t say much about purpose. Elsewhere, Graham Longley-Brown does so, noting the divide between analytical and training/education games:

Areas-of-Wargame-Use-v1.6.png

While that differentiation is useful because it points to important differences in purpose and hence design, I’ll admit that I’ve been increasingly interested in the extent to which we might be able to develop hybrid games—that is, wargames that serve an education/training function, but in which participants are also generating data that is of analytical value too. My own Brynania civil war/peacebuilding game at McGill, for example, is designed for educational purposes but has now been used to generate data for two PhD theses (one on terrorist violence, the other on educational gaming). While there’s a risk of compromising analytical rigour or educational effectiveness in doing this, it could also provide a useful way of stretching limited resources.

The Dstl presentation goes on to discuss which game approaches are often of value in which contexts:

20161018_MORS UK Allies panel briefing v1.0 (PUB098428)_O_PAXsims3.jpg

Here they comment:

On this slide the top blue line represents the different levels within the problem space.  The red, middle line represents types of adjudication.  The bottom green line indicates the different levels of complexity.  On top of these axes we have the types of wargames that we employ in Dstl and across the MOD.  Please note that these techniques are not limited to their positions on the axes.  We find that the techniques on the left of the spectrum generally provide more opportunity for original thought and creativity (imagination). In addition, methods at this end of the spectrum generally provide an opportunity for doing lots of Courses of Action with little depth – so essentially short games that might last a couple of hours to a day.  The methods on the right can provide increasing depth, but are often slower to set up and run. These methods generally employ more rigorous and precise techniques – although that does not necessarily mean that they give more accurate outputs.  All of these approaches have their merits, some being better at trying to answer certain questions than others. So, when appropriate, we try to use a combination of different approaches.

They also identify some “essential elements” of a wargame:

20161018_MORS UK Allies panel briefing v1.0 (PUB098428)_O_PAXsims4.jpg

Now, the type of game that we use is just one part of the process. This slide highlights the other factors that we need to consider. There’s no fixed order in the way we tackle these – it’s an iterative process and depends on the question.

The wargame is not the simulation. The simulation is but a subset of a wargame.

Effective communication and transparency are crucial throughout the whole of the wargaming process and it is crucial that everyone – from the players to the customers – are involved at the relevant stages.

20161018_MORS UK Allies panel briefing v1.0 (PUB098428)_O_PAXsims5.jpg

The optimal approach to providing decision-support is often to fuse the information pertaining from both human-in-the-loop and non-human-in-the-loop techniques.

There are many different types of wargames and careful consideration should be given as to which type, or types, of game are most appropriate for a particular problem.  Also wargaming should often NOT be used in isolation but as part of a broader analytical tool and / or iterative process that incorporates a range of different techniques.

Feel free to add your own thoughts in the comments section.

MORS wargaming AAR

Logo

On 17-20 October 2016 the Military Operations Research Society held a special meeting on wargaming. PAXsims’ very own Tom Mouat was there both to help facilitate the event and to bring us the report below.

Additional details from regular PAXsims reader Paul Vebber follow after Tom’s report.


PHOTO_20161020_151708.jpg

I was privileged to be invited, along with colleagues from the UK Defence Science and Technology Laboratory (Dstl), to the MORS Wargaming Special Meeting on 17 to 21 October 2016 in Alexandria, VA. Rex couldn’t make it, so again I was deputised to provide PAXSims readers with a report.

It was clear in the lead-up to the event that this was to be a more in-depth look at a few things, rather than the usual conference offering of a shallow look at a large number of things. This was unusual and I’m not entirely sure that it provided the best fit for the stated aims for the workshop:

  • How best incorporate rigorous and well-designed wargaming into the department’s larger analytical and acquisition focus.
  • As the demand for wargaming continues to grow we need to increase the pool of wargamers and wargame designers to meet those needs now and into the future.

If you were a beginner, unsure as to the role and range of wargame tools and techniques, you might have got lucky in choosing the workshop sessions that met your requirements; but if you weren’t it is perfectly possible you would get stuck in a session unsuitable for your needs. This wasn’t helped by the descriptions issued prior to the event being a little less than clear and a number of session being classified and NOFORN (no foreigners). This was exacerbated when there were a number of last minute changes to programme aims, the sessions and their classification.

I had originally intended to look at a number of the sessions and provide assistance to the “Project Cassandra, Envisioning Possible Futures” session. However one of the wargaming sessions (when I say “sessions” it was actually four half-day sessions spread over three days) had the organisation running it (US Army Training and Doctrine Command/TRADOC pull out. I was invited to stand in and run the session on matrix gaming instead—which I was delighted to do.

Travel and subsistence budgets being what they are, the cheapest flights from the UK are on a Saturday, giving us the bonus of recovering from jetlag as well as the opportunity to do some additional professional development in visiting the battlefield of Gettysburg. This is a quite outstanding battlefield, well preserved and with an excellent visitor centre. There are a large number of different lessons that can be gained from looking at details of the large battle, over the two days of the fighting. The Dstl staff, led by their own historian, took advantage of this. Sadly I was unable to participate as I was doing last minute preparation for the sessions.

The hotel recommended for the event was excellent and ideally placed for the subsequent events which were held in the hotel and at the nearby Institute for Defence Analysis (IDA).

Monday, 17 October 2016

The first day included a course, “Wargaming Introduction and Theory,” run by Dr Peter Perla and Dr Ed McGrady, which lasted all day. In addition, a shorter course, “Executive Overview of Military Wargaming,”  was run by Mike Garrambone. I attended the first of these because the UK Defence Academy is intending to run its own “Introduction to Wargaming” course, and watching how two of the foremost experts in the field do it was likely to be extremely educational.

Peter Perla started and covered wargaming history, from the earliest games and models used for training and education, through to the birth of modern wargaming. This included Kriegsspiel, Johann Hellwig’s wargame, the introduction of geomorphic maps, real topographic mapping and the use of experienced umpires in order to reduce complexity and include military common sense. He also covered the rise of the hobby game, sparked off by H G Wells’ Little Wars; the crossover from RAND’s use of hexagons to regularise movement; and the game company Avalon Hill and its success in publishing games for the hobby market.

Cu-VSBhWIAACEQP.jpg large.jpg

Peter Perla reviews the evolution of wargaming.

The course went on to cover the rise of wargaming as a fundamental part of the analytical process in the inter-war years, particularly in the US Navy War College. This is probably one of the most innovative periods of concept and doctrine development which helped shape the conflict to come, not just in the USA but also among the German General Staff.

I noted that from this period that there were two observations that emerged from these wargames:

  • Some people are dicks.
  • Innovation takes time.

Some of the participants in the wargaming process are unable to see the value of exploring a situation or problem through a game, fail to take it seriously and behave inappropriately. This is not helpful, but wargame facilitators need to be aware of this, and develop mitigating strategies to deal with it or valuable opportunities will be lost. (I would also offer that this phenomenon is not limited to manual wargaming – computer simulation is also afflicted with personnel who seem unable to grasp what the process is trying to achieve and are negative or disruptive, however well run the game.)

Innovation is not a simple process with a short timescale. It takes time to breed the open minded and intelligent organisational culture where ideas are valued from wherever they arise and where change is embraced. It is only from this basis that sustained advances can be generated and genuine advantage realised.

We then moved on to Dr Ed McGrady who covered the theory of games, how they work, what approaches work best and the human response to games. He started with a warning that, while efforts are improving, there is still no proper epistemology of wargaming and no coherent theoretical treatment—especially of manual games although there is a reasonable amount of work dealing with computer games.

Diversity in this area is a challenge and there is no simple one definition to cover all wargames.

He went on to cover the elements that make up a game, wargames vs peace games, what is not a wargame and some of the foundations of the concept of “play.” In many professional and analytical games the designers seem to want to eliminate the “play” aspects of the wargame. This is wrong, fails to get buy-in to the process, followed by a lack of understanding of the problem space and ultimately results in a bad game.He covered the elements of play, the role of making them enjoyable in a defence analytical context, their internal structure and most importantly the psychological and neurological concept of narrative (leading to engagement, and the “entre deux”, the in-between space where disbelief is suspended and insights are gained).

This included the significant observation: Lunch is important! If you are going to the time and effort in order to involve the participants in a game, where future possibilities are envisaged, disbelief suspended, and the players fully engaged, it is foolhardy to jeopardise the event by refusing to provide lunch—forcing participants to disperse, lose the game immersion and focus, and ultimately much of the value of the process.

PHOTO_20161017_130254-picsay.jpg

Some of my notes from “Wargaming: Theory and Introduction.”

I have made many pages of notes, including the dramaturgical aspects of games, the concept of “flow”, games vs simulations, hard vs soft assumptions, the big questions about the effect games have, sociological work, and theoretical principles. Indeed, it was all much too much to be able to present a coherent commentary here without significant additional thought and the risk of boring you!

Which brings me to a concern. This was not really an introduction to wargaming. Instead, it was a masterclass in the theoretical underpinnings of the art, that included some really deep stuff. I found the day incredibly useful (and I am anxiously awaiting copies of the slides because I’m afraid that my hurried notes may well have missed something), but I am also a wargaming practitioner of many years, including running and designing games used by defence as well as the wider community. I suspect that a novice, seeking an initial understanding, might well become lost and confused…

…until they decided to demonstrate what they meant, by the use of the matrix game “Lasgah Pol” dealing with peacekeeping operations in Afghanistan (available as part of Matrix Games for Modern Wargaming). Since I designed the game , and was asked to demonstrate an example move, they are obviously geniuses!.

130803-LasgahPol.png

Tuesday, 18 October 2016

This was the start of the special event proper, and followed the more usual format of a plenary keynote and panel sessions until shortly after lunch.

Following introductions and the US national anthem, we started with a keynote from Andrew Marshall, former advisor to the Secretary of Defence for Net Assessment. At first glance it looked like the organisers were rolling out someone from an earlier era, but he quickly contradicted that impression, demonstrating sharp and timely insight. He gave a brief history of the Office of Net Assessment and pointed out that reading long papers on a subject can take time and are likely to only explore the subject from a single point of view. Games, in contrast, were very quick at distilling issues to their essential fundamentals, but he also underlined the importance of a proper opposition (the Red players).

An example he gave was dealing with the Strategic Bomber programme. This was during the Cold War—strategic bombers were expensive compared to ballistic missiles, and there were calls to make cuts in the bomber fleet. Looking at the problems through a series of wargames demonstrated that the bomber fleet forced the enemy to invest in large quantities of air defence weapons. Since the enemy was resource limited, this was advantageous to the US. On the other hand, cutting the bomber fleet would permit an enemy to switch in investment from weapon systems that were essentially of limited use, to areas that would present more of a threat. This lead to the conclusion that when thinking about a subject it is often essential to look widely at the problem to ensure a holistic solution

Marshall also pointed out, from his vast experience, that if you want innovation you should select the best players and if you want good games you should use the best facilitators. Choose the best for the most important problems.

This was followed by the Defense Wargaming Alignment Group (DWAG) Quad Chair panel. This covered the initiative resulting from DEPSECDEF Robert Work’s February 2015 memo to institute a repository for wargames and their reports. It currently includes some 550 high level games on a wide range of topics, as well as including funding for additional games and wargaming projects (including funding the US DOD and foreign government attendance at the MORS event). They issue a monthly report including a listing of upcoming games, highlighting previous games that are in the depository, the usual statistics about the depository, and other areas about DOD wargaming.

I was initially very cynical about the value of such a depository, but it appears to have access at the highest levels and is being managed effectively. I was particularly impressed by the definite focus on innovation, increasing the decision space for the leadership, and the particular emphasis on “so what?”—that is, proper explanation of the value of the work done and links to real change. Of course, the repository is a US-only classified capability, but it certainly sounds useful. I’m now jealous!

The panel also covered the intriguing idea of using wargames to educate members of Congress. This was, of course, difficult, and would probably have to focus on their direct staff, but it still looks like a really good idea. They also mentioned the lack of value gained from games that generated obvious conclusions: “Don’t tell me we have a lack of a particular resource —we already know that. Tell me what you did to compensate for it and did it work!” which is, of course, intrinsically more useful.

The Services Panel followed, with a number of useful observations:

  • An understanding that putting on more, smaller sized, games helps frame specific problems.
  • Wargames and quantitative analysis are not enemies – they are complimentary, depending on each other.
  • There needs to be robust cost modelling in games – stop inventing stuff with ridiculously cheap costs.
  • Wargames help frame a problem properly for greater understanding (a recurring theme across the ages).
  • Wargaming as a discipline encourages plagiarism – get the best ideas to work for you from anywhere.

I was interested to see the Department of Homeland Security present, happy to learn from the mistakes of others and present with a sense of humour. They hope to avoid the OODA loop problem where it ends up as “Observe, Overreact, Destroy, Apologize,” instead of what it is meant to be.

The Combatant Commands were next and I was impressed at the real efforts to reinvigorate wargaming after decades of decline. It was acknowledged that the efforts were a little patchy in places, but equally there seemed to be a real appreciation of the value to be gained.

This was followed by the Allies panel, with contributions from the UK, Holland, Sweden and Canada. These showed that wargaming efforts were in place in each nation, even if at a vastly different level of effort to the USA. The UK chose to highlight the essential work of Dstl and the Connections UK conference, and Canada mentioned publishing a wargaming doctrine publication, something the UK are also working on.

Lastly we had a panel on Red Teaming from specialists in that discipline. They were initially surprised to be invited and explained the aim of Red Teaming is to get “better decisions and better plans”, through knowing oneself, mitigating group think, fostering empathy and through applied critical thinking.

Working Groups, Courses and Wargames

At this point we broke up into smaller groups to spend the rest of Tuesday, all day Wednesday and Thursday morning in our respective session. Because of this I lost sight of what else was going on, although Paul Vebber provides some additional insight at the end of this report.

The sessions were:

  • Working Group 1: Analytic Process with Paul Davis and Matt Caffrey. Classified. NOFORN.
  • Working Group 2: Communication and Implementation, with Paul Vebber.
  • Working Group 3: Adjudication, with Tim Wilkie.
  • Course 2: Red Teaming, with Steven Rotkoff.
  • Course 3: Structured Analytic Techniques, with Joseph Cyrulik.
  • Wargame 1: Project Cassandra – Envisioning Possible Futures, with Yuna Wong.
  • Wargame 2: Phase Zero Baltic Operations with Scott Simpkins. Not Classified, but NOFORN.
  • Wargame 3. Matrix Gaming, with Tom Mouat.
  • Synthesis Group: This was an oversight group with Peter Perla looking for common themes and best practices.

 

Matrix Wargaming

Since I had 4 sessions of about 4 hours each, and one of the benefits of matrix gaming is that games are quick to design and play, we did a different game in each session.

PHOTO_20161017_181142-picsay.jpg

Matrix game materials ready for play.

We started the game with a presentation on matrix wargames looking at different approaches and the value of roleplay in predicting the outcome of conflict. This was followed with “Kazhdyy Gorod” a game about a city in a former Soviet state on the border with Russia.

The game started extremely well, with everything looking on track to being sorted out with the minimum of trouble or bloodshed. Well, that was until the Chief of Police acted against orders from the Mayor, who promptly assassinated her in a scene of the finest “Godfather” tradition in front of the rest of the city council. Chaos ensued (not least for the facilitator) but soon resolved itself with the Rebels kidnapping and murdering the Mayor, the Militia Commander sitting neatly on the fence and the Protest Leader ably supported by the power of international media (in the shape of the Press player) being elected the new Mayor of the city.

I was quite shocked and wondered if anyone was going to turn up for the following session after the adjudication difficulties, but with hindsight it was a good stress test of the system and showed the participants that the game can cope with wild play.

Wednesday, 19 September 2016

The following morning began with a short presentation on my guidance tips for facilitating Matrix Games, followed by the Cyber game “All Your Secrets Are Belong To Us“, a game about stealing the next generation stealth fighter plans.

This game went extremely well with very good participation all around and it was quite rewarding to see that the flow of the narrative was appreciated by the players. This meant the consequential requirement of detailed formal adjudication was much reduced, now that the players were more familiar with the game and gameplay.

That afternoon, after another short presentation, this time on some facilitator techniques that could be helpful for facilitators, we decided to design and run a complete matrix game on a subject chosen by the participants within the time available.

Baltic Challenge

The subject chosen was the current crisis in the Baltic States, especially as we had a Swedish and Dutch participant in the group. The game was entitled “Baltic Challenge” and the game design followed the following steps:

  • Define the game scope: modelling the current crisis in the Baltic States.
  • Define the “Actors” involved in the crisis and the order of play.
  • Define the Objectives for the Actors (simple bullet point objectives).
  • Design possible “triggers” as pre-conditions to possibly upset the current equilibrium.
  • Generate a suitable visualisation (map) for the area.
  • Allocate markers representing effects in the game (DIME/PMESII/FRIS).

We had a long discussion about who to represent as players (required to influence the game) as opposed to being mainly there to be influenced by others. In the end, we chose the following “Actors”:

  • Russian separatists in the Baltic States.
  • The Baltic State Governments as a single actor:
    • Estonia
    • Latvia
    • Lithuania
  • Poland as a separate actor.
  • The USA as a separate actor.
  • The Nordic States as a single actor:
    • Sweden
    • Finland
  • NATO

We generated the objectives for each party quickly and then commenced play. A number of possible “triggers” were also discussed:

  • Iskander deployment to Kaliningrad.
  • Russian troop movements on the border.
  • An economic report demonstrating ethnic disadvantages for Russian speakers in the Baltic States.
  • Airspace violations.
  • Soviet fleet manoeuvres in the Baltic.
  • Soviet ship breakdown on the way to Kaliningrad (assumed Iskander missiles and S-400 air defences on board).

The preferred option was a mix of an economic report indicating Russian speakers have a justified grievance and the Soviet resupply ship breaking down off Tallinn on the Estonian coast.

baltic-challenge-map-v2

A later version of the “Baltic Challenge” map.

The game worked very well, highlighting a large number of points to the participants that they were unaware of. The chief insights from the game were that the Baltic States may well try to “do the right thing” for the Russian speaking minority, but they were largely pawns in the game between Russia and the West. There were a number of treaties that affected the participants (the 1997 Founding Act, EU sanctions against Russia, and NATO relations with Sweden) that were important and needed to be understood. The fact that Poland has a right-wing government keen to demonstrate that it will not be bullied by Russia might not necessarily be a good thing as NATO depended on Poland to play a key role in the area and felt limited in the sort of pressure it could bring to bear.

It was also noted that the Inkander missiles, with a range of 500km, may violate the Intermediate-range Nuclear Force (INF) Treaty (missiles with a range of 500-5,500km) and there was speculation as to why the USA or NATO governments have not challenged Russia about them. The following morning, this was the subject of a Wall Street Journal article, neatly showing the game was on the right track highlighting this issue.

PHOTO_20161020_073957-picsay.jpg

Gaming the headlines!

We felt that the game would have benefitted (as would any game) from a specialist subject matter expert in the region to assist the facilitator with the briefings, objectives, consequence management, and adjudication but nevertheless we felt that three hours of work had demonstrated the value of the game and wider regional understanding.

The game is now available via a link at PAXsims.

Thursday, 20 September 2016

On the final day, we elected to have a game run by the participants as, given the level of experience they had achieved with the game process and mechanics, they should be able to run and facilitate their own game. The game chosen was “ISIS Crisis“, with updated briefing and dispositions to reflect the current situation.

R0010168.JPG

Playing ISIS Crisis.

The pre-game discussion indicated a strong feeling that if the game was to be wider than just Iraq, it needed the involvement of Turkish and Russian actors, even at risk of slowing down play, so these roles were included.

The game ran well, even if the most up to date developments were not reflected in the initial set up. The inclusion of Russian and Turkish actors, did change the balance of the game and showed just how far things had changed in the years since the game was designed. It was felt that it would benefit from updated quality briefings for these actors to match the other briefings.

Closing Plenary Sessions

Finally, there was a closing session in which back brief were given on the different workshops, courses and wargames as well as a keynote by DEPSECDEF Robert Work.

The Deputy Secretary of Defence commenced his remarks with the inevitable senior officer’s joke and seemed, at least initially, to be a straightforward explanation of what he was trying to achieve. After a few minutes though, when he had warmed to his subject, the presentation was transformed into an inspiring call to arms that was quite different to the usual rhetoric. Having your DEPSECDEF being quite so disarmingly clear that he wakes up every day thinking of ways that he can mess up the plans of potential adversaries was a breath of fresh air from someone who clearly knows his stuff. He gets my vote and I’m not even an American.

The final thing that stuck in my mind was the realisation that we are facing a new “inter-war period” with all the implications that this brings, and that we need to develop new ways and means to give decision makers strategic choices for the future.

I am looking forward to seeing the presentations being posted on the MORS website so that I can have an understanding of what went on in the other sessions.

Friday, 21 September 2016

The following day the UK delegation (Dstl and I) visited the Applied Physics Laboratory (APL) at John Hopkins University in order to take a look at the work of APL and the Collaborative Analysis Centre. This was an utterly inspiring visit, generating a raft of ideas and possibilities.

PHOTO_20161021_132738.jpg

Visiting JHU APL.

The MORS event continued with additional sessions about Research Design by Dr John Compton, but sadly we were unable to attend those.

Summary

Despite the minor administration problems, mainly affecting us foreigners, the trip was extremely worthwhile. Being able to practice my craft with experienced and knowledgeable participants at this level was very valuable for my personal development and a significant contribution to the UK Defence Academy plans for the future.

PHOTO_20161020_170942-picsay.jpg

I got a shiny MORS challenge coin too!

I still have reservations as to the value for an inexperienced beginner in this subject area, given the level at which many of the instructional participants were operating. This needs to be addressed if we are to generate replacements for the increasingly old expertise we have in the field (myself included).

Tom Mouat


 

Additional Details from Paul Vebber:

I was a co-chair for a working group looking at the issues of “Communication and Implementation” and the relationship of those issues with technology. First, what information needs to move within the “game world” and between the players? Second, what information needs to move between the game world and players and the adjudicators? Third, what what information needs to move out of the “game world” to the observers and analysts?

Ed McGrady and I sliced the group of about 30 we had into subgroups a couple different ways, and discussed these issues in the context of the sort of problems they typically used wargaming techniques to explore. We then focused on two different types of games—Ed the more POL-MIL type, and I a more high tactical/ low operational—and walked through a game design exercise considering where it made sense to use technologies of different levels of sophistication in this communication focused design approach.

Interestingly the team looking at the more qualitative POL-MIL type of game went “high order” on technology to address the “inside the game world” communication issues linking large numbers of players dealing with a high degree of “interactional complexity”.

The group dealing with a more operational problem (exploring the decision space associated with maintaining a long term—many weeks to a few months—naval presence in a location where an ambiguous adversary occasionally lobs missiles at you, or potentially threatens you by other means, AND you have to deal with other emergent operational requirements nearby) started with a “low tech” representation that developed into a card-driven board game.

Despite initial thoughts that some fairly sophisticated M&S tools may be required, it turned out the tech requirements were more about communicating between the game world of manual game play and observer/analysts to capture situational information about why decisions were made and the risk calculus was assessed. The “high fidelity M&S” tools were then used in analysis efforts fed by information from the game and did not have to integrated into the gameplay directly.

This provided a simpler, quicker playing game which feeds M&S efforts focused on digging into the “structural complexity” of weapon system interaction in a well understood operational context that is emergent from and traceable to player decision making.

There were two other working groups, three opportunities to play in different types of games, and five different classes. Check the MORS website for more info on those events—I’m not sure how much of the material and outbriefs will be made available, my understanding is at least some of it will be.

Paul Vebber

Last Turn Madness: Jim Wallman on megagames

ltmwallman

The latest edition of the podcast Last Turn Madness has an excellent interview with evil genius Jim Wallman of Megagame Makers on the history, design, and future of megagaming. Megagames are large mass-participation games on both historical and fictional topics that use minimalist rules and instead emphasize developing narrative, player interaction, and emergent game play. Jim designed and ran the New World Order 2035 megagame we held at McGill earlier this year.

Among the many interesting issues explored in the conversation are the changing demographics of megagame participation, and the ways in which this has influenced both game design and play. Jim also discusses the central importance of narrative engagement, his “less is more” game design philosophy, the role of the Control team, and how to encourage player creativity without allowing them to exploit loopholes or break a game’s basic assumptions and reality. His serious game work is addressed too, with mentions of both the Connections UK professional wargaming conference (where he ran a game on the civil war in Binni) and PAXsims.

IMG_2180.jpg

Jim Wallman at work at the New World Order 2035 megagame (McGill University).

Jim also mentions the the forthcoming “Wide-Area Megagame” that will be held in early July 2017. The scenario for this will be a massive crisis in a fictionalized United States, involving multiple simultaneous linked games played in cities across the UK. We’ll be participating in this from Montreal too, playing the role of neighbouring “Northland.” If you’re in the Montreal area, are interested in participating, and don’t mind getting up very, very early in the morning (we’ll be playing on UK time), drop me a line!

h/t Ben Moores

Dstl wargaming trip report (or, I visited Portsdown West and all I got was this lousy mug)

Last month I visited the UK for a week of discussions on professional wargaming. My trip report has now been cleared for publication (public release identifier DSTL/PUB097079), and I’m pleased to present it below. It was a terrific visit as you’ll see!


DstlPortsdownWest

 Dstl Day 1: Wargaming and its challenges

In late June I spent a week as a guest of Defence Science and Technology Laboratory (Dstl), at their Portsdown West campus near Portsmouth. Dstl is an executive agency, sponsored by the Ministry of Defence. Dstl ensures that “innovative science and technology contribute to the defence and security of the UK.”

Dstl responsibilities include:

  • supplying sensitive and specialist science and technology services for MOD and wider government
  • providing and facilitating expert advice, analysis and assurance on defence procurement
  • leading on the MOD’s science and technology programme
  • understanding risks and opportunities through horizon-scanning
  • acting as a trusted interface between MOD, wider government, the private sector and academia to provide science and technology support to military operations by the UK and her allies
  • championing and developing science and technology skills across MOD

I was hosted by Dstl’s Wargaming Team, the team having recently been described in a memo to the UK MOD Vice-Chief of the Defence Staff as: “an MOD S&T asset responsible for enabling MOD’s wider wargaming activity”.

20160701_PAXsims slide_v1.0_1

20160701_PAXsims slide_v1.0_O

Since WWII, Dstl and its predecessors have had a good track record of delivering wargames, mainly in support of decision support and operations. One of the current challenges for the team is determining how best to reinvigorate, and grow, a wargaming capability (a combination of people, processes, and tools) that can respond to the high levels of customer interest and demand. One of the ways that the team is tackling this problem is by capitalising on external expertise, in particular academic staff who specialise in, and have a passion for, topics such as political science coupled with game design.

They certainly kept me busy, with four and a half full days of lectures, workshops, and discussions on various aspects of wargaming.

I started on Monday with a presentation on The Social Science of Gaming in which I presented ten sets of findings from social science research that I thought had important implications for wargame design and implementation. Since this was a first draft of my September keynote address at the Connections UK interdisciplinary wargaming conference, I won’t spoil the surprise by posting the lecture slides here—instead, you’ll have to come to King’s College London in a month’s time.

socialsciencegaming

Next, I was asked to give a brief on A Personal Journey Through (Sometimes) Serious Gaming, in which I discussed may own background first as a wargaming hobbyist and later as a social scientists using serious games to support teaching and analysis. [slides here]. Among the highlights was a satellite photo of the exact location in a British schoolyard where, in the autumn of 1975, I met my first two fellow teen wargamers, David Knowles and Matthew Hayward. The legendary (to us) Lymington and District Wargames Club would be born soon thereafter.

inthebeginning

In the afternoon attention turned to a presentation entitled Blessed are the Cheesemakers: The Challenges of Gaming Information Operations [slides here]. The title of the talk was a reference to a memorable scene from Monty Python’s Life of Brian, and I was happy to be speaking in a place where most of the audience recognized it. I offered some thoughts on gaming IOs: either as an adjunct to another, generally, kinetic process, or as a primary focus (focusing either on their employment, as part a process, or in an effort to develop content).

IOS

Information and influence, I noted, were part of highly contextual social and political processes that were often poorly understood, so I was a bit dubious about placing a great deal of weight on the specific outputs of IO-focused games.

Instead, I suggested, such games should largely be valued for their heuristic value in generating greater critical awareness of the role, potential, limitations, and difficulties of information and influence operations. Members of the audience also offered a great deal of useful insight into the issue, based on their own experience. As with almost all my sessions at Dstl I may have taken away far more from the conversation than I ever contributed.

The final session was devoted to Managing Player and Client Engagement: Skeptics, Seekers, and Enthusiasts [slides here].

players.jpg

I had more to say on the player end than with regard to clients, since in many cases I’m my own client or have been given very free reign to design a game as I see fit. Much of the discussion ended up focusing on problems—such as unwillingness of players, especially senior players, to risk losing—and how they might be dealt with. Not for the first time I argued that managing players and game facilitation was a skill more closely related to roleplaying games than conventional hobby wargaming—a point that I really need to develop into a full PAXsims post sometime. I learned a lot from the experiences and approaches that were shared by members of Dstl, and there were certainly several ideas that I’ll add to my game design and facilitation toolkit.

 

Dstl Day 2: Daesh and matrix gaming

The second day of my visit involved a game of the ISIS Crisis matrix game, followed by an extended discussion of the potential use of matrix game methods for educational and analytical gaming. Major Tom Mouat—who developed most of the materials for the game—was there too.

20160701_ISIS Crisis 02_WEB_O

The game itself was insightful. The Iraqi government tried to launch a systematic campaign to advance north towards Mosul, but found itself stymied by poor coordination with supposed allies, ISIS terrorism, Iranian heavy-handedness, and internal tensions. The Kurds did well and finally manage to secure some extra heavy weapons from the US, but advanced little beyond their start positions. One US air strike in support of the Iraqi government went very wrong, exacerbating Sunni anger and causing a brief hiatus in the tempo of American operations. Iran, concerned that the Iraqi cabinet was insufficiently compliant, sponsored a proliferation of Shiite militias under its direct control. Although ISIS lost some of the territory under its control, it was able to use US and Iranian actions to spur additional recruitment. Finally, the Sunni opposition eventually rose up against ISIS and supported the central government’s military campaign, but at the cost of increasing tension with the Shiite militias. This finally erupted into open sectarian fighting when Iranian-backed militias undertook security operations in the capital against suspected Sunni insurgents.

20160701_ISIS Crisis 01_WEB_O

After lunch, the post-game session was perhaps the richest and most valuable discussion of matrix gaming methods and applications that I’ve ever participated in. Among the topics we collectively addressed were:

  • Variations in format, including larger games with team dynamics (as I used last month at MIGS), games where a team leader selects from multiple potential courses of action proposed by team members (thus increasing the number of possible COAs (Course Of Actions) generated), distributed games, interlinked games, and matrix games used as an element of other, more traditional wargames.
  • Facilitator skills and requirements for subject matter expertise.
  • Suitability for various audiences.
  • Variations in adjudication methods.
  • Representation of kinetic and non-kinetic activity in matrix games.
  • Suitability for various topics recently wargamed by Dstl.
  • The value of developing a generic “matrix game construction kit” with basic components.

 

Dstl Day 3: AFTERSHOCK , humanitarian assistance, aid, and stabilization

The third day of activities at Dstl revolved around gaming issues of Humanitarian Assistance and Disaster Relief (HADR). We started with a game of AFTERSHOCK: A Humanitarian Crisis. The players secured a modest success in dealing with the aftermath of a devastating earthquake in fictional Carana. The NGO team did particularly well in racking up “organization points” (reflecting public profile and political capital), although their single-minded focus on shelter projects caused some friction with other teams. The HADR Task Force had successfully withdrawn almost all their personnel by the time the game ended, and the government—although politically vulnerable to the end—utilized its informal aid distribution networks to good effect, while managing to contain or defuse any social discontent. Needs assessments proved particularly important in identifying emerging needs and challenges.

20160701_Aftershock 01_WEB_O.png

Later that same day I made a presentation on the considerations that had informed the design of AFTERSHOCK, as well as the various ways in which in might be used [slides here].

My other presentation this day was on Aid, Stabilization, and COIN (COunter INsurgency) [slides here]. In it I warned that many of the key assumptions of COIN doctrine—namely that victory is about legitimacy; poverty and unemployment generates support for armed opposition; legitimacy is about the delivery of core government services; patronage and corruption is bad; and that we know what we’re doing—were contingent relationships. Because of this, COIN doctrine, while a useful guide to what might work most of the time in most places, does not always provide useful guidance all of the time in all places. This suggests a vital need to promote critical thinking and a willingness to modify views and approaches. I particularly stressed the importance of avoiding hubris, and the powerful (often overriding) effects that politics among local actors has on outcomes.

 

Dstl Day 4: Hybrid Warfare and Measures Short of War

Thursday was hybrid warfare day at Dstl. I offered some thoughts [slides] on the notion of hybrid warfare, arguing that most warfare was hybrid and that conflict activities across a broad spectrum were hardly new. (Later I suggested that the term had come to mean “challenges from opponents that we did not anticipate, plus things we once did that we’ve forgotten how to do.” We also identified some of the things that are commonly identified as part of hybrid warfare.

hybrid warfare

After this, we spent the rest of the day playing a few turns of three different games. Each of these explored the topic from different perspectives using a different gaming system: LTC David Barsness’ Kaliningrad 2017 (a matrix game), Brian Train’s Ukrainian Crisis (a more traditional rules/assets/area-movement wargame), and Volko Ruhnke’s Labyrinth (a card-driven game).

20160701_Kaliningrad 2017 01_WEB_O

Kaliningrad 2017

In the matrix game, players were limited only by real-world capabilities in taking potential actions across the diplomatic/information/military/economic (DIME) spectrum. This approach certainly encouraged greater innovation by players, although at the cost of a single action per turn. Kaliningrad 2017 uses a number of marker tracks to measure the game effects of global opinion, nuclear escalation, and a refugee crisis, and this sparked discussion of the strengths and weaknesses of such an approach compared to the simpler design of ISIS Crisis. Generally I’m of the view that “less is more” in matrix games, and that marker tracks can risk excessively focusing player activities in a certain area.

20160701_Ukranian Crisis 01_WEB_O.png

Ukrainian Crisis

Ukrainian Crisis builds on more explicit models and assumptions than does a matrix game. Here the analytical value is not in thinking of new applications of power (since these are predetermined in the rules), but rather discovering how the subsystems and constituent parts of a conflict might interact. Labyrinth also contains an established game model, with the cards being used both to drive these and to insert various capabilities and events. Conventional wargames can certainly do a better job of modeling combat operations than an argument-based matrix games, although they may have difficulty addressing innovation adaptation, or complex political and economic consequences arising from kinetic actions.

20160701_Labyrinth 02_WEB_O.png

Labyrinth

Because of this, I am of the view that a matrix game often offers the best way of exploring broad issues of hybrid warfare, although more detailed examination of particular domain areas could benefit from a more rigorous rules- and models-based approach. A matrix game could also be combined with another gaming approach, with the former perhaps best suited for the diplomatic/information/economic aspects, while the latter could address kinetic military activities. I also think the nature of the topic lends itself well to multimodal examination, whereby the same scenario is explored using several different gaming methodologies, each offering somewhat different insights.

Ironically, one of the problems of a matrix game approach is that it does not require a great deal of preparation, nor need it involve a great deal of materials and complexity. This makes it an unattractive proposition for defence contractors and consultants since product creation and delivery generates relatively few billable hours. Similarly, a sponsor may feel that it does not seem enough of a tangible product compared with a more complex, traditional wargame.

 

Dstl Day 5: Gaming wicked and messy problems

During my final day at Dstl we looked at gaming “wicked” and “messy” problems, with a particular emphasis on mass migration and refugee crises. The concept of wicked problems (first developed in 1973 by Rittel and Webber) addresses planning issues that are characterized by ten key characteristics:

  1. There is no definitive formulation of a wicked problem.
  2. Wicked problems have no stopping rule.
  3. Solutions to wicked problems are not true-or-false, but good or bad.
  4. There is no immediate and no ultimate test of a solution to a wicked problem.
  5. Every solution to a wicked problem is a “one-shot operation”; because there is no opportunity to learn by trial and error, every attempt counts significantly.
  6. Wicked problems do not have an enumerable (or an exhaustively describable) set of potential solutions, nor is there a well-described set of permissible operations that may be incorporated into the plan.
  7. Every wicked problem is essentially unique.
  8. Every wicked problem can be considered to be a symptom of another problem.
  9. The existence of a discrepancy representing a wicked problem can be explained in numerous ways. The choice of explanation determines the nature of the problem’s resolution.
  10. The social planner has no right to be wrong (i.e., planners are liable for the consequences of the actions they generate).

“Messy problems,” on the other hand, are rooted in complex adaptive systems wherein the key variables and the relationships between them are unclear or poorly understood, and in which adaptive subsystems seek to survive environmental change.

After a very brief introduction to the topic [slides], I highlighted a number of refugee and migration games I have either (co)designed or played:

Two of these (marked * above) were not really proper games or simulations, but rather had used game mechanisms to help motivate players.

Thereafter, we turned our attentions to identifying a migration-related topic that could be usefully gamed. After identifying the audience and purpose of such a game, we spent the duration of the session brainstorming game ideas. Some very good ideas emerged for a matrix game involving major European actors (Germany, Italy, the Balkan republics), possibly Turkey, the United Nations, an “other actors/subject matter expert” player, and the migrants themselves.

The migrant player would start the game with a “migrant deck “of economic migrants and refugees that they would seek to move into Europe. These would be played face down, with the identity of the migrant revealed only when they reached a final destination , were otherwise prevented from doing so, or died—the purpose being to personalize the otherwise faceless statistic of migrant numbers. (Tom Mouat subsequently made up a set of these, which you can download via PAXsims here.)

this-map-shows-the-routes-of-europes-refugee-nightmare--and-how-its-getting-worse

Source: Business Insider, 15 September 2015.

Other players would react to migrant flows in appropriate ways. National politics would be addressed by having each country played by a team representing political parties with differing interests and objectives, so that team members were essentially in competition with each other. Much like MIGS versions of ISIS Crisis, this would allow for a game-within-the-matrix-game approach.

20160701_D day map room group_WEB_O.png

Left to Right: Ruby Tabner, Stephen Ho, Me, Colin Marston and Mike Bagwell

The final day ended with a visit to Southwick House to visit the D-Day map room, followed by a pub lunch.

IMG_2597

All-in-all it was an absolutely terrific visit that generated some excellent discussions and ideas regarding (war)gaming methodologies. Colin Marston and the others at Dstl were excellent hosts, and I even got a Portsdown West Wargaming Suite coffee mug out of the deal! I’m very grateful to Tom Mouat for helping out too. I’ll certainly look forward to seeing many of my UK counterparts again at the Connections UK conference in September.

IMG_2880

Back home, with my mug.

 

Engle: Proposal for a simplified matrix game

shutterstock_156525197.jpg

PAXsims is pleased to present the final of a series of posts by Chris Engle on using the matrix game method. Today he offers some thoughts on how to simplify matrix games still further when exploring a common challenge.


 

Proposal for a simplified matrix game

Matrix games are a simple, low tech, low cost simulation tool that tends to be good at running highly fluid situations. It is gaining some attention now which means more people will take it up and make their own versions. This is a good thing but it also could mean a slow creep towards larger more complicated rules. I suggest that that is not the way to go.

Matrix games are simple now but can be made even simpler. The advantage in doing this is not just that it makes the system even lower cost but more importantly that it is easier to explain to policy makers, who often lack detailed knowledge of simulation techniques. When they can understand what a game is they are more likely to fund it. To this end I suggest the following rules.

  1. Define the nature of the game in the briefest way possible. A one page scenario description, maps, a list of possible goals and maybe a cast of important characters is more than enough to suggest a world matrix. The player’s own imaginations fill in the blanks without any additional effort from the designer.
  2. Start with a problem. Make it a simple statement. This is the question the game tries to answer.
  3. Players do not take on roles. Everyone cooperates to make the game happen. They all work towards answering the problem statement. Naturally players will identify with various characters in the story but they are not locked into only acting through that person.
  4. There is no order of play. Players jump in as they have ideas. This follows participant’s energy. Rigid procedures can stifle creativity.
  5. Players point to a scene or location and say what happens. They should write this down so there is a record of events for post-game analysis. Actions may be done in the form of arguments (an action, a result, and three reasons why) but don’t have to be. Novice gamers tend to just tell stories and that is okay.
  6. Other players may add to or alter the previous statement. This overwrites what the last person said. There need be no dice rolling, the effect is automatic but may lead to a discussion. It is possible for players to go entire sessions without ever using dice.
  7. Any player may call for another player to roll dice to see if their action fails. Each roll is 50/50. As many players as wish may ask for rolls. If multiple players do ask for this then it is appropriate to discuss why. If the action passes the roll then it happens and cannot be changed. If it fails, it does not happen and cannot happen in this game.
  8. Players may shift around from scene to scene inside the game as they wish. This allows the flow to go from critical event to critical event rather than get bogged down in minutia.
  9. Play continues until the initial problem is resolved. My experience is that this generally takes no more than an hour and can be done in less time if that is required.
  10. There is no game moderator but it helps to have a game host to encourage players to stay focused on the problem at hand. They do this by inviting players to say what happens next.
  11. All sessions should end with a debriefing period during which participants and spectators discuss what they learned.

I have used games like this in psychotherapy for over twenty years and found them very easy to administer. They can even be made up on the fly.

I invite people to take these rules and adapt them for their own purpose. All I ask is that you share your methods and results with the simulation community.

Chris Engle

%d bloggers like this: