PAXsims

MORS 82 Summary – Day 2

I started off the second day of this year’s Military Operations Research Society annual symposium by attending a presentation by Yuna Wong (Marine Corps) on The Search for the Black Herring: MORSS Strategist’s Corner. This wasn’t a gaming presentation per se, but Yuna is certainly well-known in the professional wargame community, and has been particularly active in encouraging the closer integration of social science theory and methods into gaming and strategic analysis. In particular, her talk asked what analytical organizations should do to prepare for future analytical challenges in an era of uncertainty. One of my current research projects looks at the political science of prediction, so I was especially interested to see what she had to say. (For those who might be wondering. a “black herring” occurs when analysts obsessively look for the next “black swans,” only to find “red herrings.”)

Her primary argument was that analytic communities needed to be multidisciplinary, broaden their methodological expertise, and use experts well. Among the challenges to being more multidisciplinary are the existing (US government) human resource system, as well as organizational culture. As an example of the latter she used the professional wargaming community, who tend to have internal measures of legitimacy (for example, many years of being a boardgamer) that have an exclusionary effect on new and different talent. It is also a risk for organizations to depart from existing practices, and the search and start-up costs of becoming more multidisciplinary may be higher than maintaining the status quo.

She also was critical of the tendency of modern operations research to focus on narrow technical problems and answers. Such approaches may be less useful for addresses issues that are better characterized as a “mess” rather than a “problem.” (For the difference between these and the effective use of judgment-based methods, see NATO’s Code of Best Practices for Judgement-Based Operational Analysis.) The real “black swans,” she suggested, were to be found in the swamp of complex and chaotic environments.

Yuna had a number of useful thoughts too on effective use of outside expertise, addressing issues of identification, recruitment, facilitation, as well as practical issues (such as contracting and clearances).

I agreed with pretty much all that she had to say. However (following on from the work of Phil Tetlock and the Good Judgment Project) I asked whether we needed to pay more attention to cognitive styles. It isn’t just a question of finding people with differing areas of expert knowledge, but finding those people who are also not locked into particular paradigms or filter everything through a preexisting worldview.

While not a wargaming panel a great deal of what she had to say was of significant value for analytic gaming. Many wargames, after all, involve need to address messy problems, challenge conventional wisdoms, engage broader expertise in game design and adjudication, and explore uncertain futures.

 

John Hanley Jr. (formerly ODNI) presented on Gaming and Game Theory: Using Game Theory to Advance Gaming. He argued that understanding game theory helped in both wargame design and analysis. Manual games, he suggested, have their limitations: they are not rigorous analysis; they don’t have fully reproducible results; they are dependent on the quality and characteristics of the gamers; they can be personnel-intensive (and hence expensive), can be error-prone; and they aren’t real (and there is a consequent risk of over-learning from them). Many of these limitations can be reduced however, by continuous gaming and a structure for capturing results. He highlighted this by discussing a series of games over the years at the Naval War College, subsequent analysis of which identified clear clusters of moves, responses, outcomes, and equilibrium strategies for Red and Blue. The data, however, was messy (suggesting that moves and adjudication needs to be more clearly delineated and recorded). Capturing manual games in game theoretic form allows for more sophisticated analysis, helping to poulate the strategy space and identification of dominant strategies and equilibria.

 

Daniel Stimpson (George Mason University) talked about Using Operational Patterns to Influence Attacker Decisions on a Transportation Network. The challenge he was addressing was how to anticipate an opponent’s IED attacks on transportation and logistics networks. To date, he suggested, much of the academic (and classified) literature did not adequately address attacker dynamics and the interaction between attacker and defender. Boyd’s OODA loop provided some of the conceptual underpinning for his approach.

He offered a useful discussion of the notion of “randomness,” noting that neither “variety” nor “surprise” was synonymous with randomness, nor was it the same as failure to predict (although prediction is only possible in constrained systems, and totally random systems are inherently unpredictable). Surprise, he noted, derives from a failure to predict—the system itself is not “surprised.” In his model, Blue seemed far more constrained in its tactical choices than Red (whose behaviour seemed to be wholly driven by trial-and-error learning). The presenter noted that there were limits in how complex the model could be, given resource and time constraints.

 

Douglas Samuelson (InfoLogix and Group W), offered a presentation title Anybody Else Wanna Negotiate? Representing Negotiations Realistically in Wargames. He argued that negotiations are generally characterized by non-zero transaction costs and multiple representatives with non-identical interests. Because of this, negotiations often have multiple phases: reaching a deal, then selling a deal to constituents or clients. For a deal to last, it needs to keep producing benefits that outlast the negotiator’s involvement. Negotiations with many parties but clear interests are good candidates for mediation. Problems with shifting interests and unclear identities are more difficult to mediate. (He used the examples of North Korea and Israel-Palestine to illustrate his argument, although I was not convinced of his application of the cases.) He suggested that achieving the best possible deal is not always in a party’s interest, given the importance of promoting trust as a basis for continued interaction. He also addressed coalition-building, as well as conditions under which negotiators may wish to prolong talks, or actors may seek to derail negotiations by attacking the negotiators.

Unfortunately the presentation didn’t link this very well to wargame design or facilitation. For the most part it simply identified aspects of negotiation, and suggested at the end that a wargame ought to include these in some way. Some of the audience probed this point, asking questions about how we might best built the many complex aspects of negotiations into a wargame—the tricks of the trade, as it were, for manipulating players into realistic negotiation behaviours

 

A key aspect of this, of course, is building an effective narrative that players will internalize, and understanding what player narratives indicate about perceptions and behaviours. Fortunately the next presentation was by Yuna Wong (USMC) and Sara Cobb (George Mason University) on Narrative Analysis in Seminar Gaming. Unfortunately the presentation was classified as For Official Use Only and those of us Canadians with yellow badges had to leave. (This is known in MORS wargaming parlance as being “Brian Train-ed.”)

With this, our cunning plan to use US government thinking about narratives and seminar gaming to assist in the rapid Canadian military seizure of Seattle, Fargo, and Albany as envisaged in Defence Scheme #1 was foiled. Curses!

(I should add the Working Group 30 chairs were very apologetic about this, and as Canadians we left very politely.)

 

The day ended with an excellent panel discussion on Practices in Wargaming that featured such wargaming luminaries as Peter Perla (CNA), John Hanley Jr., Jeff Appleget (NPS), Hank Brightman (NWC), and Ellie Bartels (Caerus Associates).

Three main topics were addressed. Far too much was said by both the panel and the audience for me to accurately record here, so instead I’ve briefly summarized some of the major points:

Gaming for DoD Analysis

Making a Playable Game

The Future of Gaming