John Cutler Warns Against ‘Self-Sealing’ Models in Business

In a recent LinkedIn post, John Cutler delves into the pitfalls of creating business models that appear infallible, cautioning that such “self-sealing” approaches can hinder genuine progress and understanding.

Cutler begins by posing a critical question about the nature of models that always seem correct: “The problem with models that are always right is that they are either common sense, or context-free.” He explains that self-sealing models are constructed in a way that allows any outcome to be interpreted as confirmation, a concept he likens to an unfalsifiable hypothesis in science or what philosopher Imre Lakatos termed “immunizing stratagems.” These stratagems, Cutler notes, involve introducing ad hoc hypotheses to protect a core theory from disconfirming evidence rather than revising or abandoning it.

The Danger of Immunizing Stratagems

As someone who frequently develops models, Cutler acknowledges the natural inclination to make them robust. However, he points out the fine line between strengthening a model and rendering it immune to criticism. “When you pressure ‘test’ a model you’re often trying to make it airtight. That instinct is good. But this is also where the problems start,” Cutler writes. He observes that once individuals become attached to their models, the defense mechanism kicks in, leading to the adoption of various tactics to preserve the model’s perceived accuracy.

Tactics Used to Protect Models

Cutler highlights several specific “immunizing stratagems” that can be employed, intentionally or unintentionally, to shield models from refutation:

• Motte-and-Bailey: This involves making a bold claim initially, then retreating to a more trivial or defensible one when challenged.
• Equivocation: Key terms within the model are stretched or redefined to prevent any contradiction from arising.
• Kafka Trap: Disagreement or criticism is treated as further evidence supporting the model’s validity, effectively turning dissent into confirmation.
• Rhetorical Asymmetry: Proponents speak in broad abstractions, forcing critics to engage with specific details, which can be a diversionary tactic.
• Narrative Closure: A seemingly clean and coherent story is used to create a strong sense of truth, overriding logical scrutiny.

According to Cutler, these methods serve to “immunize” the theory against falsification, preventing the model from being genuinely tested or improved through feedback. He reiterates his core concern:

“So to repeat: The problem with models that are always right is that they are either common sense, or context-free.”

Moving Beyond Unfalsifiable Models

Cutler’s analysis suggests that true model development requires a willingness to accept potential falsification. Embracing the possibility of being wrong is crucial for learning and adaptation in dynamic business environments. By recognizing these self-sealing tendencies, leaders and analysts can strive to create models that are not only insightful but also genuinely testable and open to revision, ultimately leading to more effective strategies and decision-making.