The Innovation Paradox: The Hidden Tension Behind Every Breakthrough
Innovation is rarely constrained by a lack of ideas. More often, it is constrained by the fear of acting on them.
Research frequently points out that up to 90 percent of new products fail within their first year, a statistic often associated with the late Clayton Christensen. It is no surprise, then, that fear has become one of the most powerful forces shaping organizational behavior. According to a 2022 report by McKinsey & Company, 85 percent of executives say fear often or always holds back innovation efforts within their organizations. This concern is particularly pronounced among average or below average innovators, who are three times more likely than innovation leaders to identify fear as a barrier. Perhaps most striking, nine out of ten organizations report doing nothing to systematically address it.
The real question, then, is not whether fear uncertainty exists. It is how individuals and organizations learn to operate in its presence. As Ranjay Gulati explains in his book, “How to Be Bold: The Surprising Science of Everyday Courage” there is a critical distinction between risk and uncertainty. Risk can be managed. Probabilities can be estimated, outcomes modeled, and safeguards put in place. Entire industries, including finance, are built on navigating risk.
He suggests that uncertainty is different. It resembles walking into a dense fog, with no clear odds, no reliable playbooks, and no guarantee that effort will pay off. We can make guesses, but in reality, we really don’t know, so it is impossible to optimize the conditions. Neuroscience helps explain why this feels so destabilizing. Uncertainty activates the amygdala, the brain’s threat detection system, triggering fear. When this system is engaged, our behavioral repertoire narrows. The response is not just fight or flight, but fight, flight, or freeze, with fight being the least common.
From an evolutionary standpoint, this is not surprising. Survival tended to favor those who avoided danger rather than those who moved toward it. As Ranjay Gulati suggests, many of us may be descendants of those who chose caution. Yet, as he notes, “research shows that the old adage is true: Fortune favors the brave, not the cautious.” Because progress, has always depended on those willing to move against that instinct. The Wright brothers risked their lives to achieve flight. Marie Curie pursued discovery despite unknown dangers. Leaders such as Mahatma Gandhi, Martin Luther King Jr., and Nelson Mandela placed themselves at extraordinary personal risk to challenge the status quo. We continue to benefit from such acts of courage, even if fear remains our default setting.
Here’s the issue: innovation is critical to a company’s growth, even its survival, so how do we navigate the fear of uncertainty that so often stands in the way? One pathway is confidence. Yet confidence is not innate. It is built over time through repeated acts of courage and reinforced by a growing sense of self-efficacy. Self-efficacy, a concept studied extensively by psychologist Albert Bandura, refers to the belief in one’s ability to succeed in a given situation. It is this belief that shapes whether individuals lean into uncertainty or retreat from it, ultimately influencing whether ideas move forward or remain unrealized. But if confidence helps counter fear, an important tension begins to emerge. Confidence does not always scale linearly. At higher levels, it can tip into something more extreme.
This raises a potentially controversial question: can overconfidence, at times, counterbalance fear?
Research by Kraft, Dickler, and Withers offers a compelling perspective. Using longitudinal data from US high tech firms, they show that overconfident CEOs can outperform their peers, when supported by boards that possess both expertise and influence. Their findings suggest that capable, well-informed boards are essential in translating CEO overconfidence into conditions that foster breakthrough innovation. Importantly, power alone is insufficient. Both power and expertise are required. Boards need the authority to influence direction and the knowledge to guide it effectively.
Boards that wield influence but lack relevant expertise may actually undermine a firm’s ability to harness CEO overconfidence productively. For governance practitioners, this underscores the importance of assembling boards that combine domain knowledge with a balanced distribution of power relative to the CEO, creating the conditions under which overconfidence can be channeled into meaningful, transformative outcomes.
This relational foundation becomes even more important when viewed through the lens of leadership. Confidence is a critical determinant of how CEOs direct their firms and shape strategy. It influences not only the decisions leaders make, but also the boldness with which they pursue new opportunities. Yet when confidence becomes inflated into overconfidence, it turns into a double-edged force.
On one hand, overconfident CEOs are more likely to take risks, increasing their willingness to pursue breakthrough innovations that more cautious leaders might avoid. On the other hand, that same overconfidence can narrow perspective, making them less attuned to potential threats and blind to the downside of high stakes decisions. This is not a flaw to eliminate, but a tension to manage. Courage and confidence, when left unchecked, can drift into misjudgment without the grounding influence of others. When shaped effectively, however, that same confidence can become a powerful driver of bold, necessary action.
This is where organizational design becomes critical. The challenge is not simply to cultivate courage or to temper overconfidence, but to hold both in productive balance. Knowledgeable and influential boards play a central role in this dynamic (Kraft et al., 2024). They do not suppress bold leadership, but channel it. They provide the expertise to expand perspective and the authority to redirect when needed, ensuring that confidence is informed rather than unchecked. In doing so, they transform what could be reckless risk-taking into disciplined exploration.
A similar tension exists more broadly in how organizations are built to support courage. Organizations that seek innovation must focus not only on individual capability, but on the systems that either mitigates fear or help people move through it. If fear is one of the most significant barriers to innovation, then courage must be intentionally designed for. This means creating environments where uncertainty is expected, early action is encouraged, sensemaking is shared, and individuals are supported rather than isolated when the stakes are high.
This points to a broader pattern. Courage and confidence are rarely individual acts. They are inherently collaborative and take shape within a system of relationships. People do not step into uncertainty alone. They typically rely on support, encouragement, and the reassurance that others are engaged in the process. Whether it is a leader endorsing a risky initiative, a colleague validating a half-formed idea, or a trusted group helping to navigate ambiguity. Courage is cultivated collectively, while overconfidence is kept in check through shared perspective and important guardrails.
Innovation does not emerge in the absence of fear. It emerges when this tension is deliberately held and skillfully managed. When organizations invest in meaning, support, learning, and self-efficacy, courage shifts from being a rare personal trait to a shared, collective capability. At the same time, confidence cannot be left to grow unchecked. It must be continuously calibrated through interaction, feedback, and informed challenge. When both forces are developed in tandem, courage to act and discipline to question, organizations create the conditions where bold ideas can move forward with clarity. That is where real innovation begins.
