July 19, 2016
Innovation is to organizations what evolution is to organisms: it is how organisations adapt to changes in the environment and improve. Governments, institutions and firms that innovate are more likely to prosper and stand the test of time; those that fail to do so fall behind their competitors and succumb to market and environmental change. Yet despite steady advances in our understanding of evolution, what drives innovation remains elusive. On the one hand, organizations invest heavily in systematic strategies to drive innovation. On the other, historical analysis and individual experience suggest that serendipity plays a significant role in the discovery process. To unify these two perspectives, we analyzed the mathematics of innovation as a search process for viable designs across a universe of building blocks. We then tested our insights using historical data from language, gastronomy and technology. By measuring the number of makeable designs as we acquire more components, we observed that the relative usefulness of different components is not fixed, but cross each other over time. When these crossovers are unanticipated, they appear to be the result of serendipity. But when we can predict crossovers ahead of time, they offer an opportunity to strategically increase the growth of our product space. Thus we find that the serendipitous and strategic visions of innovation can be viewed as different manifestations of the same thing: the changing importance of component building blocks over time.
Similar papers 1
December 6, 2019
Despite our familiarity with specific technologies, the origin of new technologies remains mysterious. Are new technologies made from scratch, or are they built up recursively from new combinations of existing technologies? To answer this, we introduce a simple model of recursive innovation in which technologies are made up of components and combinations of components can be turned into new components---a process we call technological recursion. We derive a formula for the ex...
The notion of the "adjacent possible" has been advanced to theorize the generation of novelty across many different research domains. This study is an attempt to examine in what way the notion can be made empirically useful for innovation studies. A theoretical framework is construed based on the notion of innovation a search process of recombining knowledge to discover the "adjacent possible". The framework makes testable predictions about the rate of innovation, the distrib...
Invention has been commonly conceptualized as a search over a space of combinatorial possibilities. Despite the existence of a rich literature, spanning a variety of disciplines, elaborating on the recombinant nature of invention, we lack a formal and quantitative characterization of the combinatorial process underpinning inventive activity. Here we utilize U.S. patent records dating from 1790 to 2010 to formally characterize the invention as a combinatorial process. To do th...
October 7, 2013
One new thing often leads to another. Such correlated novelties are a familiar part of daily life. They are also thought to be fundamental to the evolution of biological systems, human society, and technology. By opening new possibilities, one novelty can pave the way for others in a process that Kauffman has called "expanding the adjacent possible". The dynamics of correlated novelties, however, have yet to be quantified empirically or modeled mathematically. Here we propose...
Modularity is critical for the emergence and evolution of complex social, natural, and technological systems robust to exploratory failure. We consider this in the context of emerging business organizations, which can be understood as complex systems. We build a theory of organizational emergence as higher-order, modular recombination wherein successful start-ups assemble novel combinations of successful modular components, rather than engage in the lower-order combination of...
November 3, 2013
In order to create new products, inventors search and combine previous ideas. Few studies have examined the characteristics of search that lead to new products; most have focused on patent citations, which are often retrospective and may not reflect the usefulness of inventions. Through the analysis of collaborations in an online virtual community, the impact of originality on popularity and practicality is tested. These tests in turn are based on a method for measuring the...
June 15, 2018
A key challenge when trying to understand innovation is that it is a dynamic, ongoing process, which can be highly contingent on ephemeral factors such as culture, economics, or luck. This means that any analysis of the real-world process must necessarily be historical - and thus probably too late to be most useful - but also cannot be sure what the properties of the web of connections between innovations is or was. Here I try to address this by designing and generating a set...
Novelties are part of our daily lives. We constantly adopt new technologies, conceive new ideas, meet new people, experiment with new situations. Occasionally, we as individuals, in a complicated cognitive and sometimes fortuitous process, come up with something that is not only new to us, but to our entire society so that what is a personal novelty can turn into an innovation at a global level. Innovations occur throughout social, biological and technological systems and, th...
November 27, 2023
Novelty is not a sufficient condition for innovation. For new ideas and products to succeed, they must be integrated into the collective understanding and existing infrastructure, illustrating how the past determines the future. Here, we develop a comprehensive framework to understand how the structure of accumulated past successes curves the adjacent possible trajectory of future innovations. We observe that certain technological building blocks, upon frequent combination, c...
July 13, 2017
We introduce a model for the emergence of innovations, in which cognitive processes are described as random walks on the network of links among ideas or concepts, and an innovation corresponds to the first visit of a node. The transition matrix of the random walk depends on the network weights, while in turn the weight of an edge is reinforced by the passage of a walker. The presence of the network naturally accounts for the mechanism of the adjacent possible, and the model r...