Stylized innovation: generating timelines by interrogating incrementally available randomised dictionaries

In this work, we introduce an extremely general model for a collection of innovation processes in order to model and analyze the interaction among them. We provide theoretical results, analytically proven, and we show how the proposed model fits the behaviors observed in some real data sets (from Reddit and Gutenberg). It is worth mentioning that the given applications are only examples of the potentialities of the proposed model and related results: due to its abstractness a...

We develop a new framework for modeling innovation networks which evolve over time. The nodes in the network represent firms, whereas the directed links represent unilateral interactions between the firms. Both nodes and links evolve according to their own dynamics and on different time scales. The model assumes that firms produce knowledge based on the knowledge exchange with other firms, which involves both costs and benefits for the participating firms. In order to increas...

The quest for historically impactful science and technology provides invaluable insight into the innovation dynamics of human society, yet many studies are limited to qualitative and small-scale approaches. Here, we investigate scientific evolution through systematic analysis of a massive corpus of digitized English texts between 1800 and 2008. Our analysis reveals great predictability for long-prevailing scientific concepts based on the levels of their prior usage. Interesti...

Of basic interest is the quantification of the long term growth of a language's lexicon as it develops to more completely cover both a culture's communication requirements and knowledge space. Here, we explore the usage dynamics of words in the English language as reflected by the Google Books 2012 English Fiction corpus. We critique an earlier method that found decreasing birth and increasing death rates of words over the second half of the 20th Century, showing death rates ...

This work demonstrates the application of a birth-death Markov process, inspired by radioactive decay, to capture the dynamics of innovation processes. Leveraging the Bass diffusion model, we derive a Gompertz-like function explaining the long-term innovation trends. The validity of our model is confirmed using citation data, Google trends, and a recurrent neural network, which also reveals short-term fluctuations. Further analysis through an automaton model suggests these fl...

The availability of large diachronic corpora has provided the impetus for a growing body of quantitative research on language evolution and meaning change. The central quantities in this research are token frequencies of linguistic elements in texts, with changes in frequency taken to reflect the popularity or selective fitness of an element. However, corpus frequencies may change for a wide variety of reasons, including purely random sampling effects, or because corpora are ...

We introduce FiLex, a self-reinforcing stochastic process which models finite lexicons in emergent language experiments. The central property of FiLex is that it is a self-reinforcing process, parallel to the intuition that the more a word is used in a language, the more its use will continue. As a theoretical model, FiLex serves as a way to both explain and predict the behavior of the emergent language system. We empirically test FiLex's ability to capture the relationship b...

Growing interest in modelling complex systems from brains to societies to cities using networks has led to increased efforts to describe generative processes that explain those networks. Recent successes in machine learning have prompted the usage of evolutionary computation, especially genetic programming to evolve computer programs that effectively forage a multidimensional search space to iteratively find better solutions that explain network structure. Symbolic regression...

In this work we extend previous analyses of linguistic networks by adopting a multi-layer network framework for modelling the human mental lexicon, i.e. an abstract mental repository where words and concepts are stored together with their linguistic patterns. Across a three-layer linguistic multiplex, we model English words as nodes and connect them according to (i) phonological similarities, (ii) synonym relationships and (iii) free word associations. Our main aim is to expl...

In this work we analyze how reputation-based interactions influence the emergence of innovations. To do so, we make use of a dynamic model that mimics the discovery process by which, at each time step, a pair of individuals meet and merge their knowledge to eventually result in a novel technology of higher value. The way in which these pairs are brought together is found to be crucial for achieving the highest technological level. Our results show that when the influence of r...