How predictable is technological progress?

This work demonstrates the application of a birth-death Markov process, inspired by radioactive decay, to capture the dynamics of innovation processes. Leveraging the Bass diffusion model, we derive a Gompertz-like function explaining the long-term innovation trends. The validity of our model is confirmed using citation data, Google trends, and a recurrent neural network, which also reveals short-term fluctuations. Further analysis through an automaton model suggests these fl...

Probabilistic time series forecasting predicts the conditional probability distributions of the time series at a future time given past realizations. Such techniques are critical in risk-based decision-making and planning under uncertainties. Existing approaches are primarily based on parametric or semi-parametric time-series models that are restrictive, difficult to validate, and challenging to adapt to varying conditions. This paper proposes a nonparametric method based on ...

In the probabilistic energy forecasting literature, emphasis is mainly placed on deriving marginal predictive densities for which each random variable is dealt with individually. Such marginals description is sufficient for power systems related operational problems if and only if optimal decisions are to be made for each lead-time and each location independently of each other. However, many of these operational processes are temporally and spatially coupled, while uncertaint...

We find that improvements in speedrunning world records follow a power law pattern. Using this observation, we answer an outstanding question from previous work: How do we improve on the baseline of predicting no improvement when forecasting speedrunning world records out to some time horizon, such as one month? Using a random effects model, we improve on this baseline for relative mean square error made on predicting out-of-sample world record improvements as the comparison ...

Functional technical performance usually follows an exponential dependence on time but the rate of change (the exponent) varies greatly among technological domains. This paper presents a simple model that provides an explanatory foundation for these phenomena based upon the inventive design process. The model assumes that invention - novel and useful design- arises through probabilistic analogical transfers that combine existing knowledge by combining existing individual op...

The Bayesian statistical paradigm provides a principled and coherent approach to probabilistic forecasting. Uncertainty about all unknowns that characterize any forecasting problem -- model, parameters, latent states -- is able to be quantified explicitly, and factored into the forecast distribution via the process of integration or averaging. Allied with the elegance of the method, Bayesian forecasting is now underpinned by the burgeoning field of Bayesian computation, which...

As it is pretty sure that Moore's law will end some day, questioning about the post-Moore era is more than interesting. Similarly, looking for new computing paradigms that could provide solutions is important. Revisiting the history of digital electronics since the 60's provide significant insights on the conditions for the success of a new emerging technology to replace the currently dominant one. Specifically, the past shows when constraints and {\guillemotleft} walls {\gui...

"If you ask ten experts, you will get ten different opinions." This common proverb illustrates the common association of expert forecasts with personal bias and lack of consistency. On the other hand, digitization promises consistency and explainability through data-driven forecasts employing machine learning (ML) and statistical models. In the following, we compare such forecasts to expert forecasts from the World Semiconductor Trade Statistics (WSTS), a leading semiconducto...

Generative probabilistic forecasting produces future time series samples according to the conditional probability distribution given past time series observations. Such techniques are essential in risk-based decision-making and planning under uncertainty with broad applications in grid operations, including electricity price forecasting, risk-based economic dispatch, and stochastic optimizations. Inspired by Wiener and Kallianpur's innovation representation, we propose a weak...

Renewable energy sources provide a constantly increasing contribution to the total energy production worldwide. However, the power generation from these sources is highly variable due to their dependence on meteorological conditions. Accurate forecasts for the production at various temporal and spatial scales are thus needed for an efficiently operating electricity market. In this article - part 1 - we propose fully probabilistic prediction models for spatially aggregated win...