ID: 1207.1463

Statistical Basis for Predicting Technological Progress

July 5, 2012

View on ArXiv
Bela Nagy, J. Doyne Farmer, Quan M. Bui, Jessika E. Trancik
Physics
Quantitative Finance
Statistics
Physics and Society
General Finance
Applications

Forecasting technological progress is of great interest to engineers, policy makers, and private investors. Several models have been proposed for predicting technological improvement, but how well do these models perform? An early hypothesis made by Theodore Wright in 1936 is that cost decreases as a power law of cumulative production. An alternative hypothesis is Moore's law, which can be generalized to say that technologies improve exponentially with time. Other alternatives were proposed by Goddard, Sinclair et al., and Nordhaus. These hypotheses have not previously been rigorously tested. Using a new database on the cost and production of 62 different technologies, which is the most expansive of its kind, we test the ability of six different postulated laws to predict future costs. Our approach involves hindcasting and developing a statistical model to rank the performance of the postulated laws. Wright's law produces the best forecasts, but Moore's law is not far behind. We discover a previously unobserved regularity that production tends to increase exponentially. A combination of an exponential decrease in cost and an exponential increase in production would make Moore's law and Wright's law indistinguishable, as originally pointed out by Sahal. We show for the first time that these regularities are observed in data to such a degree that the performance of these two laws is nearly tied. Our results show that technological progress is forecastable, with the square root of the logarithmic error growing linearly with the forecasting horizon at a typical rate of 2.5% per year. These results have implications for theories of technological change, and assessments of candidate technologies and policies for climate change mitigation.

Similar papers 1

J. Doyne Farmer, Francois Lafond
Economics
Physics and Society

Recently it has become clear that many technologies follow a generalized version of Moore's law, i.e. costs tend to drop exponentially, at different rates that depend on the technology. Here we formulate Moore's law as a correlated geometric random walk with drift, and apply it to historical data on 53 technologies. We derive a closed form expression approximating the distribution of forecast errors as a function of time. Based on hind-casting experiments we show that this wo...

François Lafond, Aimee Gotway Bailey, Jan David Bakker, Dylan Rebois, Rubina Zadourian, ... , Farmer J. Doyne
Economics

Experience curves are widely used to predict the cost benefits of increasing the deployment of a technology. But how good are such forecasts? Can one predict their accuracy a priori? In this paper we answer these questions by developing a method to make distributional forecasts for experience curves. We test our method using a dataset with proxies for cost and experience for 51 products and technologies and show that it works reasonably well. The framework that we develop hel...

Quantitative Technology Forecasting: a Review of Trend Extrapolation Methods

January 4, 2024

87% Match
Peng-Hung Tsai, Daniel Berleant, Richard S. Segall, Hyacinthe Aboudja, Venkata Jaipal R. Batthula, ... , Howell Michael
Artificial Intelligence
Applications

Quantitative technology forecasting uses quantitative methods to understand and project technological changes. It is a broad field encompassing many different techniques and has been applied to a vast range of technologies. A widely used approach in this field is trend extrapolation. Based on the publications available to us, there has been little or no attempt made to systematically review the empirical evidence on quantitative trend extrapolation techniques. This study atte...

Find SimilarView on arXiv

The Importance of (Exponentially More) Computing Power

June 28, 2022

86% Match
Neil C. Thompson, Shuning Ge, Gabriel F. Manso
Hardware Architecture
Computers and Society
Performance

Denizens of Silicon Valley have called Moore's Law "the most important graph in human history," and economists have found that Moore's Law-powered I.T. revolution has been one of the most important sources of national productivity growth. But data substantiating these claims tend to either be abstracted - for example by examining spending on I.T., rather than I.T. itself - or anecdotal. In this paper, we assemble direct quantitative evidence of the impact that computing power...

Find SimilarView on arXiv

Beyond S-curves: Recurrent Neural Networks for Technology Forecasting

November 28, 2022

86% Match
Alexander Glavackij, Dimitri Percia David, Alain Mermoud, ... , Aberer Karl
Computers and Society
Machine Learning

Because of the considerable heterogeneity and complexity of the technological landscape, building accurate models to forecast is a challenging endeavor. Due to their high prevalence in many complex systems, S-curves are a popular forecasting approach in previous work. However, their forecasting performance has not been directly compared to other technology forecasting approaches. Additionally, recent developments in time series forecasting that claim to improve forecasting ac...

Find SimilarView on arXiv

Determinants of the Pace of Global Innovation in Energy Technologies

November 21, 2012

85% Match
Luis M. A. Bettencourt, Jessika E. Trancik, Jasleen Kaur
Physics and Society
Computers and Society
Applications

Understanding the factors driving innovation in energy technologies is of critical importance to mitigating climate change and addressing other energy-related global challenges. Low levels of innovation, measured in terms of energy patent filings, were noted in the 1980s and 90s as an issue of concern and were attributed to low investment in public and private research and development (R&D). Here we build a comprehensive global database of energy patents covering the period 1...

Find SimilarView on arXiv

Data-Driven Investment Decision-Making: Applying Moore's Law and S-Curves to Business Strategies

May 16, 2018

85% Match
Christopher L. Benson, Christopher L. Magee
Econometrics

This paper introduces a method for linking technological improvement rates (i.e. Moore's Law) and technology adoption curves (i.e. S-Curves). There has been considerable research surrounding Moore's Law and the generalized versions applied to the time dependence of performance for other technologies. The prior work has culminated with methodology for quantitative estimation of technological improvement rates for nearly any technology. This paper examines the implications of s...

Find SimilarView on arXiv

Re-examining rates of lithium-ion battery technology improvement and cost decline

July 28, 2020

84% Match
Micah S. 1 and 2 Ziegler, Jessika E. 1 and 2 Trancik
Physics and Society

Lithium-ion technologies are increasingly employed to electrify transportation and provide stationary energy storage for electrical grids, and as such their development has garnered much attention. However, their deployment is still relatively limited, and their broader adoption will depend on their potential for cost reduction and performance improvement. Understanding this potential can inform critical climate change mitigation strategies, including public policies and tech...

Find SimilarView on arXiv

Long-run evolution of the global economy - Part 2: Hindcasts of innovation and growth

January 2, 2016

84% Match
Timothy J. Garrett
General Finance
Physics and Society

Long-range climate forecasts use integrated assessment models to link the global economy to greenhouse gas emissions. This paper evaluates an alternative economic framework outlined in part 1 of this study (Garrett, 2014) that approaches the global economy using purely physical principles rather than explicitly resolved societal dynamics. If this model is initialized with economic data from the 1950s, it yields hindcasts for how fast global economic production and energy cons...

Find SimilarView on arXiv

Power Law Trends in Speedrunning and Machine Learning

April 20, 2023

84% Match
Ege Erdil, Jaime Sevilla
Machine Learning
Artificial Intelligence
Applications

We find that improvements in speedrunning world records follow a power law pattern. Using this observation, we answer an outstanding question from previous work: How do we improve on the baseline of predicting no improvement when forecasting speedrunning world records out to some time horizon, such as one month? Using a random effects model, we improve on this baseline for relative mean square error made on predicting out-of-sample world record improvements as the comparison ...

Find SimilarView on arXiv