ID: 2402.13870

Generative Probabilistic Time Series Forecasting and Applications in Grid Operations

February 21, 2024

View on ArXiv
Xinyi Wang, Lang Tong, Qing Zhao
Computer Science
Electrical Engineering and S...
Statistics
Machine Learning
Signal Processing
Applications

Generative probabilistic forecasting produces future time series samples according to the conditional probability distribution given past time series observations. Such techniques are essential in risk-based decision-making and planning under uncertainty with broad applications in grid operations, including electricity price forecasting, risk-based economic dispatch, and stochastic optimizations. Inspired by Wiener and Kallianpur's innovation representation, we propose a weak innovation autoencoder architecture and a learning algorithm to extract independent and identically distributed innovation sequences from nonparametric stationary time series. We show that the weak innovation sequence is Bayesian sufficient, which makes the proposed weak innovation autoencoder a canonical architecture for generative probabilistic forecasting. The proposed technique is applied to forecasting highly volatile real-time electricity prices, demonstrating superior performance across multiple forecasting measures over leading probabilistic and point forecasting techniques.

Similar papers 1

Forecasting Electricity Market Signals via Generative AI

March 9, 2024

96% Match
Xinyi Wang, Qing Zhao, Lang Tong
Signal Processing
Machine Learning
General Economics
Economics

This paper presents a generative artificial intelligence approach to probabilistic forecasting of electricity market signals, such as real-time locational marginal prices and area control error signals. Inspired by the Wiener-Kallianpur innovation representation of nonparametric time series, we propose a weak innovation autoencoder architecture and a novel deep learning algorithm that extracts the canonical independent and identically distributed innovation sequence of the ti...

Find SimilarView on arXiv

Non-parametric Probabilistic Time Series Forecasting via Innovations Representation

June 5, 2023

96% Match
Xinyi Wang, Meijen Lee, ... , Tong Lang
Machine Learning

Probabilistic time series forecasting predicts the conditional probability distributions of the time series at a future time given past realizations. Such techniques are critical in risk-based decision-making and planning under uncertainties. Existing approaches are primarily based on parametric or semi-parametric time-series models that are restrictive, difficult to validate, and challenging to adapt to varying conditions. This paper proposes a nonparametric method based on ...

Find SimilarView on arXiv

If You Like It, GAN It. Probabilistic Multivariate Times Series Forecast With GAN

May 3, 2020

91% Match
Alireza Koochali, Andreas Dengel, Sheraz Ahmed
Machine Learning
Signal Processing

The contribution of this paper is two-fold. First, we present ProbCast - a novel probabilistic model for multivariate time-series forecasting. We employ a conditional GAN framework to train our model with adversarial training. Second, we propose a framework that lets us transform a deterministic model into a probabilistic one with improved performance. The motivation of the framework is to either transform existing highly accurate point forecast models to their probabilistic ...

Find SimilarView on arXiv

Probabilistic multivariate electricity price forecasting using implicit generative ensemble post-processing

May 27, 2020

91% Match
Tim Janke, Florian Steinke
Applications
Econometrics
Risk Management
Statistical Finance
Machine Learning

The reliable estimation of forecast uncertainties is crucial for risk-sensitive optimal decision making. In this paper, we propose implicit generative ensemble post-processing, a novel framework for multivariate probabilistic electricity price forecasting. We use a likelihood-free implicit generative model based on an ensemble of point forecasting models to generate multivariate electricity price scenarios with a coherent dependency structure as a representation of the joint ...

Find SimilarView on arXiv

Learning Probability Distributions of Day-Ahead Electricity Prices

October 4, 2023

91% Match
Jozef Barunik, Lubos Hanus
General Economics
Economics

We propose a novel machine learning approach to probabilistic forecasting of hourly day-ahead electricity prices. In contrast to recent advances in data-rich probabilistic forecasting that approximate the distributions with some features such as moments, our method is non-parametric and selects the best distribution from all possible empirical distributions learned from the data. The model we propose is a multiple output neural network with a monotonicity adjusting penalty. S...

Find SimilarView on arXiv

Denoising diffusion probabilistic models for probabilistic energy forecasting

December 6, 2022

91% Match
Esteban Hernandez Capel, Jonathan Dumas
Machine Learning
Artificial Intelligence

Scenario-based probabilistic forecasts have become vital for decision-makers in handling intermittent renewable energies. This paper presents a recent promising deep learning generative approach called denoising diffusion probabilistic models. It is a class of latent variable models which have recently demonstrated impressive results in the computer vision community. However, to our knowledge, there has yet to be a demonstration that they can generate high-quality samples of ...

Find SimilarView on arXiv

A deep generative model for probabilistic energy forecasting in power systems: normalizing flows

June 17, 2021

91% Match
Jonathan Dumas, Antoine Wehenkel Damien Lanaspeze, ... , Sutera Antonio
Machine Learning
Systems and Control
Systems and Control
Machine Learning

Greater direct electrification of end-use sectors with a higher share of renewables is one of the pillars to power a carbon-neutral society by 2050. However, in contrast to conventional power plants, renewable energy is subject to uncertainty raising challenges for their interaction with power systems. Scenario-based probabilistic forecasting models have become a vital tool to equip decision-makers. This paper presents to the power systems forecasting practitioners a recent d...

Find SimilarView on arXiv

Creating Probabilistic Forecasts from Arbitrary Deterministic Forecasts using Conditional Invertible Neural Networks

February 3, 2023

90% Match
Kaleb Phipps, Benedikt Heidrich, Marian Turowski, Moritz Wittig, ... , Hagenmeyer Veit
Machine Learning

In various applications, probabilistic forecasts are required to quantify the inherent uncertainty associated with the forecast. However, numerous modern forecasting methods are still designed to create deterministic forecasts. Transforming these deterministic forecasts into probabilistic forecasts is often challenging and based on numerous assumptions that may not hold in real-world situations. Therefore, the present article proposes a novel approach for creating probabilist...

Find SimilarView on arXiv

Probabilistic Forecasting of Day-Ahead Electricity Prices and their Volatility with LSTMs

October 5, 2023

90% Match
Julius Trebbien, Sebastian Pütz, Benjamin Schäfer, Heidi S. Nygård, ... , Witthaut Dirk
Machine Learning
Data Analysis, Statistics an...
Physics and Society

Accurate forecasts of electricity prices are crucial for the management of electric power systems and the development of smart applications. European electricity prices have risen substantially and became highly volatile after the Russian invasion of Ukraine, challenging established forecasting methods. Here, we present a Long Short-Term Memory (LSTM) model for the German-Luxembourg day-ahead electricity prices addressing these challenges. The recurrent structure of the LSTM ...

Find SimilarView on arXiv

Deep Distributional Time Series Models and the Probabilistic Forecasting of Intraday Electricity Prices

October 5, 2020

90% Match
Nadja Klein, Michael Stanley Smith, David J. Nott
Methodology
Econometrics
Applications
Computation
Machine Learning

Recurrent neural networks (RNNs) with rich feature vectors of past values can provide accurate point forecasts for series that exhibit complex serial dependence. We propose two approaches to constructing deep time series probabilistic models based on a variant of RNN called an echo state network (ESN). The first is where the output layer of the ESN has stochastic disturbances and a shrinkage prior for additional regularization. The second approach employs the implicit copula ...

Find SimilarView on arXiv