ID: 2207.02832

Distributional neural networks for electricity price forecasting

July 6, 2022

View on ArXiv
Grzegorz Marcjasz, Michał Narajewski, Rafał Weron, Florian Ziel
Quantitative Finance
Statistics
Statistical Finance
Applications
Machine Learning

We present a novel approach to probabilistic electricity price forecasting which utilizes distributional neural networks. The model structure is based on a deep neural network that contains a so-called probability layer. The network's output is a parametric distribution with 2 (normal) or 4 (Johnson's SU) parameters. In a forecasting study involving day-ahead electricity prices in the German market, our approach significantly outperforms state-of-the-art benchmarks, including LASSO-estimated regressions and deep neural networks combined with Quantile Regression Averaging. The obtained results not only emphasize the importance of higher moments when modeling volatile electricity prices, but also -- given that probabilistic forecasting is the essence of risk management -- provide important implications for managing portfolios in the power sector.

Similar papers 1

Learning Probability Distributions of Day-Ahead Electricity Prices

October 4, 2023

94% Match
Jozef Barunik, Lubos Hanus
General Economics
Economics

We propose a novel machine learning approach to probabilistic forecasting of hourly day-ahead electricity prices. In contrast to recent advances in data-rich probabilistic forecasting that approximate the distributions with some features such as moments, our method is non-parametric and selects the best distribution from all possible empirical distributions learned from the data. The model we propose is a multiple output neural network with a monotonicity adjusting penalty. S...

Find SimilarView on arXiv

Deep Distributional Time Series Models and the Probabilistic Forecasting of Intraday Electricity Prices

October 5, 2020

91% Match
Nadja Klein, Michael Stanley Smith, David J. Nott
Methodology
Econometrics
Applications
Computation
Machine Learning

Recurrent neural networks (RNNs) with rich feature vectors of past values can provide accurate point forecasts for series that exhibit complex serial dependence. We propose two approaches to constructing deep time series probabilistic models based on a variant of RNN called an echo state network (ESN). The first is where the output layer of the ESN has stochastic disturbances and a shrinkage prior for additional regularization. The second approach employs the implicit copula ...

Find SimilarView on arXiv

Probabilistic Forecasting of Day-Ahead Electricity Prices and their Volatility with LSTMs

October 5, 2023

91% Match
Julius Trebbien, Sebastian Pütz, Benjamin Schäfer, Heidi S. Nygård, ... , Witthaut Dirk
Machine Learning
Data Analysis, Statistics an...
Physics and Society

Accurate forecasts of electricity prices are crucial for the management of electric power systems and the development of smart applications. European electricity prices have risen substantially and became highly volatile after the Russian invasion of Ukraine, challenging established forecasting methods. Here, we present a Long Short-Term Memory (LSTM) model for the German-Luxembourg day-ahead electricity prices addressing these challenges. The recurrent structure of the LSTM ...

Find SimilarView on arXiv

Any-Quantile Probabilistic Forecasting of Short-Term Electricity Demand

April 26, 2024

90% Match
Slawek Smyl, Boris N. Oreshkin, ... , Dudek Grzegorz
Machine Learning
Machine Learning

Power systems operate under uncertainty originating from multiple factors that are impossible to account for deterministically. Distributional forecasting is used to control and mitigate risks associated with this uncertainty. Recent progress in deep learning has helped to significantly improve the accuracy of point forecasts, while accurate distributional forecasting still presents a significant challenge. In this paper, we propose a novel general approach for distributional...

Find SimilarView on arXiv

Generative Probabilistic Time Series Forecasting and Applications in Grid Operations

February 21, 2024

90% Match
Xinyi Wang, Lang Tong, Qing Zhao
Machine Learning
Signal Processing
Applications

Generative probabilistic forecasting produces future time series samples according to the conditional probability distribution given past time series observations. Such techniques are essential in risk-based decision-making and planning under uncertainty with broad applications in grid operations, including electricity price forecasting, risk-based economic dispatch, and stochastic optimizations. Inspired by Wiener and Kallianpur's innovation representation, we propose a weak...

Find SimilarView on arXiv

Multivariate Probabilistic Forecasting of Intraday Electricity Prices using Normalizing Flows

May 27, 2022

90% Match
Eike Cramer, Dirk Witthaut, ... , Dahmen Manuel
Machine Learning

Electricity is traded on various markets with different time horizons and regulations. Short-term intraday trading becomes increasingly important due to the higher penetration of renewables. In Germany, the intraday electricity price typically fluctuates around the day-ahead price of the European Power EXchange (EPEX) spot markets in a distinct hourly pattern. This work proposes a probabilistic modeling approach that models the intraday price difference to the day-ahead contr...

Find SimilarView on arXiv

Postprocessing of point predictions for probabilistic forecasting of electricity prices: Diversity matters

April 2, 2024

90% Match
Arkadiusz Lipiecki, Bartosz Uniejewski, Rafał Weron
Statistical Finance
Applications
Machine Learning

Operational decisions relying on predictive distributions of electricity prices can result in significantly higher profits compared to those based solely on point forecasts. However, the majority of models developed in both academic and industrial settings provide only point predictions. To address this, we examine three postprocessing methods for converting point forecasts into probabilistic ones: Quantile Regression Averaging, Conformal Prediction, and the recently introduc...

Find SimilarView on arXiv

Combining predictive distributions of electricity prices: Does minimizing the CRPS lead to optimal decisions in day-ahead bidding?

August 29, 2023

89% Match
Weronika Nitka, Rafał Weron
Statistical Finance
Econometrics
Computation
Machine Learning

Probabilistic price forecasting has recently gained attention in power trading because decisions based on such predictions can yield significantly higher profits than those made with point forecasts alone. At the same time, methods are being developed to combine predictive distributions, since no model is perfect and averaging generally improves forecasting performance. In this article we address the question of whether using CRPS learning, a novel weighting technique minimiz...

Find SimilarView on arXiv

On-line conformalized neural networks ensembles for probabilistic forecasting of day-ahead electricity prices

April 3, 2024

89% Match
Alessandro Brusaferri, Andrea Ballarino, ... , Laurini Fabrizio
Machine Learning

Probabilistic electricity price forecasting (PEPF) is subject of increasing interest, following the demand for proper quantification of prediction uncertainty, to support the operation in complex power markets with increasing share of renewable generation. Distributional neural networks ensembles have been recently shown to outperform state of the art PEPF benchmarks. Still, they require critical reliability enhancements, as fail to pass the coverage tests at various steps on...

Find SimilarView on arXiv

Forecasting Electricity Market Signals via Generative AI

March 9, 2024

89% Match
Xinyi Wang, Qing Zhao, Lang Tong
Signal Processing
Machine Learning
General Economics
Economics

This paper presents a generative artificial intelligence approach to probabilistic forecasting of electricity market signals, such as real-time locational marginal prices and area control error signals. Inspired by the Wiener-Kallianpur innovation representation of nonparametric time series, we propose a weak innovation autoencoder architecture and a novel deep learning algorithm that extracts the canonical independent and identically distributed innovation sequence of the ti...

Find SimilarView on arXiv