Balancing complexity and performance in forecasting models: insights from CHAPS volume predictions

Tom Davies

CHAPS is a critical element of the UK’s payments landscape, handling 92% of UK payment values despite comprising 0.5% of volumes. CHAPS is used for high-value and time-critical payments, including money market and foreign exchange transactions, supplier payments, and house purchases. We forecast CHAPS volumes to help CHAPS participants in making staffing decisions and support our long-term planning including system capacity and tariff setting. While advanced forecasting methods can capture subtle, non-linear patterns, a tension arises: should we use complex models for the most accurate prediction, or use simpler, transparent approaches that stakeholders can quickly grasp? In practice, forecasting isn’t as straightforward as picking whichever model maximises performance; it is the combination of computation and domain expertise that shapes success.

Continue reading →

Forecast accuracy and efficiency at the Bank of England – and how forecast errors can be leveraged to do better

Derrick Kanngiesser and Tim Willems

This post describes a systematic way for central banks to employ past forecasts (and associated errors) with the aim of learning more about the structure and functioning of the economy, ultimately to enable a better setting of monetary policy going forward. Results suggest that the Monetary Policy Committee’s (MPC’s) inflation forecast has tended to underestimate pass-through from wage growth to inflation, while also underestimating the longer-term disinflationary impact of higher unemployment. Regarding the effects of monetary policy, our findings suggest that transmission through inflation expectations has played a bigger role than attributed to it in the forecast.

Continue reading →

Fuelling the tail: inflation- and GDP-at-Risk with oil-supply shocks

Marco Garofalo, Simon Lloyd and Edward Manuel

The economic consequences of the Russia-Ukraine war have brought the importance of sharp changes in commodity prices, such as oil, to centre stage. While many have focused on understanding the impact of these developments on the central projection for the macroeconomic outlook, this post investigates the balance of risks arising from oil-supply shocks, asking: could these lead to more severe or persistent changes in output growth and inflation, in rare events? Through the lens of a simple statistical model of Inflation- and GDP-at-Risk, we quantify the macroeconomic risks to inflation and GDP growth associated with (exogenous) changes in oil supply, showing that these shocks have more pronounced effects on the upper tail of the inflation distribution than at the centre.

Continue reading →

Unknown measures: assessing uncertainty around UK inflation using a new Inflation-at-Risk model

Nikoleta Anesti, Marco Garofalo, Simon Lloyd, Edward Manuel and Julian Reynolds

Understanding and quantifying risks to the economic outlook is essential for effective monetary policymaking. In this post, we describe an ‘Inflation-at-Risk’ model, which helps us assess the uncertainty and balance of risks around the outlook for UK inflation, and understand how this uncertainty relates to underlying economic conditions. Using this data-driven approach, we find that higher inflation expectations are particularly important for driving upside risks to inflation, while a widening in economic slack is important for downside risks. Our model highlights that rising tail-risks can become visible before a turning point, making the approach a useful addition to economists’ forecasting toolkit.

Continue reading →

Uncertainty in financial crisis prediction: a Bayesian approach

Jack Page

Systemic financial crises occur infrequently, giving relatively few crisis observations to feed into the models that try to warn when a crisis is on the horizon. So how certain are these models? And can policymakers trust them when making vital decisions related to financial stability? In this blog, I build a Bayesian neural network to predict financial crises. I show that such a framework can effectively quantify the uncertainty inherent in prediction.

Continue reading →

Citizens’ advice: lessons from the public

Kel Nwanuforo, Andrew Mills and Sharon Raj

The Citizens’ Panels (now the Citizens’ Forum) is a Bank of England discussion forum to engage with the UK public on important topics such as the labour and housing markets, or climate change. It included a forecasting competition, and Bank Underground invited the winners to contribute short pieces about how they evaluate the UK economy, discuss issues of their concern, and to propose solutions.

Part of Bank Underground’s purpose is to give a platform for views from Bank of England (‘Bank’) analysts that may differ from those of the Bank or its policy committees. Alternative views are encouraged within the Bank, but the range of opinions and ways of thinking by analysts is likely to be limited to some extent: by education, experience and less tangible factors such as the language analysts use to explain their thoughts. The Citizens’ Panels therefore offer a rich source of information. By now, they include some 3,200+ participants with a wide range of backgrounds: some are familiar with economics and central banking but many may know little about either. This blog represents the voices of some of those panel members about the UK economy, and how they addressed the forecasting challenge, which we put in front of participants as part of the Citizens’ Forum online community – which by-the-way is open to all.

Continue reading →

Machine learning the news for better macroeconomic forecasting

Arthur Turrell, Eleni Kalamara, Chris Redl, George Kapetanios and Sujit Kapadia

Every day, journalists collate information about the world and, with nimble keystrokes, re-express it succinctly as newspaper copy. Events about the macroeconomy are no exception. So could there be additional valuable information about the economy contained in the news? In a recent research paper, we ask whether newspaper stories could help to predict future macroeconomic developments. We find that news can be used to enhance statistical economic forecasts of growth, inflation and unemployment — but only by using supervised machine learning techniques. We also find that the biggest forecast improvements occur when it matters most — during stressed periods.

Continue reading →

‘The world turned upside down’: How the global economy was hit by the crisis

David Young

For the global economy, it was the best of times, and then it was the worst of times. Buoyed by very strong growth in emerging markets, the global economy boomed in the mid-2000s. On average, annualised world GDP growth exceeded 5% for the four years leading up to 2007 – a pace of growth that hadn’t been sustained since the early 1970s. But it wasn’t to last. In this post, I illustrate how the failure of Lehman Brothers in September 2008 coincided with the deepest, most synchronised global downturn since World War II. And I describe how after having seen the fallout of the Lehman collapse, macroeconomic forecasters were nevertheless surprised by the magnitude of the ensuing global recession.

Continue reading “‘The world turned upside down’: How the global economy was hit by the crisis” →

Can central bankers become Superforecasters?

Aakash Mankodi and Tim Pike

Tetlock and Gardner’s acclaimed work on Superforecasting provides a compelling case for seeing forecasting as a skill that can be improved, and one that is related to the behavioural traits of the forecaster. These so-called Superforecasters have in recent years been pitted against experts ranging from U.S intelligence analysts to participants in the World Economic Forum, and have performed on par or better by accurately predicting the outcomes of a broad range of questions. Sounds like music to a central banker’s ears? In this post, we examine the traits of these individuals, compare them with economic forecasting and draw some related lessons. We conclude that considering the principles and applications of Superforecasting can enhance the work of central bank forecasting.

Continue reading “Can central bankers become Superforecasters?” →

Bitesize: Understanding housing activity in real time

Christopher Hackworth, Nicola Shadbolt and David Seaward.

While official housing market statistics are relatively timely and high frequency, they usually come with a lag of at least one month. So indicators that lead official estimates are helpful for identifying turning points, or any ‘shocks’ to the economy.

Continue reading “Bitesize: Understanding housing activity in real time” →