Macro factors explaining S&P 500 equity valuation Macro factors explaining S&P 500 equity valuation Macro factors explaining S&P 500 equity valuation

Macro factors explaining S&P 500 equity valuation

Equities 8 minutes to read
Peter Garnry

Head of Saxo Strats

Summary:  We show that macro variables on the US housing market, consumer confidence, change in money supply, the US 2-year yield, unemployment rate, hourly earnings, and lending standards are the most important macro variables for explaining the variance in the earnings yield on the S&P 500 in the period 1994-2022. Our earnings yield model also have long periods during the dot-com bubble and the Covid-19 pandemic where the predicted earnings yield is considerably above the actual earnings yield suggesting these two periods are driven by strong investor sentiment and optimism not explainable by the macro backdrop.

US housing market and consumer confidence are key for equity valuation

When we set out to build an earnings yield model on S&P 500 our aim was to find the factors that can explain the variation in the earnings yield. Our first model was using mostly aggregate company fundamentals on the S&P 500 such as EBIT margin, revenue growth, capex-to-sales etc., with the 12-month trailing earnings yield as the target in the model. This model was misspecified for several reasons including the 12-month trailing earnings yield being too volatile and lagging, but more importantly company fundamentals on the S&P 500 are economically related to earnings and thus not offering an interesting model driven by external variables from the companies themselves.

In the final model, we switched from aggregate fundamental data to time series on the US economy or financial markets other than the equity market. We also changed the earnings yield from 12-month trailing to 12-month forward because this variable is more stable, and the forward-looking nature of the variable is also more interesting and how the equity market operates. We started out with a simple linear regression, but since we are modelling the earnings yield and not changes in the earnings yield we could not get rid of the autocorrelation in the residuals, which is a key violation of the linear regression model assumptions. We therefore ended up with a random forest model which is a less strict model in terms of assumptions of residuals and the underlying distribution of the data. Our final model consists of 25 features describing different aspects of the US economy and financial markets.

From the random forest model we can compute the feature importance and based on the model output the features (ordered with the most important at the top) below are the ones that explain 50% of S&P 500 12-month forward earnings yield. The two most important features are the NAHB Index taking the temperature in the US housing market and consumer confidence. These two indicators remain currently above their historic average, but both are at risk with tighter financial conditions (and higher mortgage rates) and rising inflation putting pressure on consumers. The third most important feature in explaining the S&P 500 earnings yield is the yearly change in US home prices. In other words, the US housing market is very important for US equity valuations.

  • National Association of Home Builders Market Index
  • Conference Board Consumer Confidence
  • S&P CoreLogic Case-Shiller US National Home Price Index YoY
  • US Avg Hourly Earnings Private NFP YoY
  • Fed M2 YoY
  • US U-6 Unemployment Rate
  • Net % of Domestic Respondents Tightening Standards on loans for Large companies
  • US 2-year yield
Source: Bloomberg

Is the S&P 500 earnings yield at fair value?

Based on the model fit we can see whether the current 12-month earnings yield on the S&P 500 makes sense given the US economic backdrop. The current 12-month forward earnings yield on the S&P 500 is 5.15% or 19.4 in P/E terms and the model says the earnings yield should be 5.31% or 18.8 in P/E, based on the historical relationship between the earnings yield and the features, which is a small mispricing of 3%. In other words, given the current macro indicators the S&P 500 is correctly priced as you would expect is an efficient market.

What happens if we make a new prediction given that we change the most important features to some new values that are mostly in a worse direction?

  • National Association of Home Builders Market Index (from 79 to 70)
  • Conference Board Consumer Confidence (from 107.2 to 100)
  • S&P CoreLogic Case-Shiller US National Home Price Index YoY (from 19.2 to 10)
  • US Avg Hourly Earnings Private NFP YoY (from 6.7 to 5)
  • Fed M2 YoY (from 11 to 7)
  • US U-6 Unemployment Rate (from 6.9 to 6.5)
  • Net % of Domestic Respondents Tightening Standards on loans for Large companies (from -14.5 to 0)
  • US 2-year yield (unchanged at 2.5)

Based on the above changes holding the other variables constant, the model would predict an earnings yield of 18.2 or 6% below the current earnings yield.

Overreactions in the equity market

What is the most interesting about modelling the earnings yield on the S&P 500 with macro variables is that the earnings yield is consistently below the model’s earnings yield during the dot-com bubble period and the recent pandemic. The US equity market during these two periods is reflecting something else than the underlying macro indicators. Both periods were driven by excess investor sentiment and optimism leading to an overreaction relative to the economy. While the difference between the actual earnings yield and the model’s earnings yield is persistently negative over longer periods during sentiment-driven periods of optimism, the difference also exhibits short-lived spikes on the upside (the earnings yield being higher than the predicted value by the model).

There are four distinct periods where the equity market overreacts with a too high earnings yield relative to the macro backdrop and those are in late 2002 to early 2003 before the equity market bottoms out for good post the dot-com collapse, 2008-2009 during the financial crisis, late 2011 during the euro crisis, and again during in late 2018 during the Fed’s policy mistake on rates as the economy was deteriorating. In these periods the equity market is often driven by risk reductions and liquidity constraints accelerating selloffs more than what is warranted by economic data.

The important features are constantly changing

The final model is a random forest with its hyperparameters optimized using cross-validation. The model fit is based on the in-sample data using these optimized parameters. The idea is to explain the variance and not make predictions on future values of the earnings yield. In the cross-validation the model error is considerably larger (three times larger) than the errors seen in the in-sample fit (actual earnings yield vs the model’s earnings yield). What we see in the data is that the model’s ability to explain the variance in the earnings yield rapidly deteriorates after the model fit, which is not surprising.

The factors driving the earnings yield are time-varying and dynamic making the model inherently unstable. This means that the conclusions in this equity note are valid as of today but will begin changing over the next year. The US housing market has played a bigger role in the US economy since 1994 compared to the period before 1994, which likely explains its importance in explaining the earnings yield in the period 1994-2022. We expect other variables to grow in importance over time.


The Saxo Bank Group entities each provide execution-only service and access to Analysis permitting a person to view and/or use content available on or via the website. This content is not intended to and does not change or expand on the execution-only service. Such access and use are at all times subject to (i) The Terms of Use; (ii) Full Disclaimer; (iii) The Risk Warning; (iv) the Rules of Engagement and (v) Notices applying to Saxo News & Research and/or its content in addition (where relevant) to the terms governing the use of hyperlinks on the website of a member of the Saxo Bank Group by which access to Saxo News & Research is gained. Such content is therefore provided as no more than information. In particular no advice is intended to be provided or to be relied on as provided nor endorsed by any Saxo Bank Group entity; nor is it to be construed as solicitation or an incentive provided to subscribe for or sell or purchase any financial instrument. All trading or investments you make must be pursuant to your own unprompted and informed self-directed decision. As such no Saxo Bank Group entity will have or be liable for any losses that you may sustain as a result of any investment decision made in reliance on information which is available on Saxo News & Research or as a result of the use of the Saxo News & Research. Orders given and trades effected are deemed intended to be given or effected for the account of the customer with the Saxo Bank Group entity operating in the jurisdiction in which the customer resides and/or with whom the customer opened and maintains his/her trading account. Saxo News & Research does not contain (and should not be construed as containing) financial, investment, tax or trading advice or advice of any sort offered, recommended or endorsed by Saxo Bank Group and should not be construed as a record of our trading prices, or as an offer, incentive or solicitation for the subscription, sale or purchase in any financial instrument. To the extent that any content is construed as investment research, you must note and accept that the content was not intended to and has not been prepared in accordance with legal requirements designed to promote the independence of investment research and as such, would be considered as a marketing communication under relevant laws.

Please read our disclaimers:
Notification on Non-Independent Investment Research (
Full disclaimer (
Full disclaimer (

Saxo Bank (Schweiz) AG
The Circle 38

Contact Saxo

Select region


All trading carries risk. Losses can exceed deposits on margin products. You should consider whether you understand how our products work and whether you can afford to take the high risk of losing your money. To help you understand the risks involved we have put together a general Risk Warning series of Key Information Documents (KIDs) highlighting the risks and rewards related to each product. The KIDs can be accessed within the trading platform. Please note that the full prospectus can be obtained free of charge from Saxo Bank (Switzerland) ltd. or the issuer.

This website can be accessed worldwide however the information on the website is related to Saxo Bank (Switzerland) Ltd. All clients will directly engage with Saxo Bank (Switzerland) Ltd. and all client agreements will be entered into with Saxo Bank (Switzerland) Ltd. and thus governed by Swiss Law.

The content of this website represents marketing material and has not been notified or submitted to any supervisory authority.

If you contact Saxo Bank (Switzerland) Ltd. or visit this website, you acknowledge and agree that any data that you transmit to Saxo Bank (Switzerland) Ltd., either through this website, by telephone or by any other means of communication (e.g. e-mail), may be collected or recorded and transferred to other Saxo Bank Group companies or third parties in Switzerland or abroad and may be stored or otherwise processed by them or Saxo Bank (Switzerland) Ltd. You release Saxo Bank (Switzerland) Ltd. from its obligations under Swiss banking and securities dealer secrecies and, to the extent permitted by law, data protection laws as well as other laws and obligations to protect privacy. Saxo Bank (Switzerland) Ltd. has implemented appropriate technical and organizational measures to protect data from unauthorized processing and disclosure and applies appropriate safeguards to guarantee adequate protection of such data.

Apple, iPad and iPhone are trademarks of Apple Inc., registered in the U.S. and other countries. App Store is a service mark of Apple Inc.