Machine Learning Classification and Portfolio Allocation: with Implications from Machine Uncertainty
Machine Learning Classification and Portfolio Allocation: with Implications from Machine Uncertainty
This paper pioneers the use of multi-class machine learning classifiers for cross-sectional stock return prediction, framing the problem as a classification task rather than the traditional regression. The authors employ Artificial Neural Networks, Random Forest, and Gradient Boosting Trees to assign stocks to three categories: outperformers (top decile), underperformers (bottom decile), and midperformers. The resulting long-short portfolios, which buy predicted outperformers and sell underperformers, deliver exceptional out-of-sample performance with annual Sharpe ratios of 1.67 (value-weighted) and 3.35 (equal-weighted), and annual alphas ranging from 29% to 48%. These results are robust to controlling for machine learning regressions and focusing on large-cap stocks, and they demonstrate that classification models provide complementary information to regression-based approaches.
A key innovation is the introduction of 'machine uncertainty,' measured as the information entropy of predicted probabilities across return states. This metric quantifies the model's assessment of information scarcity. Using Fama-MacBeth regressions, the authors show that higher machine uncertainty significantly reduces prediction correctness: a one-bit increase leads to a 9% decline in correct predictions. Moreover, machine uncertainty negatively predicts future stock returns in the cross-section, with a per-bit increase associated with a 1.2% decrease in annual returns. This effect is primarily driven by past underperformers, consistent with theories of slow information diffusion and investor inattention. The study also finds that the negative impact of machine uncertainty on prediction accuracy is amplified when it aligns with human proxies of information uncertainty, such as analyst forecast dispersion.
The paper contributes to the machine learning and asset pricing literature by demonstrating the viability and economic value of classification-based return prediction, and by providing a novel measure of machine uncertainty that sheds light on the information-return relationship. The findings suggest that machine learning classifiers can capture nonlinear patterns and state-dependent dynamics that regressions may miss, offering practical implications for portfolio management and risk assessment.
Highlights
- 1Frames cross-sectional return prediction as a multi-class classification problem, outperforming traditional regression approaches.
- 2Long-short portfolios based on classifiers achieve annual Sharpe ratios of 1.67 (value-weighted) and 3.35 (equal-weighted) with alphas of 29-48%.
- 3Introduces machine uncertainty (predicted probability entropy) as a novel measure of information scarcity that impairs prediction accuracy.
- 4Machine uncertainty negatively predicts stock returns, especially for past underperformers, consistent with information diffusion theories.
- 5Classification and regression models provide complementary information, with ensemble predictions enhancing value-weighted strategies.
Methods
- MMulti-class classification using Artificial Neural Networks (ANN), Random Forest (RF), and Gradient Boosting Trees (GBT) with cross-entropy loss.
- MMachine learning regression benchmarks using the same architectures with mean squared error loss.
- MFama-MacBeth regressions to analyze the impact of machine uncertainty on prediction correctness and stock returns.
- MPortfolio construction based on predicted probabilities of outperformance and underperformance, with value-weighted and equal-weighted schemes.
Results
- RValue-weighted long-short portfolio yields annual Sharpe ratio of 1.67 and alpha of 29-48%.
- REqual-weighted long-short portfolio yields annual Sharpe ratio of 3.35 and alpha of 29-48%.
- RA one-bit increase in machine uncertainty reduces prediction correctness by 9%.
- RMachine uncertainty negatively predicts stock returns: a per-bit increase reduces annual returns by 1.2%.
- RThe negative return effect is driven by past underperformers; machine uncertainty amplifies momentum-like patterns.
Analyze Paper
Generate insights from "Machine Learning Classification and Portfolio Allocation: wi...".