High-Dimensional Estimation, Basis Assets, and the Adaptive Multi-Factor Model

—

High-Dimensional Estimation, Basis Assets, and the Adaptive Multi-Factor Model

Liao Zhu
Sumanta Basu
Robert A. Jarrow
Martin T. Wells
Published on 4/23/2018
Equities
Factor investing
Machine learning
Asset class picking

The paper introduces the Adaptive Multi-Factor (AMF) model, derived from the generalized Arbitrage Pricing Theory (APT), which relaxes the assumption of a small number of risk-factors. To estimate this model, the authors propose the Groupwise Interpretable Basis Selection (GIBS) algorithm, a hybrid high-dimensional method that first uses minimax prototype clustering to group correlated basis assets (e.g., ETFs) and select representative prototypes, then applies LASSO regression with the 1se rule to identify sparse, stock-specific basis assets. This approach addresses the challenges of high-dimensionality (p > n) and multicollinearity, yielding interpretable and tradeable basis assets.

Empirically, using weekly returns over three-year windows, the AMF model is tested against the Fama-French 5-factor (FF5) model on a large cross-section of stocks. The results show that the AMF model has fewer significant intercepts (alphas), suggesting consistency with no-arbitrage, and significantly higher in-sample and out-of-sample R² values (58% improvement in prediction). The GIBS algorithm selects 186 basis assets, with each stock linked to only 3.4 on average, confirming sparsity. Additionally, 78% of these basis assets earn significant risk premiums, identifying them as risk-factors. The paper also demonstrates that positive alpha strategies do not yield arbitrage, supporting the model's validity. Comparisons with alternative methods (e.g., Elastic Net, standard LASSO) show GIBS's superior performance in prediction and interpretability.

Highlights

  • 1Proposes the Groupwise Interpretable Basis Selection (GIBS) algorithm for high-dimensional financial data.
  • 2Introduces the Adaptive Multi-Factor (AMF) model based on the generalized Arbitrage Pricing Theory.
  • 3Demonstrates superior fitting and prediction power over the Fama-French 5-factor model.
  • 4Identifies 186 basis assets, with each stock linked to only 3.4 on average, supporting sparsity.
  • 5Shows that 78% of basis assets earn significant risk premiums, acting as risk-factors.

Methods

  • M
    Groupwise Interpretable Basis Selection (GIBS) algorithm combining prototype clustering and LASSO.
  • M
    Minimax prototype clustering to reduce correlation among basis assets.
  • M
    LASSO regression with 1se rule for variable selection and sparsity control.
  • M
    Ordinary Least Squares (OLS) post-selection for intercept and goodness-of-fit tests.

Results

  • R
    AMF model yields fewer significant alphas (4.12%) compared to FF5 (6.33%), with both failing to reject zero intercept under FDR.
  • R
    AMF model achieves substantially higher in-sample adjusted R² and 58% improvement in out-of-sample R² over FF5.
  • R
    Positive alpha trading strategies do not generate arbitrage opportunities, confirming model validity.
  • R
    Each stock is associated with an average of 3.4 basis assets (range 1-10), supporting sparsity.
  • R
    78% of the 186 selected basis assets earn significant risk premiums, identifying them as risk-factors.
0/5

Analyze Paper

Generate insights from "High-Dimensional Estimation, Basis Assets, and the Adaptive ...".

Suggested Actions