FactorEngine: A Program-level Knowledge-Infused Factor Mining Framework for Quantitative Investment
FactorEngine: A Program-level Knowledge-Infused Factor Mining Framework for Quantitative Investment
FactorEngine (FE) is a novel program-level factor mining framework for quantitative investment that addresses key limitations of existing symbolic and neural approaches. Unlike prior methods that rely on bounded symbolic expressions or black-box neural networks, FE represents factors as Turing-complete Python programs, enabling complex control flows and higher-order feature interactions. The framework introduces a macro-micro co-evolution mechanism: macro-level logic mutations are guided by LLM agents using chain-of-experience (CoE) from historical trajectories, while micro-level parameter optimization is handled by Bayesian search on local computational resources. This separation of concerns significantly improves efficiency and avoids local optima. Additionally, FE incorporates a knowledge-infused bootstrapping module that extracts factor ideas from unstructured financial reports through a multi-agent pipeline (PDF processing, factor extraction, code generation), transforming domain knowledge into executable seed factors.
Extensive experiments on real-world CSI300 and CSI500 market data demonstrate that FE achieves state-of-the-art predictive and portfolio performance. With 400 iterations, FE-report achieves an IC of 0.0474 and excess annual return of 18.99% on CSI300, outperforming baselines like AlphaAgent and RD-Agent by substantial margins. FE also produces more diverse factors with lower redundancy and exhibits slower alpha decay over time. Ablation studies confirm the effectiveness of Bayesian micro-search, multi-island evolution, and CoE guidance. The framework is computationally efficient, with 99% executable ratio and low API costs. Overall, FactorEngine provides a scalable, interpretable, and high-performing solution for automated alpha factor discovery.
Highlights
- 1Proposes FactorEngine (FE), a program-level factor mining framework that represents factors as Turing-complete code, overcoming the bounded expressiveness of symbolic approaches.
- 2Introduces macro-micro co-evolution, decoupling logic evolution (LLM-guided) from parameter optimization (Bayesian search), improving efficiency and avoiding local optima.
- 3Develops a knowledge-infused bootstrapping module that transforms unstructured financial reports into executable factor programs via a closed-loop multi-agent pipeline.
- 4Achieves state-of-the-art predictive and portfolio performance, with up to 58% improvement in IC and 126% increase in excess annual return over Alpha158 on CSI300.
- 5Demonstrates superior factor diversity and reduced alpha decay compared to existing agent-based methods like AlphaAgent and RD-Agent.
Methods
- MProgram-level factor evolution with macro (LLM-driven logic mutation) and micro (Bayesian hyperparameter optimization) co-evolution.
- MMulti-agent bootstrapping pipeline: PDF processing, factor extraction with iterative reflection, and code generation with structural validation.
- MTree-structured search with Upper Confidence Bound for Trees (UCT) selection and chain-of-experience (CoE) guidance for trajectory-aware refinement.
- MMulti-island evolution with periodic migration to enhance exploration diversity and efficiency.
Results
- RFE achieves highest IC (0.0474), ICIR (0.3185), and excess annual return (18.99%) on CSI300 with 400 iterations, outperforming all baselines.
- ROn CSI500, FE achieves IC of 0.0536 and excess annual return of 8.36%, with Sharpe ratio of 0.2945.
- RFE-report (bootstrapped from reports) consistently outperforms FE-alpha (bootstrapped from manual factors) across all metrics.
- RFE generates more diverse factors (57.1% keep ratio) with lower redundancy, as shown by MDS analysis and Radius of Gyration.
- RFE exhibits slower alpha decay over time, maintaining higher IC and Rank IC compared to AlphaAgent and RD-Agent from 2017 to 2024.
Analyze Paper
Generate insights from "FactorEngine: A Program-level Knowledge-Infused Factor Minin...".