FinDeepForecast: A Live Multi-Agent System for Benchmarking Deep Research Agents in Financial Forecasting
FinDeepForecast: A Live Multi-Agent System for Benchmarking Deep Research Agents in Financial Forecasting
FinDeepForecast introduces the first live, end-to-end multi-agent system for benchmarking deep research (DR) agents in financial forecasting. The system features a dual-track taxonomy that dynamically generates both recurrent (e.g., quarterly earnings) and non-recurrent (e.g., M&A impact) forecasting tasks at corporate and macro levels. Using this system, the authors create FinDeepForecastBench, a weekly evaluation benchmark spanning ten weeks, covering 8 global economies and 1,314 listed companies. They evaluate 13 representative methods, including state-of-the-art DR agents and traditional baselines.
Extensive experiments reveal that DR agents consistently outperform strong baselines, demonstrating their potential in research-oriented financial tasks. However, their performance still falls short of genuine forward-looking financial reasoning, indicating room for improvement. The benchmark and leaderboard are publicly available on the OpenFinArena platform, providing a standardized testbed for future advancements in financial forecasting with AI agents.
Highlights
- 1First live, end-to-end multi-agent system for automatically evaluating deep research agents in financial forecasting.
- 2Dual-track taxonomy enabling dynamic generation of recurrent and non-recurrent forecasting tasks at corporate and macro levels.
- 3Weekly evaluation benchmark over ten weeks covering 8 global economies and 1,314 listed companies.
- 4Comprehensive evaluation of 13 representative methods, showing DR agents outperform strong baselines but still lack genuine forward-looking reasoning.
Methods
- MMulti-agent system with dual-track taxonomy for task generation.
- MLive evaluation pipeline with weekly benchmark updates.
- MComparison of 13 methods including DR agents and baselines.
Results
- RDR agents consistently outperform strong baselines across all tasks.
- RPerformance of DR agents still falls short of genuine forward-looking financial reasoning.
- RBenchmark covers 8 global economies and 1,314 listed companies over ten weeks.
- RRecurrent tasks (e.g., earnings forecasts) are more challenging than non-recurrent ones.
Analyze Paper
Generate insights from "FinDeepForecast: A Live Multi-Agent System for Benchmarking ...".