RETuning: Upgrading Inference-Time Scaling for Stock Movement Prediction with Large Language Models

—

RETuning: Upgrading Inference-Time Scaling for Stock Movement Prediction with Large Language Models

Xueyuan Lin
Cehao Yang
Ye Ma
Ming Li
Rongjunchen Zhang
Yang Ni
Xiaojun Wu
Chengjin Xu
Jian Guo
Hui Xiong
Published on 10/24/2025
Equities
Stocks
China
LLM
AI
Machine learning
Stock picking
Sentiment
Event Driven
Fundamental analysis

The paper introduces RETuning, a two-stage framework to enhance LLMs for stock movement prediction (SMP). In the first stage, supervised fine-tuning (SFT) teaches the model to generate structured chain-of-thought reasoning: dynamically constructing an analytical framework from diverse information sources, scoring evidence for price up/down/hold, and reflecting before making a prediction. This cold-start approach addresses the observed issues that LLMs tend to parrot analysts' opinions and fail to weigh adversarial evidence. The second stage applies rule-based reinforcement learning (GRPO) with reward shaping (format, accuracy, consistency) and curriculum learning that focuses training on medium-difficulty samples, which are identified by the cold-start model's prediction consistency.

The authors also construct Fin-2024, a large-scale dataset covering 5,123 A-share stocks across all of 2024, with over 200K samples and 32K-token contexts integrating news, fundamentals, analyst opinions, quantitative reports, macroeconomic indicators, and similar stocks. Experiments show that RETuning significantly outperforms existing LLMs and specialized SMP models, achieving F1 scores of 0.4196 (14B) and 0.4071 (32B) on the December 2024 test set. The method enables inference-time scaling via majority voting, with monotonic improvements up to 8–16 repeated samples. RETuning also generalizes to out-of-distribution stocks, future dates (6 months later), and other financial tasks on BizFinBench, demonstrating broad transferability. The work establishes that structured reasoning fine-tuning and reinforcement learning can unlock LLMs' predictive capabilities in finance, paving the way for trustworthy, reasoning-driven financial AI.

Highlights

  • 1Proposes RETuning, a cold-start method that guides LLMs to construct analytical frameworks, collect and score evidence, and reflect before predicting stock movements.
  • 2Constructs Fin-2024, a large-scale (200K+ samples, 32K tokens) long-context dataset with six heterogeneous information sources for A-share stocks.
  • 3Demonstrates that RETuning unlocks inference-time scaling for stock movement prediction, with monotonic improvements up to 8–16 repeated samples.
  • 4Shows strong generalization to out-of-distribution stocks, future dates (6 months later), and other financial tasks on BizFinBench.
  • 5Achieves state-of-the-art F1 scores (0.4196 on 14B, 0.4071 on 32B) on Fin-2024[December], significantly outperforming existing LLMs and specialized models.

Methods

  • M
    Reflective Evidence Tuning (RETuning): a two-stage framework with supervised fine-tuning (SFT) on structured reasoning chains followed by rule-based reinforcement learning (GRPO) with reward shaping and curriculum learning.
  • M
    Generative reasoning modeling: LLMs are trained to produce chain-of-thought responses that dynamically construct an analytical framework, score evidence for up/down/hold, and reflect before prediction.
  • M
    Inference-time scaling via majority voting over repeated generations (n=1 to 32) with temperature 0.6.
  • M
    Curriculum learning: samples are categorized into easy/medium/hard based on cold-start model prediction consistency; only medium-difficulty samples are used for RL training.

Results

  • R
    RETuning (SFT+GRPO) improves F1 score by 20.75% (14B) and 14.13% (32B) over instruct baselines on Fin-2024[December], outperforming all baselines including GPT-OSS-120B.
  • R
    Inference-time scaling yields monotonic improvements up to n≈8–16; gains plateau or regress beyond that.
  • R
    RETuning generalizes to out-of-distribution stocks, future dates (Fin-2025[June]), and combined OOD settings, maintaining scaling benefits.
  • R
    On BizFinBench, RETuning improves average score by +7.46 (14B) and +4.12 (32B) over instruct baselines, achieving top-3 results on multiple tasks.
  • R
    Ablation shows SFT is critical: GRPO alone underperforms, while SFT+GRPO yields substantial gains; CoT prompting alone gives limited benefits.
0/5

Analyze Paper

Generate insights from "RETuning: Upgrading Inference-Time Scaling for Stock Movemen...".

Suggested Actions