The Enhanced Physics-Informed Kolmogorov-Arnold Networks: Applications of Newton's Laws in Financial Deep Reinforcement Learning (RL) Algorithms

—

The Enhanced Physics-Informed Kolmogorov-Arnold Networks: Applications of Newton's Laws in Financial Deep Reinforcement Learning (RL) Algorithms

Trang Thoi
Hung Tran
Tram Thoi
Huaiyang Zhong
Published on 2/1/2026
Equities
China
United States (US)
Reinforcement learning
Deep learning
Machine learning
Risk management

This paper introduces a novel deep reinforcement learning framework for portfolio optimization that integrates Physics-Informed Kolmogorov-Arnold Networks (PIKANs). The core innovation lies in replacing traditional multilayer perceptrons (MLPs) with Kolmogorov-Arnold Networks (KANs) in both actor and critic components, which use learnable B-spline univariate functions for parameter-efficient and interpretable function approximation. Additionally, a physics-informed regularization loss based on Newton's second law is incorporated during actor updates. This loss enforces second-order temporal consistency by penalizing discrepancies between observed market acceleration (derived from return changes) and the acceleration implied by the agent's portfolio actions (treated as forces). The framework is evaluated on three equity markets—the United States (S&P 100), Vietnam (VN100), and China (CSI 300)—using historical daily data from 2015 to 2025. Experimental results demonstrate that PIKAN-enhanced versions of A2C, DDPG, PPO, and TD3 consistently outperform their standard counterparts and classical online portfolio selection methods. The PIKAN agents achieve higher cumulative and annualized returns, superior Sharpe and Calmar ratios, and more favorable drawdown characteristics, indicating more stable training and better risk-adjusted performance. The approach is particularly effective in highly dynamic and noisy financial markets, where conventional DRL often suffers from instability and poor generalization. The work bridges physics-informed machine learning and financial reinforcement learning, offering a structured inductive bias that improves policy learning and portfolio performance.

Highlights

  • 1Proposes a novel physics-informed DRL framework (PIKAN) for portfolio optimization by integrating Newton's second law as a regularization loss.
  • 2Replaces standard MLPs with Kolmogorov-Arnold Networks (KANs) in actor-critic architectures for parameter-efficient and interpretable function approximation.
  • 3Achieves superior risk-adjusted returns (Sharpe, Calmar ratios) and lower drawdowns across US, Vietnam, and China equity markets compared to DRL baselines and classical methods.
  • 4Introduces adaptive weighting and normalization of the physics loss to stabilize training in noisy financial environments.

Methods

  • M
    Physics-Informed Kolmogorov-Arnold Networks (PIKANs): KANs with learnable B-spline univariate functions replace MLPs in actor and critic networks.
  • M
    Newton's Second Law Regularization: A physics loss penalizes discrepancies between observed acceleration (from return changes) and predicted acceleration (action/mass), enforcing second-order temporal consistency.
  • M
    Adaptive Loss Weighting: Exponential moving averages normalize the physics loss; adaptive lambda balances RL and physics objectives based on their magnitudes.
  • M
    DRL Algorithms Enhanced: A2C, DDPG, PPO, and TD3 are augmented with the physics-informed loss and KAN architecture.

Results

  • R
    PIKAN-based agents consistently outperform standard DRL (A2C, DDPG, PPO, TD3) and classical online portfolio selection methods across all three markets.
  • R
    Higher cumulative and annualized returns, superior Sharpe and Calmar ratios, and more favorable drawdown characteristics are observed.
  • R
    The physics-informed regularization leads to more stable training and better generalization in volatile market conditions.
  • R
    KAN-based models achieve parameter efficiency and improved interpretability compared to MLP-based counterparts.
0/5

Analyze Paper

Generate insights from "The Enhanced Physics-Informed Kolmogorov-Arnold Networks: Ap...".

Suggested Actions