FinGPT: Democratizing Internet-scale Data for Financial Large Language Models

—

FinGPT: Democratizing Internet-scale Data for Financial Large Language Models

Xiao-Yang Liu
Guoxuan Wang
Hongyang Yang
Daochen Zha
Published on 7/19/2023
Equities
Stocks
Cross-asset
AI
LLM
Machine learning
Reinforcement learning
Sentiment
Sentiment trading
Stock picking

FinGPT addresses a critical gap in financial AI by introducing an open-source framework for developing financial large language models (FinLLMs). The research identifies that existing LLMs underperform in financial applications due to disparities between general text data and financial text data, compounded by limited available datasets and the closed-source nature of pioneering models like BloombergGPT. To overcome these challenges, FinGPT automates the collection and curation of real-time financial data from 34 diverse internet sources, providing researchers and practitioners with accessible, transparent resources for FinLLM development.

The framework incorporates several innovative methodologies including Reinforcement Learning with Stock Prices (RLSP) for fine-tuning models using inherent market feedback, and Low-rank Adaptation (LoRA/QLoRA) techniques that enable low-cost customization of general-purpose LLMs into specialized FinLLMs. The paper demonstrates FinGPT's practical applications in robo-advisory services, sentiment analysis for algorithmic trading, and low-code development environments. By open-sourcing the complete implementation, FinGPT aims to democratize access to financial AI, stimulate innovation in the field, and unlock new opportunities in open finance by making sophisticated financial language models more accessible and customizable.

Highlights

  • 1Introduces FinGPT, an open-source framework for democratizing financial large language models (FinLLMs)
  • 2Automates collection and curation of real-time financial data from 34 diverse internet sources
  • 3Proposes Reinforcement Learning with Stock Prices (RLSP) for fine-tuning using market feedback
  • 4Enables low-cost customization of FinLLMs using Low-rank Adaptation (LoRA/QLoRA) methods
  • 5Demonstrates practical applications including robo-advisors, sentiment analysis, and low-code development

Methods

  • M
    Automated data pipeline for real-time financial data collection and curation
  • M
    Reinforcement Learning with Stock Prices (RLSP) for market-based fine-tuning
  • M
    Low-rank Adaptation (LoRA/QLoRA) for efficient model customization
  • M
    Multi-source data integration from 34 diverse financial information sources

Results

  • R
    Created an open-source framework that addresses data scarcity and accessibility issues in financial LLMs
  • R
    Developed effective strategies for handling low signal-to-noise ratio and high time-validity in financial data
  • R
    Enabled cost-effective customization of FinLLMs from general-purpose LLMs
  • R
    Demonstrated practical viability through multiple financial applications
  • R
    Released complete open-source implementation to foster innovation in open finance
0/5

Analyze Paper

Generate insights from "FinGPT: Democratizing Internet-scale Data for Financial Larg...".

Suggested Actions