InvestLM: A Large Language Model for Investment using Financial Domain Instruction Tuning
InvestLM: A Large Language Model for Investment using Financial Domain Instruction Tuning
This paper introduces InvestLM, a large language model specifically designed for financial investment applications, built by instruction tuning the LLaMA-65B foundation model. The key innovation lies in the manual curation of a small but diverse instruction dataset, drawing from sources such as Chartered Financial Analyst (CFA) exam questions, SEC filings, and Stackexchange quantitative finance discussions. This approach is inspired by the 'less-is-more-for-alignment' principle and aligns with the Superficial Alignment Hypothesis, demonstrating that high-quality domain-specific models can be developed with minimal, carefully selected data rather than massive datasets.
InvestLM exhibits strong performance in understanding financial texts and providing investment-related advice, as validated through evaluations by financial experts including hedge fund managers and research analysts. These experts rated its responses as comparable to leading commercial models like GPT-3.5, GPT-4, and Claude-2. Additionally, zero-shot testing on financial NLP benchmarks confirms the model's generalizability. From a research perspective, this work contributes to the field by supporting efficient domain adaptation strategies for LLMs. Practically, it offers a state-of-the-art tool that could enhance the productivity of financial professionals, with the model parameters being released to the research community to encourage further exploration and application.
Highlights
- 1Development of InvestLM, a domain-specific large language model for financial investment using instruction tuning on LLaMA-65B
- 2Manual curation of a small, diverse instruction dataset covering financial topics like CFA exams, SEC filings, and quantitative finance discussions
- 3Demonstration that high-quality domain-specific LLMs can be built with minimal data, aligning with the Superficial Alignment Hypothesis
- 4Superior performance in financial text understanding and investment advice, rated comparable to state-of-the-art commercial models by experts
- 5Release of model parameters to the research community to foster further development and application
Methods
- MInstruction tuning on LLaMA-65B foundation model using a manually curated dataset
- MManual curation of a diverse instruction dataset from sources including CFA exam questions, SEC filings, and Stackexchange discussions
- MEvaluation through expert ratings by hedge fund managers and research analysts comparing to GPT-3.5, GPT-4, and Claude-2
- MZero-shot evaluation on financial NLP benchmarks to assess generalizability
Results
- RInvestLM shows strong capabilities in understanding financial text and providing helpful responses to investment-related questions
- RFinancial experts rate InvestLM's responses as comparable to state-of-the-art commercial models like GPT-3.5, GPT-4, and Claude-2
- RZero-shot evaluation on financial NLP benchmarks demonstrates strong generalizability of the model
- RThe work supports the Superficial Alignment Hypothesis, showing effective domain adaptation with minimal data
- RInvestLM is released as a state-of-the-art financial domain LLM with potential to enhance efficiency for financial professionals
Analyze Paper
Generate insights from "InvestLM: A Large Language Model for Investment using Financ...".