FinEAS: Financial Embedding Analysis of Sentiment

—

FinEAS: Financial Embedding Analysis of Sentiment

Asier Gutiérrez-Fandiño
Miquel Noguer i Alonso
Petter Kolm
Jordi Armengol-Estapé
Published on 10/31/2021
Equities
AI
Sentiment
Machine learning

The paper introduces FinEAS (Financial Embedding Analysis of Sentiment), a model for financial sentiment analysis that leverages supervised fine-tuned sentence embeddings from Sentence-BERT. The authors argue that financial sentiment is a sentence-level task, and vanilla BERT's sentence embeddings are suboptimal. FinEAS uses a Sentence-BERT backbone (fine-tuned on NLI) to produce high-quality sentence embeddings, which are then fed into a linear layer with tanh activation for regression to continuous sentiment scores between -1 and 1.

Experiments are conducted on a large-scale RavenPack financial news dataset with three temporal splits (6, 12, and 24 months) and an out-of-sample two-week test set. FinEAS is compared against vanilla BERT, BiLSTM, and FinBERT (a domain-specific BERT). Results show that FinEAS significantly outperforms all baselines in terms of MSE. Notably, FinEAS with full fine-tuning achieves MSE of 0.0044 on 6-month data versus FinBERT's 0.0050, demonstrating that general-domain sentence embeddings can surpass domain-specific models for this task. The findings suggest that for financial sentiment analysis, the quality of sentence-level embeddings is more critical than domain-specific vocabulary or structure.

The paper concludes that FinEAS is a simple, effective, and robust approach for financial sentiment analysis, and it makes the code and model weights publicly available. Future work may explore other Transformer models fine-tuned for sentence or document-level tasks in finance.

Highlights

  • 1Proposes FinEAS, a novel financial sentiment analysis model based on supervised fine-tuned sentence embeddings from Sentence-BERT.
  • 2Demonstrates that general-domain sentence embeddings outperform domain-specific BERT (FinBERT) for financial sentiment analysis.
  • 3Achieves significant improvements in MSE over vanilla BERT, BiLSTM, and FinBERT on a large-scale RavenPack dataset.
  • 4Shows robust out-of-sample performance on a two-week holdout set across multiple time frames.
  • 5Provides publicly available code and model weights for reproducibility.

Methods

  • M
    Supervised fine-tuning of Sentence-BERT (Siamese BERT network) for sentence embeddings.
  • M
    Regression head with linear layer and tanh activation to predict continuous sentiment scores from -1 to 1.
  • M
    Comparison with baselines: vanilla BERT (frozen), BiLSTM, and FinBERT (full fine-tuning).
  • M
    Training on large-scale RavenPack financial news dataset with three temporal splits (6, 12, 24 months).

Results

  • R
    FinEAS with frozen backbone achieves MSE of 0.0556 on 6-month data, compared to 0.2124 for BERT and 0.2108 for BiLSTM.
  • R
    FinEAS with full fine-tuning achieves MSE of 0.0044 on 6-month data, outperforming FinBERT (0.0050).
  • R
    Consistent improvements across all time frames (6, 12, 24 months) and on out-of-sample two-week test sets.
  • R
    Vanilla BERT performs similarly to BiLSTM, indicating poor sentence embeddings for financial sentiment.
0/5

Analyze Paper

Generate insights from "FinEAS: Financial Embedding Analysis of Sentiment".

Suggested Actions