arXivLLMs & Text

Revealing economic facts: LLMs know more than they say

The research investigates the use of hidden states in large language models to estimate and fill in economic and financial statistics, showing that a simple linear model trained on these hidden states performs better than the models' text outputs and requires minimal labelled examples for training.