Machine learningLLMs & Text

SliceGPT: Compress Large Language Models by Deleting Rows and Columns

Compressing Language Models: The paper introduces SliceGPT, a post-training sparsification scheme for large language models that reduces the network's embedding dimension, maintains high performance, reduces inference computation, and reveals computational invariance in transformer networks.