Machine learningLLMs & Text

LongVILA: Scaling Long-Context Visual Language Models for Long Videos

The authors present LongVILA, a solution for long-context vision-language models, which includes a system for Multi-Modal Sequence Parallelism, a five-stage training pipeline, and large-scale pre-training datasets, improving performance on long videos.