xGen-MM (BLIP-3):一类开放式大型多模态模型

xGen-MM (BLIP-3): A Family of Open Large Multimodal Models

GitHub - salesforce/LAVIS at xgen-mm  |  2408.08872 (arxiv.org)

Abstract

This report introduces xGen-MM (also known as BLIP-3), a framework for developing Large Multimodal Models (LMMs). The framework comprises meticulously curated datasets, a training recipe, model architectures, and a resulting suite of LMMs. xGen-MM, short for xGen-MultiModal, expands the Salesforce xGen initiative on foundation AI models. Our models undergo rigorous evaluation across a range of tasks, i