https://coobiw.github.io/project/ Projects Hugo Blox Builder (https://hugoblox.com)en-usThu, 10 Oct 2024 00:00:00 +0000 https://coobiw.github.io/media/icon_hu_557f799f97e4e28d.png https://coobiw.github.io/project/ https://coobiw.github.io/project/aria/ Thu, 10 Oct 2024 00:00:00 +0000 https://coobiw.github.io/project/aria/ <p>Aria is a multimodal native MoE model. It features：1️⃣State-of-the-art performance on various multimodal and language tasks, superior in video and document understanding; 2️⃣Long multimodal context window of 64K tokens; 3️⃣3.9B activated parameters per token, enabling fast inference speed and low fine-tuning cost.</p> https://coobiw.github.io/project/mpp-llava/ Mon, 25 Dec 2023 00:00:00 +0000 https://coobiw.github.io/project/mpp-llava/ <p>The Repo supports {video/image/multi-image} {single/multi-turn} conversations. All 7B/14B llava-like training is conducted on 3090/4090 GPUs. <em><strong>To prevent poverty (24GB of VRAM) from limiting imagination</strong></em>, I implemented an MLLM version based on deepspeed Pipeline Parallel.</p>