The code used to train and run inference with the ColVision models, e.g. ColPali, ColQwen2, and ColSmol.

Use late-interaction multi-modal models such as ColPali in just a few lines of code.

Inference, Ingestion and Indexing built in Rust 🦀

Vision-Augmented Retrieval and Generation (VARAG) - Vision first RAG Engine

Serverless Modal + FastAPI + React + ColPali + Qdrant + GPT4o Vision RAG (V-RAG) Demo

Recipes for learning, fine-tuning, and adapting ColPali to your multimodal RAG use cases. 👨🏻‍🍳

Vision Document Retrieval (ViDoRe): Benchmark. Evaluation code for the ColPali paper.

LitePali is a minimal, efficient implementation of ColPali for image retrieval and indexing, optimized for cloud deployment.

A new novel multi-modality (Vision) RAG architecture

The PyQt6 application using ColPali and OpenAI to show Efficient Document Retrieval with Vision Language Models

REST API for computing cross-modal similarity between images and text using the ColPaLI vision-language model

The repo provides the code for Qdrant for efficient image indexing and retrieval using models such as ColPali, ColQwen, and VDR-2B-Multi-V1, enhancing multimodal search capabilities across various applications.

ColPali is vision based RAG (Retrieval Augmented Generation) which can capture visual data

OCR and Document Search Web Application