Information Retrieval GitHub Repositories

📑 PageIndex: Document Index for Vectorless, Reasoning-based RAG

Open Source AI Platform - AI Chat with advanced features that works with every LLM

Ready-to-use OCR with 80+ supported languages and all popular writing scripts including Latin, Chinese, Arabic, Devanagari, Cyrillic and etc.

Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search, and conversational systems.

Private AI platform for agents, assistants and enterprise search. Built-in Agent Builder, Deep research, Document analysis, Multi-model support, and API connectivity for agents.

Weaviate is an open-source vector database that stores both objects and vectors, allowing for the combination of vector search with structured filtering with the fault tolerance and scalability of a cloud-native database​.

Topic Modelling for Humans

Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean, structured formats for language models. Visit our website to learn more about our enterprise grade Platform product for production grade workflows, partitioning, enrichments, chunking and embedding.

💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows

Retrieval and Retrieval-augmented LLMs

Open-source context retrieval layer for AI agents

Apache Lucene and Solr open-source search software

AdalFlow: The library to build & auto-optimize LLM applications.

Harness LLMs with Multi-Agent Programming

Fetches system/theme information in terminal for Linux desktop screenshots.

Apache Lucene open-source search software

Up to 100x faster strings for C, C++, CUDA, Python, Rust, Swift, JS, & Go, leveraging NEON, AVX2, AVX-512, SVE, GPGPU, & SWAR to accelerate search, hashing, sorting, edit distances, sketches, and memory ops 🦖

MTEB: State-of-the-art evaluation of embeddings across languages and modalities

Accelerated deep learning R&D

Track any ip address with IP-Tracer. IP-Tracer is developed for Linux and Termux. you can retrieve any ip address information using IP-Tracer.

Open-source inference server and production cluster for all the models your agent needs.

The code used to train and run inference with the ColVision models, e.g. ColPali, ColQwen2, and ColSmol.

Deep neural network to extract intelligent information from invoice documents.

A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.

Pyserini is a Python toolkit for reproducible information retrieval research with sparse and dense representations.

[ACL 2023] One Embedder, Any Task: Instruction-Finetuned Text Embeddings

Comprehensive and timely academic information on federated learning (papers, frameworks, datasets, tutorials, workshops)

SIMD-accelerated distances, dot products, matrix ops, geospatial & geometric kernels for 16 numeric types — from 6-bit floats to 64-bit complex — across x86, Arm, RISC-V, and WASM, with bindings for Python, Rust, C, C++, Swift, JS, and Go 📐

A collection of research on knowledge graphs

WFGY is heading toward WFGY 5.0 Polaris Protocol, a major open-source release for AI reasoning, RAG, agents, and real-world workflows. Includes Problem Map, Global Debug Card, WFGY 4.0, and the CFV Easter Egg.