Compression GitHub Repositories

Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

The Cyber Swiss Army Knife - a web app for encryption, encoding, compression and data analysis

A hands-on introduction to video technology: image, video, codec (av1, vp9, h265) and more (ffmpeg encoding). Translations: 🇺🇸 🇨🇳 🇯🇵 🇮🇹 🇰🇷 🇷🇺 🇧🇷 🇪🇸

Deduplicating archiver with compression and authenticated encryption.

Easy-to-use and powerful LLM and SLM library with awesome model zoo.

Extremely Fast Compression algorithm

Reduce the space taken up by games and programs on disk by using native Windows APIs

Mesh optimization library that makes meshes smaller and faster to render

Free Zip / Unzip software and Rar file extractor. Cross-platform file and archive manager. Features volume spanning, compression, authenticated encryption. Supports 7Z, 7-Zip sfx, ACE, ARJ, Brotli, BZ2, CAB, CHM, CPIO, DEB, GZ, ISO, JAR, LHA/LZH, NSIS, OOo, PAQ/LPAQ, PEA, QUAD, RAR, RPM, split, TAR, Z, ZIP, ZIPX, Zstandard.

Draco is a library for compressing and decompressing 3D geometric meshes and point clouds. It is intended to improve the storage and transmission of 3D graphics.

An android image compression library.

The macOS & iOS file archiver

The Universal Filesystem Abstraction for Go

Caesium is an image compression software that helps you store, send and share digital pictures, supporting JPG, PNG, WebP and TIFF formats. You can quickly reduce the file size (and resolution, if you want) by preserving the overall quality of the image.

Optimized Go Compression Packages

Collection of cross-platform one-file C/C++ libraries with no dependencies, primarily used for games

A blazingly fast multi-language serialization framework for idiomatic domain objects, schema IDL, and cross-language data exchange.

Hide secrets with invisible characters in plain text securely using passwords 🧙🏻‍♂️⭐

Painless compression and decompression in the terminal

SimpleMem: Efficient Lifelong Memory for LLM Agents — Text & Multimodal

Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

Insane(ly slow but wicked good) PNG image optimization

Modern audio compression for the internet.

Android multi-media selector based on MVP mode.

An extensible, state-of-the-art framework for columnar compression, and the fastest FOSS columnar file format. Formerly at @spiraldb, now an Incubation Stage project at LFAI&Data, part of the Linux Foundation.

Basis Universal GPU Texture Codec

High performance (de)compression in an 8kB package

Node.js compression middleware

AIMET is a library that provides advanced quantization and compression techniques for trained neural network models.