Installation

As a Library

Add LLMG to your Cargo.toml:

[dependencies]
llmg-core = "0.1.9"
llmg-providers = { version = "0.1.9", features = ["openai", "anthropic"] }

Enable only the provider features you need to keep compile times low.

As a Gateway

From Crates.io (Recommended)

cargo install llmg-gateway

From Source

git clone https://github.com/modpotatodotdev/LLMG.git
cd LLMG
cargo build --release --bin llmg-gateway

The binary will be at target/release/llmg-gateway (or in your cargo bin path if installed).

Docker

docker pull ghcr.io/modpotatodotdev/llmg:latest
docker run -p 8080:8080 -e OPENAI_API_KEY=sk-... ghcr.io/modpotatodotdev/llmg:latest

See the Docker guide for full configuration.