2 posts
OxiLLaMa 0.1.2 is the Pure Rust LLM inference engine and sovereign alternative to llama.cpp. This release adds `oxillama hub pull/list/rm` (hf-hub, no Python), a full-screen TUI chat with live streaming (ratatui), conversation save/resume serialized via oxicode with SHA-256 integrity, and real weight loading for DBRX, Grok-1, and Mamba-2.
Pure Rust Hugging Face Transformers — the first stable release. 27+ transformer architectures, 17x CPU BLAS acceleration, GGUF/AWQ/GPTQ quantization, and WASM + server + mobile deployment. No Python, no PyTorch.