COOLJAPAN

Posts tagged #tokenizer

2 posts

May 3, 2026 · 8 min

OxiBonsai 0.1.3 Released — Prefix-Cache-Aware Serving with Byte-Identical Warm Paths

OxiBonsai 0.1.3 makes sub-2-bit serving smarter: a prefix-cache-aware engine that reuses KV-cache across requests with byte-identical cold/warm parity, runtime tokenizer auto-detection, and a GPU weight cache that uploads once. Sub-2-bit Pure Rust sovereign AI inference for the COOLJAPAN ecosystem.

releaseoxibonsaillm
Jan 6, 2026 · 6 min

MeCrab 0.1.0 Released — A Pure Rust MeCab, Japanese Morphological Analysis Without the C Toolchain

MeCrab is a pure Rust morphological analyzer compatible with MeCab IPADIC dictionaries. The 0.1.0 debut brings memory-mapped zero-copy dictionary loading, a SIMD-accelerated Viterbi lattice, runtime word addition, and the KizaMe CLI — Japanese tokenization in a single safe binary.

releasemecrabrust