2 posts
OxiBonsai 0.1.3 makes sub-2-bit serving smarter: a prefix-cache-aware engine that reuses KV-cache across requests with byte-identical cold/warm parity, runtime tokenizer auto-detection, and a GPU weight cache that uploads once. Sub-2-bit Pure Rust sovereign AI inference for the COOLJAPAN ecosystem.
MeCrab is a pure Rust morphological analyzer compatible with MeCab IPADIC dictionaries. The 0.1.0 debut brings memory-mapped zero-copy dictionary loading, a SIMD-accelerated Viterbi lattice, runtime word addition, and the KizaMe CLI — Japanese tokenization in a single safe binary.