5 posts
OxiONNX 0.1.7 grows oxionnx-cuda from 25 to 40 accelerated ops with real Conv support, session-lifetime weight/buffer residency, and batched MatMul up to 17x faster — plus a fix for a two-stream race that silently returned wrong GEMM results on real hardware. 3,595 tests passing. The sovereign Pure Rust ONNX layer for COOLJAPAN.
OxiONNX 0.1.6 ships GPU weight/activation residency and a direct implicit-GEMM Conv2D kernel (~692 GFLOP/s on M3) — plus the fix making wasm32 CPU inference actually run, and a CoreML compile cache ending 857 GB of orphaned recompiles. 3,212 tests passing. The sovereign Pure Rust ONNX layer for COOLJAPAN.
OxiONNX 0.1.5 adds async execution, cancellation, streaming generation, and session serialization — backed by a 12-lens, 232-finding hardening pass across parsing, spec-conformance, and GPU/CUDA/DirectML dispatch. 23 new operators, 2,946 tests passing. The sovereign Pure Rust ONNX layer for COOLJAPAN.
Pure-Rust FFmpeg+OpenCV replacement: OxiMedia 0.1.5 adds the oximedia-ml crate — typed ML pipelines (SceneClassifier, ShotBoundaryDetector, and more) on the Pure-Rust OxiONNX runtime, with a Python oximedia.ml submodule and an opt-in, symbol-free-by-default design. Plus a codec-decoder honesty pass. 108 crates, ~2.68M SLoC, 81,383 tests.
High-performance ONNX runtime written entirely in pure Rust. Zero C/C++ dependencies, 147 operators fully supported, wgpu GPU acceleration, SIMD (AVX2/NEON), WASM + no_std ready, graph optimizer, async execution, model encryption. 30k+ SLoC, 590+ tests. The sovereign ONNX inference layer for SciRS2 and the entire COOLJAPAN ecosystem (now 21M+ SLoC total).