The inside story of building the largest pure-Rust sovereignty stack
324 posts
The high-performance Pure Rust DataFrame library reaches 0.4.0 — a correctness landmark. PandRS replaces a large swath of fabricated and stubbed ML and statistical results with real algorithms: Jacobi-rotation PCA, t-SNE, DBSCAN, agglomerative clustering, IRLS logistic regression, isolation-forest/LOF/OneClassSVM anomaly detection, real silhouette and ROC-AUC, and genuine chi-square/t/F p-values. SciRS2-Core becomes a non-optional core dependency, and the SciRS2 stats/linalg integration deepens onto the 0.5 line. The DataFrame layer of the COOLJAPAN scientific stack — no pandas, no scikit-learn C-extensions, no GIL.
OxiCode 0.2.4 makes the streaming encoder/decoder generic over the Config type so encoder and decoder pairs can share an explicit codec configuration via new_with_config, implements core::error::Error for DeError/SerError in no_std + alloc, bumps the MSRV to 1.81, and moves OxiARC pure Rust compression to 0.3.2. Same 100% bincode-2.0 binary compatibility.
OxiMedia 0.1.8 — patent-free, memory-safe FFmpeg + OpenCV replacement in pure Rust. A feature-rich release: a Whisper-compatible AutoCaption ONNX pipeline, mmap-backed file repair, log-mel spectrograms, filmic ACES/Reinhard tone curves, and zero-copy CMAF segment output via bytes::Bytes. 109 crates, 100,278 tests, zero C/Fortran in default builds.
OxiBonsai 0.2.0 opens the 0.2 series: a concurrent engine pool that shares one 1.16 GB embedding table across replicas, a CPU↔Metal byte-identical parity guard, a parity-first CUDA imagen backend (~3.2× to ~31.7s on A4000), --seed byte-exact reproducible images, and a stable-toolchain build — sub-2-bit Pure Rust sovereign AI inference for the COOLJAPAN ecosystem.
SciRS2 0.5.0 brings real pure-Rust wgpu/WebGPU acceleration — GpuNdarray, GPU graph algorithms, GPU optimizers (L-BFGS/CG/Newton), GPU RBF interpolation — plus correct Pantelides DAE index reduction, high-order SDE Lévy-area, Hilbert curves, and a maturing symbolic CAS. The NumPy/SciPy/scikit-learn replacement, in pure Rust.
OxiBonsai 0.1.5 adds the oxibonsai-image crate — the first pure-Rust, zero-FFI, C/C++/Fortran-free FLUX.2-Klein text-to-image pipeline (DiT + VAE + Qwen3-4B text encoder), parity-validated at cos≥0.999, with Metal flash-attention and ~52–62s end-to-end on an M3. Sub-2-bit Pure Rust sovereign AI inference for the COOLJAPAN ecosystem, now spanning text and image.
OxiArc 0.3.2 introduces oxiarc-szip: a Pure Rust implementation of AEC/SZIP (CCSDS-121.0-B-2), the lossless codec behind the HDF5/NetCDF SZIP filter and widely used in satellite and scientific data. Byte-for-byte compatible with libaec. No C, no zlib — 1,666 tests passing.
OxiZ is a pure-Rust SMT solver reimplementing Z3. 0.2.2 ships real LBD clause scoring (replacing the old stub), Big-M primal simplex for LP, an LRU lemma cache, ML conflict-hook branching, and deeper Z3-compat APIs — all with 100% Z3 parity and zero C/C++/Fortran.
OxiArc 0.3.1 adds front-to-back archive repair and recovery for corrupt ZIP and TAR files, custom-dictionary compression for LZH and LZMA, and a thread-safe LZMA memory pool. Pure Rust, no zlib, no libarchive — 1,647 tests passing, zero warnings.
Pure Rust FFT and the rustfft replacement. OxiFFT 0.3.2 completes multi-rank MPI execution for the 3D pencil decomposition, gates AVX-512 codelets behind a default-off feature so the build stays clean on rustc 1.95 stable, hardens ND-plan error handling, and refreshes the OxiCUDA GPU backend.
OxiGDAL 0.1.5 is a focused fix release: a stray padding field in the RayMarchUniforms WGSL layout was shifting every field by 4 bytes, making the GPU compute kernel read a billion-step max and hang indefinitely on macOS Metal. With the layout corrected, the ray-march GPU/CPU parity test passes in 0.127s. 78 Pure Rust workspace crates, 14,605 passing tests.
OxiMedia 0.1.7 — patent-free, memory-safe FFmpeg + OpenCV replacement in pure Rust. A focused stability release fixing five tracked issues: Theora plane copy, Windows/WASM gating for IPC sockets, globally-unique temp filenames, an AVC SPS doctest, and collision-free scope temp files. 109 crates, 84,064 tests, zero C/Fortran in default builds.
Pure-Rust CUDA Toolkit replacement: a maintenance release with numerical-stability refinements in the HMC variational sampler, stream-ordered allocator tuning, and TriMap reduction polish — 23,535 passing tests. No CUDA SDK, no nvcc.
The 0.3 line of Pure Rust archive and compression: a Zopfli-style optimal DEFLATE parser, an LZMA BT4 match finder that delivers SDK-grade level-9 quality, true bounded-memory LZ4 streaming, parallel Snappy, optimal LZSS for LZH, and memory-mapped archive access. ~71k SLoC across 227 files, 1,640 tests, 13 crates. API-stable as of v0.3.0.
OxiPhysics 0.1.1 — the unified pure-Rust physics engine (Bullet/OpenFOAM/LAMMPS/CalculiX replacement) gains real, feature-gated PyO3 0.28 Python bindings: 210 #[pyclass] types across 14 domain modules, plus wasm-bindgen 0.2 browser bindings. Most domain crates graduate from Alpha to Stable. Still 100% C/Fortran-free in default builds.
OxiBonsai 0.1.4 makes Pure Rust sub-2-bit inference production-grade for serving: adaptive KV-cache compression and adaptive speculative decoding that self-tune under load, full Prometheus observability with per-request X-Request-ID tracing, new FP8 and K-quant GGUF model support, and grammar-constrained decoding for guaranteed-valid JSON — sovereign AI inference for the COOLJAPAN ecosystem.
Pure-Rust replacement for the entire NVIDIA CUDA Toolkit. 0.1.7 adds a SYR2K Tensor Core kernel (fused A×Bᵀ + B×Aᵀ rank-2k update) to oxicuda-blas, cross-subsystem CUDA kernel enhancements, and Multi-Operation Scheduling improvements. No CUDA SDK, no nvcc, no C/C++ toolchain.
rs3gw is a Pure Rust S3-compatible object-storage gateway powered by scirs2-io. The 0.2.1 patch migrates compression to COOLJAPAN OxiArc (oxiarc-zstd/lz4/deflate), expands Object Lock, RestoreObject, and SSE test coverage to 961 tests, and resolves an OpenTelemetry version conflict.
SciRS2 0.4.4 turns scirs2-symbolic into a full computer algebra system — EML-IR-native canonical form, real OxiZ SMT verification, Cranelift JIT, symbolic regression, and LaTeX export. A pure-Rust SymPy/Mathematica alternative on top of the NumPy/SciPy replacement.
A maintenance patch for the AmateRS FHE database: a resolved clippy doc_lazy_continuation lint, a corrected MerkleTree intra-doc link, and a cargo fmt cleanup across the server hot-reload and main modules. Zero-warning, docs-clean discipline — no API changes.
Pure-Rust replacement for the NVIDIA CUDA Toolkit. OxiCUDA 0.1.6 adds a Tensor Core fast path for SYRK in oxicuda-blas and sixteen new ML crates (adversarial, SSL, continual, multimodal, 3D geometry, PINN, ANN, anomaly, causal, meta, MoE, NeRF, quantum, recsys, RLHF, tabular). No CUDA SDK, no nvcc.
Pure Rust archive and compression gets faster and broader. OxiArc 0.2.8 adds SIMD CRC32 via aarch64 PMULL and Snappy CRC32C via SSE4.2, ISO 9660 read support with Joliet filenames, byte-for-byte raw-preserve append for ZIP/LZH, progress/cancel builders for LZ4/Zstd/LZMA, and a per-entry memory limit. ~58k SLoC, 1,281 tests, 12 crates.
A small OxiCode patch that restores a fully clean clippy run across the workspace and eliminates temp-file collisions in seven async and file-I/O test modules under concurrent execution. No API or wire-format changes — same 100% bincode-2.0 binary compatibility, same Pure Rust guarantee.
OxigenAI is a Pure Rust GovTech reimplementation of the Digital Agency's government legal-AI system (源内 / GenAI). It keeps the familiar law-report API but adds OxiZ SMT contradiction detection and Legalis-RS LegalResult<T> outcome classification — turning a probabilistic LLM+RAG service into a verifiable computational-law platform.