I have a bunch of catch up to do in ocaml, effects/multicore/oxcaml all seem very exciting to play with!

Thanks for the kind words @anil.recoil.org , just to mention that these models are a team effort from a bunch of folks here at Kyutai! The MLX bugs are most likely mine though :) hopefully I'll get some free cycles soon and make an ocaml implementation that will have less of these!

Ah, we already have inference codebases in python/rust/swift but maybe we need an ocaml one too for folks that interact with the French ocaml community 😄

That's certainly the plan, ideally this will make it possible to run a moshi locally on a mobile phone but there is still a lot to be done before we get there!

It's certainly open-source but also pretty much a work in progress :) github.com/LaurentMazar... There is no AMD support for now but as long as the programming model is similar to cuda or metal, adding a new backend should be easy (or at least that's the goal).

Ah, sounds like a nice part to have! Note that the bindings are now developed by JS here github.com/janestreet/t... Also lately I've worked on a small compiler for deep learning models, inspired by triton/tinygrad. It's written in rust, but ocaml would be a great choice for writing such a compiler.

The benchmark code with all the matmul variants is on github: github.com/LaurentMazar...