Mobius Labs
@mobius-labs.bsky.social
Making models fast, small and taming inference. Loves multimodality.
Proponents of Open Source and Open Intelligence.
https://blog.mobiuslabs.com/ for some of our recent work.
X: https://x.com/Mobius_Labs
Proponents of Open Source and Open Intelligence.
https://blog.mobiuslabs.com/ for some of our recent work.
X: https://x.com/Mobius_Labs
Watch this video for insights into our experience during development:
www.youtube.com/watch?v=7c3c...
www.youtube.com/watch?v=7c3c...
Lecture 34: Low Bit Triton Kernels
YouTube video by GPU MODE
www.youtube.com
December 5, 2024 at 2:43 PM
Watch this video for insights into our experience during development:
www.youtube.com/watch?v=7c3c...
www.youtube.com/watch?v=7c3c...
Introduced new kernels, max-autotuning, and several other improvements Check out the release details at github.com/mobiusml/gem...
Release 0.4.0 · mobiusml/gemlite
Improved performance on the A100 and H100.
Flexible bitpacking support (32-bit / 8-bit, over cols or rows).
Best config caching over all kernels.
Helper functions for easier usage.
GEMV_SPLITK kern...
github.com
December 5, 2024 at 2:43 PM
Introduced new kernels, max-autotuning, and several other improvements Check out the release details at github.com/mobiusml/gem...