Chris Levy
@cleavey1985.bsky.social
PhD applied math. Left academia for industry. Working with AI and software.
https://drchrislevy.github.io/
https://drchrislevy.github.io/
Wrote up some notes in my most recent blog post on how images are passed into LLMs.
drchrislevy.github.io/posts/vllms/...
Inspired by recent work/posts from @merve.bsky.social and @sebastianraschka.com
drchrislevy.github.io/posts/vllms/...
Inspired by recent work/posts from @merve.bsky.social and @sebastianraschka.com
Chris Levy - Passing Images into LLMs
drchrislevy.github.io
December 7, 2024 at 2:12 AM
Wrote up some notes in my most recent blog post on how images are passed into LLMs.
drchrislevy.github.io/posts/vllms/...
Inspired by recent work/posts from @merve.bsky.social and @sebastianraschka.com
drchrislevy.github.io/posts/vllms/...
Inspired by recent work/posts from @merve.bsky.social and @sebastianraschka.com
Transformers: 4.36.2 --->4.46.3
Torch: torch-2.1.2 ---> torch-2.5.1
Look at that memory drop! This is a production workload running some fine-tuned transformer encoder models. I didn't look through all the release notes yet for the reason. Anyone from @hf.co know off the top of their head?
Torch: torch-2.1.2 ---> torch-2.5.1
Look at that memory drop! This is a production workload running some fine-tuned transformer encoder models. I didn't look through all the release notes yet for the reason. Anyone from @hf.co know off the top of their head?
November 28, 2024 at 8:45 PM
Transformers: 4.36.2 --->4.46.3
Torch: torch-2.1.2 ---> torch-2.5.1
Look at that memory drop! This is a production workload running some fine-tuned transformer encoder models. I didn't look through all the release notes yet for the reason. Anyone from @hf.co know off the top of their head?
Torch: torch-2.1.2 ---> torch-2.5.1
Look at that memory drop! This is a production workload running some fine-tuned transformer encoder models. I didn't look through all the release notes yet for the reason. Anyone from @hf.co know off the top of their head?