Filippo B
banner
olgias.bsky.social
Filippo B
@olgias.bsky.social
Rocket ship builder. Father. Currently working at NVIDIA. Software Underground founding director. Tech enthusiast. Opinions are my own.
Also in the hugging face ecosystem, there exist two separate servers: TGI and TEI.
December 24, 2024 at 4:10 PM
Hehe yes od course 😬
December 24, 2024 at 4:04 PM
(just my guess of course!) Well ollama and the likes became known and useful to allow people to use LLMs. Encoder models are anyway much lighter and faster and Generally people could already easily run them.
December 24, 2024 at 3:44 PM
I simply believe that it is not the focus of llama.cpp and ollama.
December 24, 2024 at 3:28 PM