Robin Allenson
@robina.bsky.social
Practical philosopher, co-founder & CEO at Similar.ai, occasional sax player. Has been known to talk a lot of shite on occasion.
Reposted by Robin Allenson
Yeah. 100x This. The model is just a bunch of weight data. The runtimes that run the inference are separate.
Runtimes like Ollama are open source (so we can see the code) and we can watch the network traffic.
Running locally is definitely private.
Runtimes like Ollama are open source (so we can see the code) and we can watch the network traffic.
Running locally is definitely private.
January 30, 2025 at 1:47 PM
Yeah. 100x This. The model is just a bunch of weight data. The runtimes that run the inference are separate.
Runtimes like Ollama are open source (so we can see the code) and we can watch the network traffic.
Running locally is definitely private.
Runtimes like Ollama are open source (so we can see the code) and we can watch the network traffic.
Running locally is definitely private.
Yes. But that’s just not how running a model works. An AI model is a bunch of a matrices of numbers, called the weights, where you input some characters and get some characters as outputs. The software that you run to use the DeepSeek weights is not from DeepSeek.
January 29, 2025 at 11:41 AM
Yes. But that’s just not how running a model works. An AI model is a bunch of a matrices of numbers, called the weights, where you input some characters and get some characters as outputs. The software that you run to use the DeepSeek weights is not from DeepSeek.
How can it do that eg without internet? That’s not how a local model works.
January 28, 2025 at 10:18 PM
How can it do that eg without internet? That’s not how a local model works.
Unless you run it locally
January 28, 2025 at 4:14 PM
Unless you run it locally
Gorgeous photo! (And lovely subject of course).
December 25, 2024 at 7:41 AM
Gorgeous photo! (And lovely subject of course).
Reposted by Robin Allenson
Physics 😃 Photons have some probability of interacting with matter, and we know the density of the Sun, so we know how far on average a photon travels in between interactions. Turns out it's not very far in the Sun, and every interaction changes its direction, so it can be a very long random walk.
December 20, 2024 at 11:55 PM
Physics 😃 Photons have some probability of interacting with matter, and we know the density of the Sun, so we know how far on average a photon travels in between interactions. Turns out it's not very far in the Sun, and every interaction changes its direction, so it can be a very long random walk.
Super interesting! Thanks for the answer!
December 21, 2024 at 8:55 AM
Super interesting! Thanks for the answer!
How do we know this? 🤔
December 11, 2024 at 9:08 AM
How do we know this? 🤔