nlothian.bsky.social
@nlothian.bsky.social
It shocks me how many people think LLM inference providers are somehow running at a loss.
Do the math! If you can hire a cloud H100 and run it above 50% capacity for something approaching the per token price inference providers are charging then it's easy to see they aren't.
Do the math! If you can hire a cloud H100 and run it above 50% capacity for something approaching the per token price inference providers are charging then it's easy to see they aren't.
December 24, 2025 at 6:35 AM
It shocks me how many people think LLM inference providers are somehow running at a loss.
Do the math! If you can hire a cloud H100 and run it above 50% capacity for something approaching the per token price inference providers are charging then it's easy to see they aren't.
Do the math! If you can hire a cloud H100 and run it above 50% capacity for something approaching the per token price inference providers are charging then it's easy to see they aren't.
OpenAI drama making crypto bros look like the sensible ones.
November 21, 2023 at 12:48 AM
OpenAI drama making crypto bros look like the sensible ones.
Reposted by nlothian.bsky.social
🚀Happy to announce my recent open source project- LightPHE: A Lightweight Partially Homomorphic Encryption Library for #Python. It allows computations on encrypted data without decryption. It wraps many algorithms such as RSA, ElGamal, Paillier and more!
github.com/serengil/Lig...
github.com/serengil/Lig...
November 19, 2023 at 5:31 PM
🚀Happy to announce my recent open source project- LightPHE: A Lightweight Partially Homomorphic Encryption Library for #Python. It allows computations on encrypted data without decryption. It wraps many algorithms such as RSA, ElGamal, Paillier and more!
github.com/serengil/Lig...
github.com/serengil/Lig...
Reposted by nlothian.bsky.social
We evaluate the combined architecture on two challenging planning tasks:
-Graph traversal
-Tower of Hanoi
Graph traversal:
significant improvements over zero-shot prompting or in-context learning.
Notably the architecture lowers hallucination of invalid moves to 0% (from ~20% for 4-step paths!)
4/n
-Graph traversal
-Tower of Hanoi
Graph traversal:
significant improvements over zero-shot prompting or in-context learning.
Notably the architecture lowers hallucination of invalid moves to 0% (from ~20% for 4-step paths!)
4/n
October 27, 2023 at 3:02 PM
We evaluate the combined architecture on two challenging planning tasks:
-Graph traversal
-Tower of Hanoi
Graph traversal:
significant improvements over zero-shot prompting or in-context learning.
Notably the architecture lowers hallucination of invalid moves to 0% (from ~20% for 4-step paths!)
4/n
-Graph traversal
-Tower of Hanoi
Graph traversal:
significant improvements over zero-shot prompting or in-context learning.
Notably the architecture lowers hallucination of invalid moves to 0% (from ~20% for 4-step paths!)
4/n
This seems like an appropriate first post.
Some high quality research into the frequency of compound pejoratives used on Reddit
colinmorris.github.io/blog/compoun...
colinmorris.github.io/blog/compoun...
October 19, 2023 at 1:52 AM
This seems like an appropriate first post.