James Hensman
@jameshensman.bsky.social
Trying to make all the AIs more efficient. Former Gaussian process connoisseur. Researcher at Microsoft Research.
This was a lot of fun! Build a knowledge graph and then feed the entries directly into the attention mechanism. With a little training , the model learns to read from this source as well as the context. Now you can edit, update or delete the knowledge in the model.
Introducing KBLaM, an approach that encodes and stores structured knowledge within an LLM itself. By integrating knowledge without retraining, it offers a scalable alternative to traditional methods. www.microsoft.com/en-us/resear...
March 19, 2025 at 7:03 AM
This was a lot of fun! Build a knowledge graph and then feed the entries directly into the attention mechanism. With a little training , the model learns to read from this source as well as the context. Now you can edit, update or delete the knowledge in the model.