like this?

Added a new symbols menu - let me know if I missed any of your favourite LaTeX commands!

Isserlis' (or Wick's) theorem is one of the strongest tools to handle High Dimensional Gaussians.

Turns out it generalizes to _every distribution_ using cumulant tensors!

That's higher order variance, skewness, kurtosis, etc.

I added a Playground to tensorcookbook.com for when you need that Matrix or Tensor Derivative in a hurry.

Hopefully it can also be a way to help people become familiar with tensor diagrams.

Some sketches for the next chapter

I added code execution to tensorcookbook.com so you can try tensorgrad's automatic tensor algebra without installing anything.

Tensor Product Attention illustrated with Tensor Diagrams

Neat one-page proof of "Stirling's bound"

(n/e)ⁿ√{2π n} ≤ n! ≤ (n/e)ⁿ(√{2π n}+1)

Inspired by the discussion on mathoverflow.net/a/458011/5429. Just had to keep hitting it with logarithmic inequalities...

"Central Limit Theorem" for the Poisson Distribution

Chess engines like Stockfish will keep a so-called butterfly board, keeping track of how often a move was chosen in the search tree. _Independently of the position_.

This is data is considered elsewhere in the search tree to decide how much time to spend considering the move.

Why do this?

2/5

Clever use of the KV-cache: Writing in the margins (arxiv.org/abs/2408.14906) at Neurips next week.

By "taking notes" as you read, ypu reduce the complexity from N^3 (N tokens at N^2 cost) to N^3/3 (1+4+9+...+N^2).