Philipp Petersen
@pc-pet.bsky.social
Professor at U Vienna. Math of machine learning. Other math, too.
Reposted by Philipp Petersen
In spiking neural networks, neurons communicate - as in the brain - via short electrical pulses⚡(spikes). But how can we formally quantify the (dis)advantages of using spikes? 🤔
In our new preprint, @pc-pet.bsky.social and I introduce the concept of "Causal Pieces" to approach this question!
In our new preprint, @pc-pet.bsky.social and I introduce the concept of "Causal Pieces" to approach this question!
May 2, 2025 at 8:07 AM
In spiking neural networks, neurons communicate - as in the brain - via short electrical pulses⚡(spikes). But how can we formally quantify the (dis)advantages of using spikes? 🤔
In our new preprint, @pc-pet.bsky.social and I introduce the concept of "Causal Pieces" to approach this question!
In our new preprint, @pc-pet.bsky.social and I introduce the concept of "Causal Pieces" to approach this question!
After receiving very helpful feedback from the community, Jakob Zech and I have revised our graduate textbook:
📘 𝘔𝘢𝘵𝘩𝘦𝘮𝘢𝘵𝘪𝘤𝘢𝘭 𝘛𝘩𝘦𝘰𝘳𝘺 𝘰𝘧 𝘋𝘦𝘦𝘱 𝘓𝘦𝘢𝘳𝘯𝘪𝘯𝘨
and uploaded the new version to arxiv:
🔗 arxiv.org/abs/2407.18384
If you have already read it—or plan to—we would really appreciate your feedback.
📘 𝘔𝘢𝘵𝘩𝘦𝘮𝘢𝘵𝘪𝘤𝘢𝘭 𝘛𝘩𝘦𝘰𝘳𝘺 𝘰𝘧 𝘋𝘦𝘦𝘱 𝘓𝘦𝘢𝘳𝘯𝘪𝘯𝘨
and uploaded the new version to arxiv:
🔗 arxiv.org/abs/2407.18384
If you have already read it—or plan to—we would really appreciate your feedback.
April 8, 2025 at 10:44 AM
After receiving very helpful feedback from the community, Jakob Zech and I have revised our graduate textbook:
📘 𝘔𝘢𝘵𝘩𝘦𝘮𝘢𝘵𝘪𝘤𝘢𝘭 𝘛𝘩𝘦𝘰𝘳𝘺 𝘰𝘧 𝘋𝘦𝘦𝘱 𝘓𝘦𝘢𝘳𝘯𝘪𝘯𝘨
and uploaded the new version to arxiv:
🔗 arxiv.org/abs/2407.18384
If you have already read it—or plan to—we would really appreciate your feedback.
📘 𝘔𝘢𝘵𝘩𝘦𝘮𝘢𝘵𝘪𝘤𝘢𝘭 𝘛𝘩𝘦𝘰𝘳𝘺 𝘰𝘧 𝘋𝘦𝘦𝘱 𝘓𝘦𝘢𝘳𝘯𝘪𝘯𝘨
and uploaded the new version to arxiv:
🔗 arxiv.org/abs/2407.18384
If you have already read it—or plan to—we would really appreciate your feedback.
Would you expect an LLM using over 100 billion floating-point operations in low precision to produce accurate outputs?
Not if you heard an introductory class to numerics. How bad can things get? To find out, we carried out a numerical stability analysis of the transformer arxiv.org/abs/2503.10251.
Not if you heard an introductory class to numerics. How bad can things get? To find out, we carried out a numerical stability analysis of the transformer arxiv.org/abs/2503.10251.
March 14, 2025 at 7:05 AM
Would you expect an LLM using over 100 billion floating-point operations in low precision to produce accurate outputs?
Not if you heard an introductory class to numerics. How bad can things get? To find out, we carried out a numerical stability analysis of the transformer arxiv.org/abs/2503.10251.
Not if you heard an introductory class to numerics. How bad can things get? To find out, we carried out a numerical stability analysis of the transformer arxiv.org/abs/2503.10251.