Table 1 from the Attention Is All You Need paper (arxiv.org/pdf/1706.03762). Brilliant. Beautiful!
Maximum Path Length - how far a signal travels between any two positions:
- RNNs: O(n)
- Self-Attention: O(1)
Maximum Path Length - how far a signal travels between any two positions:
- RNNs: O(n)
- Self-Attention: O(1)
February 2, 2026 at 9:31 AM
Table 1 from the Attention Is All You Need paper (arxiv.org/pdf/1706.03762). Brilliant. Beautiful!
Maximum Path Length - how far a signal travels between any two positions:
- RNNs: O(n)
- Self-Attention: O(1)
Maximum Path Length - how far a signal travels between any two positions:
- RNNs: O(n)
- Self-Attention: O(1)
Software loans in CLOs: -4% in January vs flat for everything else.
Software is 12% of the leveraged loan index. Largest single sector.
Trigger is AI disruption fears. The selloff is hitting embedded enterprise systems and point solutions equally.
Software is 12% of the leveraged loan index. Largest single sector.
Trigger is AI disruption fears. The selloff is hitting embedded enterprise systems and point solutions equally.
February 1, 2026 at 6:13 PM
Software loans in CLOs: -4% in January vs flat for everything else.
Software is 12% of the leveraged loan index. Largest single sector.
Trigger is AI disruption fears. The selloff is hitting embedded enterprise systems and point solutions equally.
Software is 12% of the leveraged loan index. Largest single sector.
Trigger is AI disruption fears. The selloff is hitting embedded enterprise systems and point solutions equally.
Japan showed you can zero out your debt service costs through financial repression
Japan also showed you pay for it in currency value
Japan also showed you pay for it in currency value
February 1, 2026 at 3:33 PM
Japan showed you can zero out your debt service costs through financial repression
Japan also showed you pay for it in currency value
Japan also showed you pay for it in currency value
This kind of outrages honesty!!
Noam Shazeer in GLU Variants Improve Transformer (arxiv.org/abs/2002.052...)
Noam Shazeer in GLU Variants Improve Transformer (arxiv.org/abs/2002.052...)
February 1, 2026 at 2:18 PM
This kind of outrages honesty!!
Noam Shazeer in GLU Variants Improve Transformer (arxiv.org/abs/2002.052...)
Noam Shazeer in GLU Variants Improve Transformer (arxiv.org/abs/2002.052...)
NFT market cap hit $3.3B this week. It's still 85% below the 2021 peak. The 30% weekly "jump" is just noise inside a range it's been stuck in for ~two years
February 1, 2026 at 2:06 PM
NFT market cap hit $3.3B this week. It's still 85% below the 2021 peak. The 30% weekly "jump" is just noise inside a range it's been stuck in for ~two years
Reposted by Dan Zhuge
It’s the beginning of history! 😃
Nomura: total returns for software debt in collateralized loan obligations have been lower than all other sectors in 2026, amid fears about AI's impact on SaaS (Bloomberg)
Main Link | Techmeme Permalink
Main Link | Techmeme Permalink
February 1, 2026 at 5:18 AM
It’s the beginning of history! 😃
"i function fine on 6 hours" is the cognitive equivalent of "i drive better drunk"
Study found that after 4 days of 6h sleep you stop feeling more tired but your brain keeps getting dumber for another 10 days
you're basically too tired to notice you're tired
Study found that after 4 days of 6h sleep you stop feeling more tired but your brain keeps getting dumber for another 10 days
you're basically too tired to notice you're tired
January 31, 2026 at 7:18 PM
"i function fine on 6 hours" is the cognitive equivalent of "i drive better drunk"
Study found that after 4 days of 6h sleep you stop feeling more tired but your brain keeps getting dumber for another 10 days
you're basically too tired to notice you're tired
Study found that after 4 days of 6h sleep you stop feeling more tired but your brain keeps getting dumber for another 10 days
you're basically too tired to notice you're tired
These 2020 ARK Invest slides live rent free in my head
January 31, 2026 at 7:01 PM
These 2020 ARK Invest slides live rent free in my head
Reposted by Dan Zhuge
What could a serious company do with 10 billion?
Amazon, a potential new investor in OpenAI, is in talks to invest more than $10 billion and possibly over $20 billion. https://thein.fo/3LVnyHu
Nvidia, Microsoft, Amazon in Talks to Invest Up to $60 Billion in OpenAI
OpenAI is lining up huge checks from some of its biggest tech partners, as it seeks to raise up to $100 billion to fund growing demand for its AI. Nvidia, an existing investor whose chips power OpenAI...
thein.fo
January 31, 2026 at 6:08 PM
What could a serious company do with 10 billion?
Unreal how much time I lately spent creating dishes with Nano Banana Pro
January 31, 2026 at 4:33 PM
Unreal how much time I lately spent creating dishes with Nano Banana Pro
The crash has been six months away for 20 years. Cassandra trades are indistinguishable from being wrong. Markets can remain irrational longer than you can remain solvent.
wilsoniumite.com/2026/01/27/s...
wilsoniumite.com/2026/01/27/s...
Surely the crash of the US economy has to be soon – Wilsons Blog
wilsoniumite.com
January 31, 2026 at 3:56 PM
The crash has been six months away for 20 years. Cassandra trades are indistinguishable from being wrong. Markets can remain irrational longer than you can remain solvent.
wilsoniumite.com/2026/01/27/s...
wilsoniumite.com/2026/01/27/s...
Silver: -31.35% (z = -15.4σ)
Gold: -11.37% (z = -10.3σ)
A 15-sigma event shouldn't happen once in the lifetime of the universe under normal distributions. Of course, returns aren't normal. But still..
Gold: -11.37% (z = -10.3σ)
A 15-sigma event shouldn't happen once in the lifetime of the universe under normal distributions. Of course, returns aren't normal. But still..
January 31, 2026 at 10:43 AM
Silver: -31.35% (z = -15.4σ)
Gold: -11.37% (z = -10.3σ)
A 15-sigma event shouldn't happen once in the lifetime of the universe under normal distributions. Of course, returns aren't normal. But still..
Gold: -11.37% (z = -10.3σ)
A 15-sigma event shouldn't happen once in the lifetime of the universe under normal distributions. Of course, returns aren't normal. But still..