@radekosmulski.bsky.social
4. execnb
• Run nbs as scripts with --verbose flag (PR#75)
• Pass args as env vars
• Infinitely flexible building block for custom behavior
• My hack: import from notebooks up to STOP_WHEN_IMPORTED marker - lets me keep adding/testing below while stable code stays at top
• Run nbs as scripts with --verbose flag (PR#75)
• Pass args as env vars
• Infinitely flexible building block for custom behavior
• My hack: import from notebooks up to STOP_WHEN_IMPORTED marker - lets me keep adding/testing below while stable code stays at top
July 4, 2025 at 1:20 AM
4. execnb
• Run nbs as scripts with --verbose flag (PR#75)
• Pass args as env vars
• Infinitely flexible building block for custom behavior
• My hack: import from notebooks up to STOP_WHEN_IMPORTED marker - lets me keep adding/testing below while stable code stays at top
• Run nbs as scripts with --verbose flag (PR#75)
• Pass args as env vars
• Infinitely flexible building block for custom behavior
• My hack: import from notebooks up to STOP_WHEN_IMPORTED marker - lets me keep adding/testing below while stable code stays at top
3. nbimporter
• Import from notebooks like py files
• Author nailed it, then overthought it 🤷♂️
• Key insight: best practices depend on context - building libs ≠ rapid prototyping/exploration
• Import from notebooks like py files
• Author nailed it, then overthought it 🤷♂️
• Key insight: best practices depend on context - building libs ≠ rapid prototyping/exploration
July 4, 2025 at 1:20 AM
3. nbimporter
• Import from notebooks like py files
• Author nailed it, then overthought it 🤷♂️
• Key insight: best practices depend on context - building libs ≠ rapid prototyping/exploration
• Import from notebooks like py files
• Author nailed it, then overthought it 🤷♂️
• Key insight: best practices depend on context - building libs ≠ rapid prototyping/exploration
2. Claude Code in VS Code
• Great at modifying notebooks (needs File Reloader)
• Reads relevant files - RAG done right, huge value add
• Skip conceptual work - use for mundane tasks & info sourcing
• You drive, CC executes
• Great at modifying notebooks (needs File Reloader)
• Reads relevant files - RAG done right, huge value add
• Skip conceptual work - use for mundane tasks & info sourcing
• You drive, CC executes
July 4, 2025 at 1:20 AM
2. Claude Code in VS Code
• Great at modifying notebooks (needs File Reloader)
• Reads relevant files - RAG done right, huge value add
• Skip conceptual work - use for mundane tasks & info sourcing
• You drive, CC executes
• Great at modifying notebooks (needs File Reloader)
• Reads relevant files - RAG done right, huge value add
• Skip conceptual work - use for mundane tasks & info sourcing
• You drive, CC executes
1. VS Code with Jupyter notebook
• Only way I know to get working LLM completions in notebooks - game changer
• Essential extensions: File Reloader + File Utils
• Custom keybindings for kernel restart/cell execution are a must
• Everything on one screen 🤩 (ssh, tmux, nbs)
• Only way I know to get working LLM completions in notebooks - game changer
• Essential extensions: File Reloader + File Utils
• Custom keybindings for kernel restart/cell execution are a must
• Everything on one screen 🤩 (ssh, tmux, nbs)
July 4, 2025 at 1:20 AM
1. VS Code with Jupyter notebook
• Only way I know to get working LLM completions in notebooks - game changer
• Essential extensions: File Reloader + File Utils
• Custom keybindings for kernel restart/cell execution are a must
• Everything on one screen 🤩 (ssh, tmux, nbs)
• Only way I know to get working LLM completions in notebooks - game changer
• Essential extensions: File Reloader + File Utils
• Custom keybindings for kernel restart/cell execution are a must
• Everything on one screen 🤩 (ssh, tmux, nbs)
Been refining my ML-project workflow and loving every minute 🙂
4 tools I'm using in unexpected ways:
4 tools I'm using in unexpected ways:
July 4, 2025 at 1:20 AM
Been refining my ML-project workflow and loving every minute 🙂
4 tools I'm using in unexpected ways:
4 tools I'm using in unexpected ways:
Journey before destination, not because the destination doesn't matter.
But because the journey is all we have access to.
Planning gives us only a false sense of security, but robs us of experimenting — our only hope to interact with the terrain and not the map in our minds.
But because the journey is all we have access to.
Planning gives us only a false sense of security, but robs us of experimenting — our only hope to interact with the terrain and not the map in our minds.
June 1, 2025 at 5:47 AM
Journey before destination, not because the destination doesn't matter.
But because the journey is all we have access to.
Planning gives us only a false sense of security, but robs us of experimenting — our only hope to interact with the terrain and not the map in our minds.
But because the journey is all we have access to.
Planning gives us only a false sense of security, but robs us of experimenting — our only hope to interact with the terrain and not the map in our minds.
And the uncertainty in our individual lives is only amplified!
There are so many random factors at play. Plus, our ability to understand our situation and what is possible is minimal!
Our mental map is not the terrain.
Hence, the best we can do is give in to the process.
There are so many random factors at play. Plus, our ability to understand our situation and what is possible is minimal!
Our mental map is not the terrain.
Hence, the best we can do is give in to the process.
June 1, 2025 at 5:46 AM
And the uncertainty in our individual lives is only amplified!
There are so many random factors at play. Plus, our ability to understand our situation and what is possible is minimal!
Our mental map is not the terrain.
Hence, the best we can do is give in to the process.
There are so many random factors at play. Plus, our ability to understand our situation and what is possible is minimal!
Our mental map is not the terrain.
Hence, the best we can do is give in to the process.
So, where do we even start to continue making progress?
We must appreciate that we might know very little.
And that sometimes the best measure of making progress is whether we are working on something interesting or not.
That interestingness, curiosity, is the signal.
We must appreciate that we might know very little.
And that sometimes the best measure of making progress is whether we are working on something interesting or not.
That interestingness, curiosity, is the signal.
June 1, 2025 at 5:46 AM
So, where do we even start to continue making progress?
We must appreciate that we might know very little.
And that sometimes the best measure of making progress is whether we are working on something interesting or not.
That interestingness, curiosity, is the signal.
We must appreciate that we might know very little.
And that sometimes the best measure of making progress is whether we are working on something interesting or not.
That interestingness, curiosity, is the signal.
But even once we discover something, we might not know what it is useful for!
I am 100% certain that the inventors of the Transformer were as surprised as everyone by the ChatGPT moment.
I suspect that to them, the arch was at best intriguing and warranted tinkering more with.
I am 100% certain that the inventors of the Transformer were as surprised as everyone by the ChatGPT moment.
I suspect that to them, the arch was at best intriguing and warranted tinkering more with.
June 1, 2025 at 5:46 AM
But even once we discover something, we might not know what it is useful for!
I am 100% certain that the inventors of the Transformer were as surprised as everyone by the ChatGPT moment.
I suspect that to them, the arch was at best intriguing and warranted tinkering more with.
I am 100% certain that the inventors of the Transformer were as surprised as everyone by the ChatGPT moment.
I suspect that to them, the arch was at best intriguing and warranted tinkering more with.
That is why the research off the beaten track is so exciting.
It can bring us closer to ASI, but above all, it explores the search space versus being stuck in a single, narrow corridor.
It can bring us closer to ASI, but above all, it explores the search space versus being stuck in a single, narrow corridor.
June 1, 2025 at 5:46 AM
That is why the research off the beaten track is so exciting.
It can bring us closer to ASI, but above all, it explores the search space versus being stuck in a single, narrow corridor.
It can bring us closer to ASI, but above all, it explores the search space versus being stuck in a single, narrow corridor.
These people weren't stupid!
They just didn't understand the nature of innovation.
In their thinking, they didn't place enough weight on the unknown, the unknowable to them, despite their recent outstanding technological achievements.
They just didn't understand the nature of innovation.
In their thinking, they didn't place enough weight on the unknown, the unknowable to them, despite their recent outstanding technological achievements.
June 1, 2025 at 5:46 AM
These people weren't stupid!
They just didn't understand the nature of innovation.
In their thinking, they didn't place enough weight on the unknown, the unknowable to them, despite their recent outstanding technological achievements.
They just didn't understand the nature of innovation.
In their thinking, they didn't place enough weight on the unknown, the unknowable to them, despite their recent outstanding technological achievements.
If we are to be honest with ourselves, we cannot presume to know the path to ASI until we reach it.
Ever since the 1970s, we have been 3 years from ASI.
However, this idea extends even further into the past!
Ever since the 1970s, we have been 3 years from ASI.
However, this idea extends even further into the past!
June 1, 2025 at 5:46 AM
If we are to be honest with ourselves, we cannot presume to know the path to ASI until we reach it.
Ever since the 1970s, we have been 3 years from ASI.
However, this idea extends even further into the past!
Ever since the 1970s, we have been 3 years from ASI.
However, this idea extends even further into the past!
Precisely because our mental map is so unrepresentative of the terrain!
If the current leading paradigm of autoregressive transformers does not lead to ASI, maximising scores on various benchmarks will not get us there.
If the current leading paradigm of autoregressive transformers does not lead to ASI, maximising scores on various benchmarks will not get us there.
June 1, 2025 at 5:46 AM
Precisely because our mental map is so unrepresentative of the terrain!
If the current leading paradigm of autoregressive transformers does not lead to ASI, maximising scores on various benchmarks will not get us there.
If the current leading paradigm of autoregressive transformers does not lead to ASI, maximising scores on various benchmarks will not get us there.
When we think of innovating, be that in our professional or personal lives:
• I want to get a job in tech
• I want to reach ASI
we often phrase such pursuits as going from point A to some imaginary state (point B).
To understand why that doesn't work, let's consider a maze.
• I want to get a job in tech
• I want to reach ASI
we often phrase such pursuits as going from point A to some imaginary state (point B).
To understand why that doesn't work, let's consider a maze.
June 1, 2025 at 5:46 AM
When we think of innovating, be that in our professional or personal lives:
• I want to get a job in tech
• I want to reach ASI
we often phrase such pursuits as going from point A to some imaginary state (point B).
To understand why that doesn't work, let's consider a maze.
• I want to get a job in tech
• I want to reach ASI
we often phrase such pursuits as going from point A to some imaginary state (point B).
To understand why that doesn't work, let's consider a maze.
That is why the research off the beaten track is so exciting.
It can bring us closer to ASI, but above all, it explores the search space versus being stuck in a single, narrow corridor.
It can bring us closer to ASI, but above all, it explores the search space versus being stuck in a single, narrow corridor.
June 1, 2025 at 5:46 AM
That is why the research off the beaten track is so exciting.
It can bring us closer to ASI, but above all, it explores the search space versus being stuck in a single, narrow corridor.
It can bring us closer to ASI, but above all, it explores the search space versus being stuck in a single, narrow corridor.
These people weren't stupid!
They just didn't understand the nature of innovation.
In their thinking, they didn't place enough weight on the unknown, the unknowable to them, despite their recent outstanding technological achievements.
They just didn't understand the nature of innovation.
In their thinking, they didn't place enough weight on the unknown, the unknowable to them, despite their recent outstanding technological achievements.
June 1, 2025 at 5:46 AM
These people weren't stupid!
They just didn't understand the nature of innovation.
In their thinking, they didn't place enough weight on the unknown, the unknowable to them, despite their recent outstanding technological achievements.
They just didn't understand the nature of innovation.
In their thinking, they didn't place enough weight on the unknown, the unknowable to them, despite their recent outstanding technological achievements.
If we are to be honest with ourselves, we cannot presume to know the path to ASI until we reach it.
Ever since the 1970s, we have been 3 years from ASI.
However, this idea extends even further into the past!
Ever since the 1970s, we have been 3 years from ASI.
However, this idea extends even further into the past!
June 1, 2025 at 5:46 AM
If we are to be honest with ourselves, we cannot presume to know the path to ASI until we reach it.
Ever since the 1970s, we have been 3 years from ASI.
However, this idea extends even further into the past!
Ever since the 1970s, we have been 3 years from ASI.
However, this idea extends even further into the past!
Precisely because our mental map is so unrepresentative of the terrain!
If the current leading paradigm of autoregressive transformers does not lead to ASI, maximising scores on various benchmarks will not get us there.
If the current leading paradigm of autoregressive transformers does not lead to ASI, maximising scores on various benchmarks will not get us there.
June 1, 2025 at 5:46 AM
Precisely because our mental map is so unrepresentative of the terrain!
If the current leading paradigm of autoregressive transformers does not lead to ASI, maximising scores on various benchmarks will not get us there.
If the current leading paradigm of autoregressive transformers does not lead to ASI, maximising scores on various benchmarks will not get us there.
When we think of innovating, be that in our professional or personal lives:
• I want to get a job in tech
• I want to reach ASI
we often phrase such pursuits as going from point A to some imaginary state (point B).
To understand why that doesn't work, let's consider a maze.
• I want to get a job in tech
• I want to reach ASI
we often phrase such pursuits as going from point A to some imaginary state (point B).
To understand why that doesn't work, let's consider a maze.
June 1, 2025 at 5:46 AM
When we think of innovating, be that in our professional or personal lives:
• I want to get a job in tech
• I want to reach ASI
we often phrase such pursuits as going from point A to some imaginary state (point B).
To understand why that doesn't work, let's consider a maze.
• I want to get a job in tech
• I want to reach ASI
we often phrase such pursuits as going from point A to some imaginary state (point B).
To understand why that doesn't work, let's consider a maze.
Nearly all the books I read feel life-changing, but this one hit different.
You know those concepts that have been almost making sense for years? Several of them just clicked for me while reading this.
Going to share excerpts + my thoughts over the next few days & list them 👇
You know those concepts that have been almost making sense for years? Several of them just clicked for me while reading this.
Going to share excerpts + my thoughts over the next few days & list them 👇
May 31, 2025 at 6:37 AM
Nearly all the books I read feel life-changing, but this one hit different.
You know those concepts that have been almost making sense for years? Several of them just clicked for me while reading this.
Going to share excerpts + my thoughts over the next few days & list them 👇
You know those concepts that have been almost making sense for years? Several of them just clicked for me while reading this.
Going to share excerpts + my thoughts over the next few days & list them 👇