Sal-mon.
Sal-mon.
From a quick google, looks like it gets about 10 tokens/s on Llama3.3 70b. Any idea what you're expecting from your 3090s?
From a quick google, looks like it gets about 10 tokens/s on Llama3.3 70b. Any idea what you're expecting from your 3090s?
Also Apple make a 128gb M4 Max, which I now want a lot.
Also Apple make a 128gb M4 Max, which I now want a lot.
I thought "ooh this is a bold start to a show. They haven't introduced any characters, but clearly these two guys are gearing up for something"
I thought "ooh this is a bold start to a show. They haven't introduced any characters, but clearly these two guys are gearing up for something"
Is there a good video host for short stuff like this that's natively supported by Bluesky? Feels like someone ought to have built one by now 🤔
Is there a good video host for short stuff like this that's natively supported by Bluesky? Feels like someone ought to have built one by now 🤔