Same here, getting kinda bored of this platform because of that

I mean, it is important, but they're mostly memory bound

Extrapolating some numbers from that specs pic, it should be ~50% faster than a 3090 in raw compute. Memory bandwidth is still unknown, but I believe it might be either a 256 or 512-bit bus.

Oh, just noticed the price is listed in the site you linked, my bad haha

I was hoping for sub $2k prices, but I guess $3k is somewhat fair still.
Not sure if I'll be getting one tho, for me it's too much for a fancy toy 🙃

I have the previous orin nano, that price cut made me regret mine a bit 🥲
Other than that, seems to be mostly a CPU/GPU OC and an upgrade to LPDDR5 6400MT/s instead of 4266.

It should be able to handle 13B at Q4

Upgrading to 15.2 apparently did the trick, but I'll keep this in mind if any other issue ever arises, thanks!

Thanks for the suggestion, but my access to the app store is a bit restricted 🥲
I really wanted to use speedcrunch, but it gave me some weird issues due to certificates.

That 2x speedup was when running in my local laptop (which has a GPU so offload some tasks), in our prod systems (CPU-only) this turned out to be a 5x speedup, yay!

But did you let it in?

yey, 2.5gbe-ish

I've never heard of such thing before, that sounds really weird

The laptop version of the 4090 uses the same chip of the desktop 4080 (AD103), and both have the exact same core count.

Thanks!

I'd love if someone came up with one of those "lists" for SBC people haha