Aman K
amandhara.bsky.social
Aman K
@amandhara.bsky.social
Not running them locally but using them through openrouter
April 1, 2025 at 9:21 AM
I use R1 and the new v3 all the time, they are quite good, especially for reasoning model R1 is something really really good
March 30, 2025 at 2:03 AM
Are you using the unsloth quants?
February 3, 2025 at 4:26 PM
Having an outburst over a sarcastic post seems like missing the point, I think the quote post makes the same point but through humour, does it not?
January 14, 2025 at 4:12 AM
How about its ability to source relevant material?
December 13, 2024 at 8:25 PM
Impressive, at the same time given its long duration run, makes you wonder if it is profitable for Google, I would expect this from $200 sub not $20 sub, quite the bang for the buck
December 13, 2024 at 4:02 PM
How was the final result? Is it a very fast but mid assistant, or a fast and good to great assistant?
December 13, 2024 at 3:52 PM
Intriguing updates, looking forward to your future attempts, these experiments are quite illustrative
December 10, 2024 at 4:28 AM
Gemini again or did you use another model this time?
December 9, 2024 at 10:38 AM
Quick question: what is the quant you are using to run the model, i.e. please describe your inference setup?
December 8, 2024 at 3:19 AM
Uber has two sided network effect, i.e pseudo-monopoly on pool of riders and drivers going for it, ChatGPT has branding power, that could serve it well, but given the headwinds from soon to be released OSS O1 like models from China, it will be tough
December 6, 2024 at 9:49 AM
Plot twist: Generated by ChatGPT Pro
December 6, 2024 at 9:15 AM
That is one hell of a supervillan arc
December 2, 2024 at 8:38 AM
👀
December 1, 2024 at 3:18 AM
Not really, never came across those, were they providing same feature as LoRA, i.e. memory efficient fine tuning?
November 30, 2024 at 5:14 PM
🤯 32B open model, available at just 20 cents per million token trading blows with GPT-4o, that has to be dramatic shift

Btw, are running this with quantization locally, or accessing it through API?
November 29, 2024 at 2:45 AM
How are accessing the model, recent Aider blogpost points out that results can be very sensitive to provider

aider.chat/2024/11/21/q...
November 29, 2024 at 2:36 AM
It's one of the lesson I learnt from Bill Burr, I am OSS and protocols sucker, so I will choose this over twitter anyday, but as Bill Burr (paraphrasing heavily) said, "I love @bsky.app, but I don't go over there with this starry look in my 👁️ that people will be ride on 🫎"

youtu.be/-hZ5gTYMk8Y?...
Bill Burr: Canada Is Not Some Post-Racial Paradise | CONAN on TBS
YouTube video by Team Coco
youtu.be
November 27, 2024 at 3:16 PM