@bytealchemist.bsky.social
Machine Learning Engineer | Tech | Local AI | Research
endless scroll feeds seem to trigger the same mechanisms as gambling, not good, should stay away
January 31, 2025 at 6:02 PM
endless scroll feeds seem to trigger the same mechanisms as gambling, not good, should stay away
Okay for local development of RAG stuff I settled on using "Llama-3.2-3B-Instruct-Q6_K.gguf" for now. Its 2.5GB in file size and not completely stupid, throughput on my RTX3060Ti is like 60tok/s which is more than enough for my use case. Has to still pass the vibe check over the next weeks though
January 29, 2025 at 6:35 PM
Okay for local development of RAG stuff I settled on using "Llama-3.2-3B-Instruct-Q6_K.gguf" for now. Its 2.5GB in file size and not completely stupid, throughput on my RTX3060Ti is like 60tok/s which is more than enough for my use case. Has to still pass the vibe check over the next weeks though
vLLM Quickstart guide comes with "Qwen/Qwen2.5-1.5B-Instruct" as the model of choice and I cannot emphasize enough how shit this model is for my (German) usecase
January 29, 2025 at 3:10 PM
vLLM Quickstart guide comes with "Qwen/Qwen2.5-1.5B-Instruct" as the model of choice and I cannot emphasize enough how shit this model is for my (German) usecase
Reposted
On the value of Twitter, btw - We had similar traffic from Bluesky, where the FT has 300 thousand followers, to what came from Twitter, where we supposedly have 6 million.
If Tesla buyers want clean power, not white power, that could be a small problem for its $1.4tn stock market valuation.
A fork in the road for Tesla
Clean power versus white power
www.ft.com
January 23, 2025 at 11:18 AM
On the value of Twitter, btw - We had similar traffic from Bluesky, where the FT has 300 thousand followers, to what came from Twitter, where we supposedly have 6 million.
Got frontend stack to finally work. Bun, vite, react, TS, tailwind, shadcn UI components. I have come to appreciate the simplicity of Python and am convinced 90% of WebDev complexity is knowing which setting in which json from which framework is misconfigured
January 23, 2025 at 4:51 PM
Got frontend stack to finally work. Bun, vite, react, TS, tailwind, shadcn UI components. I have come to appreciate the simplicity of Python and am convinced 90% of WebDev complexity is knowing which setting in which json from which framework is misconfigured
cite.config.ts tailwind.config.js tsconfig.json tsconfig.app.json package.json eslint.config.js bun.lock components.json I AM GOING TO CRY
January 23, 2025 at 12:50 PM
cite.config.ts tailwind.config.js tsconfig.json tsconfig.app.json package.json eslint.config.js bun.lock components.json I AM GOING TO CRY
Starting with modern Frontend as an ML engineer is so confusing, what do bun and vite even do and why are there a thousand config files at the top level dir after running a few init commands. Maybe I should have started more gradually with vanilla JS+HTML
January 23, 2025 at 12:27 PM
Starting with modern Frontend as an ML engineer is so confusing, what do bun and vite even do and why are there a thousand config files at the top level dir after running a few init commands. Maybe I should have started more gradually with vanilla JS+HTML
Idk man, zuck flipfloppin like that hurts his image so much - just last year he was praised for being so 'based', now he seems to copy every bad decision Elon made with Twitter. Hate to see it
January 21, 2025 at 2:37 PM
Idk man, zuck flipfloppin like that hurts his image so much - just last year he was praised for being so 'based', now he seems to copy every bad decision Elon made with Twitter. Hate to see it
Reposted
Wrote up a gnarly sequence of hacks for downloading every video in a TikTok account, just in case anyone needs such a thing in the next ~24 hours
uv, yt-dlp, JavaScript in the Firefox DevTools and optionally throws in mlx-whisper for generating transcripts too til.simonwillison.net/tiktok/downl...
uv, yt-dlp, JavaScript in the Firefox DevTools and optionally throws in mlx-whisper for generating transcripts too til.simonwillison.net/tiktok/downl...
Downloading every video for a TikTok account
TikTok may or may not be banned in the USA within the next 24 hours or so. Here's a pattern you can use to download all of the videos from a specific account.
til.simonwillison.net
January 19, 2025 at 1:12 AM
Wrote up a gnarly sequence of hacks for downloading every video in a TikTok account, just in case anyone needs such a thing in the next ~24 hours
uv, yt-dlp, JavaScript in the Firefox DevTools and optionally throws in mlx-whisper for generating transcripts too til.simonwillison.net/tiktok/downl...
uv, yt-dlp, JavaScript in the Firefox DevTools and optionally throws in mlx-whisper for generating transcripts too til.simonwillison.net/tiktok/downl...
Reposted
Yet more evidence that people can’t accurately detect well-prompted AI writing (and AI can’t accurately detect well-prompted AI writing, either). arxiv.org/pdf/2407.08853
January 18, 2025 at 8:34 PM
Yet more evidence that people can’t accurately detect well-prompted AI writing (and AI can’t accurately detect well-prompted AI writing, either). arxiv.org/pdf/2407.08853