Zach Brockway
LightNews LightNews
neverender.bsky.social
Zach Brockway
@neverender.bsky.social
200 followers 790 following 73 posts
Senior virtual production programmer @ Epic Games. Previously: XR/firmware @ OptiTrack. Spare time: Getting up to speed on ML.

Also @Zach@mastodon.gamedev.place.
Posts Replies Media Videos
neverender.bsky.social
I was cautiously optimistic SIGLIP2 might surprise me here... alas! Even siglip2-giant-opt-patch16-384 is mega-wonky.
Pairwise L2 distances between text features: ('running', 'run'): 21.87 ('running', 'walk'): 22.49 ('sit on chair', 'sit'): 30.49 ('sit on chair', 'throw chair'): 22.92 ('wave', 'waving'): 28.00 ('wave', 'surf'): 24.61 ('turn left', 'turning left'): 17.06 ('turn left', 'turn right'): 12.75
June 15, 2025 at 12:36 AM
neverender.bsky.social
I really enjoyed this! I also discovered that if you star the LanceDB repo on GitHub, you might get LinkedIn requests from their sales team, which is not a funnel I had previously considered. 🫠

FWIW I just remembered where I first saw that diagram: @fchollet.bsky.social's Deep Learning with Python.
Excerpt from chapter 1, with a block diagram labeled "Figure 1.2 - Machine learning: a new programming paradigm," contrasting two boxes labeled "classical programming" and "machine learning." The "classical programming" box takes "rules" and "data" as input, and yields "answers." The "machine learning" box takes "data" and "answers" as input, and yields "rules."
June 7, 2025 at 7:58 PM
neverender.bsky.social
Headline with man smiling: "Heartwarming: The Worst People You Know Are All Fighting" (Variation on classic Clickhole "Heartbreaking: Worst Person You Know Made a Great Point" post)
June 5, 2025 at 9:31 PM
neverender.bsky.social
To yours and especially @dame.is's point: a tragicomic summary of the dynamics at play that lives rent-free in my mind.
‪rev. howard arson‬ ‪@theophite.bsky.social‬ · 2mo i remember writing stuff in 2019 which was just, like, "we have to figure out how to make this not ruin the internet and everyone's jobs before we release it" and then chatGPT launched and they just threw all that work in the garbage ‪rev. howard arson‬ ‪@theophite.bsky.social‬ · 2mo like right now a guy whose first business was a VPN marketed to satanist child sex extortionists is running random foreign service officers' resumes through the world's worst LLM (which has an 'erotic' mode) to find out which ones to fire. how do you think that will affect sales rev. howard arson‬ ‪@theophite.bsky.social‬ · 2mo i really do love this stuff, man, and because a bunch of MBAs decided to do what they did, i'm going to spend the rest of my career fixing what they broke, breaking what i built, or apologizing for what i did ‪ SE Gyges 🏴‍☠️‬ ‪@segyges.bsky.social‬ · 2mo have you considered the possibility that this stuff just inherently makes people insane, as a domain ‪rev. howard arson‬ ‪@theophite.bsky.social‬ · 2mo rip to everyone else who went mad staring into the aleph but im different
June 5, 2025 at 1:01 AM
neverender.bsky.social
Between the specter of death threats here for learning in public about forbidden applications of linear algebra, and the fact that I don't want to help delay the demise of Twitter, I've more or less given up.

I'm already blocked by 28,000 people, some of whom I respect, for *liking one post*!
Zach Brockway‬ ‪@neverender.bsky.social‬ · 6mo Same. But I made the apparent mistake of liking Alex’s original post where he said “in the long-term i don't really care if people with reactionary opinions that i do not really respect blacklist me.” Guess what? Everyone who liked that post ended up getting added to the “AI artist” block list! ‪Zach Brockway‬ ‪@neverender.bsky.social‬ · 6mo If anyone had bothered asking, I might’ve tried to explain that I don’t use generative image models at all, and play around with LLMs locally under a microscope because “I just think they’re neat.” I think it’s Bad, Actually that companies can sack and launder the commons and privatize the profit! ‪godoglyness‬ ‪@godoglyness.bsky.social‬ · 6mo my biggest problem with this website (that isn't missing features: GCs pls? Private accounts pls?) is the propensity of some of the communities here to really zealous blocking your views seem perfectly reasonable & i don't think "pros" or "antis" should block you for them, whether or not they agree ‪Zach Brockway‬ ‪@neverender.bsky.social‬ · 6mo I think the ability to make a conscious decision to completely cut someone out of your social graph is fine! Great, even! “Nuclear block” is objectively good IMO. But outsourcing that decision to random people who accumulate lists of thousands of perceived enemies? I’m not so sure about that.
May 26, 2025 at 5:00 PM
neverender.bsky.social
Rare Anthropic tokenizer alpha. (h/t @andersonbcdefg.bsky.social)
"We will introduce our methodology for constructing attribution graphs while working through a case study regarding the model’s ability to write acronyms for arbitrary titles. In the example we study, the model successfully completes a fictional acronym. Specifically, we give the model the prompt `The National Digital Analytics Group (N` and sample its completion: `DAG)`. The tokenizer the model was trained with uses a special “Caps Lock” token, which means the prompt and completion are tokenized as follows: `The` `National` `Digital` `Analytics` `Group` `(``⇪``n``dag`." "The tokenizer used by Claude 3.5 Haiku includes some special tokens which are depicted in some of our plots. These include two capitalization tokens (↑, ⇪) and a new-line token (⏎)."
April 6, 2025 at 6:07 PM
neverender.bsky.social
Screen capture of the "Touch the Stove" game show from The Simpsons. The host and contestant stand on a stage in front of a live audience. Between them is an electric range with red hot burners.
November 25, 2024 at 4:09 PM
neverender.bsky.social
"When I choose to see the good side of things, I'm not being naive. It is strategic and necessary. It's how I've learned to survive through everything."
"CEO" Waymond from the film Everything Everywhere All at Once.
November 13, 2024 at 5:08 AM
neverender.bsky.social
Unreal 5.5 is out! Including shiny new Virtual Scouting documentation for the shiny production-ready Virtual Scouting!

dev.epicgames.com/documentatio...
November 12, 2024 at 9:32 PM
neverender.bsky.social
"In the video we visualize the analytically computed input space partition formed by the neuron-thresholds (black lines) and decision boundary (red line) of a ReLU-MLP, around three MNIST training samples (white stars)."

Also, @theophite.bsky.social has a singular gift for explaining this stuff.
November 12, 2024 at 12:31 AM
neverender.bsky.social
Feat. @somewhere.lol.
A post from my old Twitter account, dated September 15th. It’s a quote-retweet of @somewheresy saying “I LOVE Taxes and they should take 100% of my paycheck to build a Road.” My contribution was to lazily juxtapose it with an enormous Medlock PFP, with a comic speech bubble at the edge of the frame, as if he were the one saying it.
November 11, 2024 at 8:19 PM
neverender.bsky.social
Pair of tweets from @Grosdoriane. May 2019: “This is NOT what America is about. America is about *opens history book* uh oh *Frantically starts flipping though pages* uh oh. oh no. no no no. uh oh” Reply, January 6 2021: “The easiest way for me to tell that things are going bad in this country is when this tweet starts going around again.”
November 6, 2024 at 2:34 PM
neverender.bsky.social
From the Other Site:
QRT of Walz stream from @confusionm8trix: “as trump closes his rally at MSG, the two campaigns make their closing arguments” Comic panel with one extremely angry character behind a Trump/Vance 2024 podium, gritted teeth, veins bulging in their forehead, saying “I FUCKING HATE YOU AND HOPE YOU DIE” to a smaller, smiling character with a headset and a steering wheel, smiling and saying “let’s play crazy taxi :)”
October 28, 2024 at 5:09 PM
neverender.bsky.social
Cancelled Amazon Prime and would encourage anyone reading this to do the same. It’s all fake reviews and bootleg inventory contamination at this point anyway.
Email: “Confirmation: Your Prime membership will not renew.”
October 25, 2024 at 6:59 PM
neverender.bsky.social
Biden / Harris “I did that!” / “I helped!” sticker.
October 24, 2024 at 8:37 PM
neverender.bsky.social
Indescribably disappointed that this was not a Herman Miller x Mass Effect crossover.
Adjacent marketing emails. One from Bungie, advertising Mass Effect cosmetics for Destiny. The other from Herman Miller, advertising 20% off "the Asari Chair."
February 14, 2024 at 1:14 AM