Ed Fattell
@efattell.bsky.social
I love computers, Linux, industrial design and architecture.
CS Undergrad Student at UofA
Follow me on Mastodon:
https://mastodon.social/@edfattell
CS Undergrad Student at UofA
Follow me on Mastodon:
https://mastodon.social/@edfattell
Use matrix not signal.
February 7, 2025 at 8:08 AM
Use matrix not signal.
Petition to call Bluesky posters Bluesters and change the mascot to a blue Rooster named Bluester. Because Bluesky + poster = Bluester. And Bluesky + rooster = Bluester. See?
February 2, 2025 at 10:04 PM
Petition to call Bluesky posters Bluesters and change the mascot to a blue Rooster named Bluester. Because Bluesky + poster = Bluester. And Bluesky + rooster = Bluester. See?
Wow! I find the results on the Mac Studio very impressive! I have been running R1 32b distill on my M1 Max MBP w 32gb memory. I get around 11 tokens/s but I think it’s limited by thermal capacity, as some GPU clusters reach 95C. Have you tried running on the Studio? I wonder if it does better.
January 30, 2025 at 7:07 AM
Wow! I find the results on the Mac Studio very impressive! I have been running R1 32b distill on my M1 Max MBP w 32gb memory. I get around 11 tokens/s but I think it’s limited by thermal capacity, as some GPU clusters reach 95C. Have you tried running on the Studio? I wonder if it does better.
Wow I have never heard of this. Do you have any experience using it?
January 30, 2025 at 6:48 AM
Wow I have never heard of this. Do you have any experience using it?
Haha yes! I have already transitioned, I haven’t used a Mac for day to day tasks for over a year now. Besides that, I have used Linux for a very long time.
Right now, I’m using Fedora on my pcs, mostly for the newer packages.
Right now, I’m using Fedora on my pcs, mostly for the newer packages.
January 26, 2025 at 6:21 PM
Haha yes! I have already transitioned, I haven’t used a Mac for day to day tasks for over a year now. Besides that, I have used Linux for a very long time.
Right now, I’m using Fedora on my pcs, mostly for the newer packages.
Right now, I’m using Fedora on my pcs, mostly for the newer packages.
I do have asahi on this machine but ollama is running on Mac OS. I figured I get some idea of it runs in stock first. Maybe I’ll try on fedora soon. I don’t really enjoy Mac OS much anymore. Still better than windows though.
January 26, 2025 at 7:32 AM
I do have asahi on this machine but ollama is running on Mac OS. I figured I get some idea of it runs in stock first. Maybe I’ll try on fedora soon. I don’t really enjoy Mac OS much anymore. Still better than windows though.
Also I have not encountered any "hallucinations," though sometimes r1 has missed an error in code, but I have experienced something similar with o1, so I would attribute that to the model perhaps not knowing sml syntax that well.
January 26, 2025 at 5:26 AM
Also I have not encountered any "hallucinations," though sometimes r1 has missed an error in code, but I have experienced something similar with o1, so I would attribute that to the model perhaps not knowing sml syntax that well.
So it was more than able to fit into memory. Overall; I am pretty happy for running a 32b model on a MacBook. (Side note: btop doesn't report temps on mac for some reason so i had to use this weird mac fan control app.)
January 26, 2025 at 5:24 AM
So it was more than able to fit into memory. Overall; I am pretty happy for running a 32b model on a MacBook. (Side note: btop doesn't report temps on mac for some reason so i had to use this weird mac fan control app.)
Ok, so I did a little testing because I was not sure myself. I asked r1 to check for bugs in an SML file; I will not share the prompt or file because it is for an assignmnet. The highest the GPU temp got was 95C and 11 tokens/s. I have 32gb of unified ram and the quant of r1 on ollama is ~20gb
January 26, 2025 at 5:24 AM
Ok, so I did a little testing because I was not sure myself. I asked r1 to check for bugs in an SML file; I will not share the prompt or file because it is for an assignmnet. The highest the GPU temp got was 95C and 11 tokens/s. I have 32gb of unified ram and the quant of r1 on ollama is ~20gb
That’s not the most useful 😂 I sometimes have a problem giving r1 multiple files via open webui. Sometimes I just won’t recognize the file, even if I send it multiple times. Perhaps this is just an issue with ui though. Not sure.
January 26, 2025 at 2:06 AM
That’s not the most useful 😂 I sometimes have a problem giving r1 multiple files via open webui. Sometimes I just won’t recognize the file, even if I send it multiple times. Perhaps this is just an issue with ui though. Not sure.
So far, I have only used open webui, but I would be interested in finding neovim plugins for an experience akin to copilot. Tbh, I have not looked into it much because I have never used AI in a text editor before.
January 25, 2025 at 6:46 PM
So far, I have only used open webui, but I would be interested in finding neovim plugins for an experience akin to copilot. Tbh, I have not looked into it much because I have never used AI in a text editor before.
Alacritty because I don’t need my terminal to display pictures; that’s what gui apps are for 😂. But honestly, I will probably switch to ghostty soon. I’m sold on it. Plus zig :)
January 25, 2025 at 8:35 AM
Alacritty because I don’t need my terminal to display pictures; that’s what gui apps are for 😂. But honestly, I will probably switch to ghostty soon. I’m sold on it. Plus zig :)
I have also been running the 32b model on my M1 Max mbp. This is the first time I have pushed it this hard. I’m using whatever quant is on ollama on 32gb of unified memory. The thing sounds louder than a ps4.
Anyways, it’s very impressive. I have thrown a few tasks debugging SML.
Anyways, it’s very impressive. I have thrown a few tasks debugging SML.
January 25, 2025 at 8:29 AM
I have also been running the 32b model on my M1 Max mbp. This is the first time I have pushed it this hard. I’m using whatever quant is on ollama on 32gb of unified memory. The thing sounds louder than a ps4.
Anyways, it’s very impressive. I have thrown a few tasks debugging SML.
Anyways, it’s very impressive. I have thrown a few tasks debugging SML.
I would like a dm about the beta! 😇
January 25, 2025 at 7:34 AM
I would like a dm about the beta! 😇
To address the last part of your question; I would say that I can be easy to move distros, but unless you can manage your partitions very well, it can be a pain to do without nuking your system. If you are using nvidia drivers, which I think you are based on your posts, pop os is a great place to be
January 23, 2025 at 6:06 AM
To address the last part of your question; I would say that I can be easy to move distros, but unless you can manage your partitions very well, it can be a pain to do without nuking your system. If you are using nvidia drivers, which I think you are based on your posts, pop os is a great place to be
Debian is a distro; a very old one that is used as the basis for many others, namely Ubuntu and its derivatives like pop os. I use Debian for servers personally. Distros are differentiated by their app stores, called package mangers. Ex. Debian uses apt, and its package format is .deb
January 23, 2025 at 6:04 AM
Debian is a distro; a very old one that is used as the basis for many others, namely Ubuntu and its derivatives like pop os. I use Debian for servers personally. Distros are differentiated by their app stores, called package mangers. Ex. Debian uses apt, and its package format is .deb
Yes, Gnome and Debian are two different things. Gnome is a desktop environment; the stack of software that provides a GUI shell like application windows and the likes. Gnome is the most popular, but KDE Plasma, XFCE and Cosmic are other common options (I use and rec gnome).
January 23, 2025 at 6:00 AM
Yes, Gnome and Debian are two different things. Gnome is a desktop environment; the stack of software that provides a GUI shell like application windows and the likes. Gnome is the most popular, but KDE Plasma, XFCE and Cosmic are other common options (I use and rec gnome).
Nice! I have never used pop os myself but have some friends who like it. Debian based distros are always a great pick.
I think you’ll find there so much great software that was not common on windows but widely used on Linux! Don’t hesitate to reach out if you have any questions!
I think you’ll find there so much great software that was not common on windows but widely used on Linux! Don’t hesitate to reach out if you have any questions!
January 23, 2025 at 5:48 AM
Nice! I have never used pop os myself but have some friends who like it. Debian based distros are always a great pick.
I think you’ll find there so much great software that was not common on windows but widely used on Linux! Don’t hesitate to reach out if you have any questions!
I think you’ll find there so much great software that was not common on windows but widely used on Linux! Don’t hesitate to reach out if you have any questions!
Nice! Always great to have new members of the squad. Which distro and desktop environment did you choose?
January 23, 2025 at 5:29 AM
Nice! Always great to have new members of the squad. Which distro and desktop environment did you choose?