Asghar Ghorbani
@a-ghorbani.bsky.social
PocketPaling AI: https://github.com/a-ghorbani/pocketpal-ai
One of PocketPal's longest-standing open requests is finally closed:
🎉 𝗶𝗣𝗮𝗱 support is here! 🎉
Huge shoutout to Sultan Qasim (github.com/sultanqasim) for the contribution.
Feel free to give it a spin: apps.apple.com/us/app/pocke...
#PocketPalAI
🎉 𝗶𝗣𝗮𝗱 support is here! 🎉
Huge shoutout to Sultan Qasim (github.com/sultanqasim) for the contribution.
Feel free to give it a spin: apps.apple.com/us/app/pocke...
#PocketPalAI
March 29, 2025 at 6:35 PM
One of PocketPal's longest-standing open requests is finally closed:
🎉 𝗶𝗣𝗮𝗱 support is here! 🎉
Huge shoutout to Sultan Qasim (github.com/sultanqasim) for the contribution.
Feel free to give it a spin: apps.apple.com/us/app/pocke...
#PocketPalAI
🎉 𝗶𝗣𝗮𝗱 support is here! 🎉
Huge shoutout to Sultan Qasim (github.com/sultanqasim) for the contribution.
Feel free to give it a spin: apps.apple.com/us/app/pocke...
#PocketPalAI
Just shipped 𝗣𝗮𝗹𝘀 in PocketPal (v1.8.3+) 🚀🚀🚀
It's a chill way to handle system prompts and LLM setups. Think 𝘛𝘳𝘢𝘯𝘴𝘭𝘢𝘵𝘰𝘳 𝘗𝘢𝘭 or 𝘙𝘰𝘭𝘦𝘱𝘭𝘢𝘺 𝘗𝘢𝘭 etc. You can even use any of the on device LLM (like Llama 3.2 3B) to craft prompts for you.
It's a chill way to handle system prompts and LLM setups. Think 𝘛𝘳𝘢𝘯𝘴𝘭𝘢𝘵𝘰𝘳 𝘗𝘢𝘭 or 𝘙𝘰𝘭𝘦𝘱𝘭𝘢𝘺 𝘗𝘢𝘭 etc. You can even use any of the on device LLM (like Llama 3.2 3B) to craft prompts for you.
February 23, 2025 at 8:35 PM
Just shipped 𝗣𝗮𝗹𝘀 in PocketPal (v1.8.3+) 🚀🚀🚀
It's a chill way to handle system prompts and LLM setups. Think 𝘛𝘳𝘢𝘯𝘴𝘭𝘢𝘵𝘰𝘳 𝘗𝘢𝘭 or 𝘙𝘰𝘭𝘦𝘱𝘭𝘢𝘺 𝘗𝘢𝘭 etc. You can even use any of the on device LLM (like Llama 3.2 3B) to craft prompts for you.
It's a chill way to handle system prompts and LLM setups. Think 𝘛𝘳𝘢𝘯𝘴𝘭𝘢𝘵𝘰𝘳 𝘗𝘢𝘭 or 𝘙𝘰𝘭𝘦𝘱𝘭𝘢𝘺 𝘗𝘢𝘭 etc. You can even use any of the on device LLM (like Llama 3.2 3B) to craft prompts for you.
Reposted by Asghar Ghorbani
We are reproducing the full DeepSeek R1 data and training pipeline so everybody can use their recipe. Instead of doing it in secret we can do it together in the open!
Follow along: github.com/huggingface/...
Follow along: github.com/huggingface/...
GitHub - huggingface/open-r1: Fully open reproduction of DeepSeek-R1
Fully open reproduction of DeepSeek-R1. Contribute to huggingface/open-r1 development by creating an account on GitHub.
github.com
January 25, 2025 at 1:29 PM
We are reproducing the full DeepSeek R1 data and training pipeline so everybody can use their recipe. Instead of doing it in secret we can do it together in the open!
Follow along: github.com/huggingface/...
Follow along: github.com/huggingface/...
🚀 PocketPal AI 1.6.2 is released with an exciting new feature: 𝗔𝗜-𝗣𝗵𝗼𝗻𝗲 𝗕𝗲𝗻𝗰𝗵𝗺𝗮𝗿𝗸𝗶𝗻𝗴! 🚀 you can now:
✅ Benchmark your device’s performance in running AI models.
✅ Compare results on the AI-Phone Leaderboard: huggingface.co/spaces/a-gho... on Hugging Face.
✅ Benchmark your device’s performance in running AI models.
✅ Compare results on the AI-Phone Leaderboard: huggingface.co/spaces/a-gho... on Hugging Face.
January 8, 2025 at 8:55 AM
🚀 PocketPal AI 1.6.2 is released with an exciting new feature: 𝗔𝗜-𝗣𝗵𝗼𝗻𝗲 𝗕𝗲𝗻𝗰𝗵𝗺𝗮𝗿𝗸𝗶𝗻𝗴! 🚀 you can now:
✅ Benchmark your device’s performance in running AI models.
✅ Compare results on the AI-Phone Leaderboard: huggingface.co/spaces/a-gho... on Hugging Face.
✅ Benchmark your device’s performance in running AI models.
✅ Compare results on the AI-Phone Leaderboard: huggingface.co/spaces/a-gho... on Hugging Face.
Reposted by Asghar Ghorbani
PocketPal is an #opensource app that lets you locally run open #llm #ai models including those on @huggingface
https://github.com/a-ghorbani/pocketpal-ai/blob/main/docs/getting_started.md
#android: https://play.google.com/store/apps/details?id=com.pocketpalai
iPhone […]
https://github.com/a-ghorbani/pocketpal-ai/blob/main/docs/getting_started.md
#android: https://play.google.com/store/apps/details?id=com.pocketpalai
iPhone […]
Original post on mastodon.social
mastodon.social
November 25, 2024 at 5:05 PM
PocketPal is an #opensource app that lets you locally run open #llm #ai models including those on @huggingface
https://github.com/a-ghorbani/pocketpal-ai/blob/main/docs/getting_started.md
#android: https://play.google.com/store/apps/details?id=com.pocketpalai
iPhone […]
https://github.com/a-ghorbani/pocketpal-ai/blob/main/docs/getting_started.md
#android: https://play.google.com/store/apps/details?id=com.pocketpalai
iPhone […]
Wow! Hermes 3 LLM is impressive! Already GGUFs on @hf.co.
I’m playing around with Q6 one on my phone:
> Accurately follows instructions
> Great at storytelling
> Does a really good job generating structured outputs (e.g., JSON)
#Hermes @nousresearch.com #LLM #SLM
I’m playing around with Q6 one on my phone:
> Accurately follows instructions
> Great at storytelling
> Does a really good job generating structured outputs (e.g., JSON)
#Hermes @nousresearch.com #LLM #SLM
December 12, 2024 at 7:38 AM
Wow! Hermes 3 LLM is impressive! Already GGUFs on @hf.co.
I’m playing around with Q6 one on my phone:
> Accurately follows instructions
> Great at storytelling
> Does a really good job generating structured outputs (e.g., JSON)
#Hermes @nousresearch.com #LLM #SLM
I’m playing around with Q6 one on my phone:
> Accurately follows instructions
> Great at storytelling
> Does a really good job generating structured outputs (e.g., JSON)
#Hermes @nousresearch.com #LLM #SLM
🤯 Ran 10B INTELLECT-1-Instruct of on my iPhone (8GB) w/ IQ2_M quantization using PocketPal AI. Dead slow (0.7 tokens/sec) but still 🔥! Few months ago, ppl would've laughed at the idea of running this on a phone. Curios what Android users w more mem can run. #llm @hf.co #llama.cpp
November 30, 2024 at 9:59 AM
🤯 Ran 10B INTELLECT-1-Instruct of on my iPhone (8GB) w/ IQ2_M quantization using PocketPal AI. Dead slow (0.7 tokens/sec) but still 🔥! Few months ago, ppl would've laughed at the idea of running this on a phone. Curios what Android users w more mem can run. #llm @hf.co #llama.cpp
Reposted by Asghar Ghorbani
Download on Google Play: play.google.com/store/apps/d...
Download on the App Store: apps.apple.com/de/app/pocke...
Download on the App Store: apps.apple.com/de/app/pocke...
November 21, 2024 at 3:17 PM
Download on Google Play: play.google.com/store/apps/d...
Download on the App Store: apps.apple.com/de/app/pocke...
Download on the App Store: apps.apple.com/de/app/pocke...
Reposted by Asghar Ghorbani
PocketPal AI v1.5 is released 💯
You can now access to more than 45K GGUF models on the Hugging Face Hub 🤗 , directly from the application!
As a bonus, we got a brand new logo for the app too!
Huge thanks to Asghar Ghorbani!
You can now access to more than 45K GGUF models on the Hugging Face Hub 🤗 , directly from the application!
As a bonus, we got a brand new logo for the app too!
Huge thanks to Asghar Ghorbani!
November 21, 2024 at 3:16 PM
PocketPal AI v1.5 is released 💯
You can now access to more than 45K GGUF models on the Hugging Face Hub 🤗 , directly from the application!
As a bonus, we got a brand new logo for the app too!
Huge thanks to Asghar Ghorbani!
You can now access to more than 45K GGUF models on the Hugging Face Hub 🤗 , directly from the application!
As a bonus, we got a brand new logo for the app too!
Huge thanks to Asghar Ghorbani!