@cloud_thrill | Blogger | Speaker| Cloud Homie| TerraBro, MultiCloud, Devops
Beatmaker
Services: https://cloudthrill.ca
🎙Podcast: https://bit.ly/Techbeats
our FREE vLLM POC is still live - but not forever.
📢𝗔𝗽𝗽𝗹𝘆 𝗻𝗼𝘄 → cloudthrill.ca/ai-poc
Run AI assistants, RAG, or open models privately in the cloud:
✅ No external APIs
✅ No vendor lock-in
✅ Total data control
Your Infra. Your Models. Your rules.🏆🏁
our FREE vLLM POC is still live - but not forever.
📢𝗔𝗽𝗽𝗹𝘆 𝗻𝗼𝘄 → cloudthrill.ca/ai-poc
Run AI assistants, RAG, or open models privately in the cloud:
✅ No external APIs
✅ No vendor lock-in
✅ Total data control
Your Infra. Your Models. Your rules.🏆🏁
🎇Today, we’re excited to launch our 𝐀𝐈 𝐏𝐫𝐢𝐯𝐚𝐭𝐞 𝐈𝐧𝐟𝐞𝐫𝐞𝐧𝐜𝐞 𝐒𝐞𝐫𝐯𝐢𝐜𝐞: powered by Open source AI stack.
To celebrate we offer a 𝐅𝐑𝐄𝐄 𝐕𝐋𝐋𝐌 POC in any cloud you choose! Apply Now! Only 5 spots available.👉🏼 cloudthrill.ca/ai-poc
youtu.be/i_vIrOH8I3E?...
🎇Today, we’re excited to launch our 𝐀𝐈 𝐏𝐫𝐢𝐯𝐚𝐭𝐞 𝐈𝐧𝐟𝐞𝐫𝐞𝐧𝐜𝐞 𝐒𝐞𝐫𝐯𝐢𝐜𝐞: powered by Open source AI stack.
To celebrate we offer a 𝐅𝐑𝐄𝐄 𝐕𝐋𝐋𝐌 POC in any cloud you choose! Apply Now! Only 5 spots available.👉🏼 cloudthrill.ca/ai-poc
youtu.be/i_vIrOH8I3E?...
You’ve heard of RAG, vector DBs, and embeddings... 🤔
But what are 𝐞𝐦𝐛𝐞𝐝𝐝𝐢𝐧𝐠𝐬 really, and why do they matter?
learn all about it and how it works in this 5 minute post
👇🏼 cloudthrill.ca/llm_embeddin...
#LLM #Embeddingmodels #AI #RAG #VectorDB
You’ve heard of RAG, vector DBs, and embeddings... 🤔
But what are 𝐞𝐦𝐛𝐞𝐝𝐝𝐢𝐧𝐠𝐬 really, and why do they matter?
learn all about it and how it works in this 5 minute post
👇🏼 cloudthrill.ca/llm_embeddin...
#LLM #Embeddingmodels #AI #RAG #VectorDB
📖 𝐯𝐋𝐋𝐌 𝐩𝐫𝐨𝐝𝐮𝐜𝐭𝐢𝐨𝐧-𝐬𝐭𝐚𝐜𝐤: AI inference for enterprises💫
🏢Production-stack is the K8s-native, enterprise-ready inference setup that supercharges vLLM inference at scale, across Clouds.
👉Start here: cloudthrill.ca/vllm-product...
#AI #LLM #vLLM #Kubernetes #MLOps #KVCache #LMCache
📖 𝐯𝐋𝐋𝐌 𝐩𝐫𝐨𝐝𝐮𝐜𝐭𝐢𝐨𝐧-𝐬𝐭𝐚𝐜𝐤: AI inference for enterprises💫
🏢Production-stack is the K8s-native, enterprise-ready inference setup that supercharges vLLM inference at scale, across Clouds.
👉Start here: cloudthrill.ca/vllm-product...
#AI #LLM #vLLM #Kubernetes #MLOps #KVCache #LMCache
Part1️⃣: 𝐅undamentals cloudthrill.ca/what-is-vllm
Part2️⃣: 𝐊ey 𝐅eatures cloudthrill.ca/what-is-vllm...
part3️⃣: 𝐃eployment 𝐎ptions cloudthrill.ca/vllm-deloyment
#vllm_project #lmcache #LLMs
Part1️⃣: 𝐅undamentals cloudthrill.ca/what-is-vllm
Part2️⃣: 𝐊ey 𝐅eatures cloudthrill.ca/what-is-vllm...
part3️⃣: 𝐃eployment 𝐎ptions cloudthrill.ca/vllm-deloyment
#vllm_project #lmcache #LLMs
youtu.be/aAbbSk2F-Xs?...
youtu.be/aAbbSk2F-Xs?...
🔁𝐑𝐞𝐜𝐮𝐫𝐬𝐢𝐯𝐞 𝒈𝒊𝒕𝒊𝒈𝒏𝒐𝒓𝒆: "𝘞𝘩𝘦𝘯 𝘐𝘨𝘯𝘰𝘳𝘪𝘯𝘨 𝘎𝘰𝘦𝘴 𝘛𝘰𝘰 𝘍𝘢𝘳"
👉Read here: tinyurl.com/gitignorez
✅ The Usual suspects: Broad Wildcards, nested files
✅ Recursive directory matching & Trailing "/"
✅ How to stop recursive chaos before it hits prod
#DevOps #GitHub #GitLab #CICD
🔁𝐑𝐞𝐜𝐮𝐫𝐬𝐢𝐯𝐞 𝒈𝒊𝒕𝒊𝒈𝒏𝒐𝒓𝒆: "𝘞𝘩𝘦𝘯 𝘐𝘨𝘯𝘰𝘳𝘪𝘯𝘨 𝘎𝘰𝘦𝘴 𝘛𝘰𝘰 𝘍𝘢𝘳"
👉Read here: tinyurl.com/gitignorez
✅ The Usual suspects: Broad Wildcards, nested files
✅ Recursive directory matching & Trailing "/"
✅ How to stop recursive chaos before it hits prod
#DevOps #GitHub #GitLab #CICD
𝐏𝐚𝐫𝐭 𝟑: 𝐒𝐞𝐭𝐮𝐩 𝐊𝐮𝐛𝐞𝐫𝐧𝐞𝐭𝐞𝐬 𝐀𝐮𝐭𝐡𝐞𝐧𝐭𝐢𝐜𝐚𝐭𝐢𝐨𝐧 𝐰𝐢𝐭𝐡 𝐕𝐚𝐮𝐥𝐭
👉 tinyurl.com/k8sAuthVault
💡In this 5 minutes tuto you'll learn:
✅ Diff Vault auth scenarios for k8s
✅ Setup up K8s Vault Auth with SA/Client JWT & OIDC
#k8s #HashiCorp #Vault #SecretsManagement #DevOps
𝐏𝐚𝐫𝐭 𝟑: 𝐒𝐞𝐭𝐮𝐩 𝐊𝐮𝐛𝐞𝐫𝐧𝐞𝐭𝐞𝐬 𝐀𝐮𝐭𝐡𝐞𝐧𝐭𝐢𝐜𝐚𝐭𝐢𝐨𝐧 𝐰𝐢𝐭𝐡 𝐕𝐚𝐮𝐥𝐭
👉 tinyurl.com/k8sAuthVault
💡In this 5 minutes tuto you'll learn:
✅ Diff Vault auth scenarios for k8s
✅ Setup up K8s Vault Auth with SA/Client JWT & OIDC
#k8s #HashiCorp #Vault #SecretsManagement #DevOps
👉Complete guide here cloudthrill.ca/how-i-passed...
🎯 I included all you need to ace it:
✅Free exam practice
✅ Most exhaustive Cheat Sheet (all topics covered)
✅CliffsNotes, & exam expectations
#Cloudthrill #Certification #GitHubActions
👉Complete guide here cloudthrill.ca/how-i-passed...
🎯 I included all you need to ace it:
✅Free exam practice
✅ Most exhaustive Cheat Sheet (all topics covered)
✅CliffsNotes, & exam expectations
#Cloudthrill #Certification #GitHubActions
𝐯𝐋𝐋𝐌 𝐟𝐨𝐫 𝐁𝐞𝐠𝐢𝐧𝐧𝐞𝐫𝐬 𝐏𝐚𝐫𝐭 𝟑:📖 𝐃𝐞𝐩𝐥𝐨𝐲𝐦𝐞𝐧𝐭 𝐎𝐩𝐭𝐢𝐨𝐧𝐬
Learn to deploy #vLLM everywhere! Even on CPU🤫
✅Platform & model Support Matrix
✅Install on GPU & CPU
✅Build Wheel from scratch | Python vLLM package
✅Docker/Kubernetes Deployment
✅Running vLLM server (Offline + Online inference)
💎Deploy your full fledged Talos 𝐊𝐮𝐛𝐞𝐫𝐧𝐞𝐭𝐞𝐬 stack with Terraform in one command.
check it out👉: tinyurl.com/CivoK8stf
✅ Includes Grafana, Prometheus, Let's Encrypt & more
📖 My Repo: tinyurl.com/k8sCivoRepo
#Civo #Grafana #Terraform #Kubernetes #Tutorial
💎Deploy your full fledged Talos 𝐊𝐮𝐛𝐞𝐫𝐧𝐞𝐭𝐞𝐬 stack with Terraform in one command.
check it out👉: tinyurl.com/CivoK8stf
✅ Includes Grafana, Prometheus, Let's Encrypt & more
📖 My Repo: tinyurl.com/k8sCivoRepo
#Civo #Grafana #Terraform #Kubernetes #Tutorial
🗓️ Thursday 17th 11:30 AM EDT
🎯 A chill livestream unpacking LLM #Quantization: #vllm vs #ollama. Learn about the What & How.
🔥Dope guest stars:
#bartowski from arcee.ai & Eldar Kurtic from #RedHat
🔗Stream on YouTube & Linkedin:
www.youtube.com/watch?v=XTE0...
🗓️ Thursday 17th 11:30 AM EDT
🎯 A chill livestream unpacking LLM #Quantization: #vllm vs #ollama. Learn about the What & How.
🔥Dope guest stars:
#bartowski from arcee.ai & Eldar Kurtic from #RedHat
🔗Stream on YouTube & Linkedin:
www.youtube.com/watch?v=XTE0...
𝐯𝐋𝐋𝐌 𝐟𝐨𝐫 𝐁𝐞𝐠𝐢𝐧𝐧𝐞𝐫𝐬 𝐏𝐚𝐫𝐭 𝟐:📖𝐊𝐞𝐲 𝐅𝐞𝐚𝐭𝐮𝐫𝐞𝐬 & 𝐎𝐩𝐭𝐢𝐦𝐢𝐳𝐚𝐭𝐢𝐨𝐧s
💎 What makes #vLLM the Rolls Royce of inference?
👉check it out: cloudthrill.ca/what-is-vllm...
✅ #PagedAttention #PrefixCaching #ChunkedPrefill
✅ #SpeculativeDecoding #FlashAttention #lmcache
✅ Tensor & #PipelineParallelism⚡
𝐯𝐋𝐋𝐌 𝐟𝐨𝐫 𝐁𝐞𝐠𝐢𝐧𝐧𝐞𝐫𝐬 𝐏𝐚𝐫𝐭 𝟐:📖𝐊𝐞𝐲 𝐅𝐞𝐚𝐭𝐮𝐫𝐞𝐬 & 𝐎𝐩𝐭𝐢𝐦𝐢𝐳𝐚𝐭𝐢𝐨𝐧s
💎 What makes #vLLM the Rolls Royce of inference?
👉check it out: cloudthrill.ca/what-is-vllm...
✅ #PagedAttention #PrefixCaching #ChunkedPrefill
✅ #SpeculativeDecoding #FlashAttention #lmcache
✅ Tensor & #PipelineParallelism⚡
💡Over 𝟐𝟑 𝐦𝐢𝐥𝐥𝐢𝐨𝐧𝐬 secrets were exposed in #GitHub last year💀 & 𝟓𝟎K+ #Huggingface tokens leaks every month!
🛡️Switch to 𝐬𝐞𝐜𝐫𝐞𝐭𝐥𝐞𝐬𝐬 with Pipeline identity now!
👉We show you how: cloudthrill.ca/github-actio...
#Azure #NHI #CICD #Terraform #ManagedIdentity
💡Over 𝟐𝟑 𝐦𝐢𝐥𝐥𝐢𝐨𝐧𝐬 secrets were exposed in #GitHub last year💀 & 𝟓𝟎K+ #Huggingface tokens leaks every month!
🛡️Switch to 𝐬𝐞𝐜𝐫𝐞𝐭𝐥𝐞𝐬𝐬 with Pipeline identity now!
👉We show you how: cloudthrill.ca/github-actio...
#Azure #NHI #CICD #Terraform #ManagedIdentity
We’re kicking off our 𝐯𝐋𝐋𝐌 𝐟𝐨𝐫 𝐁𝐞𝐠𝐢𝐧𝐧𝐞𝐫𝐬 𝐬𝐞𝐫𝐢𝐞𝐬 with
𝐏𝐚𝐫𝐭 𝟏:📖 𝐓𝐡𝐞 𝐅𝐮𝐧𝐝𝐚𝐦𝐞𝐧𝐭𝐚𝐥𝐬💫
New to vLLM ? This one's for you👇🏻: cloudthrill.ca/what-is-vllm
✅ What is vLLM ( vLLM vs Ollama)
✅ Core Architecture (Engine, Sched, Execution, Memory)
✅ Offline and Online inference
We’re kicking off our 𝐯𝐋𝐋𝐌 𝐟𝐨𝐫 𝐁𝐞𝐠𝐢𝐧𝐧𝐞𝐫𝐬 𝐬𝐞𝐫𝐢𝐞𝐬 with
𝐏𝐚𝐫𝐭 𝟏:📖 𝐓𝐡𝐞 𝐅𝐮𝐧𝐝𝐚𝐦𝐞𝐧𝐭𝐚𝐥𝐬💫
New to vLLM ? This one's for you👇🏻: cloudthrill.ca/what-is-vllm
✅ What is vLLM ( vLLM vs Ollama)
✅ Core Architecture (Engine, Sched, Execution, Memory)
✅ Offline and Online inference
🎧🔥"𝐆𝐢𝐭𝐇𝐮𝐛 𝐒𝐞𝐜𝐮𝐫𝐢𝐭𝐲 𝐡𝐨𝐫𝐫𝐨𝐫 𝐬𝐭𝐨𝐫𝐢𝐞𝐬 with
#SteveGiguere "☢️...tons of 𝐚𝐭𝐭𝐚𝐜𝐤 𝐯𝐞𝐜𝐭𝐨𝐫𝐬, best practices, and a lot of laughs😅. You don't wanna miss this !
Thank you Steve🙏🏻
👉🏻 spoti.fi/4dYicES 👈🏻
🎧🔥"𝐆𝐢𝐭𝐇𝐮𝐛 𝐒𝐞𝐜𝐮𝐫𝐢𝐭𝐲 𝐡𝐨𝐫𝐫𝐨𝐫 𝐬𝐭𝐨𝐫𝐢𝐞𝐬 with
#SteveGiguere "☢️...tons of 𝐚𝐭𝐭𝐚𝐜𝐤 𝐯𝐞𝐜𝐭𝐨𝐫𝐬, best practices, and a lot of laughs😅. You don't wanna miss this !
Thank you Steve🙏🏻
👉🏻 spoti.fi/4dYicES 👈🏻
#TechPodcast #GitSecStory
#TechPodcast #GitSecStory
I'm kicking off a 𝐕𝐚𝐮𝐥𝐭 𝐟𝐨𝐫 𝐃𝐮𝐦𝐦𝐢𝐞𝐬 𝐬𝐞𝐫𝐢𝐞𝐬 with
𝐏𝐚𝐫𝐭 𝟏:🔐 𝐇𝐨𝐰 𝐭𝐨 𝐒𝐞𝐭 𝐔𝐩 𝐇𝐚𝐬𝐡𝐢𝐂𝐨𝐫𝐩 𝐕𝐚𝐮𝐥𝐭 with 𝐑𝐚𝐟𝐭 & 𝐓𝐋𝐒
👉check it out: tinyurl.com/HashiVault-f...
@cloudthrill.bsky.social
I'm kicking off a 𝐕𝐚𝐮𝐥𝐭 𝐟𝐨𝐫 𝐃𝐮𝐦𝐦𝐢𝐞𝐬 𝐬𝐞𝐫𝐢𝐞𝐬 with
𝐏𝐚𝐫𝐭 𝟏:🔐 𝐇𝐨𝐰 𝐭𝐨 𝐒𝐞𝐭 𝐔𝐩 𝐇𝐚𝐬𝐡𝐢𝐂𝐨𝐫𝐩 𝐕𝐚𝐮𝐥𝐭 with 𝐑𝐚𝐟𝐭 & 𝐓𝐋𝐒
👉check it out: tinyurl.com/HashiVault-f...
@cloudthrill.bsky.social
Pumped to join India Oracle Users Group for a live session #OCIDevOps #Terraform
🗓️ May 16 | 🕗 8:30 AM EST / 6:00 PM IST
Save your spot: aioug.org/events/explo...
Pumped to join India Oracle Users Group for a live session #OCIDevOps #Terraform
🗓️ May 16 | 🕗 8:30 AM EST / 6:00 PM IST
Save your spot: aioug.org/events/explo...
Read full statement: cloudthrill.ca/cloudthrill-...
#NVIDIAInception Program for Startups!
➡️With only 𝟏.𝟐% of VC funding, 𝐖𝐡𝐲 𝐁𝐥𝐚𝐜𝐤 𝐅𝐨𝐮𝐧𝐝𝐞𝐫𝐬 𝐬𝐭𝐢𝐥𝐥 𝐬𝐭𝐫𝐮𝐠𝐠𝐥𝐞 𝐢𝐧 𝐒𝐢𝐥𝐢𝐜𝐨𝐧 𝐕𝐚𝐥𝐥𝐞𝐲?
📺listen to the full take here: youtu.be/gsMjYZZOBe0 #TechBeatsUnplugged #NumbersDonLie✊🏾
➡️With only 𝟏.𝟐% of VC funding, 𝐖𝐡𝐲 𝐁𝐥𝐚𝐜𝐤 𝐅𝐨𝐮𝐧𝐝𝐞𝐫𝐬 𝐬𝐭𝐢𝐥𝐥 𝐬𝐭𝐫𝐮𝐠𝐠𝐥𝐞 𝐢𝐧 𝐒𝐢𝐥𝐢𝐜𝐨𝐧 𝐕𝐚𝐥𝐥𝐞𝐲?
📺listen to the full take here: youtu.be/gsMjYZZOBe0 #TechBeatsUnplugged #NumbersDonLie✊🏾