Graziano Casto
@cstgzn.bsky.social
Developer Relations | Kubernetes Release Team Member | CNCF TAG DevEx Tech Lead | Cloud Native Days Italy Organizer
#OpenSource #CloudNative #PlatformEngineering #AI #DeveloperExperience
#OpenSource #CloudNative #PlatformEngineering #AI #DeveloperExperience
Here is the demo repository!
You can launch the model on a local cluster (using #ramalama as the inference server) or on an EKS cluster (using #vLLM).
Leave a ⭐ and share it around if everything works perfectly. Open an issue to start a shitstorm if it doesn't! 😉
👉 github.com/graz-dev/llm...
You can launch the model on a local cluster (using #ramalama as the inference server) or on an EKS cluster (using #vLLM).
Leave a ⭐ and share it around if everything works perfectly. Open an issue to start a shitstorm if it doesn't! 😉
👉 github.com/graz-dev/llm...
November 4, 2025 at 1:14 PM
Here is the demo repository!
You can launch the model on a local cluster (using #ramalama as the inference server) or on an EKS cluster (using #vLLM).
Leave a ⭐ and share it around if everything works perfectly. Open an issue to start a shitstorm if it doesn't! 😉
👉 github.com/graz-dev/llm...
You can launch the model on a local cluster (using #ramalama as the inference server) or on an EKS cluster (using #vLLM).
Leave a ⭐ and share it around if everything works perfectly. Open an issue to start a shitstorm if it doesn't! 😉
👉 github.com/graz-dev/llm...