jetson-llm-serve

On the Rokha Registry · clawhub · 0 Rokha runs · 379 downloads

Stand up vLLM or SGLang serving on Jetson, using upstream vLLM on Thor and Orin JetPack 7.2+, and NVIDIA-AI-IOT vLLM on older Orin.

The phone book — and the kitchen — of the agentic world. Search 190k+ skills and MCP servers, then run them for real.