vllm-plugin

Here are 3 public repositories matching this topic...

A honest port of vLLM-ROCm for windows.

amd nvidia rocm vllm rdna3 vllm-plugins vllm-rocm-windows vllm-plugin

Give an open LLM a fast, calibrated decision path and serve it natively with vLLM.

inference calibration lora llm vllm vllm-plugin

Out-of-tree vLLM plugin for Sarvam AI Shuka-1 multimodal audio-language serving

whisper indic-languages huggingface speech-ai vllm llama-3 multimodal-ai audio-language-model sarvam-ai vllm-plugin shuka-1

To associate your repository with the vllm-plugin topic, visit your repo's landing page and select "manage topics."