Pinned Loading

1. llaisys llaisys Public

   Forked from InfiniTensor/llaisys

   LLAISYS：面向大模型 Serving 的 C++/CUDA 推理系统

   C++

2. pytorch-paligemma pytorch-paligemma Public

   Forked from hkproj/pytorch-paligemma

   Coding a Multimodal (Vision) Language Model from scratch in PyTorch with full explanation: https://www.youtube.com/watch?v=vAmKB7iPkWw

   Python

3. vllm-ascend vllm-ascend Public

   Forked from vllm-project/vllm-ascend

   Community maintained hardware plugin for vLLM on Ascend

   C++

4. vLLM-metax vLLM-metax Public

   Forked from MetaX-MACA/vLLM-metax

   Community maintained hardware plugin for vLLM on MetaX GPU

   Python

5. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 83.7k 18.4k