Popular repositories Loading

1. RouteLLM RouteLLM Public

   Forked from lm-sys/RouteLLM

   A framework for serving and evaluating LLM routers - save LLM costs without compromising quality!

   Jupyter Notebook

2. kineto kineto Public

   Forked from pytorch/kineto

   A CPU+GPU Profiling library that provides access to timeline traces and hardware performance counters.

   HTML

3. neuraloperator neuraloperator Public

   Forked from neuraloperator/neuraloperator

   Learning in infinite dimension with neural operators.

   Python

4. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

5. sglang sglang Public

   Forked from sgl-project/sglang

   SGLang is a fast serving framework for large language models and vision language models.

   Python

6. xgrammar xgrammar Public

   Forked from mlc-ai/xgrammar

   Efficient, Flexible and Portable Structured Generation

   C++