zhaiGOGO - Overview (original) (raw)

Awesome-LLM-Inference Awesome-LLM-Inference Public

Forked from xlite-dev/Awesome-LLM-Inference

📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.