Home » Tags

Accelerate

Benchmark for LLM Inference

Introduce some metrics for LLM inference benchmarking

August 20, 2023 · 5 min · Sherlock