Tag:accelerate

All the articles with the tag "accelerate".

• Benchmark for LLM Inference

  Posted on:August 20, 2023 |  at 12:00 AM

  Introduce some metrics for LLM inference benchmarking