Abstract: Generative large language model (LLM) applications are growing rapidly, leading to large-scale deployments of expensive and power-hungry GPUs. Our characterization of LLM inference shows ...
Some results have been hidden because they may be inaccessible to you
Show inaccessible results