Performance_benchmark

This document details the performance testing methods for vllm-kunlun and the analysis of the results to ultimately optimize performance. The main considerations are server throughput and operator performance.

Performance

• vLLM server performance
• Operator performance
• Profiling