[Feature]: Compute and log the serving FLOPs. #460
Description
🚀 The motivation and feature
Compute and log the serving FLOPs will help us understand the current resource utilization and provide guidance for performance tuning.
Alternatives
No response
Additional context
No response