NVIDIA 发布 CompileIQ 自动调优工具，可自动搜索最佳编译器选项以提升特定工作负载的性能，如 LLM 推理管线。该工具解决性能工程中编译器选项优化难题，帮助开发者在已优化的基础上进一步榨取性能。
NVIDIA CompileIQ tackles one of the hardest problems in performance engineering: finding the compiler options that unlock the best performance for a specific...NVIDIA CompileIQ tackles one of the hardest problems in performance engineering: finding the compiler options that unlock the best performance for a specific workload. Consider a team that has spent weeks optimizing an LLM inference pipeline on GPUs, tuning batch sizes, quantizing to FP8, adopting flash attention, fusing every kernel they can. The profiler says there’s nothing left to squeeze.
Source