[Tool Recommendation] How to Monitor NVIDIA GPU Usage in Real Time

🛠 Tools and Programming
1

nvitop repays your kindness

pip install nvitop

Official Website

Source of Information

【工具篇】如何优雅地监控显卡(GPU)使用情况？ - 知乎

2

TPU memory can be checked using tpu-info --memory (requires installing tpu-info via pip)