Nvitop

nvitop is an interactive viewer for NVIDIA GPU devices and processes, designed to show more than the standard nvidia-smi tool and to update continuously. It runs as a resource monitor in the terminal with colorful bar charts and history graphs, rather than printing results once.

Monitor mode includes process sorting and filtering, a tree view, viewing of environment variables, process metrics and sending signals to processes. Beyond monitoring, the package ships nvisel, a CUDA device selection tool for deep learning researchers, along with APIs for devices and processes so developers can write their own monitoring tools, building on psutil for host information. A companion nvitop-exporter feeds Prometheus, and a Grafana dashboard is available.

The tool is written in Python and licensed under Apache-2.0, and works well over SSH and in Docker, as the documentation has sections for those cases. It suits machine learning engineers and researchers sharing GPU servers who want to see who is using which GPU and how.