Frequently Used Tools

Liao Jiayi Liao Jiayi

Frequently Used Tools

Translated from Chinese with AI · Read the original

GPU

  1. nvidia-smi -l 1
  2. gpustat -i 1 --show-power
  3. nvtop (install: sudo apt install nvtop)
  4. nvidia-smi dmon -s u -c 100 , NVIDIA accelerates video/image decoding without using general-purpose SM computation
    • sm: streaming multiprocessor utilization
    • mem: gpu memory utilization
    • enc: video encoder utilization(NVENC)
    • dec: video decoder utilization(NVDEC)
    • jpg: jpeg decoder utilization
    • ofa: optical flow accelerator
  5. nsys profile --output=report uv run python run.py --model Qwen3-VL-2B-Instruct --data MM-Math *

Python

  1. py-spy dump --pid 2473
  2. py-spy record -o flamegraph.svg --pid 2473 --duration 60 (uses ptrace under the hood)
  3. py-spy top --pid 2473 (inspect the cost of individual functions)

System

  1. gdb -p 2473