In certain cases it might be needed to update the Nvidia driver of a GPU VM to a more recent version.
Also, in case of old provisioned VMs still running not supported version of the Nvidia driver and/or after a major upgrade of the underlying infrastructure it might happen that the GPU device is not recognized anymore and the following message is returned when running "nvidia-smi" command:
$ nvidia-smi
No devices were found |
GPU Nvidia Driver Update procedure
Using the morpheus web portal:
- Navigate to the instance with the GPU driver to be updated
- Click on ACTIONS - Run Task.
- Search and select the task "Update-GPUVM-Nvidia-xxx.xxx" with the latest version and press EXECUTE
- Morpheus will show the progress of this operation.
- Once the Task execution has been completed Reboot the instance (Actions→ Restart server) to make effective the new driver.
After the reboot, once your instance is running, it should be possible to verify the availability of the GPU and the new driver with the "nvidia-smi" command: $> nvidia-smi
Mon Apr 28 12:48:27 2025
+---------------------------------------------------------------------------------------+
| NVIDIA-SMI 535.154.05 Driver Version: 535.154.05 CUDA Version: 12.2 |
|-----------------------------------------+----------------------+----------------------+
| GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|=========================================+======================+======================|
| 0 GRID A100D-1-10C On | 00000000:05:00.0 Off | On |
| N/A N/A P0 N/A / N/A | 0MiB / 10240MiB | N/A Default |
| | | Enabled |
+-----------------------------------------+----------------------+----------------------+
+---------------------------------------------------------------------------------------+
| MIG devices: |
+------------------+--------------------------------+-----------+-----------------------+
| GPU GI CI MIG | Memory-Usage | Vol| Shared |
| ID ID Dev | BAR1-Usage | SM Unc| CE ENC DEC OFA JPG |
| | | ECC| |
|==================+================================+===========+=======================|
| 0 0 0 0 | 0MiB / 8811MiB | 14 0 | 1 0 0 0 0 |
| | 0MiB / 4096MiB | | |
+------------------+--------------------------------+-----------+-----------------------+
+---------------------------------------------------------------------------------------+
| Processes: |
| GPU GI CI PID Type Process name GPU Memory |
| ID ID Usage |
|=======================================================================================|
| No running processes found |
+---------------------------------------------------------------------------------------+ |
|