NIM Llama3 8B Instruct - Running container with "CUDA_ERROR_NO_DEVICE" (original) (raw)

Hi all,

I had tried the on-premise version of llama3-8b-instruct deployment follow the tutorial here Getting Started — NVIDIA NIM for Large Language Models (LLMs).
I had installed and checked all the hardware and software requirements. I have tried running it many times, but still got the same error as shown in picture below.

Screenshot 2025-03-14 1418363431×1354 419 KB

I am wondering is there any idea about this issue?
Thank you so much.