[Bug 286668] x11/nvidia-driver : PyTorch and Stable Diffusion and / or ComfyUI don't work with an nvidia driver greater than 535

Reply: bugzilla-noreply_a_freebsd.org: "maintainer-feedback requested: [Bug 286668] x11/nvidia-driver : PyTorch and Stable Diffusion and / or ComfyUI don't work with an nvidia driver greater than 535"
Reply: bugzilla-noreply_a_freebsd.org: "[Bug 286668] x11/nvidia-driver : PyTorch and Stable Diffusion and / or ComfyUI don't work with an nvidia driver greater than 535"
Reply: bugzilla-noreply_a_freebsd.org: "[Bug 286668] x11/nvidia-driver : PyTorch and Stable Diffusion and / or ComfyUI don't work with an nvidia driver greater than 535"
Reply: bugzilla-noreply_a_freebsd.org: "[Bug 286668] x11/nvidia-driver : PyTorch and Stable Diffusion and / or ComfyUI don't work with an nvidia driver greater than 535"
Reply: bugzilla-noreply_a_freebsd.org: "[Bug 286668] x11/nvidia-driver : PyTorch and Stable Diffusion and / or ComfyUI don't work with an nvidia driver greater than 535"
Go to: [ bottom of page ] [ top of archives ] [ this month ]
From: <bugzilla-noreply_at_freebsd.org>
Date: Thu, 08 May 2025 10:18:47 UTC
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=286668

            Bug ID: 286668
           Summary: x11/nvidia-driver : PyTorch and Stable Diffusion and /
                    or ComfyUI don't work with an nvidia driver greater
                    than 535
           Product: Ports & Packages
           Version: Latest
          Hardware: amd64
                OS: Any
            Status: New
          Severity: Affects Many People
          Priority: ---
         Component: Individual Port(s)
          Assignee: x11@FreeBSD.org
          Reporter: marietto2008@gmail.com
          Assignee: x11@FreeBSD.org
             Flags: maintainer-feedback?(x11@FreeBSD.org)

Hello.

I’m trying to run PyTorch and Stable Diffusion and / or ComfyUI on FreeBSD. The
whole procedure is below. Unfortunately it does not work with a nvidia driver
greater than 525 or 535 ?

marietto @ marietto:~ $ git clone h t t p s : / / g i t h u b . c o m /
outpaddling /freebsd-ports-wip . git

marietto@marietto:~ $ cd /usr/ports/wip
marietto@marietto:~ $ pkg install auto-admin
marietto@marietto:~ $ auto-ports-wip-checkout
marietto@marietto:/usr/ports/wip $ cd linux-miniconda-installer
marietto@marietto:/usr/ports/wip/linux-miniconda-installer $ ls

Makefile    distinfo    pkg-descr    work

marietto@marietto:/usr/ports/wip/linux-miniconda-installer $ make clean

===>  Cleaning for linux-miniconda-installer-0.1.0.3
===>   /usr/ports/wip/linux-miniconda-installer/work not writable, skipping

marietto @ marietto:/usr/ports/wip/linux-miniconda-installer $ su
Password:

root @ marietto:/usr/ports/wip/linux-miniconda-installer # make clean

===>  Cleaning for linux-miniconda-installer-0.1.0.3

root @ marietto:/usr/ports/wip/linux-miniconda-installer # make

===>  License BSD2CLAUSE accepted by the user
===>   linux-miniconda-installer-0.1.0.3 depends on file: /usr/local/sbin/pkg -
found
===> Fetching all distfiles required by linux-miniconda-installer-0.1.0.3 for
building
===>  Extracting for linux-miniconda-installer-0.1.0.3
=> SHA256 Checksum OK for
outpaddling-miniconda-installer-0.1.0-3-g0aa48c6_GH0.tar.gz.
===>  Patching for linux-miniconda-installer-0.1.0.3
===>   linux-miniconda-installer-0.1.0.3 depends on file:
/usr/local/bin/python3.11 - found
===>  Configuring for linux-miniconda-installer-0.1.0.3
===>  Staging for linux-miniconda-installer-0.1.0.3
===>   linux-miniconda-installer-0.1.0.3 depends on package: auto-admin>=0.8.0
- found
===>   linux-miniconda-installer-0.1.0.3 depends on package:
linux_base-rl9>=9.2 - found
===>   linux-miniconda-installer-0.1.0.3 depends on file:
/usr/local/bin/python3.11 - found
===>   Generating temporary packing list
install  -m 555
/usr/ports/wip/linux-miniconda-installer/work/miniconda-installer-0.1.0-3-g0aa48c6/miniconda-installer
/usr/ports/wip/linux-miniconda-installer/work/miniconda-installer-0.1.0-3-g0aa48c6/conda-shell
 /usr/ports/wip/linux-miniconda-installer/work/stage/usr/local/bin
====> Compressing man pages (compress-man)

root @ marietto:/usr/ports/wip/linux-miniconda-installer # make install

===>  Installing for linux-miniconda-installer-0.1.0.3
===>  Checking if linux-miniconda-installer is already installed
===>   Registering installation for linux-miniconda-installer-0.1.0.3

Installing linux-miniconda-installer-0.1.0.3...

marietto @ marietto:/$ nvidia-smi

Thu May  8 00:51:53 2025
+-----------------------------------------------------------------------------------------+
| NVIDIA-SMI 565.77                 Driver Version: 565.77         CUDA
Version: 12.7     |
|-----------------------------------------+------------------------+----------------------+
| GPU  Name                 Persistence-M | Bus-Id          Disp.A | Volatile
Uncorr. ECC |
| Fan  Temp   Perf          Pwr:Usage/Cap |           Memory-Usage | GPU-Util 
Compute M. |
|                                         |                        |           
   MIG M. |
|=========================================+========================+======================|
|   0  NVIDIA GeForce GTX 1060 3GB    Off |   00000000:01:00.0  On |           
      N/A |
| 53%   32C    P8              7W /  120W |     339MiB /   3072MiB |      8%   
  Default |
|                                         |                        |           
      N/A |
+-----------------------------------------+------------------------+----------------------+
|   1  NVIDIA GeForce RTX 2080 Ti     Off |   00000000:02:00.0 Off |           
      N/A |
| 31%   35C    P8             21W /  250W |       2MiB /  11264MiB |      0%   
  Default |
|                                         |                        |           
      N/A |
+-----------------------------------------+------------------------+----------------------+

+-----------------------------------------------------------------------------------------+
| Processes:                                                                   
          |
|  GPU   GI   CI        PID   Type   Process name                             
GPU Memory |
|        ID   ID                                                              
Usage      |
|=========================================================================================|
|    0   N/A  N/A      4116      G   /usr/local/libexec/Xorg                   
   190MiB |
|    0   N/A  N/A      4154      G   xfwm4                                     
     2MiB |
|    0   N/A  N/A      4234      G   /usr/local/lib/firefox/firefox            
   142MiB |
+-----------------------------------------------------------------------------------------+

# pkg install linux-rl9-devtools linux-rl9-libglvnd
# cd /home/marietto
# conda-shell
# source conda.sh
# conda activate
# conda create --name pytorch python=3.12
# conda activate pytorch

# pip install --pre torch torchvision torchaudio --index-url
https://download.pytorch.org/whl/nightly/cu128

# LD_PRELOAD="/home/marietto/.config/gpu/dummy-uvm.so" python3 -c 'import
torch; print(torch.cuda.is_available())'

/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages/torch/cuda/__init__.py:181:
UserWarning: CUDA initialization: Unexpected error from cudaGetDeviceCount().

Did you run some cuda functions before calling NumCudaDevices() that might have
already set an error?

Error 304: OS call failed or operation not supported on this OS (Triggered
internally at /pytorch/c10/cuda/CUDAFunctions.cpp:109.)  return
torch._C._cuda_getDeviceCount() > 0
False


$ pip install torch torchvision torchaudio --extra-index-url
https://download.pytorch.org/whl/cu127

Looking in indexes: https://pypi.org/simple,
https://download.pytorch.org/whl/cu127

Requirement already satisfied: torch in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages
(2.8.0.dev20250507+cu128)
Requirement already satisfied: torchvision in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages
(0.22.0.dev20250507+cu128)
Requirement already satisfied: torchaudio in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages
(2.6.0.dev20250507+cu128)
Requirement already satisfied: filelock in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (3.16.1)
Requirement already satisfied: typing-extensions>=4.10.0 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (4.12.2)
Requirement already satisfied: setuptools in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (78.1.1)
Requirement already satisfied: sympy>=1.13.3 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (1.13.3)
Requirement already satisfied: networkx in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (3.4.2)
Requirement already satisfied: jinja2 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (3.1.4)
Requirement already satisfied: fsspec in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (2024.10.0)
Requirement already satisfied: nvidia-cuda-nvrtc-cu12==12.8.61 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (12.8.61)
Requirement already satisfied: nvidia-cuda-runtime-cu12==12.8.57 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (12.8.57)
Requirement already satisfied: nvidia-cuda-cupti-cu12==12.8.57 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (12.8.57)
Requirement already satisfied: nvidia-cudnn-cu12==9.8.0.87 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (9.8.0.87)
Requirement already satisfied: nvidia-cublas-cu12==12.8.3.14 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (12.8.3.14)
Requirement already satisfied: nvidia-cufft-cu12==11.3.3.41 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (11.3.3.41)
Requirement already satisfied: nvidia-curand-cu12==10.3.9.55 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (10.3.9.55)
Requirement already satisfied: nvidia-cusolver-cu12==11.7.2.55 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (11.7.2.55)
Requirement already satisfied: nvidia-cusparse-cu12==12.5.7.53 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (12.5.7.53)
Requirement already satisfied: nvidia-cusparselt-cu12==0.6.3 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (0.6.3)
Requirement already satisfied: nvidia-nccl-cu12==2.26.2 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (2.26.2)
Requirement already satisfied: nvidia-nvtx-cu12==12.8.55 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (12.8.55)
Requirement already satisfied: nvidia-nvjitlink-cu12==12.8.61 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (12.8.61)
Requirement already satisfied: nvidia-cufile-cu12==1.13.0.11 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (1.13.0.11)
Requirement already satisfied: pytorch-triton==3.3.0+git96316ce5 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (3.3.0+git96316ce5)
Requirement already satisfied: numpy in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torchvision) (2.1.2)
Requirement already satisfied: pillow!=8.3.*,>=5.3.0 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torchvision) (11.0.0)
Requirement already satisfied: mpmath<1.4,>=1.1.0 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
sympy>=1.13.3->torch) (1.3.0)
Requirement already satisfied: MarkupSafe>=2.0 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
jinja2->torch) (2.1.5)

# conda install pytorch torchvision torchaudio pytorch-cuda=12.4 -c pytorch -c
nvidia

# git clone https://github.com/comfyanonymous/ComfyUI.git


(pytorch) I have no name!@marietto:/usr/home/marietto$ cd ComfyUI
(pytorch) I have no name!@marietto:/usr/home/marietto/ComfyUI$ pip install -r
requirements.txt
(pytorch) I have no name!@marietto:/usr/home/marietto/ComfyUI$ python -c
'import torch; print(torch.cuda.is_available())'

/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages/torch/cuda/__init__.py:129:
UserWarning: CUDA initialization: Unexpected error from cudaGetDeviceCount(). 

Did you run some cuda functions before calling NumCudaDevices() that might have
already set an error? 

Error 304: OS call failed or operation not supported on this OS (Triggered
internally at
/opt/conda/conda-bld/pytorch_1729647378361/work/c10/cuda/CUDAFunctions.cpp:108.)
 return torch._C._cuda_getDeviceCount() > 0

False


(pytorch) I have no name!@marietto:/usr/home/marietto/ComfyUI$
LD_PRELOAD="${HOME}/.config/gpu/dummy-uvm.so" python -c 'import torch;
print(torch.cuda.is_available())'

/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages/torch/cuda/__init__.py:129: 

UserWarning: CUDA initialization: Unexpected error from cudaGetDeviceCount().
Did you run some cuda functions before calling NumCudaDevices() that might have
already set an error? 

Error 304: OS call failed or operation not supported on this OS (Triggered
internally at
/opt/conda/conda-bld/pytorch_1729647378361/work/c10/cuda/CUDAFunctions.cpp:108.)
  return torch._C._cuda_getDeviceCount() > 0
False


(pytorch) I have no name!@marietto:/usr/home/marietto$ conda install pytorch
torchvision torchaudio pytorch-cuda=12.7 -c pytorch -c nvidia

Collecting package metadata (current_repodata.json): done
Solving environment: failed with initial frozen solve. Retrying with flexible
solve.
Collecting package metadata (repodata.json): done
Solving environment: failed with initial frozen solve. Retrying with flexible
solve.

PackagesNotFoundError: The following packages are not available from current
channels:

  - pytorch-cuda=12.7

In this thread you suggested to use cu126 :

https://discuss.pytorch.org/t/pytorch-vrsion-for-cuda-12-7/214153/2

so :

(pytorch) I have no name! @ marietto:/usr/home/marietto$ pip3 install --pre
torch torchvision torchaudio --index-url h t t p s : / / d o w n l o a d . p y 
to  r c h . o r g /w h l / nightly/ cu126

Looking in indexes: https://download.pytorch.org/whl/nightly/cu126

Requirement already satisfied: torch in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages
(2.8.0.dev20250507+cu128)
Requirement already satisfied: torchvision in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages
(0.22.0.dev20250507+cu128)
Requirement already satisfied: torchaudio in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages
(2.6.0.dev20250507+cu128)
Requirement already satisfied: filelock in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (3.16.1)
Requirement already satisfied: typing-extensions>=4.10.0 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (4.12.2)
Requirement already satisfied: setuptools in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (78.1.1)
Requirement already satisfied: sympy>=1.13.3 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (1.13.3)
Requirement already satisfied: networkx in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (3.4.2)
Requirement already satisfied: jinja2 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (3.1.4)
Requirement already satisfied: fsspec in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (2024.10.0)
Requirement already satisfied: nvidia-cuda-nvrtc-cu12==12.8.61 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (12.8.61)
Requirement already satisfied: nvidia-cuda-runtime-cu12==12.8.57 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (12.8.57)
Requirement already satisfied: nvidia-cuda-cupti-cu12==12.8.57 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (12.8.57)
Requirement already satisfied: nvidia-cudnn-cu12==9.8.0.87 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (9.8.0.87)
Requirement already satisfied: nvidia-cublas-cu12==12.8.3.14 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (12.8.3.14)
Requirement already satisfied: nvidia-cufft-cu12==11.3.3.41 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (11.3.3.41)
Requirement already satisfied: nvidia-curand-cu12==10.3.9.55 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (10.3.9.55)
Requirement already satisfied: nvidia-cusolver-cu12==11.7.2.55 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (11.7.2.55)
Requirement already satisfied: nvidia-cusparse-cu12==12.5.7.53 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (12.5.7.53)
Requirement already satisfied: nvidia-cusparselt-cu12==0.6.3 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (0.6.3)
Requirement already satisfied: nvidia-nccl-cu12==2.26.2 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (2.26.2)
Requirement already satisfied: nvidia-nvtx-cu12==12.8.55 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (12.8.55)
Requirement already satisfied: nvidia-nvjitlink-cu12==12.8.61 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (12.8.61)
Requirement already satisfied: nvidia-cufile-cu12==1.13.0.11 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (1.13.0.11)
Requirement already satisfied: pytorch-triton==3.3.0+git96316ce5 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (3.3.0+git96316ce5)
Requirement already satisfied: numpy in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torchvision) (2.1.2)
Requirement already satisfied: pillow!=8.3.*,>=5.3.0 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torchvision) (11.0.0)
Requirement already satisfied: mpmath<1.4,>=1.1.0 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
sympy>=1.13.3->torch) (1.3.0)
Requirement already satisfied: MarkupSafe>=2.0 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
jinja2->torch) (2.1.5)

no way…the only way to make work Stable diffusion is to use the nvidia driver
and the linux-nvidia-libs vers. 525.78.01 and “torch==1.12.1+cu113
--extra-index-url https://download.pytorch.org/whl/cu113” and it works like a
charme :

(pytorch) I have no name! @ marietto:/usr/home/marietto$
LD_PRELOAD="/compat/dummy-uvm.so" python3 -c 'import torch;
print(torch.cuda.is_available())'

True

(pytorch) I have no name!@marietto:/usr/home/marietto$
LD_PRELOAD="/compat/dummy-uvm.so" python3 -c 'import torch;
print(torch.cuda.get_device_name(0))'

NVIDIA GeForce RTX 2080 Ti


I've already asked all around to better understand where is the problem,without
a great success right now :


https://www.reddit.com/r/pytorch/comments/1kghunz/which_version_of_pytorch_should_i_use_with_my/

https://discuss.pytorch.org/t/trying-to-run-pytorch-and-stable-diffusion-and-or-comfyui-on-freebsd/219850

https://github.com/verm/freebsd-stable-diffusion/issues/10

https://github.com/comfyanonymous/ComfyUI/issues

https://github.com/amshafer/nvidia-driver/issues/27

https://forums.developer.nvidia.com/t/which-version-of-pytorch-should-i-use-with-my-geforce-rtx-2080-and-the-nvidia-driver-570-to-install-stable-diffusion/332405

-- 
You are receiving this mail because:
You are the assignee for the bug.