[Bug 286668] x11/nvidia-driver : PyTorch and Stable Diffusion and / or ComfyUI don't work with an nvidia driver greater than 535
- Reply: bugzilla-noreply_a_freebsd.org: "maintainer-feedback requested: [Bug 286668] x11/nvidia-driver : PyTorch and Stable Diffusion and / or ComfyUI don't work with an nvidia driver greater than 535"
- Reply: bugzilla-noreply_a_freebsd.org: "[Bug 286668] x11/nvidia-driver : PyTorch and Stable Diffusion and / or ComfyUI don't work with an nvidia driver greater than 535"
- Reply: bugzilla-noreply_a_freebsd.org: "[Bug 286668] x11/nvidia-driver : PyTorch and Stable Diffusion and / or ComfyUI don't work with an nvidia driver greater than 535"
- Reply: bugzilla-noreply_a_freebsd.org: "[Bug 286668] x11/nvidia-driver : PyTorch and Stable Diffusion and / or ComfyUI don't work with an nvidia driver greater than 535"
- Reply: bugzilla-noreply_a_freebsd.org: "[Bug 286668] x11/nvidia-driver : PyTorch and Stable Diffusion and / or ComfyUI don't work with an nvidia driver greater than 535"
- Go to: [ bottom of page ] [ top of archives ] [ this month ]
Date: Thu, 08 May 2025 10:18:47 UTC
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=286668 Bug ID: 286668 Summary: x11/nvidia-driver : PyTorch and Stable Diffusion and / or ComfyUI don't work with an nvidia driver greater than 535 Product: Ports & Packages Version: Latest Hardware: amd64 OS: Any Status: New Severity: Affects Many People Priority: --- Component: Individual Port(s) Assignee: x11@FreeBSD.org Reporter: marietto2008@gmail.com Assignee: x11@FreeBSD.org Flags: maintainer-feedback?(x11@FreeBSD.org) Hello. I’m trying to run PyTorch and Stable Diffusion and / or ComfyUI on FreeBSD. The whole procedure is below. Unfortunately it does not work with a nvidia driver greater than 525 or 535 ? marietto @ marietto:~ $ git clone h t t p s : / / g i t h u b . c o m / outpaddling /freebsd-ports-wip . git marietto@marietto:~ $ cd /usr/ports/wip marietto@marietto:~ $ pkg install auto-admin marietto@marietto:~ $ auto-ports-wip-checkout marietto@marietto:/usr/ports/wip $ cd linux-miniconda-installer marietto@marietto:/usr/ports/wip/linux-miniconda-installer $ ls Makefile distinfo pkg-descr work marietto@marietto:/usr/ports/wip/linux-miniconda-installer $ make clean ===> Cleaning for linux-miniconda-installer-0.1.0.3 ===> /usr/ports/wip/linux-miniconda-installer/work not writable, skipping marietto @ marietto:/usr/ports/wip/linux-miniconda-installer $ su Password: root @ marietto:/usr/ports/wip/linux-miniconda-installer # make clean ===> Cleaning for linux-miniconda-installer-0.1.0.3 root @ marietto:/usr/ports/wip/linux-miniconda-installer # make ===> License BSD2CLAUSE accepted by the user ===> linux-miniconda-installer-0.1.0.3 depends on file: /usr/local/sbin/pkg - found ===> Fetching all distfiles required by linux-miniconda-installer-0.1.0.3 for building ===> Extracting for linux-miniconda-installer-0.1.0.3 => SHA256 Checksum OK for outpaddling-miniconda-installer-0.1.0-3-g0aa48c6_GH0.tar.gz. ===> Patching for linux-miniconda-installer-0.1.0.3 ===> linux-miniconda-installer-0.1.0.3 depends on file: /usr/local/bin/python3.11 - found ===> Configuring for linux-miniconda-installer-0.1.0.3 ===> Staging for linux-miniconda-installer-0.1.0.3 ===> linux-miniconda-installer-0.1.0.3 depends on package: auto-admin>=0.8.0 - found ===> linux-miniconda-installer-0.1.0.3 depends on package: linux_base-rl9>=9.2 - found ===> linux-miniconda-installer-0.1.0.3 depends on file: /usr/local/bin/python3.11 - found ===> Generating temporary packing list install -m 555 /usr/ports/wip/linux-miniconda-installer/work/miniconda-installer-0.1.0-3-g0aa48c6/miniconda-installer /usr/ports/wip/linux-miniconda-installer/work/miniconda-installer-0.1.0-3-g0aa48c6/conda-shell /usr/ports/wip/linux-miniconda-installer/work/stage/usr/local/bin ====> Compressing man pages (compress-man) root @ marietto:/usr/ports/wip/linux-miniconda-installer # make install ===> Installing for linux-miniconda-installer-0.1.0.3 ===> Checking if linux-miniconda-installer is already installed ===> Registering installation for linux-miniconda-installer-0.1.0.3 Installing linux-miniconda-installer-0.1.0.3... marietto @ marietto:/$ nvidia-smi Thu May 8 00:51:53 2025 +-----------------------------------------------------------------------------------------+ | NVIDIA-SMI 565.77 Driver Version: 565.77 CUDA Version: 12.7 | |-----------------------------------------+------------------------+----------------------+ | GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC | | Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. | | | | MIG M. | |=========================================+========================+======================| | 0 NVIDIA GeForce GTX 1060 3GB Off | 00000000:01:00.0 On | N/A | | 53% 32C P8 7W / 120W | 339MiB / 3072MiB | 8% Default | | | | N/A | +-----------------------------------------+------------------------+----------------------+ | 1 NVIDIA GeForce RTX 2080 Ti Off | 00000000:02:00.0 Off | N/A | | 31% 35C P8 21W / 250W | 2MiB / 11264MiB | 0% Default | | | | N/A | +-----------------------------------------+------------------------+----------------------+ +-----------------------------------------------------------------------------------------+ | Processes: | | GPU GI CI PID Type Process name GPU Memory | | ID ID Usage | |=========================================================================================| | 0 N/A N/A 4116 G /usr/local/libexec/Xorg 190MiB | | 0 N/A N/A 4154 G xfwm4 2MiB | | 0 N/A N/A 4234 G /usr/local/lib/firefox/firefox 142MiB | +-----------------------------------------------------------------------------------------+ # pkg install linux-rl9-devtools linux-rl9-libglvnd # cd /home/marietto # conda-shell # source conda.sh # conda activate # conda create --name pytorch python=3.12 # conda activate pytorch # pip install --pre torch torchvision torchaudio --index-url https://download.pytorch.org/whl/nightly/cu128 # LD_PRELOAD="/home/marietto/.config/gpu/dummy-uvm.so" python3 -c 'import torch; print(torch.cuda.is_available())' /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages/torch/cuda/__init__.py:181: UserWarning: CUDA initialization: Unexpected error from cudaGetDeviceCount(). Did you run some cuda functions before calling NumCudaDevices() that might have already set an error? Error 304: OS call failed or operation not supported on this OS (Triggered internally at /pytorch/c10/cuda/CUDAFunctions.cpp:109.) return torch._C._cuda_getDeviceCount() > 0 False $ pip install torch torchvision torchaudio --extra-index-url https://download.pytorch.org/whl/cu127 Looking in indexes: https://pypi.org/simple, https://download.pytorch.org/whl/cu127 Requirement already satisfied: torch in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (2.8.0.dev20250507+cu128) Requirement already satisfied: torchvision in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (0.22.0.dev20250507+cu128) Requirement already satisfied: torchaudio in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (2.6.0.dev20250507+cu128) Requirement already satisfied: filelock in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (3.16.1) Requirement already satisfied: typing-extensions>=4.10.0 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (4.12.2) Requirement already satisfied: setuptools in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (78.1.1) Requirement already satisfied: sympy>=1.13.3 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (1.13.3) Requirement already satisfied: networkx in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (3.4.2) Requirement already satisfied: jinja2 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (3.1.4) Requirement already satisfied: fsspec in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (2024.10.0) Requirement already satisfied: nvidia-cuda-nvrtc-cu12==12.8.61 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (12.8.61) Requirement already satisfied: nvidia-cuda-runtime-cu12==12.8.57 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (12.8.57) Requirement already satisfied: nvidia-cuda-cupti-cu12==12.8.57 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (12.8.57) Requirement already satisfied: nvidia-cudnn-cu12==9.8.0.87 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (9.8.0.87) Requirement already satisfied: nvidia-cublas-cu12==12.8.3.14 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (12.8.3.14) Requirement already satisfied: nvidia-cufft-cu12==11.3.3.41 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (11.3.3.41) Requirement already satisfied: nvidia-curand-cu12==10.3.9.55 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (10.3.9.55) Requirement already satisfied: nvidia-cusolver-cu12==11.7.2.55 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (11.7.2.55) Requirement already satisfied: nvidia-cusparse-cu12==12.5.7.53 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (12.5.7.53) Requirement already satisfied: nvidia-cusparselt-cu12==0.6.3 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (0.6.3) Requirement already satisfied: nvidia-nccl-cu12==2.26.2 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (2.26.2) Requirement already satisfied: nvidia-nvtx-cu12==12.8.55 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (12.8.55) Requirement already satisfied: nvidia-nvjitlink-cu12==12.8.61 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (12.8.61) Requirement already satisfied: nvidia-cufile-cu12==1.13.0.11 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (1.13.0.11) Requirement already satisfied: pytorch-triton==3.3.0+git96316ce5 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (3.3.0+git96316ce5) Requirement already satisfied: numpy in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torchvision) (2.1.2) Requirement already satisfied: pillow!=8.3.*,>=5.3.0 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torchvision) (11.0.0) Requirement already satisfied: mpmath<1.4,>=1.1.0 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from sympy>=1.13.3->torch) (1.3.0) Requirement already satisfied: MarkupSafe>=2.0 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from jinja2->torch) (2.1.5) # conda install pytorch torchvision torchaudio pytorch-cuda=12.4 -c pytorch -c nvidia # git clone https://github.com/comfyanonymous/ComfyUI.git (pytorch) I have no name!@marietto:/usr/home/marietto$ cd ComfyUI (pytorch) I have no name!@marietto:/usr/home/marietto/ComfyUI$ pip install -r requirements.txt (pytorch) I have no name!@marietto:/usr/home/marietto/ComfyUI$ python -c 'import torch; print(torch.cuda.is_available())' /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages/torch/cuda/__init__.py:129: UserWarning: CUDA initialization: Unexpected error from cudaGetDeviceCount(). Did you run some cuda functions before calling NumCudaDevices() that might have already set an error? Error 304: OS call failed or operation not supported on this OS (Triggered internally at /opt/conda/conda-bld/pytorch_1729647378361/work/c10/cuda/CUDAFunctions.cpp:108.) return torch._C._cuda_getDeviceCount() > 0 False (pytorch) I have no name!@marietto:/usr/home/marietto/ComfyUI$ LD_PRELOAD="${HOME}/.config/gpu/dummy-uvm.so" python -c 'import torch; print(torch.cuda.is_available())' /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages/torch/cuda/__init__.py:129: UserWarning: CUDA initialization: Unexpected error from cudaGetDeviceCount(). Did you run some cuda functions before calling NumCudaDevices() that might have already set an error? Error 304: OS call failed or operation not supported on this OS (Triggered internally at /opt/conda/conda-bld/pytorch_1729647378361/work/c10/cuda/CUDAFunctions.cpp:108.) return torch._C._cuda_getDeviceCount() > 0 False (pytorch) I have no name!@marietto:/usr/home/marietto$ conda install pytorch torchvision torchaudio pytorch-cuda=12.7 -c pytorch -c nvidia Collecting package metadata (current_repodata.json): done Solving environment: failed with initial frozen solve. Retrying with flexible solve. Collecting package metadata (repodata.json): done Solving environment: failed with initial frozen solve. Retrying with flexible solve. PackagesNotFoundError: The following packages are not available from current channels: - pytorch-cuda=12.7 In this thread you suggested to use cu126 : https://discuss.pytorch.org/t/pytorch-vrsion-for-cuda-12-7/214153/2 so : (pytorch) I have no name! @ marietto:/usr/home/marietto$ pip3 install --pre torch torchvision torchaudio --index-url h t t p s : / / d o w n l o a d . p y to r c h . o r g /w h l / nightly/ cu126 Looking in indexes: https://download.pytorch.org/whl/nightly/cu126 Requirement already satisfied: torch in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (2.8.0.dev20250507+cu128) Requirement already satisfied: torchvision in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (0.22.0.dev20250507+cu128) Requirement already satisfied: torchaudio in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (2.6.0.dev20250507+cu128) Requirement already satisfied: filelock in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (3.16.1) Requirement already satisfied: typing-extensions>=4.10.0 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (4.12.2) Requirement already satisfied: setuptools in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (78.1.1) Requirement already satisfied: sympy>=1.13.3 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (1.13.3) Requirement already satisfied: networkx in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (3.4.2) Requirement already satisfied: jinja2 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (3.1.4) Requirement already satisfied: fsspec in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (2024.10.0) Requirement already satisfied: nvidia-cuda-nvrtc-cu12==12.8.61 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (12.8.61) Requirement already satisfied: nvidia-cuda-runtime-cu12==12.8.57 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (12.8.57) Requirement already satisfied: nvidia-cuda-cupti-cu12==12.8.57 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (12.8.57) Requirement already satisfied: nvidia-cudnn-cu12==9.8.0.87 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (9.8.0.87) Requirement already satisfied: nvidia-cublas-cu12==12.8.3.14 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (12.8.3.14) Requirement already satisfied: nvidia-cufft-cu12==11.3.3.41 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (11.3.3.41) Requirement already satisfied: nvidia-curand-cu12==10.3.9.55 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (10.3.9.55) Requirement already satisfied: nvidia-cusolver-cu12==11.7.2.55 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (11.7.2.55) Requirement already satisfied: nvidia-cusparse-cu12==12.5.7.53 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (12.5.7.53) Requirement already satisfied: nvidia-cusparselt-cu12==0.6.3 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (0.6.3) Requirement already satisfied: nvidia-nccl-cu12==2.26.2 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (2.26.2) Requirement already satisfied: nvidia-nvtx-cu12==12.8.55 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (12.8.55) Requirement already satisfied: nvidia-nvjitlink-cu12==12.8.61 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (12.8.61) Requirement already satisfied: nvidia-cufile-cu12==1.13.0.11 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (1.13.0.11) Requirement already satisfied: pytorch-triton==3.3.0+git96316ce5 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (3.3.0+git96316ce5) Requirement already satisfied: numpy in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torchvision) (2.1.2) Requirement already satisfied: pillow!=8.3.*,>=5.3.0 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torchvision) (11.0.0) Requirement already satisfied: mpmath<1.4,>=1.1.0 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from sympy>=1.13.3->torch) (1.3.0) Requirement already satisfied: MarkupSafe>=2.0 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from jinja2->torch) (2.1.5) no way…the only way to make work Stable diffusion is to use the nvidia driver and the linux-nvidia-libs vers. 525.78.01 and “torch==1.12.1+cu113 --extra-index-url https://download.pytorch.org/whl/cu113” and it works like a charme : (pytorch) I have no name! @ marietto:/usr/home/marietto$ LD_PRELOAD="/compat/dummy-uvm.so" python3 -c 'import torch; print(torch.cuda.is_available())' True (pytorch) I have no name!@marietto:/usr/home/marietto$ LD_PRELOAD="/compat/dummy-uvm.so" python3 -c 'import torch; print(torch.cuda.get_device_name(0))' NVIDIA GeForce RTX 2080 Ti I've already asked all around to better understand where is the problem,without a great success right now : https://www.reddit.com/r/pytorch/comments/1kghunz/which_version_of_pytorch_should_i_use_with_my/ https://discuss.pytorch.org/t/trying-to-run-pytorch-and-stable-diffusion-and-or-comfyui-on-freebsd/219850 https://github.com/verm/freebsd-stable-diffusion/issues/10 https://github.com/comfyanonymous/ComfyUI/issues https://github.com/amshafer/nvidia-driver/issues/27 https://forums.developer.nvidia.com/t/which-version-of-pytorch-should-i-use-with-my-geforce-rtx-2080-and-the-nvidia-driver-570-to-install-stable-diffusion/332405 -- You are receiving this mail because: You are the assignee for the bug.