如何在Pycharm中导入Pyculib?

时间:2020-06-13 13:12:16

标签: python jit numba

我想在pycharm项目中使用pyculib.fft,确切地说,是在一个numba.njit装饰函数内。 Stackoverflow上有人建议我使用它,因为我需要找到一种在装饰fft的函数内使用numba.njit函数的方法。但是我无法让pyculib工作。我尝试使用Python 3.7解释器和Anaconda解释器。在这两种情况下,都安装了pyculib 1.0.1,这是pycharm中唯一可用的版本。

使用Python解释器:

import pyculib

输出:

C:\Users\Artur\Desktop\RL_framework\venv\Scripts\python.exe C:/Users/Artur/Desktop/RL_framework/help_functions/test3.py
Traceback (most recent call last):
  File "C:\Users\Artur\Desktop\RL_framework\venv\lib\site-packages\pyculib\utils\libutils.py", line 17, in __new__
    dll = open_cudalib(cls.lib)
  File "C:\Users\Artur\Desktop\RL_framework\venv\lib\site-packages\numba\cuda\cudadrv\libs.py", line 55, in open_cudalib
    path = get_cudalib(lib)
  File "C:\Users\Artur\Desktop\RL_framework\venv\lib\site-packages\numba\cuda\cudadrv\libs.py", line 48, in get_cudalib
    libdir = get_cuda_paths()['cudalib_dir'].info
  File "C:\Users\Artur\Desktop\RL_framework\venv\lib\site-packages\numba\cuda\cuda_paths.py", line 164, in get_cuda_paths
    'nvvm': _get_nvvm_path(),
  File "C:\Users\Artur\Desktop\RL_framework\venv\lib\site-packages\numba\cuda\cuda_paths.py", line 142, in _get_nvvm_path
    candidates = find_lib('nvvm', path)
  File "C:\Users\Artur\Desktop\RL_framework\venv\lib\site-packages\numba\misc\findlib.py", line 34, in find_lib
    return find_file(regex, libdir)
  File "C:\Users\Artur\Desktop\RL_framework\venv\lib\site-packages\numba\misc\findlib.py", line 46, in find_file
    entries = os.listdir(ldir)
FileNotFoundError: [WinError 3] Das System kann den angegebenen Pfad nicht finden: 'C:\\Users\\Artur\\Desktop\\RL_framework\\venv\\DLLs'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "C:/Users/Artur/Desktop/RL_framework/help_functions/test3.py", line 1, in <module>
    import pyculib
  File "C:\Users\Artur\Desktop\RL_framework\venv\lib\site-packages\pyculib\__init__.py", line 49, in <module>
    from . import blas, sparse, fft, rand, sorting
  File "C:\Users\Artur\Desktop\RL_framework\venv\lib\site-packages\pyculib\sparse\__init__.py", line 2, in <module>
    from .api import *
  File "C:\Users\Artur\Desktop\RL_framework\venv\lib\site-packages\pyculib\sparse\api.py", line 6, in <module>
    from .binding import (cuSparse, CUSPARSE_INDEX_BASE_ZERO,
  File "C:\Users\Artur\Desktop\RL_framework\venv\lib\site-packages\pyculib\sparse\binding.py", line 1307, in <module>
    cuSparse = _init_cuSparse()
  File "C:\Users\Artur\Desktop\RL_framework\venv\lib\site-packages\pyculib\sparse\binding.py", line 1292, in _init_cuSparse
    name, func = _init_api_function(k, v)
  File "C:\Users\Artur\Desktop\RL_framework\venv\lib\site-packages\pyculib\sparse\binding.py", line 1237, in _init_api_function
    lib = libcusparse()
  File "C:\Users\Artur\Desktop\RL_framework\venv\lib\site-packages\pyculib\utils\libutils.py", line 20, in __new__
    e))
Exception: Cannot open library for cusparse:
[WinError 3] Das System kann den angegebenen Pfad nicht finden: 'C:\\Users\\Artur\\Desktop\\RL_framework\\venv\\DLLs'

Process finished with exit code 1

Das System kann den angegebenen Pfad nicht finden的意思是system can not find stated path

使用Anaconda解释器:

import pyculib

输出:

C:\Users\Artur\Anaconda\python.exe C:/Users/Artur/Desktop/RL_framework/help_functions/test3.py
Traceback (most recent call last):
  File "C:\Users\Artur\Anaconda\lib\site-packages\pyculib\utils\libutils.py", line 17, in __new__
    dll = open_cudalib(cls.lib)
  File "C:\Users\Artur\Anaconda\lib\site-packages\numba\cuda\cudadrv\libs.py", line 56, in open_cudalib
    return ctypes.CDLL(path)
  File "C:\Users\Artur\Anaconda\lib\ctypes\__init__.py", line 364, in __init__
    self._handle = _dlopen(self._name, mode)
OSError: [WinError 126] Das angegebene Modul wurde nicht gefunden

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "C:/Users/Artur/Desktop/RL_framework/help_functions/test3.py", line 1, in <module>
    import pyculib
  File "C:\Users\Artur\Anaconda\lib\site-packages\pyculib\__init__.py", line 49, in <module>
    from . import blas, sparse, fft, rand, sorting
  File "C:\Users\Artur\Anaconda\lib\site-packages\pyculib\sparse\__init__.py", line 2, in <module>
    from .api import *
  File "C:\Users\Artur\Anaconda\lib\site-packages\pyculib\sparse\api.py", line 6, in <module>
    from .binding import (cuSparse, CUSPARSE_INDEX_BASE_ZERO,
  File "C:\Users\Artur\Anaconda\lib\site-packages\pyculib\sparse\binding.py", line 1307, in <module>
    cuSparse = _init_cuSparse()
  File "C:\Users\Artur\Anaconda\lib\site-packages\pyculib\sparse\binding.py", line 1292, in _init_cuSparse
    name, func = _init_api_function(k, v)
  File "C:\Users\Artur\Anaconda\lib\site-packages\pyculib\sparse\binding.py", line 1237, in _init_api_function
    lib = libcusparse()
  File "C:\Users\Artur\Anaconda\lib\site-packages\pyculib\utils\libutils.py", line 20, in __new__
    e))
Exception: Cannot open library for cusparse:
[WinError 126] Das angegebene Modul wurde nicht gefunden

Process finished with exit code 1

Das angegebene Modul wurde nicht gefunden的意思是the stated module can not be found

谢谢您的时间。

编辑:

按照@ norok2的建议,我尝试在具有import pyculib解释程序的Linux服务器上运行anaconda3。它已安装numbacudatoolkit以及3个兼容的GPU(2个{Quadro P2000和1个RTX 2080)。

运行import命令会引发此错误:

/home/amu/anaconda3/bin/python /home/amu/Desktop/RL_framework/help_functions/test.py
Traceback (most recent call last):
  File "/home/amu/Desktop/RL_framework/help_functions/test.py", line 1, in <module>
    import pyculib
  File "/home/amu/anaconda3/lib/python3.7/site-packages/pyculib/__init__.py", line 49, in <module>
    from . import blas, sparse, fft, rand, sorting
  File "/home/amu/anaconda3/lib/python3.7/site-packages/pyculib/sparse/__init__.py", line 2, in <module>
    from .api import *
  File "/home/amu/anaconda3/lib/python3.7/site-packages/pyculib/sparse/api.py", line 6, in <module>
    from .binding import (cuSparse, CUSPARSE_INDEX_BASE_ZERO,
  File "/home/amu/anaconda3/lib/python3.7/site-packages/pyculib/sparse/binding.py", line 1307, in <module>
    cuSparse = _init_cuSparse()
  File "/home/amu/anaconda3/lib/python3.7/site-packages/pyculib/sparse/binding.py", line 1292, in _init_cuSparse
    name, func = _init_api_function(k, v)
  File "/home/amu/anaconda3/lib/python3.7/site-packages/pyculib/sparse/binding.py", line 1237, in _init_api_function
    lib = libcusparse()
  File "/home/amu/anaconda3/lib/python3.7/site-packages/pyculib/utils/libutils.py", line 25, in __new__
    inst._initialize()
  File "/home/amu/anaconda3/lib/python3.7/site-packages/pyculib/utils/libutils.py", line 34, in _initialize
    fn = getattr(self.dll, name)
  File "/home/amu/anaconda3/lib/python3.7/ctypes/__init__.py", line 369, in __getattr__
    func = self.__getitem__(name)
  File "/home/amu/anaconda3/lib/python3.7/ctypes/__init__.py", line 374, in __getitem__
    func = self._FuncPtr((name_or_ordinal, self))
AttributeError: /home/amu/anaconda3/lib/libcusparse.so.10.3.1.89: undefined symbol: cusparseCaxpyi_v2

Process finished with exit code 1

编辑_2:

cudatoolkit降级到版本10.1.168及以下版本会产生以下错误。 pyculib仅在pycharm版本1.0.1中可用:

/home/amu/anaconda3/bin/python /home/amu/Desktop/RL_framework/help_functions/test.py
Traceback (most recent call last):
  File "/home/amu/Desktop/RL_framework/help_functions/test.py", line 1, in <module>
    import pyculib
  File "/home/amu/anaconda3/lib/python3.7/site-packages/pyculib/__init__.py", line 49, in <module>
    from . import blas, sparse, fft, rand, sorting
  File "/home/amu/anaconda3/lib/python3.7/site-packages/pyculib/sorting/__init__.py", line 1, in <module>
    from .radixsort import RadixSort
  File "/home/amu/anaconda3/lib/python3.7/site-packages/pyculib/sorting/radixsort.py", line 30, in <module>
    from .common import load_lib
  File "/home/amu/anaconda3/lib/python3.7/site-packages/pyculib/sorting/common.py", line 2, in <module>
    from numba import findlib
ImportError: cannot import name 'findlib' from 'numba' (/home/amu/anaconda3/lib/python3.7/site-packages/numba/__init__.py)

Process finished with exit code 1

0 个答案:

没有答案
相关问题