在HPC集群上安装`transformers`

时间:2020-07-20 12:19:17

标签: pip centos hpc huggingface-transformers

我正在尝试在HPC上安装转换器库。我这样做:

git clone https://github.com/huggingface/transformers.git
cd transformers
pip install -e . --user

所有这三个功能均按预期工作,最后输出为:

Successfully installed dataclasses-0.7 numpy-1.19.0 tokenizers-0.8.1rc2 transformers

然后,我尝试python -c "import transformers",但出现以下错误:

Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/home/maths/btech/mt1170727/transformers/src/transformers/__init__.py", line 23, in <module>
    from .configuration_albert import ALBERT_PRETRAINED_CONFIG_ARCHIVE_MAP, AlbertConfig
  File "/home/maths/btech/mt1170727/transformers/src/transformers/configuration_albert.py", line 18, in <module>
    from .configuration_utils import PretrainedConfig
  File "/home/maths/btech/mt1170727/transformers/src/transformers/configuration_utils.py", line 25, in <module>
    from .file_utils import CONFIG_NAME, cached_path, hf_bucket_url, is_remote_url
  File "/home/maths/btech/mt1170727/transformers/src/transformers/file_utils.py", line 37, in <module>
    import torch
  File "/home/soft/PYTHON/3.6.0/ucs4/gnu/447/lib/python3.6/site-packages/torch/__init__.py", line 125, in <module>
    _load_global_deps()
  File "/home/soft/PYTHON/3.6.0/ucs4/gnu/447/lib/python3.6/site-packages/torch/__init__.py", line 83, in _load_global_deps
    ctypes.CDLL(lib_path, mode=ctypes.RTLD_GLOBAL)
  File "/home/soft/PYTHON/3.6.0/ucs4/gnu/447/lib/python3.6/ctypes/__init__.py", line 344, in __init__
    self._handle = _dlopen(self._name, mode)
OSError: libnvToolsExt.so.1: cannot open shared object file: No such file or directory

我已经按照documentation中的说明进行了操作,但看不到为什么会遇到此错误。任何帮助都会很棒。谢谢...

0 个答案:

没有答案