question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

`pip install` from local dir failed on importing files from repo.

See original GitHub issue

setuptools version

57.0.0/57.1.0

Python version

3.6

OS

CentOS 7/Ubuntu 18.04

Additional environment information

pip 21.1.3 wheel 0.36.2

Description

We’re having trouble building pytorch recently. Seems it tries to import from its own repo but cannot: https://github.com/pytorch/pytorch/blob/05c1e5b65571d2fa14b0f06c37ba970fd7cc43d0/setup.py#L219

    File "setup.py", line 219, in <module>
      from tools.build_pytorch_libs import build_caffe2
  ModuleNotFoundError: No module named 'tools'

The failing import is in the very early place of setup.py, before actual code, and has been there for long. I cannot tell whether this issue is from pip or setuptools, so filed based on what’s in the stack trace.

  Successfully installed setuptools-57.0.0 wheel-0.36.2
  WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
  Removed build tracker: '/tmp/pip-req-tracker-kcpyqhnm'
  Installing build dependencies ... done              
  Running command /usr/bin/python3 /usr/local/lib/python3.6/site-packages/pip/_vendor/pep517/in_process/_in_process.py get_requires_for_build_wheel /tmp/tmpfn5afm8_
  Traceback (most recent call last):
    File "/usr/local/lib/python3.6/site-packages/pip/_vendor/pep517/in_process/_in_process.py", line 280, in <module>
      main()                                                                    
    File "/usr/local/lib/python3.6/site-packages/pip/_vendor/pep517/in_process/_in_process.py", line 263, in main
      json_out['return_val'] = hook(**hook_input['kwargs'])
    File "/usr/local/lib/python3.6/site-packages/pip/_vendor/pep517/in_process/_in_process.py", line 114, in get_requires_for_build_wheel
      return hook(config_settings)
    File "/tmp/pip-build-env-z43ukowd/overlay/lib/python3.6/site-packages/setuptools/build_meta.py", line 155, in get_requires_for_build_wheel
      config_settings, requirements=['wheel'])
    File "/tmp/pip-build-env-z43ukowd/overlay/lib/python3.6/site-packages/setuptools/build_meta.py", line 135, in _get_build_requires
      self.run_setup()      
    File "/tmp/pip-build-env-z43ukowd/overlay/lib/python3.6/site-packages/setuptools/build_meta.py", line 150, in run_setup
      exec(compile(code, __file__, 'exec'), locals())
    File "setup.py", line 219, in <module>
      from tools.build_pytorch_libs import build_caffe2
  ModuleNotFoundError: No module named 'tools'
  Getting requirements to build wheel ... error
WARNING: Discarding file:///tmp/scratch/pytorch. Command errored out with exit status 1: /usr/bin/python3 /usr/local/lib/python3.6/site-packages/pip/_vendor/pep517/in_process/_in_process.py get_requires_for_build_wheel /tmp/tmpfn5afm8_ Check the logs for
 full command output.
ERROR: Command errored out with exit status 1: /usr/bin/python3 /usr/local/lib/python3.6/site-packages/pip/_vendor/pep517/in_process/_in_process.py get_requires_for_build_wheel /tmp/tmpfn5afm8_ Check the logs for full command output.
Exception information:
Traceback (most recent call last):
  File "/usr/local/lib/python3.6/site-packages/pip/_internal/cli/base_command.py", line 180, in _main
    status = self.run(options, args)
  File "/usr/local/lib/python3.6/site-packages/pip/_internal/cli/req_command.py", line 205, in wrapper
    return func(self, options, args)
  File "/usr/local/lib/python3.6/site-packages/pip/_internal/commands/install.py", line 319, in run
    reqs, check_supported_wheels=not options.target_dir
  File "/usr/local/lib/python3.6/site-packages/pip/_internal/resolution/resolvelib/resolver.py", line 104, in resolve
    req, requested_extras=()
  File "/usr/local/lib/python3.6/site-packages/pip/_internal/resolution/resolvelib/factory.py", line 444, in make_requirement_from_install_req
    raise self._build_failures[ireq.link]
  File "/usr/local/lib/python3.6/site-packages/pip/_internal/resolution/resolvelib/factory.py", line 205, in _make_candidate_from_link
    version=version,
  File "/usr/local/lib/python3.6/site-packages/pip/_internal/resolution/resolvelib/candidates.py", line 312, in __init__
    version=version,
  File "/usr/local/lib/python3.6/site-packages/pip/_internal/resolution/resolvelib/candidates.py", line 151, in __init__
    self.dist = self._prepare()
  File "/usr/local/lib/python3.6/site-packages/pip/_internal/resolution/resolvelib/candidates.py", line 234, in _prepare
    dist = self._prepare_distribution()
  File "/usr/local/lib/python3.6/site-packages/pip/_internal/resolution/resolvelib/candidates.py", line 318, in _prepare_distribution
    self._ireq, parallel_builds=True
  File "/usr/local/lib/python3.6/site-packages/pip/_internal/operations/prepare.py", line 508, in prepare_linked_requirement
    return self._prepare_linked_requirement(req, parallel_builds)
  File "/usr/local/lib/python3.6/site-packages/pip/_internal/operations/prepare.py", line 571, in _prepare_linked_requirement
    req, self.req_tracker, self.finder, self.build_isolation,
  File "/usr/local/lib/python3.6/site-packages/pip/_internal/operations/prepare.py", line 60, in _get_prepared_distribution
    abstract_dist.prepare_distribution_metadata(finder, build_isolation)
  File "/usr/local/lib/python3.6/site-packages/pip/_internal/distributions/sdist.py", line 34, in prepare_distribution_metadata
    self._setup_isolation(finder)
  File "/usr/local/lib/python3.6/site-packages/pip/_internal/distributions/sdist.py", line 88, in _setup_isolation
    reqs = backend.get_requires_for_build_wheel()
  File "/usr/local/lib/python3.6/site-packages/pip/_vendor/pep517/wrappers.py", line 169, in get_requires_for_build_wheel
    'config_settings': config_settings
  File "/usr/local/lib/python3.6/site-packages/pip/_vendor/pep517/wrappers.py", line 268, in _call_hook
    extra_environ=extra_environ
  File "/usr/local/lib/python3.6/site-packages/pip/_internal/utils/subprocess.py", line 278, in runner
    spinner=spinner,
  File "/usr/local/lib/python3.6/site-packages/pip/_internal/utils/subprocess.py", line 244, in call_subprocess
    raise InstallationSubprocessError(proc.returncode, command_desc)
pip._internal.exceptions.InstallationSubprocessError: Command errored out with exit status 1: /usr/bin/python3 /usr/local/lib/python3.6/site-packages/pip/_vendor/pep517/in_process/_in_process.py get_requires_for_build_wheel /tmp/tmpfn5afm8_ Check the log
s for full command output.
Removed file:///tmp/scratch/pytorch from build tracker '/tmp/pip-req-tracker-kcpyqhnm'
Removed build tracker: '/tmp/pip-req-tracker-kcpyqhnm'

Local repo

[root@ff8bb53a4a06 pytorch]# pwd
/tmp/scratch/pytorch
[root@ff8bb53a4a06 pytorch]# ls -la tools/build_pytorch_libs.py 
-rw-r--r-- 1 root root 2698 Jul  4 18:01 tools/build_pytorch_libs.py
[root@ff8bb53a4a06 pytorch]# python3 -m pip install -Uv .
Using pip 21.1.3 from /usr/local/lib/python3.6/site-packages/pip (python 3.6)
Value for scheme.platlib does not match. Please report this to <https://github.com/pypa/pip/issues/9617>
distutils: /usr/local/lib64/python3.6/site-packages
sysconfig: /usr/lib64/python3.6/site-packages
Value for scheme.purelib does not match. Please report this to <https://github.com/pypa/pip/issues/9617>
distutils: /usr/local/lib/python3.6/site-packages
sysconfig: /usr/lib/python3.6/site-packages
Value for scheme.headers does not match. Please report this to <https://github.com/pypa/pip/issues/9617>
distutils: /usr/local/include/python3.6m/UNKNOWN
sysconfig: /usr/include/python3.6m/UNKNOWN
Value for scheme.scripts does not match. Please report this to <https://github.com/pypa/pip/issues/9617>
distutils: /usr/local/bin
sysconfig: /usr/bin
Value for scheme.data does not match. Please report this to <https://github.com/pypa/pip/issues/9617>
distutils: /usr/local
sysconfig: /usr
Additional context:
user = False
home = None
root = None
prefix = None
Non-user install because site-packages writeable
Created temporary directory: /tmp/pip-ephem-wheel-cache-8ir56xxf
Created temporary directory: /tmp/pip-req-tracker-ryunaqfh
Initialized build tracking at /tmp/pip-req-tracker-ryunaqfh
Created build tracker: /tmp/pip-req-tracker-ryunaqfh
Entered build tracker: /tmp/pip-req-tracker-ryunaqfh
Created temporary directory: /tmp/pip-install-pqloyx7p
Processing /tmp/scratch/pytorch
  Created temporary directory: /tmp/pip-req-build-w7_n2r71
  DEPRECATION: A future pip version will change local packages to be built in-place without first copying to a temporary directory. We recommend you use --use-feature=in-tree-build to test your packages with this new behavior before it becomes the default.
   pip 21.3 will remove support for this functionality. You can find discussion regarding this at https://github.com/pypa/pip/issues/7555.

...<a huge chunk of "Found link">...

    Found link https://files.pythonhosted.org/packages/bb/10/44230dd6bf3563b8f227dbf344c908d412ad2ff48066476672f3a72e174e/wheel-0.33.4-py2.py3-none-any.whl#sha256=5e79117472686ac0c4aef5bad5172ea73a1c2d1646b808c35926bd26bdfb0c08 (from https://pypi.org/sim
ple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.33.4                                                 
    Found link https://files.pythonhosted.org/packages/1d/b0/f478e80aeace42fe251225a86752799174a94314c4a80ebfc5bf0ab1153a/wheel-0.33.4.tar.gz#sha256=62fcfa03d45b5b722539ccbc07b190e4bfff4bb9e3a4d470dd9f6a0981002565 (from https://pypi.org/simple/wheel/) (r
equires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.33.4                                                                    
    Found link https://files.pythonhosted.org/packages/65/55/8d1fab74c43c0b4bcfcaad988888b4bd03234dde245f9536d165f26e103f/wheel-0.33.5-py2.py3-none-any.whl#sha256=fd85f7f5ba5b13376fc0ba78dc34f7d7dd2ee944b15d4bac7a34b7a25ee226af (from https://pypi.org/sim
ple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.33.5                                             
    Found link https://files.pythonhosted.org/packages/18/50/3289ccedef5251e9b1de59946038aacc46da1c7810589c9271381f7d1d0b/wheel-0.33.5.tar.gz#sha256=0f83c322fbe95b5298aa306e822b273903c8b56c4729fae2a0650cc25a7678b4 (from https://pypi.org/simple/wheel/) (r
equires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.33.5                                                 
    Found link https://files.pythonhosted.org/packages/00/83/b4a77d044e78ad1a45610eb88f745be2fd2c6d658f9798a15e384b7d57c9/wheel-0.33.6-py2.py3-none-any.whl#sha256=f4da1763d3becf2e2cd92a14a7c920f0f00eca30fdde9ea992c836685b9faf28 (from https://pypi.org/sim
ple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.33.6
    Found link https://files.pythonhosted.org/packages/59/b0/11710a598e1e148fb7cbf9220fd2a0b82c98e94efbdecb299cb25e7f0b39/wheel-0.33.6.tar.gz#sha256=10c9da68765315ed98850f8e048347c3eb06dd81822dc2ab1d4fde9dc9702646 (from https://pypi.org/simple/wheel/) (r
equires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.33.6
    Found link https://files.pythonhosted.org/packages/58/2b/2a307602a01ade0a4ef1774213f978aac87d1f4b9a875942c8cead888871/wheel-0.34.0-py2.py3-none-any.whl#sha256=98a7bd648493d21da3463c52c437e81061c61b4dcca63d56c6d041c9f747abeb (from https://pypi.org/sim
ple/wheel/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 0.34.0                                                                                                                                                                      Found link https://files.pythonhosted.org/packages/15/39/728ccb81172c73f14084948b2d4561d5e51649dcf4b21d1f207b7363b1d7/wheel-0.34.0.tar.gz#sha256=a69231973dccde8558f80f2ef058335a1d0bc1b55b2a5a2dfb5097e151e3c498 (from https://pypi.org/simple/wheel/) (r
equires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 0.34.0                                                                                                                                                           
    Found link https://files.pythonhosted.org/packages/81/44/db78754a73d9a88c5bd1bb692b40004410970e88aa0c5dff20b57f231505/wheel-0.34.1-py2.py3-none-any.whl#sha256=48e082fac9a549bb30abcb71360db41e9e999f63bfc9933fdb7339ba7205330f (from https://pypi.org/sim
ple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*, !=3.4.*), version: 0.34.1
    Found link https://files.pythonhosted.org/packages/f9/85/120a5ad1565398efb1184eacaa597e925abbf8fff8cc748877add71257f1/wheel-0.34.1.tar.gz#sha256=664b9c5033ee7cd5aa6b355bc8a4a5915eadb7612e7b0acab1aa71f005457107 (from https://pypi.org/simple/wheel/) (r
equires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*, !=3.4.*), version: 0.34.1
    Found link https://files.pythonhosted.org/packages/8c/23/848298cccf8e40f5bbb59009b32848a4c38f4e7f3364297ab3c3e2e2cd14/wheel-0.34.2-py2.py3-none-any.whl#sha256=df277cb51e61359aba502208d680f90c0493adec6f0e848af94948778aed386e (from https://pypi.org/sim
ple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*, !=3.4.*), version: 0.34.2
    Found link https://files.pythonhosted.org/packages/75/28/521c6dc7fef23a68368efefdcd682f5b3d1d58c2b90b06dc1d0b805b51ae/wheel-0.34.2.tar.gz#sha256=8788e9155fe14f54164c1b9eb0a319d98ef02c160725587ad60f14ddc57b6f96 (from https://pypi.org/simple/wheel/) (r
equires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*, !=3.4.*), version: 0.34.2
    Found link https://files.pythonhosted.org/packages/85/37/7252beacf7e60cffe3bc5a97f94e3ccf22a927e87697d377cfe16abea7cf/wheel-0.35.0-py2.py3-none-any.whl#sha256=64a0d73747636637479b8b8741f9304bee7a568c80e4029eeb9529ef134b471d (from https://pypi.org/sim
ple/wheel/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 0.35.0
    Found link https://files.pythonhosted.org/packages/5b/e1/fa6dccd0d461520fbaa98d47cdf1ba26d5a2666e24b454d0e27387420e4b/wheel-0.35.0.tar.gz#sha256=625e645aae0706ad09690bded523196a065fbcf9afcdb2d713b59e01ef8699c0 (from https://pypi.org/simple/wheel/) (r
equires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 0.35.0
    Found link https://files.pythonhosted.org/packages/a7/00/3df031b3ecd5444d572141321537080b40c1c25e1caa3d86cdd12e5e919c/wheel-0.35.1-py2.py3-none-any.whl#sha256=497add53525d16c173c2c1c733b8f655510e909ea78cc0e29d374243544b77a2 (from https://pypi.org/sim
ple/wheel/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 0.35.1
    Found link https://files.pythonhosted.org/packages/83/72/611c121b6bd15479cb62f1a425b2e3372e121b324228df28e64cc28b01c2/wheel-0.35.1.tar.gz#sha256=99a22d87add3f634ff917310a3d87e499f19e663413a52eb9232c447aa646c9f (from https://pypi.org/simple/wheel/) (r
equires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 0.35.1
    Found link https://files.pythonhosted.org/packages/84/e8/3caa0d932d0edd9c9611065831fd06cf05c53671f78a0fa553a635da7e2f/wheel-0.36.0-py2.py3-none-any.whl#sha256=645f81da70dcd993844005762acbb7e8628306bec414c90539d276fbd4fc7cbe (from https://pypi.org/sim
ple/wheel/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 0.36.0
    Found link https://files.pythonhosted.org/packages/57/73/1911bfa69482de2a6327db4ca5eda87ae7599160018910007d6d6a1d3ada/wheel-0.36.0.tar.gz#sha256=e17f05e14282d0e666327f800ef43123b40f3dbc13a86193b604f2ebfae0dabc (from https://pypi.org/simple/wheel/) (r
equires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 0.36.0
    Found link https://files.pythonhosted.org/packages/c9/0b/e0fd299d93cd9331657f415085a4956422959897b333e3791dde40bd711d/wheel-0.36.1-py2.py3-none-any.whl#sha256=906864fb722c0ab5f2f9c35b2c65e3af3c009402c108a709c0aca27bc2c9187b (from https://pypi.org/sim
ple/wheel/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 0.36.1
    Found link https://files.pythonhosted.org/packages/d4/cf/732e05dce1e37b63d54d1836160b6e24fb36eeff2313e93315ad047c7d90/wheel-0.36.1.tar.gz#sha256=aaef9b8c36db72f8bf7f1e54f85f875c4d466819940863ca0b3f3f77f0a1646f (from https://pypi.org/simple/wheel/) (r
equires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 0.36.1
    Found link https://files.pythonhosted.org/packages/65/63/39d04c74222770ed1589c0eaba06c05891801219272420b40311cd60c880/wheel-0.36.2-py2.py3-none-any.whl#sha256=78b5b185f0e5763c26ca1e324373aadd49182ca90e825f7853f4b2509215dc0e (from https://pypi.org/sim
ple/wheel/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 0.36.2
    Found link https://files.pythonhosted.org/packages/ed/46/e298a50dde405e1c202e316fa6a3015ff9288423661d7ea5e8f22f589071/wheel-0.36.2.tar.gz#sha256=e11eefd162658ea59a60a0f6c7d493a7190ea4b9a85e335b33489d9f17e0245e (from https://pypi.org/simple/wheel/) (r
equires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 0.36.2          
  Skipping link: not a file: https://pypi.org/simple/wheel/                                                                                                                                                                                                   
  Given no hashes to check 104 links for project 'wheel': discarding no candidates
  Collecting wheel                                                                                                                                                                                                                                            
    Created temporary directory: /tmp/pip-unpack-arfgeyyi                               
    Looking up "https://files.pythonhosted.org/packages/65/63/39d04c74222770ed1589c0eaba06c05891801219272420b40311cd60c880/wheel-0.36.2-py2.py3-none-any.whl" in the cache                                                                                    
    Current age based on date: 85916                                      
    Ignoring unknown cache-control directive: immutable                                                                                                                                                                                                       
    Freshness lifetime from max-age: 365000000                                          
    The response is "fresh", returning cached response                                                                                                                                                                                                        
    365000000 > 85916                                                     
    Using cached wheel-0.36.2-py2.py3-none-any.whl (35 kB)                                                                                                                                                                                                    
    Added wheel from https://files.pythonhosted.org/packages/65/63/39d04c74222770ed1589c0eaba06c05891801219272420b40311cd60c880/wheel-0.36.2-py2.py3-none-any.whl#sha256=78b5b185f0e5763c26ca1e324373aadd49182ca90e825f7853f4b2509215dc0e to build tracker '/t
mp/pip-req-tracker-t0avr3r3'                                                                                                                                                                                                                                      Removed wheel from https://files.pythonhosted.org/packages/65/63/39d04c74222770ed1589c0eaba06c05891801219272420b40311cd60c880/wheel-0.36.2-py2.py3-none-any.whl#sha256=78b5b185f0e5763c26ca1e324373aadd49182ca90e825f7853f4b2509215dc0e from build tracker
 '/tmp/pip-req-tracker-t0avr3r3'                                                                                                                                                                                                                              
  Created temporary directory: /tmp/pip-unpack-v80az1kj                                 
  Installing collected packages: wheel, setuptools                                                                                                                                                                                                            
                                                                          
    Creating /tmp/pip-build-env-5rq6gdb4/overlay/bin
    changing mode of /tmp/pip-build-env-5rq6gdb4/overlay/bin/wheel to 755

  Successfully installed setuptools-57.1.0 wheel-0.36.2
  WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
  Removed build tracker: '/tmp/pip-req-tracker-t0avr3r3'
  Installing build dependencies ... done
  Running command /usr/bin/python3 /usr/local/lib/python3.6/site-packages/pip/_vendor/pep517/in_process/_in_process.py get_requires_for_build_wheel /tmp/tmpq2p9mz22
  Traceback (most recent call last):
    File "/usr/local/lib/python3.6/site-packages/pip/_vendor/pep517/in_process/_in_process.py", line 280, in <module>
      main()
    File "/usr/local/lib/python3.6/site-packages/pip/_vendor/pep517/in_process/_in_process.py", line 263, in main
      json_out['return_val'] = hook(**hook_input['kwargs'])
    File "/usr/local/lib/python3.6/site-packages/pip/_vendor/pep517/in_process/_in_process.py", line 114, in get_requires_for_build_wheel
      return hook(config_settings)
    File "/tmp/pip-build-env-5rq6gdb4/overlay/lib/python3.6/site-packages/setuptools/build_meta.py", line 155, in get_requires_for_build_wheel
      config_settings, requirements=['wheel'])
    File "/tmp/pip-build-env-5rq6gdb4/overlay/lib/python3.6/site-packages/setuptools/build_meta.py", line 135, in _get_build_requires
      self.run_setup()
    File "/tmp/pip-build-env-5rq6gdb4/overlay/lib/python3.6/site-packages/setuptools/build_meta.py", line 150, in run_setup
      exec(compile(code, __file__, 'exec'), locals())
    File "setup.py", line 219, in <module>
      from tools.build_pytorch_libs import build_caffe2
  ModuleNotFoundError: No module named 'tools'
  Getting requirements to build wheel ... error
WARNING: Discarding file:///tmp/scratch/pytorch. Command errored out with exit status 1: /usr/bin/python3 /usr/local/lib/python3.6/site-packages/pip/_vendor/pep517/in_process/_in_process.py get_requires_for_build_wheel /tmp/tmpq2p9mz22 Check the logs for
 full command output.
ERROR: Command errored out with exit status 1: /usr/bin/python3 /usr/local/lib/python3.6/site-packages/pip/_vendor/pep517/in_process/_in_process.py get_requires_for_build_wheel /tmp/tmpq2p9mz22 Check the logs for full command output.
Exception information:
Traceback (most recent call last):
  File "/usr/local/lib/python3.6/site-packages/pip/_internal/cli/base_command.py", line 180, in _main
    status = self.run(options, args)
  File "/usr/local/lib/python3.6/site-packages/pip/_internal/cli/req_command.py", line 205, in wrapper
    return func(self, options, args)
  File "/usr/local/lib/python3.6/site-packages/pip/_internal/commands/install.py", line 319, in run
    reqs, check_supported_wheels=not options.target_dir
  File "/usr/local/lib/python3.6/site-packages/pip/_internal/resolution/resolvelib/resolver.py", line 104, in resolve
    req, requested_extras=()
  File "/usr/local/lib/python3.6/site-packages/pip/_internal/resolution/resolvelib/factory.py", line 444, in make_requirement_from_install_req
    raise self._build_failures[ireq.link]
  File "/usr/local/lib/python3.6/site-packages/pip/_internal/resolution/resolvelib/factory.py", line 205, in _make_candidate_from_link
    version=version,
  File "/usr/local/lib/python3.6/site-packages/pip/_internal/resolution/resolvelib/candidates.py", line 312, in __init__
    version=version,
  File "/usr/local/lib/python3.6/site-packages/pip/_internal/resolution/resolvelib/candidates.py", line 151, in __init__
    self.dist = self._prepare()
  File "/usr/local/lib/python3.6/site-packages/pip/_internal/resolution/resolvelib/candidates.py", line 234, in _prepare
    dist = self._prepare_distribution()
  File "/usr/local/lib/python3.6/site-packages/pip/_internal/resolution/resolvelib/candidates.py", line 318, in _prepare_distribution
    self._ireq, parallel_builds=True
  File "/usr/local/lib/python3.6/site-packages/pip/_internal/operations/prepare.py", line 508, in prepare_linked_requirement
    return self._prepare_linked_requirement(req, parallel_builds)
  File "/usr/local/lib/python3.6/site-packages/pip/_internal/operations/prepare.py", line 571, in _prepare_linked_requirement
    req, self.req_tracker, self.finder, self.build_isolation,
  File "/usr/local/lib/python3.6/site-packages/pip/_internal/operations/prepare.py", line 60, in _get_prepared_distribution
    abstract_dist.prepare_distribution_metadata(finder, build_isolation)
  File "/usr/local/lib/python3.6/site-packages/pip/_internal/distributions/sdist.py", line 34, in prepare_distribution_metadata
    self._setup_isolation(finder)
  File "/usr/local/lib/python3.6/site-packages/pip/_internal/distributions/sdist.py", line 88, in _setup_isolation
    reqs = backend.get_requires_for_build_wheel()
  File "/usr/local/lib/python3.6/site-packages/pip/_vendor/pep517/wrappers.py", line 169, in get_requires_for_build_wheel
    'config_settings': config_settings
  File "/usr/local/lib/python3.6/site-packages/pip/_vendor/pep517/wrappers.py", line 268, in _call_hook
    extra_environ=extra_environ
  File "/usr/local/lib/python3.6/site-packages/pip/_internal/utils/subprocess.py", line 278, in runner
    spinner=spinner,
  File "/usr/local/lib/python3.6/site-packages/pip/_internal/utils/subprocess.py", line 244, in call_subprocess
    raise InstallationSubprocessError(proc.returncode, command_desc)
pip._internal.exceptions.InstallationSubprocessError: Command errored out with exit status 1: /usr/bin/python3 /usr/local/lib/python3.6/site-packages/pip/_vendor/pep517/in_process/_in_process.py get_requires_for_build_wheel /tmp/tmpq2p9mz22 Check the log
s for full command output.
Removed file:///tmp/scratch/pytorch from build tracker '/tmp/pip-req-tracker-t0avr3r3'
Removed build tracker: '/tmp/pip-req-tracker-t0avr3r3'

Code of Conduct

  • I agree to follow the PSF Code of Conduct

Issue Analytics

  • State:closed
  • Created 2 years ago
  • Comments:12 (8 by maintainers)

github_iconTop GitHub Comments

5reactions
laydaycommented, Oct 18, 2021

backend-path exists to support in-tree backends, it’s not meant to be used to add cwd on sys.path and pep517 (the library) actually enforces this - if you use backend-path but build-backend is not imported from backend-path, it errors out.

2reactions
jaracocommented, Nov 24, 2021

Do you happen to know the reason behind [removing the implicit current-working-directory-on-path]?

I believe the rationale is that some packages might not want cwd on sys.path, causing packages in the local directory to mask installed packages. For example, if a package provided a setup module, it would not be importable if there’s a setup.py script in the local directory.

I’m not sure why I suggested sys.path manipulation. I believe there’s a better supported mechanism in PEP 517, namely backend-path:

# pyproject.toml
[build-system]
backend-path = ["."]

That of course requires a PEP 517-based build, which still doesn’t support editable installs, so you may still need a sys.path hack for editable installs.

Read more comments on GitHub >

github_iconTop Results From Across the Web

python pip - install from local dir - Stack Overflow
Running pip install -e /path/to/package installs the package in a way, that you can edit the package, and when a new import call...
Read more >
Environment Dependencies — Ray 2.2.0
Your Ray script may import some files outside of the script. ... This feature requires a full installation of Ray using pip install...
Read more >
User Guide - pip documentation v22.3.1
pip supports installing from PyPI, version control, local projects, and directly from distribution files. The most common scenario is to install from PyPI...
Read more >
Installing Packages - Python Packaging User Guide - Python.org
This section covers the basics of how to install Python packages. ... (most recent call last): File "<stdin>", line 1, in <module> NameError:...
Read more >
Package installation issues | PyCharm Documentation
The most viable troubleshooting action is to try installing the problematic package on the selected Python interpreter using the terminal. If ...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found