question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

BUG: scipy 1.9 build issue

See original GitHub issue

Describe your issue.

We build scipy and scikit-learn from source. With scipy 1.9, scikit-learn build always failed immediately with log below. We also tried python3 -c 'from scipy.lib import _ccallback_c' and that failed in the same way.

This wasn’t an issue in 1.8 or even earlier version.

If we build lower version first and gradually upgrade, it works fine, indicating probably some file is left there.

Reproducing Code Example

Bascially python3 -m pip install on locally cloned repo of scipy/scikit-learn

Error message

#12 247.1   Traceback (most recent call last):                                                                                                                                                        
#12 247.1     File "/usr/local/lib/python3.9/dist-packages/scipy/__init__.py", line 166, in <module>                                                                                                  
#12 247.1       from scipy._lib._ccallback import LowLevelCallable                                                                                                                                    
#12 247.1     File "/usr/local/lib/python3.9/dist-packages/scipy/_lib/_ccallback.py", line 1, in <module>                                                                                             
#12 247.1       from . import _ccallback_c                                                                                                                                                            
#12 247.1   ImportError: cannot import name '_ccallback_c' from 'scipy._lib' (/usr/local/lib/python3.9/dist-packages/scipy/_lib/__init__.py)                                                          
#12 247.1                                                                                                                                                                                             
#12 247.1   The above exception was the direct cause of the following exception:                                                                                                                      
#12 247.1                                                                                                                                                                                             
#12 247.1   Traceback (most recent call last):                                                                                                                                                        
#12 247.1     File "setup.py", line 200, in check_package_status                                                                                                                                      
#12 247.1       module = importlib.import_module(package)                                                                                                                                             
#12 247.1     File "/usr/lib/python3.9/importlib/__init__.py", line 127, in import_module                                                                                                             
#12 247.1       return _bootstrap._gcd_import(name[level:], package, level)                                                                                                                           
#12 247.1     File "<frozen importlib._bootstrap>", line 1030, in _gcd_import                                                                                                                         
#12 247.1     File "<frozen importlib._bootstrap>", line 1007, in _find_and_load                                                                                                                      
#12 247.1     File "<frozen importlib._bootstrap>", line 986, in _find_and_load_unlocked                                                                                                              
#12 247.1     File "<frozen importlib._bootstrap>", line 680, in _load_unlocked                                                                                                                       
#12 247.1     File "<frozen importlib._bootstrap_external>", line 790, in exec_module                                                                                                                 
#12 247.1     File "<frozen importlib._bootstrap>", line 228, in _call_with_frames_removed                                                                                                            
#12 247.1     File "/usr/local/lib/python3.9/dist-packages/scipy/__init__.py", line 171, in <module>                                                                                                  
#12 247.1       raise ImportError(msg) from e                                                                                                                                                         
#12 247.1   ImportError: The `scipy` install you are using seems to be broken, (extension modules cannot be imported), please try reinstalling.                                                       
#12 247.1   Traceback (most recent call last):                                                                                                                                                        
#12 247.1     File "/usr/local/lib/python3.9/dist-packages/pip/_vendor/pep517/in_process/_in_process.py", line 363, in <module>                                                                       
#12 247.1       main()                                                                                                                                                                                
#12 247.1     File "/usr/local/lib/python3.9/dist-packages/pip/_vendor/pep517/in_process/_in_process.py", line 345, in main                                                                           
#12 247.1       json_out['return_val'] = hook(**hook_input['kwargs'])                                                                                                                                 
#12 247.1     File "/usr/local/lib/python3.9/dist-packages/pip/_vendor/pep517/in_process/_in_process.py", line 164, in prepare_metadata_for_build_wheel                                               
#12 247.1       return hook(metadata_directory, config_settings)                                                                                                                                      
#12 247.1     File "/usr/local/lib/python3.9/dist-packages/setuptools/build_meta.py", line 188, in prepare_metadata_for_build_wheel                                                                   
#12 247.1       self.run_setup()                                                                                                                                                                      
#12 247.1     File "/usr/local/lib/python3.9/dist-packages/setuptools/build_meta.py", line 281, in run_setup                                                                                          
#12 247.1       super(_BuildMetaLegacyBackend,                                                                                                                                                        
#12 247.1     File "/usr/local/lib/python3.9/dist-packages/setuptools/build_meta.py", line 174, in run_setup                                                                                          
#12 247.1       exec(compile(code, __file__, 'exec'), locals())                                                                                                                                       
#12 247.1     File "setup.py", line 329, in <module>                                                                                                                                                  
#12 247.1       setup_package()                                                                                                                                                                       
#12 247.1     File "setup.py", line 305, in setup_package                                                                                                                                             
#12 247.1       check_package_status("scipy", min_deps.SCIPY_MIN_VERSION)                                                                                                                             
#12 247.1     File "setup.py", line 227, in check_package_status                                                                                                                                      
#12 247.1       raise ImportError(                                                                                                                                                                    
#12 247.1   ImportError: scipy is not installed.

SciPy/NumPy/Python version information

Latest/Latest/3.8

Issue Analytics

  • State:closed
  • Created a year ago
  • Comments:12 (5 by maintainers)

github_iconTop GitHub Comments

1reaction
xkszltlcommented, Oct 17, 2022

I can close now and reopen if I got this again, thanks again for the quick help~!

0reactions
rgommerscommented, Oct 16, 2022

Another possibly related thing is, we manually cleared ccache used by some docker build, although that cannot explained what happened elsewhere.

That could indeed explain an issue going away. You filed the issue on Oct 9th, while there were bug fix releases for both meson and meson-python on Oct 5th with fixes relevant to SciPy builds.

Do you want to test more, or close this issue now and reopen in case it comes back?

Read more comments on GitHub >

github_iconTop Results From Across the Web

SciPy 1.9.0 Release Notes — SciPy v1.9.3 Manual
SciPy 1.9.0 is the culmination of 6 months of hard work. It contains many new features, numerous bug-fixes, improved test coverage and better...
Read more >
BUG: Cannot install SciPy 1.9.3 in Python 3.10 in macOS
This is the error shown: Collecting scipy Using cached scipy-1.9.3.tar.gz (42.1 MB) Installing build dependencies: started Installing build ...
Read more >
BUG: Cannot compile for 3.11 · Issue #16262 · scipy ... - GitHub
Using cached scipy-1.6.1.tar.gz (27.3 MB) I've attached the log file and the suspected issue - Reproducing Code Example pip install scipy ...
Read more >
SciPy - PyPI
scipy 1.9.3 ... Bug reports: https://github.com/scipy/scipy/issues ... develop graphic design for our brand assets and promotional materials.
Read more >
SageMath 9.8 beta 4: Error building a wheel for scipy-1.9.2
This new build failed at 'scipy-1.9.2'. Your help to debug and fix this issue is much appreciated. Please find 'non-default-config.log', ...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found