Stuck on an issue?
Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.
And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.
Version 0.6.0: gcc: error: fastparquet/speedups.c: No such file or directory
See original GitHub issueIt seems pip install fastparquet fails with latest version. Hit this issue with some CI pipelines, but it seems it is easy to reproduce locally with Conda envs:
What happened:
$ conda create -n asdf python=3.8
$ conda activate asdf
(asdf) $ pip install fastparquet==0.6.0
Collecting fastparquet==0.6.0
Using cached fastparquet-0.6.0.tar.gz (70 kB)
Collecting pandas>=1.1.0
Downloading pandas-1.2.4-cp38-cp38-manylinux1_x86_64.whl (9.7 MB)
|████████████████████████████████| 9.7 MB 3.9 MB/s
Collecting numba>=0.49
Using cached numba-0.53.1-cp38-cp38-manylinux2014_x86_64.whl (3.4 MB)
Collecting numpy>=1.11
Using cached numpy-1.20.2-cp38-cp38-manylinux2010_x86_64.whl (15.4 MB)
Collecting thrift>=0.11.0
Using cached thrift-0.13.0-cp38-cp38-linux_x86_64.whl
Collecting cramjam>=2.3.0
Using cached cramjam-2.3.0-cp38-cp38-manylinux2010_x86_64.whl (1.4 MB)
Requirement already satisfied: setuptools in /cache/miniconda/envs/asdf/lib/python3.8/site-packages (from numba>=0.49->fastparquet==0.6.0) (52.0.0.post20210125)
Collecting llvmlite<0.37,>=0.36.0rc1
Using cached llvmlite-0.36.0-cp38-cp38-manylinux2010_x86_64.whl (25.3 MB)
Collecting python-dateutil>=2.7.3
Using cached python_dateutil-2.8.1-py2.py3-none-any.whl (227 kB)
Collecting pytz>=2017.3
Using cached pytz-2021.1-py2.py3-none-any.whl (510 kB)
Collecting six>=1.5
Using cached six-1.16.0-py2.py3-none-any.whl (11 kB)
Building wheels for collected packages: fastparquet
Building wheel for fastparquet (setup.py) ... error
ERROR: Command errored out with exit status 1:
command: /cache/miniconda/envs/asdf/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-11xbyye0/fastparquet_cffe3e49744f46f6a1c645ac8cc2a225/setup.py'"'"'; __file__='"'"'/tmp/pip-install-11xbyye0/fastparquet_cffe3e49744f46f6a1c645ac8cc2a225/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-w32uhk53
cwd: /tmp/pip-install-11xbyye0/fastparquet_cffe3e49744f46f6a1c645ac8cc2a225/
Complete output (45 lines):
running bdist_wheel
running build
running build_py
creating build
creating build/lib.linux-x86_64-3.8
creating build/lib.linux-x86_64-3.8/fastparquet
copying fastparquet/writer.py -> build/lib.linux-x86_64-3.8/fastparquet
copying fastparquet/util.py -> build/lib.linux-x86_64-3.8/fastparquet
copying fastparquet/thrift_structures.py -> build/lib.linux-x86_64-3.8/fastparquet
copying fastparquet/schema.py -> build/lib.linux-x86_64-3.8/fastparquet
copying fastparquet/encoding.py -> build/lib.linux-x86_64-3.8/fastparquet
copying fastparquet/dataframe.py -> build/lib.linux-x86_64-3.8/fastparquet
copying fastparquet/core.py -> build/lib.linux-x86_64-3.8/fastparquet
copying fastparquet/converted_types.py -> build/lib.linux-x86_64-3.8/fastparquet
copying fastparquet/compression.py -> build/lib.linux-x86_64-3.8/fastparquet
copying fastparquet/api.py -> build/lib.linux-x86_64-3.8/fastparquet
copying fastparquet/__init__.py -> build/lib.linux-x86_64-3.8/fastparquet
running egg_info
writing fastparquet.egg-info/PKG-INFO
writing dependency_links to fastparquet.egg-info/dependency_links.txt
writing requirements to fastparquet.egg-info/requires.txt
writing top-level names to fastparquet.egg-info/top_level.txt
reading manifest file 'fastparquet.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
warning: no previously-included files found matching 'fastparquet/*.c'
no previously-included directories found matching 'fastparquet/test/'
no previously-included directories found matching 'test-data/'
no previously-included directories found matching 'docs/'
writing manifest file 'fastparquet.egg-info/SOURCES.txt'
copying fastparquet/parquet.thrift -> build/lib.linux-x86_64-3.8/fastparquet
creating build/lib.linux-x86_64-3.8/fastparquet/benchmarks
copying fastparquet/benchmarks/columns.py -> build/lib.linux-x86_64-3.8/fastparquet/benchmarks
creating build/lib.linux-x86_64-3.8/fastparquet/parquet_thrift
copying fastparquet/parquet_thrift/__init__.py -> build/lib.linux-x86_64-3.8/fastparquet/parquet_thrift
creating build/lib.linux-x86_64-3.8/fastparquet/parquet_thrift/parquet
copying fastparquet/parquet_thrift/parquet/__init__.py -> build/lib.linux-x86_64-3.8/fastparquet/parquet_thrift/parquet
copying fastparquet/parquet_thrift/parquet/constants.py -> build/lib.linux-x86_64-3.8/fastparquet/parquet_thrift/parquet
copying fastparquet/parquet_thrift/parquet/ttypes.py -> build/lib.linux-x86_64-3.8/fastparquet/parquet_thrift/parquet
running build_ext
building 'fastparquet.speedups' extension
creating build/temp.linux-x86_64-3.8
creating build/temp.linux-x86_64-3.8/fastparquet
gcc -pthread -B /cache/miniconda/envs/asdf/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/cache/miniconda/envs/asdf/include/python3.8 -I/tmp/pip-install-11xbyye0/fastparquet_cffe3e49744f46f6a1c645ac8cc2a225/.eggs/numpy-1.20.2-py3.8-linux-x86_64.egg/numpy/core/include -c fastparquet/speedups.c -o build/temp.linux-x86_64-3.8/fastparquet/speedups.o
gcc: error: fastparquet/speedups.c: No such file or directory
error: command 'gcc' failed with exit status 1
----------------------------------------
ERROR: Failed building wheel for fastparquet
Running setup.py clean for fastparquet
Failed to build fastparquet
Installing collected packages: six, pytz, python-dateutil, numpy, llvmlite, thrift, pandas, numba, cramjam, fastparquet
Running setup.py install for fastparquet ... error
ERROR: Command errored out with exit status 1:
command: /cache/miniconda/envs/asdf/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-11xbyye0/fastparquet_cffe3e49744f46f6a1c645ac8cc2a225/setup.py'"'"'; __file__='"'"'/tmp/pip-install-11xbyye0/fastparquet_cffe3e49744f46f6a1c645ac8cc2a225/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-4sklhgab/install-record.txt --single-version-externally-managed --compile --install-headers /cache/miniconda/envs/asdf/include/python3.8/fastparquet
cwd: /tmp/pip-install-11xbyye0/fastparquet_cffe3e49744f46f6a1c645ac8cc2a225/
Complete output (22 lines):
running install
running build
running build_py
running egg_info
writing fastparquet.egg-info/PKG-INFO
writing dependency_links to fastparquet.egg-info/dependency_links.txt
writing requirements to fastparquet.egg-info/requires.txt
writing top-level names to fastparquet.egg-info/top_level.txt
reading manifest file 'fastparquet.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
warning: no previously-included files found matching 'fastparquet/*.c'
no previously-included directories found matching 'fastparquet/test/'
no previously-included directories found matching 'test-data/'
no previously-included directories found matching 'docs/'
writing manifest file 'fastparquet.egg-info/SOURCES.txt'
running build_ext
building 'fastparquet.speedups' extension
creating build/temp.linux-x86_64-3.8
creating build/temp.linux-x86_64-3.8/fastparquet
gcc -pthread -B /cache/miniconda/envs/asdf/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/cache/miniconda/envs/asdf/include/python3.8 -I/cache/miniconda/envs/asdf/lib/python3.8/site-packages/numpy/core/include -c fastparquet/speedups.c -o build/temp.linux-x86_64-3.8/fastparquet/speedups.o
gcc: error: fastparquet/speedups.c: No such file or directory
error: command 'gcc' failed with exit status 1
----------------------------------------
ERROR: Command errored out with exit status 1: /cache/miniconda/envs/asdf/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-11xbyye0/fastparquet_cffe3e49744f46f6a1c645ac8cc2a225/setup.py'"'"'; __file__='"'"'/tmp/pip-install-11xbyye0/fastparquet_cffe3e49744f46f6a1c645ac8cc2a225/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-4sklhgab/install-record.txt --single-version-externally-managed --compile --install-headers /cache/miniconda/envs/asdf/include/python3.8/fastparquet Check the logs for full command output.
Issue Analytics
- State:
- Created 2 years ago
- Comments:11 (4 by maintainers)
Top Results From Across the Web
Pod error - Failed building wheel for fastparquet - Stack Overflow
... fastparquet/speedups.c -o build/temp.linux-x86_64-3.7/fastparquet/speedups.o unable to execute 'gcc': No such file or directory error: ...
Read more >fastparquet — fastparquet 0.7.1 documentation
This package aims to provide a performant library to read and write Parquet files from Python, without any need for a Python-Java bridge....
Read more >conda-forge - :: Anaconda.org
A software package for algebraic, geometric and combinatorial problems... 7za, 9.20, LGPL, X, A file archiver with a high compression ratio. 7zip, 19.00 ......
Read more >develop PDF - EasyBuild Documentation
Version -specific documentation relevant to easyconfigs . ... If no such easyconfig file was specified on the eb command line, the dependency ...
Read more >fastparquet Documentation - Read the Docs
With versions 0.6.0 and 0.7.0, a LOT of new features and enhancements ... Reading a directory without a _metadata summary file now works...
Read more >
Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free
Top Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Let’s close this one, then, and continue discussion in the other issue, as needed. Thanks for the feedback, everyone. I would be happy for help on the “right” way to package fastprarquet for pip. Note that conda seems to do the right thing in all cases.
Please try now. With any luck, you will get v0.6.0post1, which includes the C file in the source distribution while I figure out how to build wheels for everyone.