Lightrun
question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Ray doesn't build on Ubuntu 19.10 due to GRPC

See original GitHub issue

System information

  • OS Platform and Distribution (e.g., Linux Ubuntu 16.04): Linux Ubuntu 19.10
  • Ray installed from (source or binary): Source
  • Ray version: 34fbc7f
  • Python version: Anaconda 3.7
  • Exact command to reproduce: pip install -e . --verbose

Describe the problem

Source code / logs

pip install -e . --verbose
Created temporary directory: /tmp/pip-ephem-wheel-cache-ri_9ne9g
Created temporary directory: /tmp/pip-req-tracker-03xdp_qj
Created requirements tracker '/tmp/pip-req-tracker-03xdp_qj'
Created temporary directory: /tmp/pip-install-czi9468r
Obtaining file:///home/matt/Code/ray/python
  Added file:///home/matt/Code/ray/python to build tracker '/tmp/pip-req-tracker-03xdp_qj'
    Running setup.py (path:/home/matt/Code/ray/python/setup.py) egg_info for package from file:///home/matt/Code/ray/python
    Running command python setup.py egg_info
    running egg_info
    writing ray.egg-info/PKG-INFO
    writing dependency_links to ray.egg-info/dependency_links.txt
    writing entry points to ray.egg-info/entry_points.txt
    writing requirements to ray.egg-info/requires.txt
    writing top-level names to ray.egg-info/top_level.txt
    reading manifest file 'ray.egg-info/SOURCES.txt'
    writing manifest file 'ray.egg-info/SOURCES.txt'
  Source in /home/matt/Code/ray/python has version 0.8.0.dev6, which satisfies requirement ray==0.8.0.dev6 from file:///home/matt/Code/ray/python
  Removed ray==0.8.0.dev6 from file:///home/matt/Code/ray/python from build tracker '/tmp/pip-req-tracker-03xdp_qj'
Requirement already satisfied: numpy>=1.14 in /home/matt/anaconda3/envs/gpu/lib/python3.7/site-packages (from ray==0.8.0.dev6) (1.17.2)
Requirement already satisfied: filelock in /home/matt/anaconda3/envs/gpu/lib/python3.7/site-packages (from ray==0.8.0.dev6) (3.0.12)
Requirement already satisfied: jsonschema in /home/matt/anaconda3/envs/gpu/lib/python3.7/site-packages (from ray==0.8.0.dev6) (3.1.1)
Requirement already satisfied: funcsigs in /home/matt/anaconda3/envs/gpu/lib/python3.7/site-packages (from ray==0.8.0.dev6) (1.0.2)
Requirement already satisfied: click in /home/matt/anaconda3/envs/gpu/lib/python3.7/site-packages (from ray==0.8.0.dev6) (7.0)
Requirement already satisfied: colorama in /home/matt/anaconda3/envs/gpu/lib/python3.7/site-packages (from ray==0.8.0.dev6) (0.4.1)
Requirement already satisfied: pytest in /home/matt/anaconda3/envs/gpu/lib/python3.7/site-packages (from ray==0.8.0.dev6) (5.2.1)
Requirement already satisfied: pyyaml in /home/matt/anaconda3/envs/gpu/lib/python3.7/site-packages (from ray==0.8.0.dev6) (5.1.2)
Requirement already satisfied: redis>=3.3.2 in /home/matt/anaconda3/envs/gpu/lib/python3.7/site-packages (from ray==0.8.0.dev6) (3.3.8)
Requirement already satisfied: six>=1.0.0 in /home/matt/anaconda3/envs/gpu/lib/python3.7/site-packages (from ray==0.8.0.dev6) (1.12.0)
Requirement already satisfied: protobuf>=3.8.0 in /home/matt/anaconda3/envs/gpu/lib/python3.7/site-packages (from ray==0.8.0.dev6) (3.9.2)
Requirement already satisfied: attrs>=17.4.0 in /home/matt/anaconda3/envs/gpu/lib/python3.7/site-packages (from jsonschema->ray==0.8.0.dev6) (19.3.0)
Requirement already satisfied: setuptools in /home/matt/anaconda3/envs/gpu/lib/python3.7/site-packages (from jsonschema->ray==0.8.0.dev6) (41.4.0)
Requirement already satisfied: importlib-metadata in /home/matt/anaconda3/envs/gpu/lib/python3.7/site-packages (from jsonschema->ray==0.8.0.dev6) (0.23)
Requirement already satisfied: pyrsistent>=0.14.0 in /home/matt/anaconda3/envs/gpu/lib/python3.7/site-packages (from jsonschema->ray==0.8.0.dev6) (0.15.4)
Requirement already satisfied: py>=1.5.0 in /home/matt/anaconda3/envs/gpu/lib/python3.7/site-packages (from pytest->ray==0.8.0.dev6) (1.8.0)
Requirement already satisfied: packaging in /home/matt/anaconda3/envs/gpu/lib/python3.7/site-packages (from pytest->ray==0.8.0.dev6) (19.2)
Requirement already satisfied: more-itertools>=4.0.0 in /home/matt/anaconda3/envs/gpu/lib/python3.7/site-packages (from pytest->ray==0.8.0.dev6) (7.2.0)
Requirement already satisfied: atomicwrites>=1.0 in /home/matt/anaconda3/envs/gpu/lib/python3.7/site-packages (from pytest->ray==0.8.0.dev6) (1.3.0)
Requirement already satisfied: pluggy<1.0,>=0.12 in /home/matt/anaconda3/envs/gpu/lib/python3.7/site-packages (from pytest->ray==0.8.0.dev6) (0.13.0)
Requirement already satisfied: wcwidth in /home/matt/anaconda3/envs/gpu/lib/python3.7/site-packages (from pytest->ray==0.8.0.dev6) (0.1.7)
Requirement already satisfied: zipp>=0.5 in /home/matt/anaconda3/envs/gpu/lib/python3.7/site-packages (from importlib-metadata->jsonschema->ray==0.8.0.dev6) (0.6.0)
Requirement already satisfied: pyparsing>=2.0.2 in /home/matt/anaconda3/envs/gpu/lib/python3.7/site-packages (from packaging->pytest->ray==0.8.0.dev6) (2.4.2)
Installing collected packages: ray
  Running setup.py develop for ray
    Running command /home/matt/anaconda3/envs/gpu/bin/python -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/home/matt/Code/ray/python/setup.py'"'"'; __file__='"'"'/home/matt/Code/ray/python/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' develop --no-deps
    running develop
    running egg_info
    writing ray.egg-info/PKG-INFO
    writing dependency_links to ray.egg-info/dependency_links.txt
    writing entry points to ray.egg-info/entry_points.txt
    writing requirements to ray.egg-info/requires.txt
    writing top-level names to ray.egg-info/top_level.txt
    reading manifest file 'ray.egg-info/SOURCES.txt'
    writing manifest file 'ray.egg-info/SOURCES.txt'
    running build_ext
    + set -e
    +++ dirname ../build.sh
    ++ cd ..
    ++ pwd
    + ROOT_DIR=/home/matt/Code/ray
    ++ uname
    + unamestr=Linux
    + [[ Linux == \L\i\n\u\x ]]
    + PARALLEL=1
    + RAY_BUILD_PYTHON=YES
    + RAY_BUILD_JAVA=NO
    + PYTHON_EXECUTABLE=
    + BUILD_DIR=
    + [[ 2 -gt 0 ]]
    + key=-p
    + case $key in
    + PYTHON_EXECUTABLE=/home/matt/anaconda3/envs/gpu/bin/python
    + shift
    + shift
    + [[ 0 -gt 0 ]]
    + [[ -z /home/matt/anaconda3/envs/gpu/bin/python ]]
    + echo 'Using Python executable /home/matt/anaconda3/envs/gpu/bin/python.'
    Using Python executable /home/matt/anaconda3/envs/gpu/bin/python.
    ++ PATH=/home/matt/anaconda3/envs/gpu/bin:/home/matt/anaconda3/condabin:/home/matt/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/home/matt/.bazel/bin
    ++ which bazel
    + BAZEL_EXECUTABLE=/home/matt/bin/bazel
    + echo 'Using Bazel executable /home/matt/bin/bazel.'
    Using Bazel executable /home/matt/bin/bazel.
    + RAY_BUILD_PYTHON=YES
    + RAY_BUILD_JAVA=NO
    + bash /home/matt/Code/ray/setup_thirdparty.sh /home/matt/anaconda3/envs/gpu/bin/python
    + set -e
    +++ dirname /home/matt/Code/ray/setup_thirdparty.sh
    ++ cd /home/matt/Code/ray
    ++ pwd
    + ROOT_DIR=/home/matt/Code/ray
    + [[ -z /home/matt/anaconda3/envs/gpu/bin/python ]]
    + PYTHON_EXECUTABLE=/home/matt/anaconda3/envs/gpu/bin/python
    + echo 'Using Python executable /home/matt/anaconda3/envs/gpu/bin/python.'
    Using Python executable /home/matt/anaconda3/envs/gpu/bin/python.
    + RAY_BUILD_PYTHON=YES
    + RAY_BUILD_JAVA=NO
    + /home/matt/Code/ray/thirdparty/scripts/setup.sh /home/matt/anaconda3/envs/gpu/bin/python
    + set -e
    +++ dirname /home/matt/Code/ray/thirdparty/scripts/setup.sh
    ++ cd /home/matt/Code/ray/thirdparty/scripts
    ++ pwd
    + TP_SCRIPT_DIR=/home/matt/Code/ray/thirdparty/scripts
    + TP_DIR=/home/matt/Code/ray/thirdparty/scripts/..
    + mkdir -p /home/matt/Code/ray/thirdparty/scripts/../build
    + mkdir -p /home/matt/Code/ray/thirdparty/scripts/../pkg
    + [[ -z /home/matt/anaconda3/envs/gpu/bin/python ]]
    + PYTHON_EXECUTABLE=/home/matt/anaconda3/envs/gpu/bin/python
    + echo 'Using Python executable /home/matt/anaconda3/envs/gpu/bin/python.'
    Using Python executable /home/matt/anaconda3/envs/gpu/bin/python.
    + [[ NO == \Y\E\S ]]
    + [[ YES == \Y\E\S ]]
    + echo 'Python library will be built.'
    Python library will be built.
    ++ uname
    + unamestr=Linux
    + BUILD_DIR=/home/matt/Code/ray/build/
    + '[' '!' -d /home/matt/Code/ray/build/ ']'
    + pushd /home/matt/Code/ray/build/
    ~/Code/ray/build ~/Code/ray/python
    + '[' -z '' ']'
    + /home/matt/anaconda3/envs/gpu/bin/python -m pip install -q --target=/home/matt/Code/ray/python/ray/pyarrow_files pyarrow==0.14.0.RAY --find-links https://s3-us-west-2.amazonaws.com/arrow-wheels/516e15028091b5e287200b5df77d77f72d9a6c9a/index.html
    WARNING: Target directory /home/matt/Code/ray/python/ray/pyarrow_files/pyarrow already exists. Specify --upgrade to force replacement.
    WARNING: Target directory /home/matt/Code/ray/python/ray/pyarrow_files/numpy-1.17.3.dist-info already exists. Specify --upgrade to force replacement.
    WARNING: Target directory /home/matt/Code/ray/python/ray/pyarrow_files/six-1.12.0.dist-info already exists. Specify --upgrade to force replacement.
    WARNING: Target directory /home/matt/Code/ray/python/ray/pyarrow_files/six.py already exists. Specify --upgrade to force replacement.
    WARNING: Target directory /home/matt/Code/ray/python/ray/pyarrow_files/pyarrow-0.14.0.RAY.dist-info already exists. Specify --upgrade to force replacement.
    WARNING: Target directory /home/matt/Code/ray/python/ray/pyarrow_files/__pycache__ already exists. Specify --upgrade to force replacement.
    WARNING: Target directory /home/matt/Code/ray/python/ray/pyarrow_files/numpy already exists. Specify --upgrade to force replacement.
    WARNING: Target directory /home/matt/Code/ray/python/ray/pyarrow_files/bin already exists. Specify --upgrade to force replacement.
    + export PYTHON_BIN_PATH=/home/matt/anaconda3/envs/gpu/bin/python
    + PYTHON_BIN_PATH=/home/matt/anaconda3/envs/gpu/bin/python
    + '[' NO == YES ']'
    + '[' YES == YES ']'
    + /home/matt/bin/bazel build //:ray_pkg --verbose_failures
    Extracting Bazel installation...
    Starting local Bazel server and connecting to it...
    Loading:
    Loading: 0 packages loaded
    DEBUG: Rule 'com_github_checkstyle_java' indicated that a canonical reproducible form can be obtained by modifying arguments shallow_since = "1552542575 +0800"
    Loading: 0 packages loaded
    DEBUG: Rule 'com_github_nelhage_rules_boost' indicated that a canonical reproducible form can be obtained by modifying arguments shallow_since = "1556014830 +0800"
    INFO: SHA256 (https://github.com/jovany-wang/prometheus-cpp/archive/master.zip) = d0c773da8af3db99c543dd0413f4427d835170eddfd517bfeba104236a8d2c07
    DEBUG: Rule 'com_github_jupp0r_prometheus_cpp' indicated that a canonical reproducible form can be obtained by modifying arguments sha256 = "d0c773da8af3db99c543dd0413f4427d835170eddfd517bfeba104236a8d2c07"
    Loading: 0 packages loaded
    Loading: 0 packages loaded
    Loading: 0 packages loaded
    Loading: 0 packages loaded
    Loading: 0 packages loaded
    Loading: 0 packages loaded
    INFO: SHA256 (https://github.com/grpc/grpc/archive/76a381869413834692b8ed305fbe923c0f9c4472.tar.gz) = b5efbe086b9a00826a3f830094312e6d1647157b5a5e7954a8ac4179bce3de8b
    Loading: 0 packages loaded
    DEBUG: Rule 'com_github_grpc_grpc' indicated that a canonical reproducible form can be obtained by modifying arguments sha256 = "b5efbe086b9a00826a3f830094312e6d1647157b5a5e7954a8ac4179bce3de8b"
    INFO: SHA256 (https://github.com/google/bazel-common/archive/f1115e0f777f08c3cdb115526c4e663005bec69b.zip) = 1e05a4791cc3470d3ecf7edb556f796b1d340359f1c4d293f175d4d0946cf84c
    DEBUG: Rule 'bazel_common' indicated that a canonical reproducible form can be obtained by modifying arguments sha256 = "1e05a4791cc3470d3ecf7edb556f796b1d340359f1c4d293f175d4d0946cf84c"
    INFO: SHA256 (https://github.com/bazelbuild/bazel-skylib/archive/0.6.0.tar.gz) = eb5c57e4c12e68c0c20bc774bfbc60a568e800d025557bc4ea022c6479acc867
    DEBUG: Rule 'bazel_skylib' indicated that a canonical reproducible form can be obtained by modifying arguments sha256 = "eb5c57e4c12e68c0c20bc774bfbc60a568e800d025557bc4ea022c6479acc867"
    Loading: 0 packages loaded
        currently loading:
    Loading: 0 packages loaded
        currently loading:
    DEBUG: Rule 'com_github_google_flatbuffers' indicated that a canonical reproducible form can be obtained by modifying arguments shallow_since = "1547755012 -0800"
    Analyzing: target //:ray_pkg (1 packages loaded, 0 targets configured)
    Analyzing: target //:ray_pkg (3 packages loaded, 16 targets configured)
    Analyzing: target //:ray_pkg (3 packages loaded, 16 targets configured)
    DEBUG: Rule 'plasma' indicated that a canonical reproducible form can be obtained by modifying arguments shallow_since = "1570611764 -0700"
    INFO: SHA256 (https://github.com/census-instrumentation/opencensus-cpp/archive/3aa11f20dd610cb8d2f7c62e58d1e69196aadf11.zip) = 92eef77c44d01e8472f68a2f1329919a1bb59317a4bb1e4d76081ab5c13a56d6
    DEBUG: Rule 'io_opencensus_cpp' indicated that a canonical reproducible form can be obtained by modifying arguments sha256 = "92eef77c44d01e8472f68a2f1329919a1bb59317a4bb1e4d76081ab5c13a56d6"
    DEBUG: Rule 'com_github_google_glog' indicated that a canonical reproducible form can be obtained by modifying arguments shallow_since = "1550458164 +0900"
    DEBUG: Rule 'com_github_gflags_gflags' indicated that a canonical reproducible form can be obtained by modifying arguments commit = "e171aa2d15ed9eb17054558e0b3a6a413bb01067", shallow_since = "1541971260 +0000" and dropping ["tag"]
    DEBUG: Rule 'com_google_absl' indicated that a canonical reproducible form can be obtained by modifying arguments shallow_since = "1565288385 -0400"
    Analyzing: target //:ray_pkg (29 packages loaded, 486 targets configured)
    DEBUG: Rule 'com_google_googletest' indicated that a canonical reproducible form can be obtained by modifying arguments shallow_since = "1534270723 -0700"
    Analyzing: target //:ray_pkg (48 packages loaded, 6524 targets configured)
    INFO: SHA256 (https://boringssl.googlesource.com/boringssl/+archive/afc30d43eef92979b05776ec0963c9cede5fb80f.tar.gz) = 939ea34bd847d8ef5dcabed747e2a65c5d8e82e6b63758c7d1fb11b806b495e7
    DEBUG: Rule 'boringssl' indicated that a canonical reproducible form can be obtained by modifying arguments sha256 = "939ea34bd847d8ef5dcabed747e2a65c5d8e82e6b63758c7d1fb11b806b495e7"
    Analyzing: target //:ray_pkg (49 packages loaded, 7007 targets configured)
    Analyzing: target //:ray_pkg (50 packages loaded, 7031 targets configured)
    Analyzing: target //:ray_pkg (50 packages loaded, 7031 targets configured)
    Analyzing: target //:ray_pkg (50 packages loaded, 7031 targets configured)
    DEBUG: Rule 'cython' indicated that a canonical reproducible form can be obtained by modifying arguments shallow_since = "1547888711 +0100"
    INFO: Analyzed target //:ray_pkg (51 packages loaded, 7305 targets configured).
    INFO: Found 1 target...
    [0 / 14] [Prepa] BazelWorkspaceStatusAction stable-status.txt
    [134 / 335] [Analy] Compiling external/com_google_protobuf/src/google/protobuf/compiler/java/java_context.cc [for host]; 15s ... (145 actions, 10 running)
    [208 / 335] [Analy] Compiling external/com_google_protobuf/src/google/protobuf/compiler/java/java_helpers.cc [for host]; 34s ... (71 actions, 11 running)
    INFO: From Compiling external/com_google_protobuf/src/google/protobuf/descriptor.cc [for host]:
    external/com_google_protobuf/src/google/protobuf/descriptor.cc: In member function 'google::protobuf::Symbol google::protobuf::DescriptorPool::NewPlaceholderWithMutexHeld(const string&, google::protobuf::DescriptorPool::PlaceholderType) const':
    external/com_google_protobuf/src/google/protobuf/descriptor.cc:3901:58: warning: 'void* memset(void*, int, size_t)' clearing an object of type 'class google::protobuf::EnumDescriptor' with no trivial copy-assignment; use assignment or value-initialization instead [-Wclass-memaccess]
     3901 |     memset(placeholder_enum, 0, sizeof(*placeholder_enum));
          |                                                          ^
    In file included from external/com_google_protobuf/src/google/protobuf/message.h:121,
                     from external/com_google_protobuf/src/google/protobuf/descriptor.pb.h:30,
                     from external/com_google_protobuf/src/google/protobuf/descriptor.cc:50:
    external/com_google_protobuf/src/google/protobuf/descriptor.h:904:23: note: 'class google::protobuf::EnumDescriptor' declared here
      904 | class PROTOBUF_EXPORT EnumDescriptor {
          |                       ^~~~~~~~~~~~~~
    external/com_google_protobuf/src/google/protobuf/descriptor.cc:3915:60: warning: 'void* memset(void*, int, size_t)' clearing an object of type 'class google::protobuf::EnumValueDescriptor' with no trivial copy-assignment; use assignment or value-initialization instead [-Wclass-memaccess]
     3915 |     memset(placeholder_value, 0, sizeof(*placeholder_value));
          |                                                            ^
    In file included from external/com_google_protobuf/src/google/protobuf/message.h:121,
                     from external/com_google_protobuf/src/google/protobuf/descriptor.pb.h:30,
                     from external/com_google_protobuf/src/google/protobuf/descriptor.cc:50:
    external/com_google_protobuf/src/google/protobuf/descriptor.h:1062:23: note: 'class google::protobuf::EnumValueDescriptor' declared here
     1062 | class PROTOBUF_EXPORT EnumValueDescriptor {
          |                       ^~~~~~~~~~~~~~~~~~~
    external/com_google_protobuf/src/google/protobuf/descriptor.cc:3934:64: warning: 'void* memset(void*, int, size_t)' clearing an object of type 'class google::protobuf::Descriptor' with no trivial copy-assignment; use assignment or value-initialization instead [-Wclass-memaccess]
     3934 |     memset(placeholder_message, 0, sizeof(*placeholder_message));
          |                                                                ^
    In file included from external/com_google_protobuf/src/google/protobuf/message.h:121,
                     from external/com_google_protobuf/src/google/protobuf/descriptor.pb.h:30,
                     from external/com_google_protobuf/src/google/protobuf/descriptor.cc:50:
    external/com_google_protobuf/src/google/protobuf/descriptor.h:233:23: note: 'class google::protobuf::Descriptor' declared here
      233 | class PROTOBUF_EXPORT Descriptor {
          |                       ^~~~~~~~~~
    external/com_google_protobuf/src/google/protobuf/descriptor.cc: In member function 'google::protobuf::FileDescriptor* google::protobuf::DescriptorPool::NewPlaceholderFileWithMutexHeld(const string&) const':
    external/com_google_protobuf/src/google/protobuf/descriptor.cc:3968:46: warning: 'void* memset(void*, int, size_t)' clearing an object of type 'class google::protobuf::FileDescriptor' with no trivial copy-assignment; use assignment or value-initialization instead [-Wclass-memaccess]
     3968 |   memset(placeholder, 0, sizeof(*placeholder));
          |                                              ^
    In file included from external/com_google_protobuf/src/google/protobuf/message.h:121,
                     from external/com_google_protobuf/src/google/protobuf/descriptor.pb.h:30,
                     from external/com_google_protobuf/src/google/protobuf/descriptor.cc:50:
    external/com_google_protobuf/src/google/protobuf/descriptor.h:1309:23: note: 'class google::protobuf::FileDescriptor' declared here
     1309 | class PROTOBUF_EXPORT FileDescriptor {
          |                       ^~~~~~~~~~~~~~
    [419 / 514] Compiling external/com_google_protobuf/src/google/protobuf/descriptor.pb.cc; 6s linux-sandbox ... (12 actions, 11 running)
    ERROR: /home/matt/.cache/bazel/_bazel_matt/5655070513dc5b66b5cbb80b53498d5d/external/com_github_grpc_grpc/BUILD:545:1: C++ compilation of rule '@com_github_grpc_grpc//:gpr_base' failed (Exit 1) gcc failed: error executing command
      (cd /home/matt/.cache/bazel/_bazel_matt/5655070513dc5b66b5cbb80b53498d5d/sandbox/linux-sandbox/372/execroot/com_github_ray_project_ray && \
      exec env - \
        PATH=/home/matt/anaconda3/envs/gpu/bin:/home/matt/anaconda3/condabin:/home/matt/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin \
        PWD=/proc/self/cwd \
        PYTHON_BIN_PATH=/home/matt/anaconda3/envs/gpu/bin/python \
      /usr/bin/gcc -U_FORTIFY_SOURCE -fstack-protector -Wall -Wunused-but-set-parameter -Wno-free-nonheap-object -fno-omit-frame-pointer -g0 -O2 '-D_FORTIFY_SOURCE=1' -DNDEBUG -ffunction-sections -fdata-sections '-std=c++0x' -MD -MF bazel-out/k8-opt/bin/external/com_github_grpc_grpc/_objs/gpr_base/log_linux.pic.d '-frandom-seed=bazel-out/k8-opt/bin/external/com_github_grpc_grpc/_objs/gpr_base/log_linux.pic.o' -fPIC -iquote external/com_github_grpc_grpc -iquote bazel-out/k8-opt/bin/external/com_github_grpc_grpc -isystem external/com_github_grpc_grpc/include -isystem bazel-out/k8-opt/bin/external/com_github_grpc_grpc/include -isystem external/com_github_grpc_grpc/src/core/ext/upb-generated -isystem bazel-out/k8-opt/bin/external/com_github_grpc_grpc/src/core/ext/upb-generated -Werror -w -DGRPC_BAZEL_BUILD -fno-canonical-system-headers -Wno-builtin-macro-redefined '-D__DATE__="redacted"' '-D__TIMESTAMP__="redacted"' '-D__TIME__="redacted"' -c external/com_github_grpc_grpc/src/core/lib/gpr/log_linux.cc -o bazel-out/k8-opt/bin/external/com_github_grpc_grpc/_objs/gpr_base/log_linux.pic.o)
    Execution platform: @bazel_tools//platforms:host_platform

    Use --sandbox_debug to see verbose messages from the sandbox: gcc failed: error executing command
      (cd /home/matt/.cache/bazel/_bazel_matt/5655070513dc5b66b5cbb80b53498d5d/sandbox/linux-sandbox/372/execroot/com_github_ray_project_ray && \
      exec env - \
        PATH=/home/matt/anaconda3/envs/gpu/bin:/home/matt/anaconda3/condabin:/home/matt/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin \
        PWD=/proc/self/cwd \
        PYTHON_BIN_PATH=/home/matt/anaconda3/envs/gpu/bin/python \
      /usr/bin/gcc -U_FORTIFY_SOURCE -fstack-protector -Wall -Wunused-but-set-parameter -Wno-free-nonheap-object -fno-omit-frame-pointer -g0 -O2 '-D_FORTIFY_SOURCE=1' -DNDEBUG -ffunction-sections -fdata-sections '-std=c++0x' -MD -MF bazel-out/k8-opt/bin/external/com_github_grpc_grpc/_objs/gpr_base/log_linux.pic.d '-frandom-seed=bazel-out/k8-opt/bin/external/com_github_grpc_grpc/_objs/gpr_base/log_linux.pic.o' -fPIC -iquote external/com_github_grpc_grpc -iquote bazel-out/k8-opt/bin/external/com_github_grpc_grpc -isystem external/com_github_grpc_grpc/include -isystem bazel-out/k8-opt/bin/external/com_github_grpc_grpc/include -isystem external/com_github_grpc_grpc/src/core/ext/upb-generated -isystem bazel-out/k8-opt/bin/external/com_github_grpc_grpc/src/core/ext/upb-generated -Werror -w -DGRPC_BAZEL_BUILD -fno-canonical-system-headers -Wno-builtin-macro-redefined '-D__DATE__="redacted"' '-D__TIMESTAMP__="redacted"' '-D__TIME__="redacted"' -c external/com_github_grpc_grpc/src/core/lib/gpr/log_linux.cc -o bazel-out/k8-opt/bin/external/com_github_grpc_grpc/_objs/gpr_base/log_linux.pic.o)
    Execution platform: @bazel_tools//platforms:host_platform

    Use --sandbox_debug to see verbose messages from the sandbox
    external/com_github_grpc_grpc/src/core/lib/gpr/log_linux.cc:43:13: error: ambiguating new declaration of 'long int gettid()'
       43 | static long gettid(void) { return syscall(__NR_gettid); }
          |             ^~~~~~
    In file included from /usr/include/unistd.h:1170,
                     from external/com_github_grpc_grpc/src/core/lib/gpr/log_linux.cc:41:
    /usr/include/x86_64-linux-gnu/bits/unistd_ext.h:34:16: note: old declaration '__pid_t gettid()'
       34 | extern __pid_t gettid (void) __THROW;
          |                ^~~~~~
    Target //:ray_pkg failed to build
    INFO: Elapsed time: 168.147s, Critical Path: 16.70s
    INFO: 361 processes: 361 linux-sandbox.
    FAILED: Build did NOT complete successfully
    FAILED: Build did NOT complete successfully
    Traceback (most recent call last):
      File "<string>", line 1, in <module>
      File "/home/matt/Code/ray/python/setup.py", line 198, in <module>
        license="Apache 2.0")
      File "/home/matt/anaconda3/envs/gpu/lib/python3.7/site-packages/setuptools/__init__.py", line 145, in setup
        return distutils.core.setup(**attrs)
      File "/home/matt/anaconda3/envs/gpu/lib/python3.7/distutils/core.py", line 148, in setup
        dist.run_commands()
      File "/home/matt/anaconda3/envs/gpu/lib/python3.7/distutils/dist.py", line 966, in run_commands
        self.run_command(cmd)
      File "/home/matt/anaconda3/envs/gpu/lib/python3.7/distutils/dist.py", line 985, in run_command
        cmd_obj.run()
      File "/home/matt/anaconda3/envs/gpu/lib/python3.7/site-packages/setuptools/command/develop.py", line 38, in run
        self.install_for_development()
      File "/home/matt/anaconda3/envs/gpu/lib/python3.7/site-packages/setuptools/command/develop.py", line 140, in install_for_development
        self.run_command('build_ext')
      File "/home/matt/anaconda3/envs/gpu/lib/python3.7/distutils/cmd.py", line 313, in run_command
        self.distribution.run_command(command)
      File "/home/matt/anaconda3/envs/gpu/lib/python3.7/distutils/dist.py", line 985, in run_command
        cmd_obj.run()
      File "/home/matt/Code/ray/python/setup.py", line 96, in run
        subprocess.check_call(command)
      File "/home/matt/anaconda3/envs/gpu/lib/python3.7/subprocess.py", line 347, in check_call
        raise CalledProcessError(retcode, cmd)
    subprocess.CalledProcessError: Command '['../build.sh', '-p', '/home/matt/anaconda3/envs/gpu/bin/python']' returned non-zero exit status 1.
Cleaning up...
Removed build tracker '/tmp/pip-req-tracker-03xdp_qj'
ERROR: Command errored out with exit status 1: /home/matt/anaconda3/envs/gpu/bin/python -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/home/matt/Code/ray/python/setup.py'"'"'; __file__='"'"'/home/matt/Code/ray/python/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' develop --no-deps Check the logs for full command output.
Exception information:
Traceback (most recent call last):
  File "/home/matt/anaconda3/envs/gpu/lib/python3.7/site-packages/pip/_internal/cli/base_command.py", line 153, in _main
    status = self.run(options, args)
  File "/home/matt/anaconda3/envs/gpu/lib/python3.7/site-packages/pip/_internal/commands/install.py", line 455, in run
    use_user_site=options.use_user_site,
  File "/home/matt/anaconda3/envs/gpu/lib/python3.7/site-packages/pip/_internal/req/__init__.py", line 62, in install_given_reqs
    **kwargs
  File "/home/matt/anaconda3/envs/gpu/lib/python3.7/site-packages/pip/_internal/req/req_install.py", line 851, in install
    install_options, global_options, prefix=prefix,
  File "/home/matt/anaconda3/envs/gpu/lib/python3.7/site-packages/pip/_internal/req/req_install.py", line 700, in install_editable
    cwd=self.unpacked_source_directory,
  File "/home/matt/anaconda3/envs/gpu/lib/python3.7/site-packages/pip/_internal/utils/subprocess.py", line 242, in call_subprocess
    raise InstallationError(exc_msg)
pip._internal.exceptions.InstallationError: Command errored out with exit status 1: /home/matt/anaconda3/envs/gpu/bin/python -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/home/matt/Code/ray/python/setup.py'"'"'; __file__='"'"'/home/matt/Code/ray/python/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' develop --no-deps Check the logs for full command output.

Issue Analytics

  • State:closed
  • Created 4 years ago
  • Comments:8 (6 by maintainers)

github_iconTop GitHub Comments

2reactions
gallmercicommented, Oct 24, 2019

@pcmoritz you need to execute grpc_deps() before you load grpc_extra_deps.bzl because the repos are defined after calling grpc_deps()

load("@com_github_grpc_grpc//bazel:grpc_deps.bzl", "grpc_deps", "grpc_test_only_deps")
grpc_deps()
load("@com_github_grpc_grpc//bazel:grpc_extra_deps.bzl", "grpc_extra_deps")
grpc_extra_deps()
1reaction
mawrightcommented, Oct 24, 2019

Thanks for trying it out! This seems to be a new issue that is fixed in grpc/grpc#20586, however with that PR I get another error:

ERROR: /Users/pcmoritz/ray/BUILD.bazel:216:1: error loading package '@com_github_grpc_grpc//': in /private/var/tmp/_bazel_pcmoritz/65b142b3f2651cc0f42773a358f37553/external/com_github_grpc_grpc/bazel/grpc_build_system.bzl: in /private/var/tmp/_bazel_pcmoritz/65b142b3f2651cc0f42773a358f37553/external/build_bazel_rules_apple/apple/ios.bzl: in /private/var/tmp/_bazel_pcmoritz/65b142b3f2651cc0f42773a358f37553/external/build_bazel_rules_apple/apple/internal/ios_rules.bzl: in /private/var/tmp/_bazel_pcmoritz/65b142b3f2651cc0f42773a358f37553/external/build_bazel_rules_apple/apple/internal/rule_factory.bzl: Unable to find package for @build_bazel_rules_swift//swift:swift.bzl: The repository '@build_bazel_rules_swift' could not be resolved. and referenced by '//:ray_common'
ERROR: Analysis of target '//:ray_pkg' failed; build aborted: error loading package '@com_github_grpc_grpc//': in /private/var/tmp/_bazel_pcmoritz/65b142b3f2651cc0f42773a358f37553/external/com_github_grpc_grpc/bazel/grpc_build_system.bzl: in /private/var/tmp/_bazel_pcmoritz/65b142b3f2651cc0f42773a358f37553/external/build_bazel_rules_apple/apple/ios.bzl: in /private/var/tmp/_bazel_pcmoritz/65b142b3f2651cc0f42773a358f37553/external/build_bazel_rules_apple/apple/internal/ios_rules.bzl: in /private/var/tmp/_bazel_pcmoritz/65b142b3f2651cc0f42773a358f37553/external/build_bazel_rules_apple/apple/internal/rule_factory.bzl: Unable to find package for @build_bazel_rules_swift//swift:swift.bzl: The repository '@build_bazel_rules_swift' could not be resolved.

Is it possible for you to use ubuntu 18 in the meantime while this gets fixed?

I am only doing development on Python stuff so I think I will be able to work around it by installing from the wheel and symlinking stuff.

Read more comments on GitHub >

github_iconTop Results From Across the Web

fails in src/compiler/csharp_generator.cc - Google Groups
I checked that I had all prerequisites specified in INSTALL. I have a pretty normal/standard/working Ubuntu development environment.
Read more >
Package List — Spack 0.20.0.dev0 documentation
The AOCC environment provides various options to developers when building and optimizing C, C++, and Fortran applications targeting 32-bit and 64-bit Linux ......
Read more >
Bug listing with status UNCONFIRMED as at 2022/12/20 15 ...
Bug:128538 - "sys-apps/coreutils: /bin/hostname should be installed from coreutils not sys-apps/net-tools" status:UNCONFIRMED resolution: severity:enhancement ...
Read more >
10.26. Digital Pathology Image Processing Operator
This loads a tiled/multi-resolution image and saves tiles into multiple JPEG files. This doesn't use the multithreading/multiprocessing to process the image ...
Read more >
PDF - Citrix Workspace app for Linux
rix does not support Microsoft Teams Optimization [MTOP] in Citrix Workspace app for Linux. [RFLNX-3674]. Known issue in 1910. • Due to ...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found
Previous page

Doubt about combining AsyncHyperBand with HyperOpt

Next page

Ray RunOutOfMemoryError is consistently raised for Apex-DQN