Bootstrapping Bazel with MSVC on Windows output lots of garbage: 23G!

While testing jenkins pipeline, the bootstrapping got stalled. The cause was the windows MSVC build was outputting a lot of garbage warnings from compiling protobuf. The output of the generated log is 23G!!! root@jenkins:/volumes/jenkins_home/jobs/Global/jobs/pipeline/builds/23# ls -lah 419.log -rw-r–r-- 1 jcater jcater 23G May 29 00:22 419.log

The log is viewable here: http://ci.bazel.io/job/Global/job/pipeline/23/execution/node/419/log/

Since it is hard to get the beginning, here the 100 lines from the log on the machine:

[pipeline] Running batch script

c:\jenkins\workspace\Global\pipeline>c:\bazel_ci\installs\latest\bazel.exe --bazelrc=c:\jenkins\workspace\Global\pipeline/bazel.bazelrc --nomaster_bazelrc build //src:bazel 
Extracting Bazel installation...
............
==INFO: =Loading package: src
==INFO: =Loading package: @bazel_tools//tools/cpp
==INFO: =Loading package: @local_config_xcode//
==INFO: =Loading package: @local_jdk//
==WARNING: =C:/windows/temp/_bazel_system/0vwpzsga/external/bazel_tools/tools/cpp/cc_configure.bzl:67:3: 
====Auto-Configuration Warning:== 'BAZEL_PYTHON' is not set, start looking for python in PATH.
.
==WARNING: =C:/windows/temp/_bazel_system/0vwpzsga/external/bazel_tools/tools/cpp/cc_configure.bzl:67:3: 
====Auto-Configuration Warning:== Python found at C:/python_27_amd64/files/python.exe
.
==WARNING: =C:/windows/temp/_bazel_system/0vwpzsga/external/bazel_tools/tools/cpp/cc_configure.bzl:67:3: 
====Auto-Configuration Warning:== 'BAZEL_VC' is not set, start looking for the latest Visual C++ installed.
.
==WARNING: =C:/windows/temp/_bazel_system/0vwpzsga/external/bazel_tools/tools/cpp/cc_configure.bzl:67:3: 
====Auto-Configuration Warning:== Looking for VS%VERSION%COMNTOOLS environment variables,eg. VS140COMNTOOLS
.
==WARNING: =C:/windows/temp/_bazel_system/0vwpzsga/external/bazel_tools/tools/cpp/cc_configure.bzl:67:3: 
====Auto-Configuration Warning:== Visual C++ build tools found at C:\Program Files (x86)\Microsoft Visual Studio 14.0\VC\
.
==INFO: =Loading package: @local_config_cc//
==INFO: =Loading complete.  Analyzing...
==INFO: =Loading package: src/main/cpp
==INFO: =Loading package: @bazel_tools//tools/genrule
==INFO: =Loading package: tools/jdk
==INFO: =Loading package: third_party/ijar
==INFO: =Loading package: third_party/java/jarjar
==INFO: =Loading package: src/tools/android/java/com/google/devtools/build/android/dexer
==INFO: =Loading package: src/java_tools/buildjar/java/com/google/devtools/build/java/turbine
==INFO: =Loading package: src/java_tools/buildjar/java/com/google/devtools/build/buildjar/genclass
==INFO: =Loading package: third_party/grpc
==INFO: =Loading package: third_party/protobuf
==INFO: =Loading package: third_party/protobuf/3.2.0
==INFO: =Loading package: tools/build_defs/apple
==INFO: =Loading package: src/java_tools/buildjar/java/com/google/devtools/build/java/turbine/javac
==INFO: =Loading package: src/java_tools/junitrunner/java/com/google/testing/junit/junit4
==INFO: =Loading package: src/java_tools/buildjar/java/com/google/devtools/build/buildjar/javac/plugins
==WARNING: =C:/jenkins/workspace/global/pipeline/tools/build_defs/docker/docker.bzl:19:1: The docker_{build,bundle} rules bundled with Bazel are deprecated in favor of:
https://github.com/bazelbuild/rules_docker. Please change BUILD loads to reference: @io_bazel_rules_docker//docker:docker.bzl and add the following to your WORKSPACE:
git_repository(
    name = "io_bazel_rules_docker",
    remote = "https://github.com/bazelbuild/rules_docker.git",
    commit = "...",
)
load("@io_bazel_rules_docker//docker:docker.bzl", "docker_repositories")
docker_repositories().
==INFO: =Loading package: tools/build_defs/docker/testdata/test
==INFO: =Loading package: @com_google_protobuf//
==INFO: =Loading package: @com_google_protobuf_java//
==INFO: =Loading package: src/main/java/com/google/devtools/build/lib/rules/objc
==INFO: =Loading package: third_party/protobuf/3.2.0/util/python
==INFO: =Found 1 target...
==INFO: =Building...
==[0 / 29] =Writing file src/main/tools/process-wrapper.exe-2.params
==[9 / 44] =Extracting interface //third_party:slf4j
==[10 / 46] =Expanding template third_party/java/jarjar/jarjar_command.cmd
==[12 / 47] =Expanding template third_party/java/jarjar/jarjar_command
==[13 / 49] =Writing file third_party/java/jarjar/jarjar_command_deploy.jar-2.params
==[17 / 60] =Writing file src/java_tools/buildjar/java/com/google/devtools/build/buildjar/libJarOwner.jar-2.params
==[29 / 82] =Extracting interface //third_party:auto_value_value
==[32 / 99] =Writing file third_party/protobuf/3.2.0/libprotobuf.a-2.params [for host]
==[56 / 300] =Writing file src/main/java/com/google/devtools/common/options/liboptions.jar-2.params
==[59 / 311] =Writing file src/main/protobuf/libpackage_manifest_java_proto-hjar.jar-2.params
==[71 / 396] =Writing file external/com_google_protobuf/libprotobuf_lite.a-2.params [for host]
==[74 / 495] =Writing file external/com_google_protobuf/libprotoc_lib.a-2.params [for host]
==[84 / 535] =Extracting interface @com_google_protobuf_java//:protobuf
==[97 / 545] =Writing script src/embedded_tools.genrule_script.sh
==[114 / 575] =Extracting interface //third_party:jcip_annotations
==[126 / 595] =Building src/tools/android/java/com/google/devtools/build/android/resources/libresources.jar (7 source files)
====Auto-Configuration Warning:== 'BAZEL_VC' is not set, start looking for the latest Visual C++ installed.
==[156 / 618] =Creating source manifest for //src/java_tools/singlejar:SingleJar
==[172 / 633] =Building src/java_tools/singlejar/java/com/google/devtools/build/zip/libzip.jar (16 source files)
==[182 / 651] =Writing file src/java_tools/junitrunner/java/com/google/testing/junit/junit4/librunner-hjar.jar-2.params
==[201 / 681] =Building src/java_tools/junitrunner/java/com/google/testing/junit/junit4/librunner.jar (6 source files)
==[216 / 692] =Writing file src/java_tools/buildjar/java/com/google/devtools/build/buildjar/genclass/GenClass_deploy.jar-2.params
==[240 / 727] =Building src/java_tools/buildjar/java/com/google/devtools/build/java/turbine/javac/libzip_util.jar (1 source file)
==[289 / 788] =Compiling Java headers src/tools/android/java/com/google/devtools/build/android/ziputils/libziputils_lib-hjar.jar (12 files)
==[382 / 921] =Compiling third_party/protobuf/3.2.0/src/google/protobuf/api.pb.cc
==[443 / 921] =Compiling external/com_google_protobuf/src/google/protobuf/compiler/objectivec/objectivec_map_field.cc [for host]
==INFO: =From Compiling external/com_google_protobuf/src/google/protobuf/compiler/plugin.pb.cc [for host]:
external/com_google_protobuf/src\google/protobuf/stubs/port.h(359): warning C4365: 'return': conversion from 'int' to 'google::protobuf::uint32', signed/unsigned mismatchexternal/com_g
oogle_protobuf/src\google/protobuf/stubs/port.h(359): warning C4365: 'return': conversion from 'int' to 'google::protobuf::uint32', signed/unsigned mismatch
external/com_google_protobuf/src\google/protobuf/stubs/port.h(372): warning C4365: 'return': conversion from 'int' to 'google::protobuf::uint32', signed/unsigned mismatch
external/com_google_protobuf/src\google/protobuf/stubs/port.h(397): warning C4365: 'return': conversion from 'google::protobuf::uint32' to 'int', signed/unsigned mismatchexternal/com_g
oogle_protobuf/src\google/protobuf/stubs/port.h(397): warning C4365: 'return': conversion from 'google::protobuf::uint32' to 'int', signed/unsigned mismatch
external/com_google_protobuf/src\google/protobuf/stubs/port.h(399): warning C4365: 'return': conversion from 'google::protobuf::uint32' to 'int', signed/unsigned mismatch
external/com_google_protobuf/src\google/protobuf/stubs/logging.h(98): warning C4820: 'google::protobuf::internal::LogMessage': '4' bytes padding added after data member 'google::protob
uf::internal::LogMessage::level_'external/com_google_protobuf/src\google/protobuf/stubs/logging.h(98): warning C4820: 'google::protobuf::internal::LogMessage': '4' bytes padding added 
after data member 'google::protobuf::internal::LogMessage::level_'
external/com_google_protobuf/src\google/protobuf/stubs/logging.h(100): warning C4820: 'google::protobuf::internal::LogMessage': '4' bytes padding added after data member 'google::proto
buf::internal::LogMessage::line_'external/com_google_protobuf/src\google/protobuf/stubs/logging.h(100): warning C4820: 'google::protobuf::internal::LogMessage': '4' bytes padding added
 after data member 'google::protobuf::internal::LogMessage::line_'
external/com_google_protobuf/src\google/protobuf/stubs/callback.h(136): warning C4820: 'google::protobuf::internal::FunctionClosure0': '7' bytes padding added after data member 'google
::protobuf::internal::FunctionClosure0::self_deleting_'external/com_google_protobuf/src\google/protobuf/stubs/callback.h(136): warning C4820: 'google::protobuf::internal::FunctionClosu
re0': '7' bytes padding added after data member 'google::protobuf::internal::FunctionClosure0::self_deleting_'
external/com_google_protobuf/src\google/protobuf/stubs/callback.h(136): warning C4625: 'google::protobuf::internal::FunctionClosure0': copy constructor was implicitly defined as delete
dexternal/com_google_protobuf/src\google/protobuf/stubs/callback.h(136): warning C4625: 'google::protobuf::internal::FunctionClosure0': copy constructor was implicitly defined as delet
ed
external/com_google_protobuf/src\google/protobuf/stubs/callback.h(136): warning C4626: 'google::protobuf::internal::FunctionClosure0': assignment operator was implicitly defined as del
etedexternal/com_google_protobuf/src\google/protobuf/stubs/callback.h(136): warning C4626: 'google::protobuf::internal::FunctionClosure0': assignment operator was implicitly defined as
 deleted
external/com_google_protobuf/src\google/protobuf/stubs/common.h(222): warning C4820: 'google::protobuf::FatalException': '4' bytes padding added after data member 'google::protobuf::Fa
talException::line_'external/com_google_protobuf/src\google/protobuf/stubs/common.h(222): warning C4820: 'google::protobuf::FatalException': '4' bytes padding added after data member '
google::protobuf::FatalException::line_'
external/com_google_protobuf/src\google/protobuf/stubs/common.h(223): warning C4626: 'google::protobuf::FatalException': assignment operator was implicitly defined as deletedexternal/c
om_google_protobuf/src\google/protobuf/stubs/common.h(223): warning C4626: 'google::protobuf::FatalException': assignment operator was implicitly defined as deleted
external/com_google_protobuf/src\google/protobuf/io/coded_stream.h(557): warning C4820: 'google::protobuf::io::CodedInputStream': '2' bytes padding added after data member 'google::pro
tobuf::io::CodedInputStream::aliasing_enabled_'external/com_google_protobuf/src\google/protobuf/io/coded_stream.h(557): warning C4820: 'google::protobuf::io::CodedInputStream': '2' byt
es padding added after data member 'google::protobuf::io::CodedInputStream::aliasing_enabled_'
external/com_google_protobuf/src\google/protobuf/io/coded_stream.h(582): warning C4820: 'google::protobuf::io::CodedInputStream': '3' bytes padding added after data member 'google::pro
tobuf::io::CodedInputStream::disable_strict_correctness_enforcement_'external/com_google_protobuf/src\google/protobuf/io/coded_stream.h(582): warning C4820: 'google::protobuf::io::Code
dInputStream': '3' bytes padding added after data member 'google::protobuf::io::CodedInputStream::disable_strict_correctness_enforcement_'
external/com_google_protobuf/src\google/protobuf/io/coded_stream.h(913): warning C4820: 'google::protobuf::io::CodedOutputStream': '4' bytes padding added after data member 'google::pr
otobuf::io::CodedOutputStream::serialization_deterministic_override_'external/com_google_protobuf/src\google/protobuf/io/coded_stream.h(913): warning C4820: 'google::protobuf::io::Code
dOutputStream': '4' bytes padding added after data member 'google::protobuf::io::CodedOutputStream::serialization_deterministic_override_'
external/com_google_protobuf/src\google/protobuf/io/coded_stream.h(864): warning C4800: 'google::protobuf::internal::AtomicWord': forcing value to bool 'true' or 'false' (performance w
arning)
external/com_google_protobuf/src\google/protobuf/io/coded_stream.h(868): warning C4800: 'google::protobuf::internal::Atomic64': forcing value to bool 'true' or 'false' (performance war
ning)
external/com_google_protobuf/src\google/protobuf/arena.h(926): warning C4820: 'google::protobuf::Arena': '7' bytes padding added after data member 'google::protobuf::Arena::owns_first_
block_'external/com_google_protobuf/src\google/protobuf/arena.h(926): warning C4820: 'google::protobuf::Arena': '7' bytes padding added after data member 'google::protobuf::Arena::owns
_first_block_'

[meteorcloudy]

@laszlocsomor Thanks for looking into this. I just checked, the top four warnings are level 4, which should be off by default. They must be turned on by -Wall option. 86445d41f0636c3cfc375dd5e72171f6cbf4da81 should have already eased this issue a lot. And /W3 option is already removed from CROSSTOOL at HEAD, but not in 0.5.0.

[meteorcloudy]

Sounds good to me.