question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

remote_download_minimal: downloaded inputs shouldn't be deleted after the build

See original GitHub issue

Description of the problem / feature request:

When using --remote_download_minimal, downloaded inputs shouldn’t be deleted after the build.

Feature requests: what underlying problem are you trying to solve with this feature?

Currently, when bazel needs to download inputs for a locally run action while using --remote_download_minimal, it deletes these inputs after the build: https://github.com/bazelbuild/bazel/blob/570f01968093d943b1f878f2cf57da4c20ba5355/src/main/java/com/google/devtools/build/lib/remote/RemoteModule.java#L788-L810

This makes incremental compilation less efficient.

For example, if we set a bundling rule to run locally, bazel will download all of the various artifacts that need to be bundled together, and if we incrementally only change a single artifact in that bundle, bazel will have to re-download all of the artifacts, even though they didn’t change since the last build. The fact that disk_cache doesn’t work with remote builds ensure that this is a slow download as well.

What operating system are you running Bazel on?

macOS 10.15.7

What’s the output of bazel info release?

release 4.0.0rc10

Have you found anything relevant by searching the web?

Issue Analytics

  • State:closed
  • Created 3 years ago
  • Comments:9 (4 by maintainers)

github_iconTop GitHub Comments

1reaction
coeuvrecommented, Aug 27, 2021

Can you please create a new issue and maybe include a repro there?

0reactions
brentleyjonescommented, Aug 26, 2021

I’m running into an issue on HEAD (though it probably existed since this was fixed), where even though the inputs are no longer deleted, they aren’t used on subsequent runs, causing them to be downloaded again. If I generate the inputs locally, so they aren’t downloaded for the local action, they aren’t downloaded on subsequent runs.

Of note for this, the inputs being downloaded are outputs (though not all the outputs) from previous actions in the graph.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Remote build with `--remote_download_outputs=minimal` issue
in the course of work, the cache is evicted on the CAS nodes, but does not deleted from Redis;; bazel client send to...
Read more >
Delete built-in Apple apps from the Home Screen on your iOS ...
With iOS 14 and later and iPadOS, you can delete some built-in Apple apps from your iPhone, iPad, or Apple Watch.
Read more >
Bazel's Remote Caching and Remote Execution Explained
Currently, BwtB requires remote caches to never evict outputs, can result in slower builds due to clumping of downloads, doesn't allow ...
Read more >
Remove entries from Remote Desktop Connection Computer
This article describes how to remove entries from the Remote Desktop Connection Computer box. Applies to: Windows Server 2012 R2
Read more >
Error: Execution failed for task ':app:clean'. Unable to delete file
And after the same update the AS cries for NDK 15 but there is only a NDK14 available, set build gradle compile SDK...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found