Skip to content

GCS do not upload zero - #1995

Merged
chrisstaite-menlo merged 1 commit into
mainfrom
feature/GCS-do-not-upload-zero
Oct 21, 2025
Merged

GCS do not upload zero#1995
chrisstaite-menlo merged 1 commit into
mainfrom
feature/GCS-do-not-upload-zero

Conversation

@chrisstaite-menlo

@chrisstaite-menlo chrisstaite-menlo commented Oct 20, 2025

Copy link
Copy Markdown
Collaborator

Description

We take pains not to attempt to fetch the zero byte digest from the GCS store, so we should avoid uploading it too. The stdout is usually zero bytes and uploading loads of them causes a lot of 429 errors.

Add a check for the zero byte digest and error if it's not zero bytes.

Type of change

Please delete options that aren't relevant.

  • Bug fix (non-breaking change which fixes an issue)

How Has This Been Tested?

Tested with my Chromium build.

Checklist

  • Updated documentation if needed
  • Tests added/amended
  • bazel test //... passes locally
  • PR is contained in a single commit, using git amend see some docs

This change is Reviewable

@palfrey

palfrey commented Oct 20, 2025

Copy link
Copy Markdown
Member

Can we get a test for this please!

We take pains not to attempt to fetch the zero byte digest from the GCS store, so we should avoid uploading it too.  The stdout is usually zero bytes and uploading loads of them causes a lot of 429 errors.

Add a check for the zero byte digest and error if it's not zero bytes.
@chrisstaite-menlo
chrisstaite-menlo merged commit ab0d4e6 into main Oct 21, 2025
29 checks passed
@chrisstaite-menlo
chrisstaite-menlo deleted the feature/GCS-do-not-upload-zero branch October 21, 2025 10:42
MarcusSorealheis pushed a commit to MarcusSorealheis/nativelink that referenced this pull request Nov 3, 2025
We take pains not to attempt to fetch the zero byte digest from the GCS store, so we should avoid uploading it too.  The stdout is usually zero bytes and uploading loads of them causes a lot of 429 errors.

Add a check for the zero byte digest and error if it's not zero bytes.
@palfrey palfrey mentioned this pull request Nov 10, 2025
19 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants