Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

test(storage): more tweaks to ranged reads #9400

Merged
merged 2 commits into from
Jul 1, 2022

Conversation

coryan
Copy link
Contributor

@coryan coryan commented Jun 30, 2022

The benchmark would perform a range read with 50% probability, but some
ranged reads were "full" as the range was larger than the object. I
found it hard to reason about this, so now only the range size controls
whether the read is full or not.

I also rediscovered a quirk of the JSON API, that it is better avoided:
reading the last 0 bytes actually returns all the bytes. Maybe we should
fix this in the client library itself, for now just avoid running into
it.


This change is Reviewable

The benchmark would perform a range read with 50% probability, but some
ranged reads were "full" as the range was larger than the object. I
found it hard to reason about this, so now only the range size controls
whether the read is full or not.

I also rediscovered a quirk of the JSON API, that it is better avoided:
reading the last 0 bytes actually returns all the bytes. Maybe we should
fix this in the client library itself, for now just avoid running into
it.
@product-auto-label product-auto-label bot added the api: storage Issues related to the Cloud Storage API. label Jun 30, 2022
@google-cloud-cpp-bot
Copy link
Collaborator

Google Cloud Build Logs
For commit: 31927d89f67392f737b383a35e1462f1bc5f021b

ℹ️ NOTE: Kokoro logs are linked from "Details" below.

@codecov
Copy link

codecov bot commented Jun 30, 2022

Codecov Report

Merging #9400 (a08ef62) into main (76ef5a9) will increase coverage by 0.00%.
The diff coverage is 100.00%.

@@           Coverage Diff           @@
##             main    #9400   +/-   ##
=======================================
  Coverage   94.60%   94.60%           
=======================================
  Files        1485     1485           
  Lines      136008   136008           
=======================================
+ Hits       128672   128674    +2     
+ Misses       7336     7334    -2     
Impacted Files Coverage Δ
...gle/cloud/storage/benchmarks/throughput_options.cc 99.13% <100.00%> (ø)
...cloud/pubsub/internal/subscription_session_test.cc 98.00% <0.00%> (+0.24%) ⬆️
google/cloud/pubsub/subscriber_connection_test.cc 97.93% <0.00%> (+0.68%) ⬆️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 76ef5a9...a08ef62. Read the comment docs.

@coryan coryan marked this pull request as ready for review June 30, 2022 22:25
@coryan coryan requested a review from a team as a code owner June 30, 2022 22:25
@google-cloud-cpp-bot
Copy link
Collaborator

Google Cloud Build Logs
For commit: a08ef62a087e10600a95a018705598711da14575

ℹ️ NOTE: Kokoro logs are linked from "Details" below.

@coryan coryan merged commit 36396e4 into googleapis:main Jul 1, 2022
@coryan coryan deleted the test-storage-fine-tune-range-reads branch July 1, 2022 17:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
api: storage Issues related to the Cloud Storage API.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants