Nix: Streaming gsutil transfers
Cloud Storage supports streaming transfers, which allow you to stream data to and from your Cloud Storage account without requiring that the data first be saved to a file.
# Stream uploads.
sort data_measurements.json | gsutil cp - gs://my_app_bucket/data_measurements.json
# Stream downloads.
gsutil -m cp gs://my_app_bucket/data_measurements.json.gz - | gunzip | jq '.'
Via Google Cloud docs.
Leave a comment