Giter Site home page Giter Site logo

Comments (11)

tseaver avatar tseaver commented on June 20, 2024

I'm afraid that the current batch implementation does not deal well with any methods whose return values depend on the response payload (as opposed to just being able to update the relevant blobs / buckets from those responses when the batch completes).

Adding support for such methods would be a large undertaking.

from python-storage.

bits01 avatar bits01 commented on June 20, 2024

Could the issue be left open and marked as a future enhancement request?

from python-storage.

chemelnucfin avatar chemelnucfin commented on June 20, 2024

@bits01 I have added this issue to our feature request project

from python-storage.

bits01 avatar bits01 commented on June 20, 2024

Thank you. Should the issue be re-opened then? It's currently marked closed.

from python-storage.

IlyaFaer avatar IlyaFaer commented on June 20, 2024

I think, it can be done in fashion of: googleapis/google-cloud-python#8618. But first it's better to deal with 8618

from python-storage.

tseaver avatar tseaver commented on June 20, 2024

@IlyaFaer, what is the issue that needs to be dealt with first? googleapis/google-cloud-python#8616 doesn't seem related.

from python-storage.

IlyaFaer avatar IlyaFaer commented on June 20, 2024

@tseaver, sorry, mistake, 8618. I'm waiting for review in it, and if changes will be accepted, we could use something alike in this issue

from python-storage.

verasativa avatar verasativa commented on June 20, 2024

Just to be clear: at this moment the most reliable way to copy a lots of files from one bucket to another (retry strategy, batch requests and object rewrite) in python is subprocess.run(["gsutil", "cp",...]) ?

I was comparing contributors here to gsutil repo, and looks like are totally different and isolated teams, why?

from python-storage.

tseaver avatar tseaver commented on June 20, 2024

Noted during review: Blob.rewrite returns a 3-tuple, (rewrite_token, bytes_rewritten, object_size), in order to permit tracking progress on the rewrite (it may only complete partially).

from python-storage.

billyvg avatar billyvg commented on June 20, 2024

This is also an issue when trying to use batch() to copy blobs while preserving the ACL of the original blob.

from python-storage.

cojenco avatar cojenco commented on June 20, 2024

Closing; We've added clarifications on the limited Batch support in the python client, see details in #1045

from python-storage.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.