Giter Site home page Giter Site logo

Comments (3)

BenedekFarkas avatar BenedekFarkas commented on August 22, 2024

Yeah, we've got some outdated stuff going on here. At the time of implementing this, there was no better way to apply the necessary filtering for blobs, but even without filtering AFAIR copy needed to be executed one by one, but that was a long time ago. My best guess (without any research done on this) is that az copy might be suitable for upgrading this process.

from infrastructure-scripts.

Piedone avatar Piedone commented on August 22, 2024

AzCopy can be used as well (or is it the same as az copy?). It doesn't download the files, but the copy operation still seems to happen one by one. This can be configured to be concurrent, however.

from infrastructure-scripts.

BenedekFarkas avatar BenedekFarkas commented on August 22, 2024

I think az copy is an umbrella command, so AFAIR it can be other types of resources too, but I don't know if it's using the same concept/library as AzCopy under hood when processing blobs. AzCopy is specific to Azure Blob Storage.

As much as I could find out, copy happens one-by-one (and definitely has to, when we need to do any filtering), but yes, concurrency would help anyway.

from infrastructure-scripts.

Related Issues (8)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.