Giter Site home page Giter Site logo

BlobDownloadMiscError: Miscellaneous error encountered while downloading one of the specified Azure Blob(s) about azure-batch-samples HOT 5 CLOSED

azure-samples avatar azure-samples commented on July 18, 2024
BlobDownloadMiscError: Miscellaneous error encountered while downloading one of the specified Azure Blob(s)

from azure-batch-samples.

Comments (5)

mmacy avatar mmacy commented on July 18, 2024

Hi Sinan,

It is possible that this is a temporary error - can you please try running the sample again? If it still fails, please paste the contents of the console window after completion of the sample run.

In this sample, it is very possible for the start task to fail on one or two of the three nodes. This is because one node may start up and complete the tasks before the other two nodes have a chance to boot up completely. The sample then deletes the storage containers as part of its cleanup process, so when the slower-to-start nodes do eventually start, the container is not available for the start task to download the TaskApplication from the container (because the container was deleted).

You can use the Batch Explorer to get more information on errors. This shows an example of a blob download error for a failed start task as it appears in Batch Explorer:

image

Thanks,

--Marsh

from azure-batch-samples.

sinanakyazici avatar sinanakyazici commented on July 18, 2024

Thanks Marsh.

I solved my problem. It was about my storage. Probably the batch service cannot download aplication.exe because of not connected storage account. I created a batch service. I also created a storage service. But they weren't connected together. I deleted the batch service and storage service. I started to create them all over. It was an option about storage service while creating batch service. I selected related storage service while creating batch service.

postimage

I created a storage service while creating batch service. It solved this problem.

from azure-batch-samples.

mmacy avatar mmacy commented on July 18, 2024

Glad to hear you got it working, Sinan!

I would like to point out, however, that task resource files (including start tasks) do not need to use a linked storage account. You must use a linked storage account for the application packages feature of Batch, but a standard, unlinked General purpose storage account is sufficient for your nodes to download start task resource files.

Is it possible that your old storage account was a Blob storage account? Batch does not currently support the Blob storage account type (which is the one that provides the hot/cold access tiers). The General purpose storage account includes blob storage support, and is compatible with Batch. If you were using a Blob storage account, the DotNetTutorial application would successfully create the containers and upload the resource files, but the start tasks would fail to download those resource files to the compute nodes when the nodes joined the pool. Using Batch Explorer, you'd see something similar to this error if you were trying to use a Blob storage account:

image

Step 5 of Create a storage account talks a bit about the differences between the two types of storage accounts.

Will now close this issue as it seems you've resolved the problem. Thanks for using Batch!

from azure-batch-samples.

sinanakyazici avatar sinanakyazici commented on July 18, 2024

Thank you so much for your advices. I don't use application packages. Actually You said exactly what I want to do. I have a exe file and some DLLs. These are stored on blob storage with containers. I want to run code block in exe file on azure batch. I have stream data to calculate, not a file. My windows service needs to send the stream data to this exe file. I didn't understand how to use a resource file exactly.I researched about using stream file with resource files of tasks but I couldn't anything about this. So I tried to use storage account for my stream data. I will be so glad if you can help me for this.

Best Regards...

from azure-batch-samples.

mmacy avatar mmacy commented on July 18, 2024

Hi Sinan,

I suggest that you post this question to the Azure Batch forum on MSDN. The Batch team monitors the forum closely, and can more thoroughly address the details of your use case. The Batch forum can be found here:

https://social.msdn.microsoft.com/forums/azure/en-US/home?forum=azurebatch

from azure-batch-samples.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.