Comments (6)
There could be a lot of causes for this problem, but most likely the uncommitted block list on storage is in a state that will no longer work with the script. You will need to do one of the following: (1) perform a GetBlockList (with blocklisttype=uncommitted) to retrieve the uncommitted block list, commit the block list, then delete the blob, (2) create a dummy blob (can be of length zero) with the same blob name in the same container and transfer it using a non-blocked transfer, (3) wait 7 days for the uncommitted block list to garbage collect.
You can do either of (1) or (2) using the azure-storage python package, or you can perform (2) easily with a GUI-based tool like Azure Storage Explorer (windows-only unfortunately).
from azure-batch-samples.
Bump I have the same exact issue. For a 120mb file.
from azure-batch-samples.
Can you provide more context and/or output from the execution?
from azure-batch-samples.
I am transfer a tsv file to the blob and i disable the match md5 and using sas key which provided by the cup.
from azure-batch-samples.
Thanks for your reply.
Again I have another question.
The problem you said already fixed but other problem arise,
that is it always said that connection aborted, error(110,'connection timed out') when the progress around 96%, no matter I change the chunksizebytes and num of workers.
How should I do for this problem?
from azure-batch-samples.
Unfortunately, that's an issue that will be hard to diagnose since that will depend on a variety of factors, including your connection quality and bandwidth, among other things. I would try to keep the chunksizebytes at default and decreasing the number of workers in the range of 2 to 8 to see if that alleviates your problem. Then you can increase that number with something that's a good tradeoff between speed and consistency in transfer.
I am closing this issue now since the discussion is no longer related to the original issue.
from azure-batch-samples.
Related Issues (20)
- "TypeError" exception when running sample1_helloword.py. HOT 1
- Cannot run CSharp/GettingStarted/01HelloWorld.csproj
- Java sample code fails to get batchUrl HOT 4
- C++ samples
- Access Linked Storage Account HOT 1
- add sample for Docker
- Azure batch -python running flask app in node and hitting it via flask
- How to upload applicationPackage to be installed on each node of the pool HOT 2
- 'BatchServiceClientConfiguration' object has no attribute 'signed_session'
- accountsettings null HOT 2
- Python Batch samples - please update to azure.storage.blob v12+ HOT 1
- CSharp/GettingStarted/02_PoolsAndResourceFiles throws NotFound for stdout.txt when run a 2nd time
- Hello world is insanely complex for a hello world
- How to use ILogger for AppInsights logs with azure batch
- Support for dotnet-sdk 3.1
- Loading mpi modules in Azure Batch with Ubuntu-hpc image
- Update samples to use VirtualMachineConfiguration
- BatchManagementClient example uses ADAL, which is out of support in December 2022 HOT 1
- OnAllTasksComplete.TerminateJob inconsistent
- Microsoft.Azure.Management.Batch - Deprecated
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from azure-batch-samples.