Comments (1)
huangzbaws
commented on June 13, 2024
这个设计目的是为了满足这样的需求：
避免jobsender扫描S3桶的时候，上一次任务没有执行完，就提交了第二次的任务，这样上一次还没传输完的就会被再次扫描到，并且重新提交任务，导致重复任务。所以在Jobsender运行的时候，如果SQS 队列非空，则不予以执行。直到上一轮任务全部结束了，重新运行jobsender的时候会扫描到新出现的文件，并触发传输
from amazon-s3-resumable-upload.
Related Issues (20)
- same size and same file name with different content will be ignored HOT 5
- cdk-serverless can not deploy HOT 4
- 3T数据从OSS同步S3，有没有办法可以提速？5个小时内完成同步 HOT 8
- cluster edition report error HOT 1
- Cluster model can not sync the data with error Fail to list multipart upload - hawkey999/s3-migration-test/... HOT 1
- Can't do "cdk synth" on cdk-cluster.
- cdk-cluster aws-cdk.aws_s3_deployment not found
- Crontab s3_migration_cluster_jobsender.py
- cannot create subfolder under windows environment HOT 1
- Windows下传输完成之后，出现WARING - There are xx files not in destination or not the sam size HOT 1
- Does this tool support --no-sign-request? HOT 2
- get error when run too many tasks HOT 1
- pre signed S3 url download usage help HOT 1
- ModuleNotFoundError: No module named 'aws_cdk.aws_events_targets' HOT 1
- Serverless 版本部署完毕后会立即启动 jobsender么？还是必须等待一个小时之后 HOT 8
- S3 Object Metadata has been changed HOT 2
- support s3 bucket with RequestPayer HOT 3
- Serverless version CN to Standard Partition failed HOT 2
- aws cdk AutoScalingGroup now support enable GroupMetric HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from amazon-s3-resumable-upload.