Giter Site home page Giter Site logo

aws-solutions / amazon-s3-glacier-refreezer Goto Github PK

View Code? Open in Web Editor NEW
21.0 10.0 16.0 6.06 MB

The Amazon S3 Glacier Re:Freezer is a serverless solution that automatically copies entire Amazon S3 Glacier vault archives to a defined destination Amazon Simple Storage Service (Amazon S3 bucket) and S3 storage class.

Home Page: https://aws.amazon.com/solutions/implementations/amazon-s3-glacier-refreezer

License: Apache License 2.0

Shell 4.78% JavaScript 59.26% Python 1.18% TypeScript 34.78%
aws-cloud amazon-glacier amazon-s3 serverless

amazon-s3-glacier-refreezer's People

Contributors

amazon-auto avatar bassemwanis avatar dependabot[bot] avatar eminaws avatar evanwieren avatar g-lenz avatar georgebearden avatar gsingh04 avatar kamyarz-aws avatar mobri2a avatar schana avatar vishwanz avatar yuwindr avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

amazon-s3-glacier-refreezer's Issues

Cosmetic Bug: "Error" messages from files with "error" in name

Describe the bug
In the CloudWatch management console, while the stack is running, an error message is logged when there is no actual apparent error, but rather it's just an info message for any file / directory being copied that has the string "error" within it.

To Reproduce
For the transfer, use a .csv mapping file as described in the implementation guide, where some entries contain the string 'error' within the "FileName" column.

Expected behavior
Only actual errors would be displayed in the error message box.

Please complete the following information about the solution:

  • Version: 1.0.1

  • Region: us-east-1

  • Was the solution modified from the version published on this repository? -- No

  • If the answer to the previous question was yes, are the changes available on GitHub? -- N/A

  • Have you checked your service quotas for the sevices this solution uses? -- Not relevant I believe

  • Were there any errors in the CloudWatch Logs?

Screenshots
I blacked out some info where I wasn't sure what it was for just out of an abundance of caution. These are all the error messages that appeared during the processing. Screenshot was taken after everything was done.
Error Messages

Additional context
The files both appear to have copied without issue. The only two files in the 'error' messages are also the only two files in the vault that contain the string 'error' (I searched the csv mapping file to be sure).

The files were originally uploaded to the old glacier using FastGlacier software. Looking at the inventory file retrieved from old glacier, FastGlacier encodes the file paths/names in base64 inside the "ArchiveDescription" field. Therefore, the string 'error' does not occur anywhere in the raw inventory file on AWS's side (I searched to be sure), only in the csv mapping file. So I'm not sure if this would also happen if the string occurred in the actual inventory file.

Appears to only be cosmetic but did confuse me when I saw the messages pop up.

Files from Glacier with Non-English characters not transferring correctly

Describe the bug
I've run the script (1.01) and transferred data to an S3 bucket. During the transfer I noticed errors in Cloudwatch (which I didn't save). On inspecting the S3 bucket, file names with German umlauts were being renamed (ü to C<) and ones with Greek letters also (μ to B5).

To Reproduce
Transfer non English file name to S3 bucket using refreezer script v 1.01

Expected behavior
Non-English characters should transfer and not be displayed as the Unicode character

Please complete the following information about the solution:

  • Version: [e.g. v1.0.1]

To get the version of the solution, you can look at the description of the created CloudFormation stack. For example, "Amazon S3 Glacier Re:Freezer. Version v1.0.0".

  • Region: [e.g. us-east-1]
  • Was the solution modified from the version published on this repository?
  • No
  • If the answer to the previous question was yes, are the changes available on GitHub?
  • Have you checked your [service quotas]
  • Yes
  • (https://docs.aws.amazon.com/general/latest/gr/aws_service_limits.html) for the sevices this solution uses?
  • Were there any errors in the CloudWatch Logs?
  • Yes, but I neglected to record them.

Screenshots
If applicable, add screenshots to help explain your problem (please DO NOT include sensitive information).

Additional context

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.