pentaho/pentaho-s3-vfs

kettle

pentaho-s3-vfs's Issues

Enhancement: allow set S3 client for s3n file system

This allows maximum customization.

S3: Could not create file

When using the s3 output step. We seem to be encountering an error when outputting files sequently. We seem to hit a 50 files limit when outputting to s3.

This 50 limit can be repeated and with different files sizes also.

This was not an issue on version 8.1.0.0-365 but i notice that the s3 plugin has been updated in between those versions.

Logging within S3FileObject - improve error messaging

Hello there!

I was working on something related to this plugin this week and we hit a bit of a snag when it came to determine the root cause of an issue as it relates to the S3FileObject. We often ended up in a position where we would get a NullPointerException, but it was difficult to trace back.

We ultimately traced it back to the getS3Object method, where is wraps the try/catch, and in the catch block, there is just a comment. If we were able to see the exception set there, we may have had a better chance to identify the root cause (permissions).

I'd like to request adding some simple output statements to assist in debugging when this condition occurs.