Endpoint URL not utilized for external S3 resources

[kellrott]

Endpoint URL not utilized for external S3 resources

[thomasyu888]

Thanks for the report @kellrott . This is a known issue and this is the issue:

synapsePythonClient/synapseclient/core/remote_file_storage_wrappers.py

Line 136 in 1967179

ExtraArgs={'ACL': 'bucket-owner-full-control'},

.

Basically this was added because there was an issue that the owner of the S3 bucket actually didn't have access to the S3 objects uploaded into the buckets.

That being said, this particular canned ACL is not supported on the IBM buckets. Currently unsure of the resolution other than pointing people to use older verisons of the synapseclient (2.3.1). (unfortunately...)

[JenniferShelton]

I had been using older versions of synapseclient (2.3.1) but recently an attempt to install the older version is failing. I'm not sure which dependency(ies) have a new releases that causes conda and pip to fail to install. Do you have record of the version of python, pandas, boto, etc that are compatible with 2.3.1?

[thomasyu888]

@JenniferShelton Apologies, I must have missed this message!

Python==3.8,3.9
pandas>=0.25.0,<1.5
boto3>=1.7.0,<2.0

We just onboarded an engineer to help with the client, I'll be sure to re-visit this issue again as we will eventually reach a point where Python 3.9 EOL. For more transparency, here is the Jira ticket internally to track this work: https://sagebionetworks.jira.com/browse/SYNPY-1198