EMR Studio Notebook Examples

This repository contains ready-to-use notebook examples for a wide variety of use cases in Amazon EMR Studio.

For more information about using Amazon EMR Studio, see Use EMR Studio in the Amazon EMR Management Guide.

You can submit feedback and requests for changes by opening an issue in this repository or by making proposed changes and submitting a pull request. We welcome contributions to this repository in the form of fixes to existing examples or addition of new examples. For more information on contributing, please see the CONTRIBUTING guide.

Security
License
FAQ

Security

See CONTRIBUTING for more information.

License

This library is licensed under the MIT-0 License. See the LICENSE file.

FAQ

Will these examples work outside of Amazon EMR Studio?

Most of the examples should work with/without minimal modifications even outside EMR Studio.

How do I contribute my own example notebook?

Although we're extremely excited to receive contributions from the community, we're still working on the best mechanism to take in examples from external sources. Please bear with us in the short-term if pull requests take longer than expected or are closed.

Possible issue with Getting-started-emr-serverless.ipynb python package installer code

When following the Getting-started-emr-serverless.ipynb notebook in EMR examples [0], the cell with code sc.install_pypi_package("matplotlib") gives me the response:

WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'ConnectTimeoutError(<pip._vendor.urllib3.connection.HTTPSConnection object at 0x7fbcc4d18590>, 'Connection to pypi.org timed out. (connect timeout=15)')': /simple/matplotlib/
WARNING: Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'ConnectTimeoutError(<pip._vendor.urllib3.connection.HTTPSConnection object at 0x7fbcc4cf4b50>, 'Connection to pypi.org timed out. (connect timeout=15)')': /simple/matplotlib/
WARNING: Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'ConnectTimeoutError(<pip._vendor.urllib3.connection.HTTPSConnection object at 0x7fbcc4cf4d90>, 'Connection to pypi.org timed out. (connect timeout=15)')': /simple/matplotlib/
WARNING: Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'ConnectTimeoutError(<pip._vendor.urllib3.connection.HTTPSConnection object at 0x7fbcc4cf4f10>, 'Connection to pypi.org timed out. (connect timeout=15)')': /simple/matplotlib/
WARNING: Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'ConnectTimeoutError(<pip._vendor.urllib3.connection.HTTPSConnection object at 0x7fbcc4d0a110>, 'Connection to pypi.org timed out. (connect timeout=15)')': /simple/matplotlib/
ERROR: Could not find a version that satisfies the requirement matplotlib (from versions: none)
ERROR: No matching distribution found for matplotlib

The notebook has internet access and can download the public dataset "s3://athena-examples-us-east-1/notebooks/yellow_tripdata_2016-01.parquet". All of the cells in the notebook complete except for the ones dealing with matplotlib.

Should sc.install_pypi_package("matplotlib") fail to run if the public data set in accessible? (S3 is accessed through a NAT Gateway, not through an S3 VPC endpoint)

p.s. I work for Amazon and my handle is [email protected].

[0] https://github.com/aws-samples/emr-studio-notebook-examples/blob/main/examples/Getting-started-emr-serverless.ipynb

aws-samples / emr-studio-notebook-examples Goto Github PK