deanwampler/justenoughscalaforspark

A tutorial on the most important features and idioms of Scala that you need to use Spark's Scala APIs.

justenoughscalaforspark's Issues

The link to JustEnoughScalaForSpark doesn’t show up after upload

Now the line is moved towards the bottom of the page and the buttons to the right are different. Click the JustEnoughScalaForSpark link and the tutorial notebook will open in another browser tab. (It might take a minute to load completely.)

This part is not working. I do not see the Link after upload in my spark-notebook, can you help what might be wrong.

What is now the best Spark Jupyter Notebook image to use that retains Scala support?

Previously, the run.sh and run.bat scripts just used jupyter/all-spark-notebook:latest for the Docker image. However, Scala support was removed in July 2022 (https://github.com/jupyter/docker-stacks, commit: 5048b022466a8c7d4ecff149396e6bf35babb9c8).

I will shortly release an update to the run.* scripts and the README instructions that hard-code the last image that appears to retain Scala support jupyter/all-spark-notebook:spark-3.2.0 (which actually appears to support 3.2.1). Since Spark 3.3.0 recently came out, it won't be possible to keep the tutorial up to date with Spark releases using jupyter/all-spark-notebook.

While the purpose of this tutorial isn't to teach Spark, per se, it would be nice to keep it current with Spark releases. Therefore, this issue is to determine if there is an alternative to jupyter/all-spark-notebook that still maintains Scala support.

opening notebook in jupyter / toree

I tried to open the .snb file in jupyter but jupyter doesn't seem to recognize as a valid notebook.

After renaming the file from .snb to .ipynb i am getting a validation error.

Notebook Validation failed: 'nbformat_minor' is a required property:

error when uploading JustEnoughScalaForSpark.snb

The message is:

The error was: SyntaxError: JSON.parse: unexpected character at line 7 column 1 of the JSON data

Typo in the project's description

A tutorial on the most important features and idioms of Scala they you need to use Spark's Scala APIs.

Should probably be:

A tutorial on the most important features and idioms of Scala that you need to use Spark's Scala APIs.