mgalarnyk/installations_mac_ubuntu_windows

Installations for Data Science. Anaconda, RStudio, Spark, TensorFlow, AWS (Amazon Web Services).

installations_mac_ubuntu_windows's Issues

CuDNN library incompatibility error

I am getting the following error when running tensorflow:

Loaded runtime CuDNN library: 4007 (compatibility version 4000) but source was compiled with 5103 (compatibility version 5100).  If using a binary install, upgrade your CuDNN library to match.  If building from sources, make sure the library loaded at runtime matches a compatible version specified during compile configuration.
F tensorflow/core/kernels/conv_ops.cc:457] Check failed: stream->parent()->GetConvolveAlgorithms(&algorithms)

Based on tensorflow issue #3225, I think perhaps cudnn v.5.1 is required, rather than cudnn v.4.0.

Facing Error When installing Anoconda in Aws ubnutu

After installed anaconda in Aws instance
Error - 1
ubuntu@ip-172-31-4-52:$ ls
anaconda2 Anaconda2-4.3.1-Linux-x86_64.sh certs
ubuntu@ip-172-31-4-52:$ source .bashrc
ubuntu@ip-172-31-4-52:~$ conda update conda
conda: command not found

After creating password and key

Error -2
ubuntu@ip-172-31-4-52:$ jupyter notebook --generate-config
jupyter: command not found
ubuntu@ip-172-31-4-52:$

How can solve this ? Any help me to solve this
Thanks in advance

Issue with Path set up for Spark on Windows 10

I am having issues with my path in setting up Spark on my Windows 10 machine. I'm pretty sure it is not a security issue.

In your video, you add the spark path to your Anaconda path. I do not have Anaconda because it would not install/set paths properly (I’ve had several people look at this and not figure out the problem), so I have Miniconda installed instead.

When I open my Environmental Variables and click to Edit my “Path” a window with what looks like many paths opens up, but none of them are Miniconda. I tried just adding a new path for the spark path, but this doesn’t seem to work. I've attached a screenshot.

Can't open Ipython note book ends in Time out

After installed anaconda.

Checked in nohup kernel is active
Jupyter$ cat nohup.out
NotebookApp] Writing notebook server cookie secret to /run/user/1000/jupyter/notebook_cookie_secret
NotebookApp] 0 active kernels
NotebookApp] The Jupyter Notebook is running at: https://[all ip addresses on your system]:8888/

When i copied Notebook https with my public ip with port it end up in time out.

Kindly help

openssl on ubuntu 18 produce unsuitable permissions

The command

sudo openssl req -x509 -nodes -days 365 -newkey rsa:1024 -keyout mycert.pem -out mycert.pem

on ubuntu 18 produces a file only readable and writable by root, which gives errors when running jupyter as non-root user. This requires a chmod +r.

ip='*' does not work un jupyter 4.4.0

See also jupyter/notebook#4107, should be '0.0.0.0'

"Not found file/dir" error though "~/spark-2.2.1-bin-hadoop2.7/bin/load-spark-env.sh" is there.

SPARK-2.2.1
HADOOP- 2.8.1
JDK- 1.8

After running following command===========
$ snotebook

Error========
/home/shachi/spark-2.2.1-bin-hadoop2.7/bin/pyspark: line 24: ~/spark-2.2.1-bin-hadoop2.7/bin/load-spark-env.sh: No such file or directory

/home/shachi/spark-2.2.1-bin-hadoop2.7/bin/spark-class: line 24: ~/spark-2.2.1-bin-hadoop2.7/bin/load-spark-env.sh: No such file or directory

Failed to find Spark jars directory (~/spark-2.2.1-bin-hadoop2.7/assembly/target/scala-/jars). You need to build Spark with the target "package" before running this program.

I have followed each and every step very carefully. Kindly, let help me in rectifying this error. Thanks

AWS blogpost question

Hi Michael, I had a question related to AWS related blogpost you had written. I am stuck on point 15. Any help, would be highly appreciated! Thank you very much.

15.Open your rdp file. Click on continue. If your local computer is a Mac, you will need to download "Microsoft Remote Desktop" from the App Store to be able to open your rdp file.

I tried using both "microsoft remote desktop" and "microsoft remote desktop beta" for mac.

This was the instruction I followed from AWS:

[Mac OS X] For the Microsoft Remote Desktop app, choose New and do the following:

For PC Name, enter the IPv6 address of your Windows instance; for example,2001:db8:1234:1a00:9691:9503:25ad:1761.

For User name, enter Administrator.

Close the dialog box. Under My Desktops, select the connection and choose Start.

---

And these are my AWS details:
Public DNS | ec2-18-218-163-206.us-east-2.compute.amazonaws.com
User name| Administrator

---

However, I get an error, which is:
We couldn't connect to the remote PC. Make sure the PC is turned on and connected to the network, and that remote access is enabled.
Error code: 0x204