ibm/visualize-food-insecurity

Use Watson Analytics and Pixie Dust to visualize US Food Insecurity

visualize-food-insecurity's Issues

Document need to unzip/extract combined_data.csv.zip

Be explicit about extracting file to combined_data.csv

Issue on exporting dataframe/file

I´m in problem in the end of notebook to download dataframe from DSX to csv file (in order to import it to WA)

So according to this help I should get something like this ( https://medium.com/ibm-data-science-experience/working-with-object-storage-in-data-science-experience-python-edition-c96bc6c6101)

credentials_1 = {
        'auth_url': 'https://identity.open.softlayer.com',
        'project': 'object_storage_9-----3',
        'project_id': '7babac2********e0',
        'region': 'dallas',
        'user_id': '9603b8************70f',
        'domain_id': '2c66d***********b9d26',
        'domain_name': '1026***',
        'username': 'member_******************',
        'password': ""
        "***************"
        "",
        'container': 'TemplateNotebooks',
        'tenantId': 'undefined',
        'filename': 'data_by_var.json'
}

But instead I´m getting code like this :

credentials_100 = {
'IBM_API_KEY_ID': 'api-key-here',
'IAM_SERVICE_ID': 'service-id-here',
'ENDPOINT': 'https://s3-api.us-geo.objectstorage.service.networklayer.com',
'IBM_AUTH_ENDPOINT': 'https://iam.ng.bluemix.net/oidc/token',
'BUCKET': 'bucket-name-really-in-here',
'FILE': 'combined_data.csv'
}

It doesnt inclyude user_id etc. which are required in next notebook cell def_putfile - call and as you have in your examåple

What I´m doing wrong in here and anyidea how to fix this? Thanks a lot for great example =)

Issues creating Data Science projects in current steps

When signing up for Watson Studio using the link in:

https://github.com/IBM/visualize-food-insecurity?cm_sp=Developer-_-create-visualizations-to-understand-food-insecurity-_-Get-the-Code#1-sign-up-for-the-watson-studio

The Watson Studio account doesn't provide tooling for creating a Data Science project. Instead using the IBM Cloud Catalog to create the service instance for Watson Studio needs be used to be able to see the option for Data Science projects.

change credentials to credentials_1 and document

modify notebook name

use dashes instead of spaces in the notebook name. Otherwise you can't add the link in the README. If fact, to get it to work in the current README, dashes were added to the name which means if you click on it you get a 404 error.

@MadisonJMyers

Mismatch in notebook name

Link to copy in README is
https://github.com/IBM/visualize-food-insecurity/blob/master/notebooks/Diet-Related-Disease-Exploratory.ipynb

Current file in repo has name
https://github.com/IBM/visualize-food-insecurity/blob/master/notebooks/Diet-Related%20Disease%20Exploratory.ipynb

Data analytics is no longer available?

this needs update not only interfaces have changed but services are no longer acting up

add cell for pandas data frame

I'm not sure if it's necessary, but following the existing instructions to just add the data frame without clicking on a specific cell for that results in the data frame being added to the first cell.
This first cell is merely instructional, so the data frame info gets merged in and it has some weird formatting.

upload new example_output

The notebook has changed, so generate and save a new example of the output. Also, document where this lives in the README.

Need architecture diagram to README along with flow discription

See other Spark journeys for examples.

Note, diagram should be placed in /doc/source/images/architecture.png

Notebook getting warnings

@MadisonJMyers - using the latest version of IBM Watson Studio, I'm getting warnings in a couple of cells which I don't recall seeing before. The notebook appears to run correctly, but you should probably check it out.

Cell 2 - /opt/conda/envs/DSX-Python35/lib/python3.5/site-packages/IPython/core/interactiveshell.py:2698: DtypeWarning: Columns (208,209,211,214) have mixed types. Specify dtype option on import or set low_memory=False.
interactivity=interactivity, compiler=compiler, result=result)

Cell 13 - /opt/conda/envs/DSX-Python35/lib/python3.5/site-packages/seaborn/categorical.py:1460: FutureWarning: remove_na is deprecated and is a private function. Do not use.
stat_data = remove_na(group_data)

Update notebook

Please update text - replace "journey" with "Code Pattern" (case sensitive), and any references to "Bluemix" should be replaced with "IBM Cloud".

@MadisonJMyers

Put files in folders

Put .csv file in /data
Put .ipynb in /notebooks

Fix typo(s)

".. one third of American minors are considered obsese,.."

Remove notebook content from README

Lots of good info in README, but most of the steps describe is repeated in the notebook. I think you should just describe what you are going to accomplish/show with the notebook, then provide the steps to run it. Once there, they can see all of the specific detail about each of the steps/cells.

Need journey files

From other Spark journeys, copy the following files:
ACKNOWLEDGMENT.md (add appropriate contributors here)
CONTRIBUTING.md (update links in the file to point to your repo - this can wait until you move to IBM)
MAINTAINERS.md (no changes needed)

README changes

@MadisonJMyers - nice progress, but still needs some minor tweeks. This will be easier once we move this repo to IBM, where I can just make changes directly.

1. remove the dashes from your title
2. remove the everything after that until the "This journey will guide ...". This will be your intro paragraph.
3. remove the "architecture image" tag and title for your diagram.
4. substitute the word "journey" with "Code Pattern".
5. "Steps". Each of the steps should be a title with a section. Please check out how Dilip's does this in his journey in the section "Run using a jupyter notebook in the IBM data science experience".

Assuming your journey only runs in a notebook, your steps should probably mimic his journey steps. Note that each step has a section to provide details on how to accomplish the step. If you have additional steps on loading data, you would add those steps here.

We can talk about this more on Slack...

Replace data_1 with streaming_body_1

Autogenerated pandas data frame uses streaming_body_1 now, instead of data_1

Document changes to remove Swift Object storage

Bad Link

in the README text "but you can follow along with the steps below!", the "steps" link gives a 404 error

Add included components and featured technologies to README

See other Spark journeys for examples, as well as https://github.ibm.com/developer-journeys/journey-docs for appropriate descriptions.

Need new architecture diagram

Need to change 'IBM Data Science Experience' to 'IBM Watson Studio'

Notebook URL is not valid

Get a 404 for this:

https://github.com/IBM/visualize-food-insecurity/blob/visualize-food-insecurity/notebooks/Diet-Related-Disease-Exploratory.ipynb

Save copy of notebook without output

We usually start with a copy of the notebook with no output.
WE can save off a copy with output in an examples/ dir