astrojuanlu/ie-mbd-advanced-python

"Advanced Python" subject from the Master in Big Data @ IE

Advanced Python

"Advanced Python" subject from the Master in Big Data @ IE.

Try in the cloud!

Installation

$ python -m pip install -r requirements.txt

Or, alternatively:

$ python -m pip install pip-tools
$ pip-sync

ie-mbd-advanced-python's Issues

Fix Binder build

jupyterhub/mybinder.org-user-guide#221

Update line-profiler installation instructions

New repository lives at https://github.com/pyutils/line_profiler, and in any case the maintainers have released wheels compatible with modern Python versions.

Clarification on special characters

https://github.com/Juanlu001/ie-mbd-advanced-python/blob/e1a779569ebb3ddc140094706cc4270aeb8c3e6d/sessions/02_layout-unit-tests.ipynb#L95

I would suggest adding a comment or a link to something specifying which are special characters ("_" is not, while "-" is).

Review miniconda installation instructions

• Adapt for MSYS2
• Review post-installation steps

Session 4-5

Missing instruction for the switch command. git switch -c etc

ImportError when doing pytest

Hello,
I am trying TDD process, so first I created a test function for the simple example of suming 2 numbers:

def test_sum_two_numbers_give_expected_result():
    a=2
    b=2
    
    expected_output=4
    assert output==expected_output

When I do this, the pytest works an tells me that does not work because output is not defined. So I proceed and an the 2 lines:

from  ie_nlp_utils import sum_numbers

def test_sum_two_numbers_give_expected_result():
    a=2
    b=2
    
    expected_output=4
    output=sum_numbers
    assert output==expected_output

Then in the > src/ie_nlp_utils/init.py

I create the following super simple function:

def sum_numbers():
	return 4

Save the changes and when I run the pytest again I get the following error:

¿?

Typo in code comment

https://github.com/Juanlu001/ie-mbd-advanced-python/blob/e1a779569ebb3ddc140094706cc4270aeb8c3e6d/sessions/02_layout-unit-tests.ipynb#L322

Should read
# src/ie_nlp_utils/init.py

Problems with .mask()

Hello professor,

I need to rewrite with Dask a function that replace the values of a column according to some rules.

However, when I test the function I am getting the following error:

I have tried everything but still did not get answer...
Thank you

Problems when pip install

Hello professor,
I am redoing all we have done in class this week. So I have created again a folder with the structure provided (src, tests, ...) when I am done, I try to do pip install ie_nlp_utils (name provided in metadata of setup.cfg) and I find this error:

By the way, in this case I called the package and the name in setup.cfg ie_nlp_utils, the same exactly name.
What am I doing wrong?

Problema con dask_ml.preprocessing

Hola Profe!

Estoy trabajando en el assignment individual y la verdad es que me esta costando la parte de MinMaxScaler en dask_ml.preprocessing, ya que segun el error message que me da la funcion, deberia haber la definicion de la variable 'scale_' adentro del method 'transform' como la hay en 'fit'. Segun tu experiencia, deberia de modificar directamente el archivo 'data.py' para agregar la variable 'scale_', o ves con mayor probabilidad de éxito que use sklearn.preprocessing? De manera mas amplia, deberia utilizar dask_ml en lugar de sklearn en todas las intancias? Abajo podés ver las capturas de pantallas.

Gracias!
Paul

Consider adding Git for Windows installation guide

Including these super useful "Known Issues" https://github.com/git-for-windows/build-extra/blob/master/ReleaseNotes.md#known-issues

Migrate layout instructions to flit

See sample project: https://github.com/Juanlu001/ie-sample-python-project

Consider splitting sessions

All notebooks contain two sessions, perhaps I should split them in two.