teachingdata/basic-python

Lesson dealing directly with the Python Language (split into the lesson modules)

Example Solutions for Workbook

• Example Answers for problems proposed by The Python Workbook by B. Stephenson (Springer, 2014)
  • These were used in teaching a Python course
  • Not every example was used (as noted or just skipped)
• There are also self made examples which are indicted in each specific program.

Note on Examples

This is also used with Junior & Senior level (undergrad) Data analytic courses. The idea is that the students already have a general understanding of programming (with Java & C++) but have not encountered data analytic applications of programming.

There was also an expectation of full completion of at least calculus & statistics with some students having completed linear algebra and discrete math courses. So the math concepts only received a cursory review, with the course focused on application.

Due to this, the class moved very quickly through the first chapters in the workbook and found the solutions that were provided were too elementary. They also required a small update in a few places (yeah! type hints) - as is to be expected after 10+ years.

Modules

• Module 1: Basic input and output using the console and standard control structures
• Module 2: More detailed look at control and data structures with introduction to loops
• Module 3: File input and output with a Bag of Words project
• Module 4: Single program at the moment which shows a basic graph (will expand with a game example soon)
• Module 5: Using parallel operations (threading)
• Network Operations: Provides examples of Networking tools (sockets with requests and a little automation)
• Review 1: Classes with type hinting and basic review of math

License

The content of any data used within projects themselves is licensed under the Creative Commons Attribution 4.0 International license while the source code of any script or program is licensed under the MIT license.

All code was authored and written by Professor Greenwell (self) based on problems proposed in workbook or his own lessons.

basic-python's Issues

I need italic module names

see title (in readme.md)

Add Chapters for SQL

Add new chapters for SQL lessons.

Fix chapters for ETL

Fix the ETL chapters:

• local data processing (backend) separated
• data flow (network) added and edited
• ETL Overview expanded

Move data code into seperate module

Reorganize and rename to be self-documenting (then update the documentation)

Consider removing the "Assorted Programs" repository

I used to use that and do like the Ackerman fix and few things with splat - but most of this is based on Python 2 and I think may just need removed over cleaned up.

I'll look at it and remove them if I see its true (might clean up one or two and put them in their appropriate sections)

Create Version 3 of Requests Lectures

Add version 3 of requests lectures to networking

Add Big Data Section (multiple Chapters)

I may make this a whole sprint unto itself:

• Big Data Overview and History
• Heterogenous Sources
  • IoT and Devices
  • JSON vs. XML
  • Images
  • Stream, Audio, Video (Signal Processing)
• Using Data Warehousing vs. NoSQL
• NoSQL
• Coding Examples and Basic Algorithms

Reorganize the basic python scripts

• Need to rename modules to reflect code inside
• Update readme
• move code to better locations
• add zip of just code contained in each section for easy download (as scripts)

Fix the Modules in readme to be bold

What the title says

Add Data Warehousing Chapter

Add chapter on Data Warehousing

Add basic examples for basic python

• A few examples of the command line (args and argsparse)
• Examples of comprehensions
• Examples of Generators

Add OS Threading code and multprocess code

• basic mutex
• basic mutex with library
• basic mutex with library and with statement
• very basic semaphore
• asyncio semaphore
• multprocess and scheduling

Add socket code to networking examples

• basic chat client and server
• basic knock knock
• ensure readme updated
• organize into separate directories for searching

Reorganize for Operating Systems

Reorganize all code for Operating Systems:

• Rename Module or add one
• Move/rename scripts
• Add relevent code from other sources (centralize)
• Add directory readme (with links to C++/C/Shell OS code)
• Update repository readme

Add selenium code

Add Selenium code for scraping website and automating clicks

Add better class examples for basic Python

Add better (and reorganize) class example for Python basic code modules

ETL and Networking

Add new code for multiprocess with network ops (ping and monitoring)

• simple ping with multiprocess
• monitoring code

Data Flow and Data Operations

Add examples of:

• File handling
• Database (SQLite, PostgreSQL, MySQL)
• Signal handling
• Data Flow
• Async operations
• Data Warehousing and Data Frames (pandas over spark)
• Visualizations

Add Graphing Chapter

Graphing:

• Usage and Examples
• Code
• CQL
• Issues with Big Data (Sharding)