dsp-testing/a2z-f15

Repository for ITP Fall 2015 Course

Programming from A to Z, Fall 2015

This course focuses on programming strategies and techniques behind procedural analysis and generation of text-based data. We'll explore topics ranging from evaluating text according to its statistical properties to the automated production of text with probabilistic methods to text visualization. Students will learn server-side and client-side JavaScript programming and develop projects that can be shared and interacted with online. There will be weekly homework assignments as well as a final project.

Info

• Daniel Shiffman, Mondays, 12:10pm-2:40pm
• All class dates
• Office Hours

Mailing List

• Join ITP A2Z Google Group.

Week 1 - Intro

• Notes
• Homework Assignment
• Git and Github
  • Introduction to Git and Command Line by Steve Klise
  • Git workflow for beginners
  • "Try" Git tutorial
• Github Pages: By no means, is github pages required for hosting your projects. But it's free and fast and lives on github. So there are many reasons why you might like to consider it, at least during the homework / experimentation stage / of a project.
  • A Guide to Github pages
• p5.js
  • Overview of p5.js
  • p5.js transition from Processing
  • p5.js DOM library
  • Objects in JavaScript
  • Basics of HTML and CSS with p5.js
• JavaScript
  • Eloquent JavaScript: Chapters 1-4
• Client-side vs. Server-side?

Week 2 -- Strings and DOM

• Notes
• Homework Assignment
• DOM manipulation in p5.js
• Strings in JS
• Text input (from user, from file)

Week 3 - Regular Expressions

• Notes
• Notes on callbacks in a loop
• Homework Assignment: Regular Expression Exercise
• Project 1 (due week 6): Use a text input source (user input, raw text file, API/data source) to generate an output presented back to the user in the browser. Possibilities include data visualization of text data, generative text maker, etc. We'll discuss details in class.
• Review OOP in JS
• Regular Expressions
  • meta-characters
    • position
    • single character
    • quantifiers
    • character classes
  • Regex in sublime text
  • Regex in JS: test(), search(), match(), exec()
  • Splitting with regex: split()
  • Replace with regex: replace()
  • randexp.js

Week 4 - Data/API Workshop

• Notes and examples
• APIs
• Working with google sheets
• Parse
• Homework: Start working on a text analysis project, due Week 6 (October 19).

Week 5 - Text Analysis Workshop

• Notes and examples
• In class, we'll build a simple concordance together as well as demonstrate and discuss TF/IDF and Bayesian analysis.
• Simple Concordance
• TF/IDF
• Bayesian Analysis

Week 6 - Show text analysis projects

Week 7 - Text Generation: Markov chains

• Using google sheets for text input
• Object "prototypes"
• ngrams and markov chains
• Homework Assignment

Week 8 - Text Generation: Grammars

• Using parse for saving data
• Closures
• Context free grammars
• Homework Assignment

Week 9 - Twitter Bots

• All notes
• All examples
• Server side programming with Node
• How to do data scraping
• How to make your own "API"
• How to make a Twitter bot
• Bot Homework Assignment

Week 10 - More Bots + Chrome Extensions

• Notes on chrome extensions
• More on bots -- Twitter streaming API, video tutorial
• More on bots -- Working with images/media, video tutorial
• Deploying
  • Notes on EC2
  • Notes on Heroku
• Assignment: Final project proposals

Week 11 - Final Project Proposals part 1

• half of you talk about ideas this week
• Text Analysis in Node
  • building your own API

Week 12 - Final Project Proposals part 2

• half of you talk about ideas this week
• Text Analysis in Node
  • Persistance (files, database, parse.com)
  • GET vs POST
  • Node packages for text: NaturalNode, sentiment, and more

Week 13 - User Testing

Week 14 - Final Presentations

References and Inspiration

• Moved to references wiki

Tools

• p5.js
• p5.js on GitHub
• p5.js CDN
• Node
• Servi
• RitaJS

JS reference books

• JavaScript: The Definitive Guide
• Eloquent JavaScript, Marijn Haverbeke
• Beginning JavaScript, Paul Wilton and Jeremy McPeak

Learning / Intro

• CodeAcademy: JavaScript
• How to learn JavaScript properly
• JavaScript the right way
• Code School
• JavaScript garden
• A re-introduction to JS by Mozilla
• JavaScript 101 from JQuery

Tools

• Checking code: JSLint / JSHint
• Browser debugging: Chrome Developer Tools (tutorial) / Firebug (tutorial)
• Mobile debugging jsconsole.com
• Sharing code snippets (useful for asking questions): gist.github.com

Requirements

• You are required to attend all class meetings and submit all weekly assignments and a final project.
• Grading (pass/fail) will be based on a combination of factors:
  • Attendance, participation in class discussion, and engagement in other students' projects (25%)
  • Quality of assignments (50%)
  • Final Project (25%)