deekshaarya4/comp599_fall2021

COMP 599 Course Portal -- Design and Build Intelligent Systems

[COMP599_Fall2021] Design and Build Intelligent Systems

General Information

Instructor	Jin Guo
TA	Deeksha Arya
Class Time	TR 2:35 am-3:55 pm
TA Office Hours	Zoom (Tuesday 9:20-10:20am)
Location	BURN 1B24
Discussion Forum	Slack

• I normally design many in-class activities for upper-level classes to motivate discussion and collaborative learning. However, given the risks of going to a classroom and other constraints you might have, I will allow people to join remotely through Zoom for the first few weeks. The zoom session will also be recorded. We will adjust as the semester goes.

• Please fill in this background survey and topic preference as discussant before Sept 7th.

Description

This course is going to explore how to design and build an intelligent system from a software engineering perspective, from requirement gathering and analysis to deployment and maintenance. We will also touch AI ethics and its implications to design.

Prerequisite

While there are no official prerequisite courses, you will enjoy and appreciate this course more if you have taken COMP303, COMP424 and COMP551 already.

Reference Material

We will not concentrate on any particular resources. Instead, the readings will include content from book chapters, research papers, blog posts, talks, etc. The pointers to those content will be added to the schedule later.

• Books:
  • Thinking in Systems: A Primer (Chapter scans will be shared through OneDrive links)
  • Human Compatible: AI and the Problem of Control (Chapter scans will be shared through OneDrive links)
  • Design Justice (open access)
  • Building Intelligent Systems A Guide to Machine Learning Engineering (access through McGill Library)

Assessment and Evaluation (Tentative)

Assessment Method	Weight
Participation (inclass and online)	10%
Assignment	60%
Final Project	30%

• Any form of plagiarism, cheating is strictly banned during midterm or final exam. Integrity is crucial to this course and your future career. Any violation against academic integrity will be taken very seriously. For more information, please refer here.

Schedule (Tentative)

Subject to adjustments

Lecture	Date	Content	Reading	Note	Discussant
1	2 Sep	Introduction	BIS book: Chapter 1, 2 TIS book: Intro (Onedrive)
2	7 Sep	Intro to Modern Software Engineering	A collection of videos by Sommerville Ian about fundatoinal SE Quality Attributes
3	9 Sep	Intelligence and ML	BIS book: Chapter 16, 17, 18 Human Compatible: Intelligence (Onedrive)	Assignment-1 (On MyCourses, Due 20 Sep)
4	14 Sep	Model Quality	BIS book: Chapter 19, 20 How NOT To Evaluate Your Dialogue System: An Empirical Study of Unsupervised Evaluation Metrics for Dialogue Response Generation Beyond Accuracy: Behavioral Testing of NLP Models with CheckList Model Cards for Model Reporting
5	16 Sep	From Model to System	Software Engineering for Machine Learning: A Case Study Hidden Technical Debt in Machine Learning Systems TIS book: Chapter 4 Why Systems Suprise Us (Onedrive)		Saskia
6	21 Sep	Data Acquisition & Management	BIS book: Chapter 9 A Survey on Data Collection for Machine Learning: A Big Data - AI Integration Perspective		Luca
7	23 Sep	Requirement and AI - 1	Requirements Engineering for Machine Learning: Perspectives from Data Scientists		Ada
8	28 Sep	Requirement and AI - 2	Keynote talk by Amy Ko at RE 2021
9	30 Sep	Team and Collaboration	How AI Developers Overcome Communication Challenges in a Multidisciplinary Team: A Case Study Data Scientists in Software Teams:State of the Art and Challenges		Martin
10	5 Oct	Data Quality	The ML Test Score: A Rubric for ML Production Readiness and Technical Debt Reduction BIS book: Chapter 15
11	7 Oct	System Quality			Avinash
12	15 Oct (READING WEEK MakeUp Class)	Continous Delivery Design for Human-AI Interaction (UX)	Guidelines for Human-AI Interaction Human-Centered Artificial Intelligence: Three Fresh Ideas
13	19 Oct	Design for Human-AI Interaction (data visualization, communication)
14	21 Oct	Focus: Design for Learning
15	26 Oct	Focus: Design for Decision-making
16	28 Oct	Fcous: Design for Creativity
17	2 Nov	Focus: Inclusive Design for AI	Design Values: Hard-Coding Liberation?
18	4 Nov	AI principles Overview
19	9 Nov	Safety	Autonomous Vehicle Safety: An Interdisciplinary Challenge An Analysis of ISO 26262: Using Machine Learning Safely in Automotive Software
20	11 Nov	Security and Privacy	SoK: Towards the Science of Security and Privacy in Machine Learning Designing privacy-aware internet of things applications
21	16 Nov	Accountability/Auditing	Closing the AI Accountability Gap: Defining an End-to-End Framework for Internal Algorithmic Auditing Toward Trustworthy AI Development: Mechanisms for Supporting Verifiable Claims (Section 2 and 3)
22	18 Nov	Transparent and Explainability	Explainable machine learning in deployment Designing Theory-Driven User-Centric Explainable AI
23	23 Nov	Transparent and Explainability
24	25 Nov	Fairness	Co-Designing Checklists to Understand Organizational Challenges and Opportunities around Fairness in AI
25	30 Nov	Value in AI Design	“The Human Body is a Black Box”: Supporting Clinical Decision-Making with Deep Learning
26	2 Dec	Presentation

Credit:

The content of this course is greatly inspired by CMU 17-445/645: Software Engineering for AI-Enabled Systems which is developed by Christian Kästner et. al.

License

Unless otherwise noted, the content of this repository is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.