Programming with data (Fall 2023 Schedule)

Syllabus with course description and policies etc.

All readings are available online, either on the open web or through the NYU Library EZproxy.

Please turn in homework using this Google form.

Unit A: Computational building blocks

Session 01 (2023-09-06): Introduction

• Syllabus and schedule
• Lecture: What is data and what is it good for?
• Exploratory data analysis: an example

Some interesting data-related projects in the worlds of art and design:

• Stephanie Posavec and Georgia Lupi, Dear Data
• Jia Zhang, censusAmericans
• Mimi Ọnụọha, Library of Missing Datasets
• Tempestry Project
• Sam Lavigne and Tega Brain, New York Apartment
• Lam Thuy Vo, Quantified Breakup
• The Markup, e.g. See the neighborhoods internet providers excluded from fast internet

Places to look for interesting datasets:

• Data Is Plural newsletter
• Allison’s ‘dataset’ bookmarks
• NYC Open Data
• Google Dataset Search

Reading assigned: What is data?

• Garvey, Ellen Gruber. “‘Facts and FACTS’: Abolitionists’ Database Innovations.” “Raw Data” Is an Oxymoron, edited by Lisa Gitelman, The MIT Press, 2013, pp. 89-102.
• Keyes, Os. “Counting the Countless.” Real Life, 8 Apr. 2019.

Optional but recommended:

• O’Connor, Maureen. “Heartbreak and the Quantified Selfie.” The Cut, 2 Dec. 2013.
• Spector, Alfred Z., et al. “Foundations of Data Science.” Data Science in Context: Foundations, Challenges, Opportunities, Cambridge University Press, 2022, pp. 7–28.

Session 02 (2023-09-15): Python basics

• Reading discussion
• Install Anaconda
• Jupyter Notebook introduction
• Python basics: Expressions, types and strings. I’ll be using these notes.

Session 03 (2023-09-22): Strings, lists and loops

• Python: Lists and loops
• How to download notebooks

Exercise #1 assigned: Python basics. Download the notebook to your own computer, open it in Jupyter Notebook, and follow the instructions. We’ll review the exercise and discuss how to upload your completed notebook next week.

Unit B: Tools for data

Session 04 (2023-09-29): Dataframes with Pandas

• How to share your notebooks
• Review exercise #1
• Lecture: “Tidy data”
• Python: Pandas, part 1

Reading assigned: Forms of data.

• Broman, Karl W., and Kara H. Woo. “Data Organization in Spreadsheets.” The American Statistician, vol. 72, no. 1, Jan. 2018, pp. 2–10.
• Onuoha, Mimi. “The Point of Collection.” Data & Society: Points, 31 Oct. 2016.
• Rawson, Katie, and Trevor Muñoz. “Against Cleaning.” Curating Menus, 6 July 2016.

Session 05 (2023-10-06): Pandas, continued

• Reading discussion
• Lecture: Basics of descriptive statistics
• Python: Pandas (part 2)

No homework this week, but if you’re looking for more practice with Python and Pandas, try Julia Evans’ Pandas Cookbook.

Session 06 (2023-10-13): Data structures

• Python: Still more pandas
• Python: Dictionaries, sets, tuples
• Python: JSON files

Exercise #2 assigned: Fun with Pandas.

Midterm project assigned (due Session 08).

Session 07 (2023-10-20): Regular expressions

• Review exercise #2
• Python: Regular expressions

Session 08 (2023-10-27): Midterm presentations

• Midterm presentations

Session 09 (2023-11-03): Clustering and correlation

• Python: Clustering and correlation.

Reading assigned: Corpora and databases.

• Heller, Nathan. “What the Enron Emails Say About Us.” The New Yorker, 17 July 2017.
• Ramsay, Stephen. “Databases.” A Companion to the Digital Humanities, 2004.,
• Voida, Amy, et al. “Homebrew Databases: Complexities of Everyday Information Management in Nonprofit Organizations.” Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 2011, pp. 915–24.

Unit C: Databases

Session 10 (2023-11-10): Structured Query Language (SQL)

• Reading discussion
• Lecture: Relational databases
• Python: Introduction to SQL

Session 11 (2023-11-17): SQL, part 2

• Python: SQL (part 2)

Exercise #3 assigned: SQL practice.

Session 12 (2023-12-01): Sharing data projects

• Review exercise 3
• Final project proposal
• Python: Interactive stuff in Jupyter Notebooks
• Python: Going live on Binder! My prepped gist, more info
• NYC Dog Licensing Dataset

Session 13 (2023-12-08): Final project presentations 1

• Final project presentations

Session 14 (2023-12-15): Final project presentations 2

• Final project presentations