|
Spring
2020 Algorithms
that Affect Lives |
General Information
·
Instructor: Professor Tina Eliassi-Rad, Khoury College of Computer Sciences
·
Lectures: Mondays
& Wednesdays, 2:50 PM – 4:30 PM, Snell Library, Room 043
·
Office hours: Mondays,
4:45 PM – 6:00 PM, 177
Huntington Ave, Room 1023
o
Also, available by
appointment. Email eliassi [at] ccs [dot] neu [dot] edu to setup appointment; begin the subject line with [sp20].
Overview
This is a
4-credit freshman honors inquiry seminar. The course covers many of the algorithms that one uses on a daily
basis. Examples include algorithms for web search, online auctions,
recommendation systems, crowdsourcing, and social networking. We will also
discuss algorithms used in high-stakes decisions such as criminal justice,
policing, hiring, and loan approvals. Additionally, the course covers
individual and collective consequences of using these algorithms such as the loss
privacy, algorithmic bias, and ethical dilemmas. This course is on SAIL.
Prerequisites
This course does not have prerequisites. To excel in it, you do not need previous experience with programming, computer science, statistics, or mathematics.
Grading
·
Homework assignments (45% = 3 * 15%)
·
Semester-long project (35%)
·
In-class participation (20%)
Textbooks
This course does not have a designated
textbook. The readings are assigned in the syllabus (see below). You are
expected to have read the assigned material before each lecture. Here are some
recommended books (all optional, in chronological order):
· David Easley and Jon Kleinberg. 2010. Networks,
Crowds, and Markets: Reasoning About a Highly Connected World, Cambridge
University Press. (free online)
· Daniel Kahneman. 2013. Thinking
Fast and Slow. Farrar, Straus and Giroux.
·
Anand Rajaraman, Jurij Leskovec, and Jeffrey Ullman. 2014. Mining Massive
Data Sets. v2.1, Cambridge University
Press. (free online) (Errata)
· Brian Christian and Tom Griffiths. 2016. Algorithms
to Live By: The Computer Science of Human Decisions. Henry Holt and
Co.
· Cathy O'Neil. 2016. Weapons
of Math Destruction: How Big Data Increases Inequality and Threatens Democracy.
Crown.
· Meredith Broussard. 2018. Artificial
Unintelligence: How Computers Misunderstand the World. The MIT Press.
· Virginia Eubanks. 2018. Automating
Inequality: How High-Tech Tools Profile, Police, and Punish the Poor. St.
Martin's Press.
· Hannah Fry. 2018. Hello
World: Being Human in the Age of Algorithms. W. W. Norton & Company.
· Safiya Noble. 2018. Algorithms
of Oppression: How Search Engines Reinforce. NYU Press.
· Michael Kearns and Aaron Roth. 2019. The
Ethical Algorithm. Oxford University Press.
· Gary Marcus and Ernest Davis. 2019. Rebooting
AI: Building Artificial Intelligence We Can Trust. Pantheon.
· Brad Smith and Carol Ann Brown. 2019. Tools
and Weapons: The Promise and The Peril of The Digital Age. Penguin
Press.
Recommended Videos (in Chronological Order)
· We need a “moral operating system” by Damon Horowitz (TEDxSiliconValley, May 2011)
·
Machine
intelligence makes human morals more important by Zeynep Tufekci (TEDSummit,
Jun 2016)
· How I'm fighting bias in algorithms by Joy Buolamwini (TEDxBeaconStreet, Nov 2016)
· Junk News by Newshour Science Series (PBS, May 2018)
·
How
we can protect truth in the age of misinformation by Sinan Aral (TEDxCERN, Nov 2018)
· The Great Hack (Netflix, 2019)
·
Facebook's
role in Brexit — and the threat to democracy by Carole Cadwalladr
(TED, Apr 2019)
· Jaron Lanier Fixes the Internet by Jaron Lanier, Produced by Adam Westbrook (New York Times, Sep 2019)
· In the Age of AI (PBS/Frontline, Nov 2019)
· The Age of A.I. (YouTube Originals, Dec 2019)
Schedule (Evolving and Subject to Change)
Lec # |
Date |
Topic |
Readings & Notes |
1 |
Mon Jan 6 |
Overview of the course |
|
2 |
Wed Jan 8 |
Overview of algorithms, artificial intelligence, and machine learning |
What Are Algorithms, and Why Do They Make People Uncomfortable? by Heinzman and Hoffman (How to Geek, April 2019). Chapter 1 of Artificial Intelligence: A Modern Approach by Russell and Norvig (Prentice Hall, 3rd Edition, 2010) Machine Learning: Trends, Perspectives, and Prospects by Jordan and Mitchell (Science, 2015) Science and Data Science by Blei and Smyth (Proceedings of the National Academy of Sciences, 2017) Top 9 Ethical Issues in Artificial Intelligence by Bossmann (World Economic Forum, Oct 2016) |
3 |
Mon Jan 13 |
Overview of networks and graphs |
Chapter 1 of Networks, Crowds, and Markets by Easley and Kleinberg (Cambridge University Press, 2010) Chapter 2 of Networks, Crowds, and Markets by Easley and Kleinberg (Cambridge University Press, 2010) |
4 |
Wed Jan 15 |
Pros and cons of the algorithm age |
Code-Dependent: Pros and Cons of the Algorithm Age by Rainie and Anderson (Pew Research Center, Feb 2017) (Read to the end of Page 18) |
-- |
Mon Jan 20 |
No class |
Martin Luther King Jr. Day |
5 |
Wed Jan 22 |
Web search |
Chapter 13 of Networks, Crowds, and Markets by Easley and Kleinberg (Cambridge University Press, 2010) Chapter 14 of Networks, Crowds, and Markets by Easley and Kleinberg (Cambridge University Press, 2010) (skip Section 14.6) Optional: Chapter 5 of Mining Massive Datasets by Rajaraman, Leskovec, and Ullman (Cambridge University Press, 2014) |
6 |
Mon Jan 27 |
Online auctions |
Chapter 15 of Networks, Crowds, and Markets by Easley and Kleinberg (Cambridge University Press, 2010) (skip Section 15.9) Optional: Chapter 8 of Mining Massive Datasets by Rajaraman, Leskovec, and Ullman (Cambridge University Press, 2014) |
7 |
Wed Jan 29 |
Societal impact of Web search and online auctions |
Discrimination in Online Ad Delivery by Latanya Sweeney (Communications of the ACM, May 2013) – Additional informational website Bias on the Web by Ricardo Baeza-Yates (Communications of the ACM, Jun 2018) Google Autocomplete Still Makes Vile Suggestions by Issie Lapowsky (Wired, Feb 2018) The Secretive Company That Might End Privacy as We Know It by Kashmir Hill (NY Times, Jan 2020) Optional: Auditing Autocomplete: Suggestion Networks and Recursive Algorithm Interrogation by Robertson et al (ACM Web Science 2019) |
8 |
Mon Feb 3 |
Recommender systems |
Chapter 1 of Recommender Systems: The Textbook by Aggarwal (Springer, 2016) The Long Tail by Chris Anderson (Wired, Oct 2004) Optional: Chapter 9 of Mining Massive Datasets by Rajaraman, Leskovec, and Ullman (Cambridge University Press, 2014) |
9 |
Wed Feb 5 |
Recommender systems (continued) |
The Million Dollar Programming Prize by Bell et al. (IEEE Spectrum, May 2009) Rise of the Netflix Hackers by Demerjian (Wired, Mar 2007) Up Next: A Better Recommendation System by DiResta (Wired, Apr 2018) |
10 |
Mon Feb 10 |
Social bots |
The Rise of Social Bots by Ferrara et al (Communications of the ACM, Jul 2016) Deception Strategies and Threats for Online Discussions by Varol and Uluturk (arXiv, Jun 2019) |
11 |
Wed Feb 12 |
Content ranking & |
Auditing Partisan Audience Bias within Google Search by Ronald Robertson et al. (Proceedings of the ACM Human-Computer Interaction, Jun 2018) Bias Misperceived: The Role of Partisanship and Misinformation in YouTube Comment Moderation by Jiang, Robertson, and Wilson (Proceedings of the International AAAI Conference on Weblogs and Social Media, Jun 2019). |
-- |
Mon Feb 17 |
No class |
President’s Day |
12 |
Wed Feb 19 |
Crowdsourcing |
The Wisdom of Crowds: Introduction Chapter (Parts I through V) by James Surowiecki (Anchor, 2005) Human Computation: A Survey and Taxonomy of a Growing Field by Alexander Quinn and Benjamin Bederson (Proceedings of ACM CHI Conference, May 2011) |
13 |
Mon Feb 24 |
Wikipedia |
Governance in Social Media: A Case Study of the Wikipedia Promotion Process by Jure Leskovec, Daniel Huttenlocher, and Jon Kleinberg (Proceedings of the International AAAI Conference on Weblogs and Social Media, May 2010) Disinformation on the Web: Impact, Characteristics, and Detection of Wikipedia Hoaxes by Srijan Kumar, Robert West, Jure Leskovec (Proceedings of the 25th International Conference on World Wide Web, Apr 2016) Wikipedia’s “Constitutional Crisis” Pits Community Against Foundation by Stephen Harrison (Slate, Jul 2019) |
14 |
Wed Feb 26 |
The gig economy |
Gig Work, Online Selling and Home Sharing by Pew Research Center (Nov 2016) Digital Labor Platforms and the Future of Work: Towards Decent Work in the Online World (Chapters 1, 2, and 6) by Janine Bergs et al. (International Labor Organization, 2018) |
-- |
Mon Mar 2 |
No class |
Spring Break |
-- |
Wed Mar 4 |
No class |
Spring Break |
15 |
Mon Mar 9 |
Facial recognition |
Case Study: Facial Recognition by Hilary Cohen, Rob Reich, Mehran Sahami, and Jeremy Weinstein (Ethics, Technology, and Public Policy at Stanford University, 2018) The Secretive Company That Might End Privacy as We Know It by Kashmir Hill (New York Times, Jan 2020) Clearview’s Facial Recognition App Has Been Used By The Justice Department, ICE, Macy’s, Walmart, And The NBA by Ryan Mac, Caroline Haskins, and Logan McDonald (BuzzFeed News, Feb 2020) Here’s the File Clearview AI Has Been Keeping on Me, and Probably on You Too by Anna Merlan (Vice, Feb 2020) |
16 |
Wed Mar 11 |
Use of algorithms in law enforcement and judicial system |
Case Study: Algorithmic Decision Making and Accountability by Hilary Cohen, Rob Reich, Mehran Sahami, and Jeremy Weinstein (Ethics, Technology, and Public Policy at Stanford University, 2018) Machine Bias by Angwin, Larson, Mattu, and Kirchner (ProPublica, May 2016) Algorithms, Correcting Biases by Cass R. Sunstein (Social Research: An International Quarterly, 2019) Combatting Police Discrimination in The Age of Big Data by Sharad Goel et al. (New Criminal Law Review, 2017) |
17 |
Mon Mar 16 |
Use of algorithms in law enforcement and judicial system |
The Accuracy, Fairness, and Limits of Predicting Recidivism by Dressel and Farid (Science Advances, Jan 2018) The Limits of Human Predictions of Recidivism by Zhiyuan “Jerry” Lin et al (Science Advances, Feb 2020) Impact of Risk Assessment on Judges’ Fairness in Sentencing Relatively Poor Defendants by Jennifer Skeem, Nicholas Scurich, and John Monahan (Law and Human Behavior, 2020) |
18 |
Wed Mar 18 |
Misinformation online |
Misinformation and Its Correction: Cognitive Mechanisms and Recommendations for Mass Communication by Briony Swire and Ullrich Ecker (In. B. Southwell, E. A. Thorson, and L. Sheble. (Eds), Misinformation and Mass Audiences. Austin, TX: University of Texas Press, 2018) They Might Be a Liar But They’re My Liar: Source Evaluation and the Prevalence of Misinformation by Briony Swire-Thompson et al. (In Political Psychology, 2019) |
19 |
Mon Mar 23 |
Online social networking |
Chapter 3 of Networks, Crowds, and Markets by Easley and Kleinberg (Cambridge University Press, 2010) Chapter 4 of Networks, Crowds, and Markets by Easley and Kleinberg (Cambridge University Press, 2010) Chapter 5 of Networks, Crowds, and Markets by Easley and Kleinberg (Cambridge University Press, 2010) Facebook Ads Can Still Discriminate Against Women and Older Workers, Despite a Civil Rights Settlement by Ava Kofman and Ariana Tobin (ProPublica, Dec 2019) |
20 |
Wed Mar 25 |
Facebook ads |
Investigating Sources of PII Used in Facebook’s Targeted Advertising by Venkatadri et al. (Proceedings on Privacy Enhancing Technologies, Jul 2019) Discrimination through Optimization: How Facebook’s Ad Delivery Can Lead to Biased Outcomes by Ali et al. (Proceedings of the ACM on Human-Computer Interaction, Nov 2019) |
21 |
Mon Mar 30 |
Use of algorithms in healthcare & medicine |
Proposed Regulatory Framework for Modifications to Artificial Intelligence/Machine Learning (AI/ML)-Based Software as a Medical Device (US Food and Drug Administration, Apr 2019) Dissecting Racial Bias in an Algorithm Used to Manage the Health of Populations by Ziad Obermeyer et al. (Science, Oct 2019) |
22 |
Wed Apr 1 |
Use of algorithms in hiring |
The Legal and Ethical Implications of Using AI in Hiring by Ben Dattner et al. (Harvard Business Review, Apr 2019) Can Social Media Lead to Labor Market Discrimination? Evidence from a Field Experiment by Matthieu Manant, Serge Pajak, and Nicolas Soulié (Journal of Economics & Management Strategy, Aug 2018) |
23 |
Mon Apr 6 |
Use of algorithms in credit scoring & loan approvals |
Credit Denial in the Age of AI by Aaron Klein (Brookings, Apr 2019) Fairness and Machine Learning: Limitations and Opportunities by Solon Barocas, Moritz Hardt, Arvind Narayanan |
24 |
Wed Apr 8 |
Web privacy and tracking |
Online
Tracking: A 1-million-site Measurement and Analysis by Englehardt and Narayanan (Extended version of a paper
that appeared in Proceedings of the 23rd ACM Conference on Computer and
Communications Security, Oct 2016) – (Un)informed Consent: Studying GDPR Consent Notices in the Field by Utz et al. (Proceedings of the 26th ACM Conference on Computer and Communications Security, Nov 2019) Panoptispy: Characterizing Audio and Video Exfiltration from Android Applications by Pan et al. (Proceedings on Privacy Enhancing Technologies, Jul 2018) |
25 |
Mon Apr 13 |
What should we as citizens demand in the age of AI? |
Differential Privacy: A Primer for a Non-technical Audience by Kobbi Nissim et al. (Mar 2017) Case Study: Private Platforms by Hilary Cohen, Rob Reich, Mehran Sahami, and Jeremy Weinstein (Ethics, Technology, and Public Policy at Stanford University, 2018) A
Blueprint for a Better Digital Society by Lanier and Weyl (Harvard
Business Review, Sep 2018) |