Introduction to Computational Cognitive Science (Fall 2019)

Johns Hopkins University, AS.050.202

Krieger 111

Lectures: Tuesday and Thursday, 10:30-11:45 am

Lab: Friday 2:15-3:30 pm
Instructor

Tal Linzen

tal.linzen@jhu.edu

Office hour: Krieger 243, by appointment only (sign-up spreadsheet)

Teaching assistants

Najoung Kim (A-N)

n.kim@jhu.edu

Office hour: Friday 4-5 pm, Krieger 145

Grusha Prasad (O-Z)

grusha.prasad@jhu.edu

Office hour: Wednesday 5-6 pm, Krieger 239

Course description

How does the mind work? Cognitive science addresses this question from a multidiscliplinary perspective, drawing upon methods and ideas from psychology, neurophysiology, neuroscience, philosophy, linguistics, and computer science. Within this framework, computational cognitive science has two related goals. The first is to create computational models of human cognition, computer programs that simulate certain aspects of the mind. The second is to understand how to produce intelligent behavior in machines, taking cues from humans. The computational frameworks we will discuss include symbolic structured representations, probabilistic inference and artificial neural networks, as applied to concept learning, language and vision.

At the end of this class, you are expected to be able to:

Prerequisites: While there are no formal prerequisites for the class, some programming experience, as obtained by taking a class such as Introduction to Computing, is highly recommended. Familiarity with high school calculus (derivatives in particular) will also be beneficial, as will a general willingness to engage with mathematical problems.

Course organization

Lab: The class will be accompanied by weekly lab sessions led by the TAs. The goals of the lab are to reinforce the mathematical and computational concepts covered in the lecture, and to provide hands-on technical introduction to the software tools that are essential for successful completion of the homework assignments. All students are expected to enroll in the lab; exceptions will be granted by the professor to students who can demonstrate sufficient computational experience.

Interacting with the instructors: Students are assigned to a TAs based on their last names. If your last name starts with A-L, you're assigned to Najoung; otherwise you're assigned to Grusha. The main point of this system is to make it easier for us to track individual students' attendance and progress in the class; you're still free to attend either of the TAs' office hours, of course. If you have questions about the material, please attend one of our office hours or post a question on Piazza. We will only use email to communicate about personal or confidential matters.

Tal's office hours: If you'd like to attend my office hour, please sign up for a slot on this spreadsheet; do not show up without an appointment. To maximize access to office hours, the timing of the office hour may change from week to week, if there is sufficient demand. Please let me know if you're unable to attend my office hour due to a conflict and I'll try to schedule it at a different time the following week. My office hour is most appropriate for conceptual questions about course material and computational cognitive science more generally; technical issues and questions about the homework are best discussed in the lab section or the TA's office hour.

Piazza: We will be using a Piazza site to make announcements and answer questions. Students who were enrolled at the beginning of the semester should have received an invitation to join the Piazza site. If you have not eceived an invitation for any reason, you can also add yourself to the site.

Laptop policy: Cognitive scientists have found that laptop use in the classroom can lead to lower test scores:

Raviza, S. M., Uitvlugt, M. G., & Fenn, K. M. (2016). Logged in and zoned out: How laptop Internet use relates to classroom learning. Psychological Science, 28(2), 171–180.

See also the New York Times opinion piece, Laptops Are Great. But Not During a Lecture or a Meeting.

We recommend that you avoid using your laptop in class, except for activities that are directly related to the class (e.g., following a Jupyter notebook in lab sessions). Consider taking notes with a pen and paper. If you prefer to use your laptop, please avoid checking social media and using your laptop for any other activities that are not related to the class. Failure to observe this policy will affect your participation grade.

Anxiety, Stress and Mental Health: If you are struggling with anxiety, stress, depression or other mental health related concerns, please consider visiting the JHU Counseling Center. If you are concerned about a friend, please encourage that person to seek out their services. The Counseling Center is located at 3003 North Charles Street in Suite S-200 and can be reached at 410-516-8278 and online.

Disability services: Any student with a disability who may need accommodations in this class should obtain an accommodation letter from Student Disability Services, studentdisabilityservices@jhu.edu, 385 Garland, (410) 516-4720. Please bring it to our attention as early as possible so we can do the best we can to accommodate your needs.

Ethics policy

The strength of the university depends on academic and personal integrity. In this course, you must be honest and truthful. Ethical violations include cheating on exams, plagiarism, reuse of assignments, improper use of the Internet and electronic devices, unauthorized collaboration, alteration of graded assignments, forgery and falsification, lying, facilitating academic dishonesty, and unfair competition. Please report any ethics violations you witness to the instructor. You may consult the associate dean of student affairs and/or the chairman of the Ethics Board beforehand. See also the Guide on Academic Ethics for Undergraduates and the Ethics Board Web site. In particular:

Do not cheat. You are encouraged to talk with other students about the content of the course, and to use written material (lecture slides, the readings, external websites, newspaper/magazine stories, and so on) as sources, but your written work must be original to you, with the exception of short quotes that are clearly indicated as such (see next paragraph).

Do not plagiarize. If you quote directly from a book or other resource, please indicate this with quotes ("...") and a parenthesized citation after the quoted material; in any case, do not quote extensively from other sources. If you are simply paraphrasing a portion of a resource, leave off the quotes but keep the citation. Use a simple format for citations, for example: "human language syntax is not regular (Chomsky 1957: pages xxx-xxx)".

Course requirements

Your responsibilities for the course are:

Attendance: Students are expected to attend all of the meetings of the class. We will occasionally check attendance. Please email your TA in advance if you need to miss a meeting for religious, health or any other valid reason. Do not come to class if you're sick; you do not need to bring a doctor's note, but again, do email your TA in advance to let us know you'll be missing class. Repeated unexplained absence will have consequences beyond the participation grade and may result in failure in the class.

Participation: Participation will count for 10% of the grade. To obtain the full participation grade, students are expected to attend classes regularly, participate in the discussion and only use their laptops for class-related purposes. Be advised that this part of the grade is most certainly not an automatic 10% bonus (ask the students who took this class last year!): if you obtain a perfect score on the homework assignments and exams, but never participate and attend irregularly, your grade will be 90 (A-). Make sure not to dominate the discussion, however: give space to all of the students to participate.

Exams: There will be two non-cumulative in-class exams, one on Tuesday, Oct 8 and another on Thursday, Dec 5. There will not be an additional exam during finals period. Each of the exams will make up 25% of the grade. A review session will be held before each exam; the review sessions will be scheduled during normal class hours (in the lecture immediately before each exam). There will be no make-up exams, with the exception of documented emergencies and requests approved in advance by the instructor. In all other cases, the grade for the missed exam will be 0.

Homework assignments: There will be ten homework assignments over the course of the semester. The homework assignments will include very short essays about the readings, problem sets reinforcing mathematical concepts, and short programming assignments. All ten homework assignments must be submitted to pass the class. The homework assignments will make up 40% of the grade: 5% for each of the eight homework assignments with the highest grades.

Late homework assignments: You have a budget of 15 late days that you can use as you see fit. Late days cannot be subdivided into smaller units; for example, an assignment that is 27 hours late will cost you two late days. Every late day exceeding this budget will result in the deduction of two grade points (of the overall grade for the class). Note that late days are meant to cover all eventualities such as short illnesses, unexpected family obligations, or technical issues with your computer. Don't use all of your late days early in the semester: for fairness reasons, I will not authorize additional late days.

Readings: There is no required textbook. All of the readings will be available for download from this page.

Course outline

The topics and readings may change during the semester, depending on our rate of progress and interests.

Foundations

Concepts and learning

Probabilistic inference

Formal grammars

Reinforcement learning

Artificial neural networks

Language acquisition across modeling approaches

Vision across modeling approaches

Contemporary artificial intelligence and cognitive science

Optional reading:

Labs

Tentative lab schedule:
8/30Introduction to Python (1)
9/6Introduction to Python (2)
9/13Probability
9/20Models of concept learning; Bayesian inference
9/27HW2 review; Bayesian inference (continued)
10/4HW3 review; midterm Q&A
10/11No lab (midterm)
10/18No lab (fall break)
10/25HW4 and HW5 review; neural networks
11/1HW6 review; neural networks
11/8Neural networks
11/15Computational models of vision
11/22
11/29No lab (Thanksgiving)
12/6No lab (last week)

Grading

Extra credit: Extra credit of up to 2% of the total grade will be available for participating in one or more cognitive science or psychology experiments. Four SONA credit hours will be counted as 1% of the total grade. There will be no additional extra credit opportunities.

Grade composition:

Letter grades: We will use the following key to assign letter grades:

Number Letter
97–100A+
93–96A
90–92A-
87–89B+
83–86B
80–82B-
77–79C+
73–76C
70–72C-
60–69D
0–59F