Chatbots for Art’s Sake

NYU IMA, Spring 2025 // Instructor: Carrie Sijia Wang

QUICK LINKS:

Week 6: 02/24 & 02/26

Week 7: 03/03 & 03/05

Week 8: 03/10 & 3/12

Week 9: 03/17 & 03/19

Week 10: 03/31 & 04/02

Week 11: 04/07 & 04/09

Week 12: 04/14 & 04/16

Week 13: 04/21 & 04/23

Week 14: 04/28 & 04/30

Week 15: 05/05

About


CLASS INFORMATION

Time: Mondays & Wednesdays 3:40 – 5:10 pm

Location: 370 Jay St., 409

Instructor: Carrie Wang / [email protected] / Office Hour Signup

Support:

Coding Lab

Design Lab

Documentation Lab

ITP Residents Office Hours
Scroll down to “Research Residents.”


DESCRIPTION

This course is designed to repurpose existing chatbot technologies and use them for the sake of art. Comprising technical labs, design workshops, thematic seminars, and creative project development, it offers an exploration of the historical, present, and future dimensions of conversational AI; and the various roles AI has played and could play in human society. Students will delve into the design elements of conversational AI, and learn to use different techniques— such as RiveScript, p5.speech, APIs, Markov Chains, and Language Models—to create functional and artistic chatbots. The course expects students to conduct research and complete creative assignments, encouraging them to express their unique artistic visions.


LEARNING OBJECTIVES

At the completion of this course, the students will:

  1. Creatively adopt chatbot technologies to complete artistic projects.
  2. Have a better understanding of the process of project development from ideation to completion.
  3. Develop a set of skills to build functional chatbots.
  4. Learn to think critically about how technology is shaping the world we live in.

TEACHING METHODOLOGY

This is a 14-week course that meets twice a week. Class time is divided into topic-based lectures and discussions, design and content development workshops, technical labs and experiments, creative project development and presentations.

This course values critical thinking about technology and society as much as learning programming skills.


CREATIVE ASSIGNMENTS

  • All creative assignments are due in the form of in-class presentations.
  • Students are required to complete functional projects following specific requirements, document their processes, and present in class.

INDEPENDENT RESEARCH ASSIGNMENTS

  • Throughout the semester, every student will be assigned a selection of materials as a basis for further research.
  • Students are required to conduct research, come up with their own unique interpretation of the assigned materials, and present their reflections in class.

FINAL PROJECT

  • The course will culminate with the completion of a final project to be shared in class.
  • We are expected to push our abilities to produce something that builds off or is inspired by the concepts we cover during the semester.

EVALUATION

Grades will be determined according to this criteria:

  • Participation (including research presentations) and Attendance 40%
  • Creative Assignments 30%
  • Final Project 30%

To do well in this class, you should make efforts to learn and explore the lecture/research topics, design concepts, and technical tools. You are expected to complete all the assignments on time, have things to show for the in class presentations, and actively participate in discussions.


ASSIGNMENTS 

Homework assignments must be documented (written description, photos, screenshots, screen recording, code, and video all qualify based on the assignment). Each assignment has a due date as stated.

Each assignment will be marked as complete (full credit), partially complete (half credit), or incomplete (no credit). To be complete, an assignment should meet the criteria specified in the syllabus including documentation. If significant portions are simply not attempted it may be marked partially complete.  If an attempt isn’t made to meet the criteria specified it will be marked incomplete.

COMMUNICATION

You must check your email for important updates about class.

PARTICIPATION

ITP/IMA is committed to facilitating the fullest possible participation of all students. There are many forms of participation. Please communicate what kinds of engagement are best for you so it can be taken into account.

Examples of modes of participation can look like: asking questions, going to office hours, sending and reading emails, class group discussion, arriving on time, going to class, taking notes, listening to peers, submitting responses to a form (anonymous or not), following instructions, active listening, etc.

Attendance

Attendance is mandatory. Please email your instructor if you are going to miss a class. After the first two weeks of the add/drop period, effective in week three onward, students are permitted the following number of absences: 3 absences.

Any more than 3 absences after add/drop will affect your grade. Two late arrivals (more than 10 minutes after start time) will count as 1 absence. 

For example:

4 absences will result in your highest possible grade being a B instead of an A

5 absences will result in your highest possible grade being a C instead of an A

6 absences will result in your highest possible grade being a D instead of an A

7 absences will result in an automatic F for the course


STATEMENT OF ACADEMIC INTEGRITY

Plagiarism is presenting someone else’s work as though it were your own. More specifically, plagiarism is to present as your own: A sequence of words quoted without quotation marks from another writer or a paraphrased passage from another writer’s work or facts, ideas or images composed by someone else.

Collaboration is highly valued and often necessary to produce great work. Students build their own work on that of other people and giving credit to the creator of the work you are incorporating into your own work is an act of integrity. Plagiarism, on the other hand, is a form of fraud. Proper acknowledgment and correct citation constitute the difference. 

Link to the Tisch Student Handbook 

Link to Suggested Practices for Syllabus Accessibility Statements 

STATEMENT ON ACCESSIBILITY

It’s crucial for our community to create and uphold learning environments that empower students of all abilities. We are committed to create an environment that enables open dialogue about the various temporary and long term needs of students and participants for their academic success. We encourage all students and participants to discuss with faculty and staff possible accommodations that would best support their learning.  Students may also contact the Moses Center for Student Accessibility (212-998-4980) for resources and support. Link to the Moses Center for Student Accessibility 

STATEMENT ON COUNSELING AND WELLNESS

Your health and safety are a priority at NYU. Emphasizing the importance of the wellness of each individual within our community, students are encouraged to utilize the resources and support services available to them 24 hours a day, 7 days a week via the NYU Wellness Exchange Hotline at 212-443-9999. Additional support is available over email at [email protected] and within the NYU Wellness Exchange app. Link to the NYU Counseling and Wellness Center

STATEMENT ON USE OF ELECTRONIC DEVICES

Laptops and other electronic devices are essential tools for learning and interaction in classrooms. However, they can create distractions that hinder students’ ability to actively participate and engage. Please be mindful of the ways in which these devices can affect the learning environment, please refrain from doing non-class oriented activities during class.

STATEMENT ON TITLE IX

Tisch School of the Arts is dedicated to providing its students with a learning environment that is rigorous, respectful, supportive and nurturing so that they can engage in the free exchange of ideas and commit themselves fully to the study of their discipline. To that end, Tisch is committed to enforcing University policies prohibiting all forms of sexual misconduct as well as discrimination on the basis of sex and gender. Detailed information regarding these policies and the resources that are available to students through the Title IX office can be found by using the following link: Link to the NYU Title IX Office 

STATEMENT OF PRINCIPLE

Teachers and students work together to create a supportive learning environment. The educational experience in the classroom is one that is enhanced by integrating varying perspectives and learning modes brought by students. 


CODE OF CONDUCT

Our signature is collaboration – Not competition.
– Red Burns

We live in a fractured world where communities are burdened by differences – so what we ask of you is nothing short of miraculous.
— Red Burns

ITP/IMA is a community whose mission is to explore the imaginative uses of emerging technologies — to make people’s lives safer, more just, more beautiful, more meaningful, and more fun. We pledge to act and interact in ways that contribute to an open, welcoming, diverse, inclusive, and healthy community.

The scope of this Code of Conduct applies to all ITP/IMA community members (faculty, staff, students, residents, fellows, and guests), ITP/IMA physical and digital spaces (e.g. Email listservs, Yorb, and ITP/IMA Discord server), and all courses, events, and projects created at or in service to ITP/IMA.

SOLIDARITY

We are a community of and in solidarity with, people from every gender identity and expression, sexual orientation, race, ethnicity, language, neuro-type, all visible or invisible disability, body size, ability, class, religion, culture, subculture, age, skill level, occupation and background. As a result, we continually work to make participation in our community a harassment-free experience for identities above as well as all levels of experience, education and socio-economic status.

INTERNATIONAL

Our student body typically has a large International student presence. We understand that, by the nature of being established in New York, our curriculum and social environment naturally centers events and histories specific to the United States of America. We know that a large percentage of our student body are international and we will continue to incorporate, celebrate and acknowledge events and histories from those countries with respect and an open mind.

We align ourselves with any values in pursuit of equity and freedom for all identities and, by that nature, are in alignment with similar views in International countries as well.

LAND ACKNOWLEDGEMENT

We acknowledge that we are gathered on the unceded land of the Lenape and Canarsie peoples. We acknowledge the Lenape and Canarsie communities, their elders both past and present, as well as future generations.

We also acknowledge that NYU, Tisch School of the Arts, and ITP were founded upon exclusions and erasures of many Indigenous peoples, including those on whose land this institution is located. This acknowledgement demonstrates a commitment to beginning the process of working to dismantle the ongoing legacies of settler colonialism.

PRIVILEGE

We recognize that simply being part of the ITP/IMA community places us in a privileged position as we have the opportunity to receive an education from a private, expensive and prestigious university. We know that there are many equally talented students around the world who would like to partake of this community and, due to academic inaccessibility, it is not possible. We know and will continue to acknowledge that our privilege does not mean that we have more value than other people. We acknowledge this inequality and hold personal responsibility to share what we do in the spirit of inclusivity and create access where we can, as often as we can. We will use this privilege as a tool to help those most in need.

TECHNOLOGY

We pledge to center creative and ethical uses of technology in our research, teaching, and making. We accept the claim that technology is a reflection of society, its histories, and its politics. We reject the claim that technology is neutral and acknowledge that every technology has the potential to do as much harm as good. We acknowledge that when technologies cause harm, the harm disproportionately affects Black, Brown, Indigenous, People of Color (BIPOC), queertrans, disabled, femme, low-income, survivors, and all other marginalized bodies and communities worldwide.

Schedule


Week 1: Overview + History

Session 1: History // Wednesday 01/22

SLIDESHOW

In Class:

  • Introductions
  • Course Overview
  • A Brief History
  • Group Activity: A Turing Test!

Homework

Mini Research: Due 01/27

See requirements here.


Week 2: Current Landscape of Text-Based AI

Session 1: Share Mini Research // Monday 01/27

SLIDESHOW

In Class:

  • Share Mini Research
Session 2: Landscape // Wednesday 01/29

SLIDESHOW

In Class:

  • Chatbot + Art?
  • How to Make a Chatbot
  • Large Language Models and Generative AI
  • Group Activity: A Chatbot Version of You

Homework

Thinking About the Future

Our first creative project (to be assigned next week) will be about predicting the future of conversational AI. For this week, start doing some initial research, gather thoughts and materials regarding possible futures. What are the news headlines about AI nowadays? What are some popular predictions about AI’s future impact regarding our everyday lives, what kind of jobs we will do, who will have more power in the society, opportunities versus risks? Can you find blueprints for alternative futures in fictional works about AI?

Independent Research 01: Due 02/03

See requirements here.


Week 3: Scenarios of the Future

Session 1: RiveScript Intro // Monday 02/03

SLIDESHOW

In Class:

  • Independent Research: History
  • Creative Assignment #1: Can You Predict the Future? – A Performance
  • Introducing RiveScript
  • Code a RiveScript Bot
Session 2: Versions of the Future + Conversation Writing // Wednesday 02/05

SLIDESHOW

In Class:

  • Versions of the Future
  • Group Activity: Predict the Future & Write a Conversation

Homework

Creative Assignment #1: Can You Predict the Future? — A Performance: Due 02/18

See requirements here.

For this week, focus on writing the conversation and getting the RiveScript part to work.

Independent Research 02: Due 02/10

See requirements here.


Week 4: Homage to the Human Voice

Session 1: Voice Design History + Methods // Monday 02/10

SLIDESHOW

In Class:

  • Independent Research: Voice
  • Voice Interface
  • Characteristics of the Human Voice
  • A Brief History of Voice Synthesis
  • A Little About Speech Recognition
  • Related Projects
Session 2: Voice Design Tools // Wednesday 02/12

SLIDESHOW

In Class:

  • p5.speech Basics
  • Combine p5.Speech with RiveScript Chatbot
  • Other Voice Design Tools
  • Voice Design Exercise

Homework

Creative Assignment #1: Can You Predict the Future? — A Performance: Due 02/18

See requirements here.

For this week, design and add a voice for the AI. Get ready to share the performance, and talk through your future predicting, conversation writing, and voice design process in class next week.


Week 5: Creative Assignment #1 Presentations

Session 1: Creative Assignment #1 Presentations // Tuesday 02/18

FOLDER

Session 2: Creative Assignment #1 Presentations // Wednesday 02/19

FOLDER

Homework

Independent Research 03: Due 02/24

See requirements here.


Week 6: Building a Character

Session 1: Roles AI Plays // Monday 02/24

SLIDESHOW

In Class:

  • Independent Research: Character
  • Creative Assignment #2: A Chatbot with a Personality
  • AI in Fiction
  • AI in Reality
  • Relevant Art Projects
  • Character Design
Session 2: Character Building Tools // Wednesday 02/26

SLIDESHOW

In Class:

  • Creative Assignment #2: Guided, Open, or Combo
  • A Guided Experience with RiveScript
  • An Open Conversation with OpenAI API
  • Character Design Continued

Homework

Creative Assignment #2: A Chatbot with a Personality: Due 03/10

See requirements here.

For this week, focus on building the character (appearance, voice, and more), exploring the tools introduced, and do some conversation/instruction writing.

Independent Research 04: Due 03/03

See requirements here.


Week 7: Interface & Experience Design

Session 1: AI Interface & User Experience // Monday 03/03

SLIDESHOW

In Class:

  • Independent Research: Interface
  • Share Character Design and Technical Prototype
Session 2: AI Interface & User Experience // Wednesday 03/05

SLIDESHOW

In Class:

  • User Experience and User Interface Design
  • Real-World AI Interfaces
  • Sci-Fi AI Interfaces
  • Interface & Experience Design Exercise

Homework

Creative Assignment #2: A Chatbot with a Personality: Due 03/10

See requirements here.

Refine the interface and experience design of your AI character. Do some user testing with friends and classmates. Complete the assignment and get ready to present in class.


Week 8: Creative Assignment #2 Presentations

Session 1: Creative Assignment #2 Presentations // Monday 03/10

FOLDER

Session 2: Creative Assignment #2 Presentations // Wednesday 03/12

FOLDER

Homework

Midterm Survey: Due 03/17

Independent Research 05: Due 03/17

See requirements here.


Week 9: Who Is the Machine Learning From?

Session 1: Data in AI and Markov Chain // Monday 03/17

SLIDESHOW

In Class:

  • Data in AI
  • Independent Research: Data
  • Markov Chain
Session 2: Markov Chain Experiment // Wednesday 03/19

SLIDESHOW

In Class:

  • Data Collection
  • Data Processing
  • Coding a Bot
  • Reflections
  • Relevant Projects

Homework

Bring a Project That Inspires You – Due 03/31

Post a link to a project that inspires you here.

Independent Research 06: Due 03/31

See requirements here.


Week 10: Ethical AI

Session 1: Ethical AI + Assign Final Project // Monday 03/31

SLIDESHOW

In Class:

  • Independent Research: Ethical AI
  • Assign Final Project
  • Share Inspirations
Session 2: CharRNN & ml5.js // Wednesday 04/02

SLIDESHOW

In Class:

  • Markov Chain, CharRNN, & GPT Models
  • Using a Desktop Editor
  • CharRNN & ml5.js Demo
  • More Examples
  • Hosting on Glitch

Homework

Final Project Proposal Presentation: Due 04/07

Final Project Requirements and Timeline

Decide on an idea for your final project. Start doing research and preliminary design. Put a comprehensive proposal and plan together. Add your slides to this folder. Be prepared to share your proposal in class.


Week 11: Final Project Research & Pitch Presentations

Session 1: Final Project Proposal Presentations // Monday 04/07

FOLDER

Session 2: Final Project Proposal Presentations // Wednesday 04/09

FOLDER

Homework

Final Project Work-in-Progress Share: Due 04/14

Final Project Requirements and Timeline

Make progress on your project. Get ready to meet with the instructor and share your work on character design, conversation design, interface design, technical functionality, and your thoughts on usertesting.


Week 12: Final Project Work-in-Progress

Session 1: Final Project 1:1 Meetings // Monday 04/14
Session 2: Final Project 1:1 Meetings // Wednesday 04/16

Homework

Final Project Proof of Concept: Due Monday 04/21

Final Project Requirements and Timeline

Get your project to work in the most basic way. Have something at least partially functional for your classmates to test out!


Week 13: Final Project Usertesting

Session 1: Usertesting Part 01 // Monday 04/21
Session 2: Usertesting Part 02 // Wednesday 04/23

Homework

Final Project Presentations: Due 04/28

Final Project Requirements and Timeline

Document your project and prepare a presentation to share. Make sure to include: a brief introduction, your intention and target audience, your research and design process, a demo or video of your project, the tools you used to realize your concept, and your next steps.


Week 14: Final Project Presentations

Session 1: Presentations Part 01 // Monday 04/28

FOLDER

Session 2: Presentations Part 02 // Wednesday 04/30

FOLDER


Week 15: Flexible Class

Session 1: Flexible Class // Monday 05/05