Communications Lab: Hypercinema
Fall 2020, Fall 2021, Spring 2021, Fall 2022
Description
4 Credits / 14 Weeks
Storytelling is a powerful method of communicating messages and engaging an audience. Whether you are building an expressive narrative world, documenting existing work, or pitching a new project, a carefully crafted story is a meaningful way to connect with others. Communications Lab: Hypercinema will examine new forms of communication and storytelling through an investigation of time-based and interactive media. This course will cover principles of interpersonal communication, media theory and collaborative storytelling through a series of weekly assignments and labs. Over the course of the semester, students will become comfortable with the basics of time-based and interactive media, and examine the contexts in which this media exists in society, both historically and in current practice. Topics include: sound art, video, animation, immersion and interactivity and real time 3d game engine environments.
Real Time Social Spaces: Building Video & Audio Interactions for the Web
Spring 2021, Spring 2022, Fall 2022, Spring 2023
Description
4 Credits / 14 Weeks
Over the past 3 years, we have seen many aspects of our lives thrust online. Increasingly, we are working, learning, socializing with family and friends, attending live performances and more through 2D grids of video feeds on platforms such as Zoom and Google Meet. These communication tools have become essential for remote communities to connect, yet fail to replicate many of the most engaging, messy and human aspects of our in-person experience. What happens when we break out of this grid and explore new forms of real-time social interactions online using webcam video and audio?
Some recent explorations in this realm (including gather.town, topia.io and ITP’s own YORB.itp.io) have shown the promise of spatial metaphors in creating engaging real-time social interactions online. In this course, students will create their own series of experimental social spaces that explore these questions: how does the shape and nature of our environment affect the way we communicate? What unique forms of real-time expression and sharing might be possible online (and only online)? How might we design experiences for the unique social dynamics we want to support?
Students will be exposed to principles of spatial design as well as a series of open source Javascript tools for arranging live webcam video and audio in 2D and 3D space in the browser. They will use WebGL (through the THREE.js library) to build 2D and 3D environments, and will be exposed to WebRTC (Web Real-Time Communications) and Node.js to add interactivity to those environments.