Skip to main content

AI-generated Video Incorporated Into Classical Music Performance

About HKAPA About HKAPA.
AI-generated Video Incorporated Into Classical Music Performance

Jason Li, School of Music (Year 4) explores how AI technology can be leveraged to enhance vocal performances through his Honor's Project. You are invited to join Jason's lecture-demonstration of Robert Schumann's song cycle Dichterliebe. This performance incorporates AI-generated videos by Midjourney and Runway AI, that narrate the romance between Schumann and his fiancée, Clara Schumann.

1/3

What is Midjourney and Runway AI?

Midjourney is a generative AI program used to create images from text prompts. It allows users to input text descriptions, and the AI then generates corresponding visual images. Midjourney is accessible primarily through a Discord bot, where users can interact with the AI to produce images. 

 

Runway AI is a software platform that enables users to create, edit, and manipulate multimedia content using AI models. It is a useful and innovative tool for creative professionals and business leaders who want to explore the possibilities of AI for their projects and goals.

 

The making of
Reimagining Robert Schumann's Dichterliebe

An Experiment Project on Classical Music Performance Integrating AI Technology

Reimagining Robert Schumann's Dichterliebe