AMT Lab @ CMU

View Original

In What Ways is AI Disrupting the Dance Industry?

By: Yikun Yang

Introduction

Artificial Intelligence (AI) is transforming industries by enabling computers to perform tasks like learning, pattern recognition, and decision-making. It’s integrated into daily life through virtual assistants, self-driving cars, and healthcare diagnostics. In the realm of dance, AI has revolutionized training, choreography, and performance. This article explores AI’s impact on the dance industry, and its potential to enhance accessibility, not only for dance but for performing arts at large.

ai in training

AI is now used in professional training by dancers. DancingInside is a groundbreaking system that leverages AI technology to revolutionize the landscape of online dance learning.

Figure 1: Learning Cycle in DancingInside
Source: Dancing on the inside: A qualitative study on online dance learning with teacher-AI cooperation

This innovative platform addresses the challenges of remote and asynchronous dance education by providing timely and comprehensive feedback through a teacher-AI collaboration. DancingInside incorporates an AI-based tutor agent that quantitatively assesses the similarity between a learner’s movements and those of a teacher using a 2D pose estimation approach. A recent two-week user study showcased its potential to support learners in refining their dance skills, marking a significant step forward in the realm of dance education.

This transformative technology empowers dancers to receive invaluable feedback that enhances their proficiency and comprehension of dance techniques, irrespective of their physical location. It democratizes dance education, breaking geographical barriers and expanding access to learners worldwide.

Notably, this disruptive force acknowledges the indispensable role of human teachers in providing holistic assessments and social feedback, thereby fostering a harmonious blend of AI and human expertise. The result is a groundbreaking approach to dance instruction that promises to redefine how individuals learn and excel in dance, ushering in a new era of innovation and accessibility.

AI in Choreography

Choreography is the core of dancing, and now AI can help choreographers make more creative and even quicker choreography. Several examples have put the idea into practice:

The Living Archive, a pioneering platform, utilizes AI and machine learning to catalog and analyze an extensive archive of dance performances, providing dancers and choreographers with a wealth of historical references and inspiration. Inspired by the neural network predicting the form of the next letter people will write based on the handwriting in the previous letter, this algorithm can make predictions for the dancer’s next move and give options for dancers to choose from.

Video 1: An AI Experiment with Wayne McGregor

Source: Living Archive by Wayne McGregor

Discrete Figures, developed by Rhizomatiks in collaboration with Kyle McDonald, employs real-time motion capture and AI algorithms to create mesmerizing, dynamic visualizations of dance movements. This is achieved by leveraging Openpose (a system that tracks and records poses from movie scenes and public stage footage) and creating a pose analysis system. It extends its capabilities by capturing and integrating audience movements into live performances. Motion data from dancers is processed, visualized in two or three dimensions using dimension reduction techniques, and explored for various dance styles.

Video 2: discrete figures at Spiral Hall Tokyo

Source: Rhizomatiks with Kyle McDonald

LifeForms, known for its intuitive interface, empowers dancers to craft intricate choreographies by sketching on a digital canvas, harnessing AI to transform concepts into seamless dance sequences. The program’s founder, Merce Cunningham, adopted it to innovate his choreography. Using avatars as proxies for his dancers, he ventured into unconventional movements beyond his physical capabilities and traditional methods. Cunningham’s pioneering method involved meticulous adjustments of the avatars’ joint movements to unlock unforeseen potential. Additionally, he incorporated Motion Capture technology to introduce digital figures that interacted with his dancers on stage, as exemplified in “BIPED.” This fusion of creative thinking and cutting-edge technology expanded dance possibilities.

Video 3: “BIPED” Trailer

Source: Merce Cunningham + BIPED: Meet the master artist through one of his most important works

EDGE Dance Animator offers precision and efficiency through AI-driven motion analysis, assisting dancers in refining their techniques. A standout feature is its editability, allowing animators to intuitively edit various aspects of dance motion, enabling realistic, seamless, and music-aligned sequences.

Video 4: EDGE demonstrations

Source: AI-powered EDGE Dance Animator Applies Generative AI to Choreography

These AI-powered dance tools are collectively reshaping the dance industry by introducing revolutionary changes in choreography and artistic expression. They utilize advanced data analysis and creative generation, liberating dancers and choreographers from conventional limitations and providing access to a wealth of historical references while offering an innovative platform for experimentation. Yet, this transformative potential raises concerns about how AI might influence the distinctiveness of individual artistic expression and the ethical implications of technology’s role in shaping the future of dance. Nevertheless, these tools undoubtedly broaden the creative horizons and enhance accessibility in the dance realm, leading to a profound transformation of the industry for future generations.

AI as A Dancing Partner

In the ever-evolving landscape of the dance industry, two groundbreaking innovations are poised to make a lasting impact: LuminAI and Hyundai’s robot project.

LuminAI, powered by artificial intelligence, serves as both a training partner and a capable dance performer. This remarkable technology excels in learning and replicating dance movements with exceptional precision, offering dancers an invaluable tool for practice and collaboration. Imagine having an AI partner who seamlessly mirrors your moves, aiding dancers in honing their skills and exploring creative possibilities. LuminAI is set to disrupt the dance industry by enhancing the learning process and expanding avenues for artistic expression.

Video 5: LuminAI demonstrations

Source: LUMINAI

Furthermore, Hyundai’s collaboration with Boston Dynamics introduces a compelling example of AI in the form of robots. This collaboration led to the remarkable spectacle of robots dancing alongside the world-famous K-Pop boy group BTS.

Video 6: Hyundai x Boston Dynamics | Robots dancing with BTS

Source: Hyundai x Boston Dynamics | Welcome to the Family with BTS

Look Into the Future

Accessibility is a critical aspect of the arts industry, and the integration of AI and technology holds immense potential for enhancing this accessibility.

At its core, accessibility in the arts is about ensuring that everyone, regardless of their physical or cognitive abilities, can fully participate in and enjoy artistic experiences. This includes addressing barriers that might prevent people with disabilities from engaging with the arts, whether they are physical obstacles in accessing venues or sensory limitations in experiencing performances.

AI and technology are poised to revolutionize accessibility in the arts. By leveraging these tools, we can create more inclusive environments and experiences that cater to a diverse audience. This is not just a futuristic vision; some applications are already in development or use, demonstrating the potential of AI in this field.

For instance, consider platforms like DancingInside. These platforms exemplify how AI can make arts more accessible. They offer an opportunity for individuals who face challenges in attending traditional, offline dance studios – such as those with mobility issues or chronic illnesses like Parkinson’s disease – to learn and enjoy dancing. By using AI, these platforms can provide personalized, adaptive learning experiences that accommodate the unique needs and abilities of each user.

Looking ahead, AI’s role in enhancing accessibility can take many forms. One promising area is the development of systems that provide audio descriptions or tactile feedback for visually impaired audience members. Imagine an AI system that can analyze dance movements and translate them into descriptive audio or haptic feedback in real-time. This technology would open up new dimensions of experiencing performances for those with visual impairments, allowing them to perceive and appreciate the nuances of dance through alternative sensory channels.

Another area where AI can make a significant impact is in developing advanced sign language interpretation solutions. Utilizing natural language processing and computer vision, AI can facilitate accurate and real-time sign language translations. This technology would be invaluable for audiences with hearing issues, ensuring they can fully engage with and enjoy performances. Such AI-driven solutions could provide more nuanced and context-aware interpretations than traditional methods, enhancing the overall experience for those relying on sign language.

In summary, the integration of AI and technology in the arts holds great promise for improving accessibility. By addressing the unique needs of individuals with disabilities, AI can help create more inclusive and enjoyable artistic experiences for everyone. As these technologies continue to evolve, we can expect to see even more innovative and impactful applications in the realm of arts accessibility.