Overview

At Humelo (휴멜로), led the development of AI systems for music composition, lyrics generation, and rap synthesis. This project combined deep learning with music theory to create AI-aided music, culminating in collaborations with major K-pop artists, presentation at SXSW 2019, and a feature in a KBS Documentary with professional rapper Sleepy.

Key Achievements

  • SXSW 2019: Presented AI-aided music production at South by Southwest in Austin, Texas
  • SM Entertainment Collaboration: Worked with SM Entertainment through KOCCA’s “Music X A.I.” program
  • KBS Documentary Feature: Featured on KBS1 Documentary “New-contents, changing the world” with professional rapper Sleepy
  • Media Coverage: Covered by 10+ national media outlets
  • Artist Collaborations: Created AI-generated music with Korean hip-hop band XXX, rapper Sleepy, and other artists
  • Patents: Multiple registered patents for polyphonic music generation systems

Technical Approach

ALPHACH - LSTM-based Chord Progression Melody Composing

Developed an AI system (ALPHACH) for music composition using LSTM-based models capable of:

  • Generating chord progressions based on music theory constraints
  • Creating melodic compositions over generated chord sequences
  • Polyphonic music generation using LSTM and polynomial approaches

Lyrics Generation and Rap Synthesis

Created a system for automated lyrics generation and rap synthesis that:

  • Generates contextually coherent rap lyrics
  • Synthesizes rap vocals for collaboration with human artists
  • Featured in the collaboration with professional rapper Sleepy on KBS Documentary

AI-Aided Music Production (SXSW 2019)

SXSW 2019 Showcase: “XXX - Flight Attendant”

  • Integrated sound and visual interpretation
  • Collaborated with XXX (Korean Hip-hop Band), Seonggu de Kim (Sound Designer, DJ), and Seong Pil Kim (Visual Artist)

Tech Stack

  • Deep Learning: Seq2Seq, LSTM, Polynomial models for music generation
  • NLP: Lyrics generation, text processing
  • Audio: Sound synthesis and rap vocal generation
  • Framework: TensorFlow

Music X AI Poster

Period

2017 - 2019

Impact

This work demonstrated that AI could be a creative partner in artistic endeavors, opening new possibilities for human-AI collaboration in music and entertainment. The extensive media coverage across 10+ national outlets and the KBS Documentary feature brought significant public attention to AI-generated music.

Publications

  • Jungbae Park, Jaryong Lee, Sang Wan Lee - “A New Approach for LSTM Polynomial Melody Composition based on Finite Chord Progression” (Korea Intelligent Information System Conference, 2017 Spring)

Patents

  • System, Device, and Method to Generate Polyphonic Music (KR 1022274150000, registered; PCT/KR2019/003333 applied)