Presentation is loading. Please wait.

Presentation is loading. Please wait.

JamBot: Music Theory Aware Chord Based Generation of Polyphonic Music with LSTMs Gino Brunner, Yuyi Wang, Roger Wattenhofer, Jonas Wiesendanger Distributed.

Similar presentations


Presentation on theme: "JamBot: Music Theory Aware Chord Based Generation of Polyphonic Music with LSTMs Gino Brunner, Yuyi Wang, Roger Wattenhofer, Jonas Wiesendanger Distributed."— Presentation transcript:

1 JamBot: Music Theory Aware Chord Based Generation of Polyphonic Music with LSTMs Gino Brunner, Yuyi Wang, Roger Wattenhofer, Jonas Wiesendanger Distributed Computing Group ETH Zurich Switzerland TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AAAAAAA

2

3 12 notes Black and white keys of piano
G# A# C# C D E F G A H C D 12 notes Black and white keys of piano Same pitch interval between notes Notes names repeat

4 Scale Subset of the 12 Notes Defined by pitch intervals
G A H C# D# F# G# A# C# D# F# G# A# C D E F G A H Scale Subset of the 12 Notes Defined by pitch intervals e.g. major scale: 2→2→1→2→2→2→1

5 Key root note + scale e.g., C major C D E F G A H C# D# F# G# A# C# D#

6 Key root note + scale e.g., C major C D E F G A H C# D# F# G# A# C# D#

7 C D E F G A H C# D# F# G# A# C# D# F# G# A# C D E F G A H Chord Subset of two or more (usually three) notes played at the same time e.g., C major

8

9

10 LSTMs (Long Short-Term Memory)

11

12 Dataset MIDI (Musical Instrument Digital Interface) format
Like Sheet Music No Sound ~100’000 Songs

13 Scales of the Songs Only use songs in major scale
Shift all songs to same root note

14 time pitch pitch time

15 Extract Chords 1. Histogram of notes over every bar

16 1. Histogram of notes over every bar

17 1. Histogram of notes over every bar
2. 3 most played notes form chord 3. Assign id to 50 most occurring chords

18 Input: Output: 10-dimensional chord embedding
chord id embedded chord Output: Probability of every chord to be played in next bar

19 Input: Output: Probability of every note to be played in next timestep

20 Music Generation 1. 2. 3.

21 Midi Synthesizer

22 Chord Embeddings Circle of Fifths

23 Song 1 Instrument: Bright Acoustic Piano Tempo: 160 BPM

24 Song 2 Instrument: Electric Piano Tempo: 110 BPM

25 What’s Next? Instrumentation and Tempo Long Term Structure and Style
Note Duration and Velocity

26 ? JamBot TexPoint fonts used in EMF.
Gino Brunner TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AAAAAAA


Download ppt "JamBot: Music Theory Aware Chord Based Generation of Polyphonic Music with LSTMs Gino Brunner, Yuyi Wang, Roger Wattenhofer, Jonas Wiesendanger Distributed."

Similar presentations


Ads by Google