Transcribing Audio Recordings to the Guitar Fretboard Using Transformer Encoders

I transcribe a raw audio recording of a chord progression played on my guitar to its tablature representation. Moreover, I utilize the encoder-only transformer architecture to perform chord and key classification on the progression once the audio is represented as tablature. This project consists of four main parts: (1) in an audio pre-processing step, identify the time stamps of each chord onset and extract the frequency content from each corresponding chord window, (2) use an encoder to convert the frequency content into tablature, (3) use a second encoder to charcaterize the geometry of the chord shape and identify each chord, and (4) use a third encoder to classify the key of a sequence of the four most recently played chords.