http://UDUK.ORG (ZerFretSung) - The Shredfulness

Given an arbitrary backing track (format: wav, mp3) can computer shred ? 
o   o o-o   o   o o  o 
|   | |  \  |   | | /  
|   | |   O |   | OO   
|   | |  /  |   | | \  
 o-o  o-o    o-o  o  o

Algorithmic Shredding
  • http://github.com/uduk/uduk-algorhythmm

    • Procedural Steps:
  • Probe1: Estimate base tempo - see below
  • Probe2: Detect significant beat - timing alignment, time-signature intersection (w/ space partitioning) - see below
  • Collect all frequencies pitch - see below
  • Estimate base chord, populate scales and intersection - http://uduk.org/scale.json
  • Query importance from Harmonic Table - https://en.wikipedia.org/wiki/Harmonic_table_note_layout
  • Methods: HMM, randomwalk, kdtree, etc ...
  • Pre-generated rule-based dataset, and/or scale coloring: i.e John Petrucci, etc
  • UDUK SALT Method - Sweep Alternate Legato Tapping
  • Mark pitch-shifter, pitch-bending positioning - MIDI Event
  • Zhred()

    • Advance real-time technique to consider (non-browser):
  • input-based high quality MIC
  • sample detect beat - pitch
  • parallel background-process - p_thread 1 estimation & measuring p_thread 2 zhred generation p_thread n ...
  • real-time Zhred()
  • http://alsa.opensrc.org/Record_from_mic

    • Sample Demo - pre-selected canvas sketching (not automatic)
  • https://www.youtube.com/watch?v=r7MUdRifVNY
  • https://www.youtube.com/watch?v=Sl_WTGp7wPU

    • Reference:
  • https://github.com/cwilso/PitchDetect
  • https://jmperezperez.com/beats-audio-api/
  • http://joesul.li/van/beat-detection-using-web-audio/
  • https://www.w3.org/TR/webaudio/
  • https://www.w3.org/TR/webmidi/
  • https://en.wikipedia.org/wiki/Space_partitioning
  • http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.20.5803
  • http://www.nytimes.com/interactive/2011/04/18/science/20110419-music-expression.html?_r=0
  • https://www.cs.ucf.edu/~dcm/Teaching/COT4810-Spring2011/Literature/ComputerSystemsForMusic.pdf
  • https://gist.github.com/webapprentice/7878474

    • Web Audio API
  • http://chimera.labs.oreilly.com/books/1234000001552/ch01.html#s01_5
  • https://developer.apple.com/library/safari/documentation/AudioVideo/Conceptual/Using_HTML5_Audio_Video/PlayingandSynthesizingSounds/PlayingandSynthesizingSounds.html
  • http://webaudioapi.com/samples/visualizer/
  • http://www.smartjava.org/examples/webaudio-filters/#
  • https://developer.mozilla.org/en-US/docs/Web/API/Web_Audio_API/Visualizations_with_Web_Audio_API
  • https://developers.google.com/web/updates/2012/05/requestAnimationFrame-API-now-with-sub-millisecond-precision?hl=en

  • http://joshondesign.com/p/books/canvasdeepdive/chapter12.html

    • Tempo

    Beat zhred schedule

    Note