From a395e55659b7fe0801913a8bd65e1babbcde0fcc Mon Sep 17 00:00:00 2001 From: Brian Jordan Date: Tue, 27 Mar 2012 20:55:20 -0400 Subject: move readme --- README | 88 --------------------------------------------------------------- README.md | 88 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2 files changed, 88 insertions(+), 88 deletions(-) delete mode 100644 README create mode 100644 README.md diff --git a/README b/README deleted file mode 100644 index 751efad..0000000 --- a/README +++ /dev/null @@ -1,88 +0,0 @@ -# Generating music based on video - * mp3 and add audio-ducking (potentially covered by iMovie) - * midi generation (tough algorithmically, maybe more of an april project or entire thesis) - * very hard, high likelihood of bad-sounding music - -* get a movie, get frames from the movie - * number of attribute variables from video - - * (maybe just analyze images?) - * build music from images - -# options: -## build movie image thing, do music later - -* Use EchoNest API to chop up songs into bars and allow users to mix and match, creating a new remixed song. Pick n' Mixer - -** Pros -- potentially fun to play with. Musically oriented -** Cons -- similar to garage band? Might not split up automatically though... - -# Echonest technique: - -## Movie -1. User picks video -2. User specifies song from library or URL (or we give list of available remote songs) -3. (automatically) API call to EchoNest and beat match songs -4. (automatically or user) build order of bars to fit video length (longer or shorter) -5. (automatically) duck music volume based on video volume -6. export back to library - -3 songs: -a. 1 2 3 [ … n-3] n-2 n-1 n (bars) -1 2 3 n-2 n-1 n (correct length) - -b. 1 2 3 4 5 -c. - -(interface) -movie -> image -> variables -> music - -# Variables from music (via echo nest): -* time signature -* key signature - - -# variables from movie: -## Video import/headers -* length of film (NSString *const MPMediaItemPropertyPlaybackDuration;)? - - Tracks -> Time -> [1][value] - -## With image analysis -* fade-out -* color content - -# Effects (output) -* duck audio -* pitch transpose -* switch clips - -## Video: -* shake orientation -* discolor -* slow down / speed up - - -# Resources - -## EchoNest / Remix / Chopping code -* Scissor - auto - https://github.com/youpy/scissor - -* Python remix examples (see reverse) https://github.com/echonest/remix - -Maybe we can build a web-based version and api… - - -## iOS sample code - -* AVMovieExporter - imports and from Asset/Media library, changes some metadata and re-exports as different filetype - https://developer.apple.com/library/ios/#samplecode/AVMovieExporter/Introduction/Intro.html#//apple_ref/doc/uid/DTS40011364 - -* MoviePlayer - movie playback, playback controls, scaling and repeat - https://developer.apple.com/library/ios/#samplecode/MoviePlayer_iPhone/Introduction/Intro.html#//apple_ref/doc/uid/DTS40007798 - -* AVPlayer - play video from Camera roll - https://developer.apple.com/library/ios/#samplecode/AVPlayerDemo/Introduction/Intro.html#//apple_ref/doc/uid/DTS40010101 - -*auriotouch - waveform display in openGL https://developer.apple.com/library/ios/#samplecode/aurioTouch2/Introduction/Intro.html#//apple_ref/doc/uid/DTS40011369 - -* StopNGo - capture images to live stream, re-export as movie https://developer.apple.com/library/ios/#samplecode/StopNGo/Introduction/Intro.html#//apple_ref/doc/uid/DTS40011123 - -## Pizzaz -* Squarecam - live camera, face detection and drawing https://developer.apple.com/library/ios/#samplecode/SquareCam/Introduction/Intro.html#//apple_ref/doc/uid/DTS40011190 diff --git a/README.md b/README.md new file mode 100644 index 0000000..751efad --- /dev/null +++ b/README.md @@ -0,0 +1,88 @@ +# Generating music based on video + * mp3 and add audio-ducking (potentially covered by iMovie) + * midi generation (tough algorithmically, maybe more of an april project or entire thesis) + * very hard, high likelihood of bad-sounding music + +* get a movie, get frames from the movie + * number of attribute variables from video + + * (maybe just analyze images?) + * build music from images + +# options: +## build movie image thing, do music later + +* Use EchoNest API to chop up songs into bars and allow users to mix and match, creating a new remixed song. Pick n' Mixer + +** Pros -- potentially fun to play with. Musically oriented +** Cons -- similar to garage band? Might not split up automatically though... + +# Echonest technique: + +## Movie +1. User picks video +2. User specifies song from library or URL (or we give list of available remote songs) +3. (automatically) API call to EchoNest and beat match songs +4. (automatically or user) build order of bars to fit video length (longer or shorter) +5. (automatically) duck music volume based on video volume +6. export back to library + +3 songs: +a. 1 2 3 [ … n-3] n-2 n-1 n (bars) +1 2 3 n-2 n-1 n (correct length) + +b. 1 2 3 4 5 +c. + +(interface) +movie -> image -> variables -> music + +# Variables from music (via echo nest): +* time signature +* key signature + + +# variables from movie: +## Video import/headers +* length of film (NSString *const MPMediaItemPropertyPlaybackDuration;)? + - Tracks -> Time -> [1][value] + +## With image analysis +* fade-out +* color content + +# Effects (output) +* duck audio +* pitch transpose +* switch clips + +## Video: +* shake orientation +* discolor +* slow down / speed up + + +# Resources + +## EchoNest / Remix / Chopping code +* Scissor - auto - https://github.com/youpy/scissor + +* Python remix examples (see reverse) https://github.com/echonest/remix + +Maybe we can build a web-based version and api… + + +## iOS sample code + +* AVMovieExporter - imports and from Asset/Media library, changes some metadata and re-exports as different filetype - https://developer.apple.com/library/ios/#samplecode/AVMovieExporter/Introduction/Intro.html#//apple_ref/doc/uid/DTS40011364 + +* MoviePlayer - movie playback, playback controls, scaling and repeat - https://developer.apple.com/library/ios/#samplecode/MoviePlayer_iPhone/Introduction/Intro.html#//apple_ref/doc/uid/DTS40007798 + +* AVPlayer - play video from Camera roll - https://developer.apple.com/library/ios/#samplecode/AVPlayerDemo/Introduction/Intro.html#//apple_ref/doc/uid/DTS40010101 + +*auriotouch - waveform display in openGL https://developer.apple.com/library/ios/#samplecode/aurioTouch2/Introduction/Intro.html#//apple_ref/doc/uid/DTS40011369 + +* StopNGo - capture images to live stream, re-export as movie https://developer.apple.com/library/ios/#samplecode/StopNGo/Introduction/Intro.html#//apple_ref/doc/uid/DTS40011123 + +## Pizzaz +* Squarecam - live camera, face detection and drawing https://developer.apple.com/library/ios/#samplecode/SquareCam/Introduction/Intro.html#//apple_ref/doc/uid/DTS40011190 -- cgit v1.2.3