An open source audio-responsive VJ application that we (Joel Pitt, Kelly Cheesman, Will Marshall) have been building in Processing. This application uses a multitouch control surface to trigger videos, mask layers, control motion and capture live video. Visual inspiration came from a video by Kate Moross for SIMIAN MOBILE DISCO .
INSPIRATION
CONCEPT
We wanted to to make sound-responsive shapes mask video in real-time.
We used Joel’s JazzMutant Lemur as a control interface (shiny awesomeness), as it supports OSC and has a built-in physics model, allowing us very hands-on control of our visuals.
Features include:
- Four live camera feeds
- Preset patterns for the shapes
- OpenGL blending for layering video
- Beat detection
- Interface to select from a grid of videos
- Use of gifs as layer masks
DEMOS
IMAGES
DOWNLOADS
Download source @ GitHub
http://github.com/willrjmarshall/Speed-of-Sound
Minim beatDetect documentation and examples
http://code.compartmental.net/tools/minim/manual-beatdetect/
Lemur Template
JazzEditor
***********
Suggestions, contributions and pings welcome.
TODO
- Video controls:
- loop points
- scrubbing (manual frame control)
- Package media and make available for download
- Make all points respond to same frequency and allow frequency response to be configurable.
- Better presets which save frequency responses and size of points.
- Refactor demo mode so that each component has a doDemo method or something similar
- Make responses dependent on intensity (stop stuff going nuts when there is hardly any noise)
- Allow other backgrounds (GIFs, images, plain, colour)
- Add more point shapes and images.
- Add a PointMotion that makes things bounce up and down.
- Convert Rorshach into a PointArtist object
- Scale point size range to resolution of frame.
2 Comments
Permalink
I builLd sOund reacting Visuals likE YOU.
They are also interactive, my latest is a 2m sphere which I project into, using a wiimote party goers can paint colours which rotate and melt through each other and pulse with music. We should collaborate, I’m sure we could create someting great. I tend to code from the ground up so there are no limitiations, another project Koru renders fractals inteactivly as computer have recently got fast enough to animate fractals, using a technique I developed, I’m not netoworking lots of computers to render more pixels per second. Let’s meet up and talk about the future
of graphics.
Gene Thomas.
Permalink
HI Gene, yes I remember, have you got any links of this sphere project? sounds interesting