Exploring Audio and Geometry

This is some R&D I've been working on as a side project. The satisfying interaction and sound and shape is something I've been trying to create for years. It turns out Houdini is an excellent tool for this as It's flexibility allows audio to be created directly from f-curves, from geometry, samples or from MIDI and then manipulated in myriad ways. But it can be kind of tricky so these posts are me working out how to use the software and exploring ideas, they are not finished pieces.

I've only just started to scratch the surface so will keep posting as I have time to explore. The aim is to create something which goes beyond the experimental to the coherent and beautiful but I'm not sure what that is yet.


Update: This work has had a really nice reception, being featured in Creative Application plus screenings at Ars Technica. I've also made this piece which is based on some of the MIDI techniques shown here.

There’s also some additional, more polished pieces (Piano Shapes, Neon Interpolation, Auto Interpolation) that I made with Google’s Magenta algorithm.


1.01 'Circles Within Circles'

The audio is generated from the geometry, as the particles collide they create an audio pulse based on their height. The is also audio generated from the small burst of particles. The outer and inner ring also emit a constant tone. The Plexus like effect also generates audio based on it's height. You'll notice it pop in and out based on the proximity of the points.

The basic elements are exported from Houdini into Cinema 4D where cloners and splines are used to create additional geometry for render. I then finished with a simple composite and mix in After Effects and Audition.

21.01 'The Harmonograph'


This is based on mechanical Harmonograph, the precursor to the oscilloscope. My version is MIDI and audio driven. It uses the notes in the chord ratio relationships to build the patterns. It uses the audio intensity to drive the turbulence and overall size. It's pretty much based on this book.

20.01 'Machine Drummer'


This is a semi-automated drum machine. You can set the probability of the notes and mix two different patterns. I haven't really had time to make something nice (or funky) with it, really it's a proof of concept.



2.01 ‘Bach, The Goldberg Variations, BWV 988’

I used a MIDI file to create the geometry in Houdini. I then moved the geometry into Cinema 4D to make it more interesting and render it.


18.01 ‘Piano Waves’

----------LISTEN IN STEREO----------
The piano phrase is based on a sine wave pattern.
The phrase is played at 4 speeds x2 x1 x0.5 x0.25.
The right channel an inverted version of the left,
you can see this in the animation.


6.01 ‘Fireflies’


----------LISTEN IN STEREO----------
The idea here was to mimic how fireflies can sychronise their pulses. It begins chaotically and then they begin to sychronise. The pitch of each 'firefly' is determined by it's height and we it's left/right position also defines it's place in the stereo spread.


6.01 ‘Sine Cosine Audio’


-------------LISTEN IN STEREO-------------
Pitch based on Y position and cosine.
Stereo based on X position sine.
Z position controls volume although it's not too apparent here.


6.01 'Music of the Spheres'


This is based on our solar system. The relative size and rotation and day length etc are all based on real values. Relatively at least :)
Each planet has a pitch based on it’s size. This wave is multiplied by a frequency based on the day length of each planet (it's rotation).
Volume and stereo panning is based on the planets postiion relative to the camera.

In some of these renders I increased the speed of the system to see what would happen.
Given some time and tweaking I think this system could make some really interesting audio visuals. It's fun to build and just see what comes out.

The initial idea is Pythagoras'.


6.01 ‘Strange Attractor’


-------------LISTEN IN STEREO-------------
Pitch based on Y position and cosine.
Stereo based on X position sine.
Z position controls amplitude.
Strange Attractor based this tutorial by Entagma.


'10.01 Primitives’

2D primitives trigger audio. The audio pitch is based on the length of the side.

'10.02 Stereo Primitives’

This is similar to the previous primitives video but with a left and right hand trigger which correspond to the stereo channel. I've also used primitive shapes with odd numbers which give the rhythm a less symmetric feel.


'11.01 Curl Noise Evil ’

The particle system drives the audio. I like it because it feels kind of audio.

'12.01 Gridify Audio ’

Particle system drives audio.
Pitch Controlled by Y postion and direction change

'16.01 Son Clave Round ’

The Son Clave is a mathematically interesting Afro-Cuban rhythm. (See link below to Godfried T. Toussaint's book)
Here it is repeated and offset in a ‘round’ like ‘row row row your boat’ with different instruments.


5.01 ‘Beat Wheel’

These are Houdini screen captures of an experiment based on Godfried T. Toussaint's The Geometry of Musical Rhythm.

In the first example drum samples are triggered by each shape. If the shape is changed by adding or deleting points, so too will the rhythm.

The second example uses procedural sounds. The length of each 'stem' denotes the volume of the drum hit.

amazon.co.uk/Godfried-T.-Toussaint/e/B00E96BXFM/ref=dp_byline_cont_book_1



3.00-04 Audio Geometry Exploration

A few audio geometry tests created in Houdini and rendered in Cinema 4D



4.03 ‘Mad Rush’

I used a MIDI file I found online of Philip Glass' Mad Rush to trigger particles which emit from the centre of the screen outwards. A fairly simple setup but interesting to see the geometry in Glass' music.

17.01 ‘Organ Phase’


The idea of this is taken from Steve Reich's phase concept; playing one sequence at an incrementally different speed to another parallel clip.


7.01 ‘Echo’ by Sibbs (Excerpt)

A radial EQ created in Houdini and rendered in Cinema 4D.
Echo by iamsibbs.com/


14.01 Cog

This is a relatively simple test where the trigger picks up the length of the line and uses it to define the pitch. I wouldn't say it sounded pretty :/