For an upcoming project, we have decided with my client to visualise sound during a piece to camera. This sound is just a voice. I remember that the BBC did this in a great way whilst demonstrating that new born babies "see" sound as their senses are all muddled up. It was achieved by a simple ripple distortion effect over the scene.
I want to take this further and distort the picture slightly and subtly as the narrator speaks. This is what I tried in V5 but with poor results. It was just a rough test.
Firstly, I ran the sound through Sound Forge and recorded the wave at various magnifications on a white screen. I did this by filming the TFT screen as I figured it didn't need to be a great picture. I placed this on the first track. Second track I had some colour bars. Track 1, I introduced a mask so that only the bars were visable though the wave lines, now giving multi-colour sound waves on a white back ground. On track 2, I shifted the bars overs a few pixels and rendered the output to another track.
Then I get rid of everything but my rendered colour waves on track 1 and the colour bars on track 2. I reset the position of the bars to normal. Now, what I should have been able to do was add a mask on track 1 to show the bars through the white background but the waves to still be visable over the top. Because of the slight misalignment of the bars during render, I hoped to get a shimmering effect or distortion but leaving the waves invisible. Needless to say, it didn't work.
The result, depending on the luminance mask properties ranged from white wave linse to nasty compression blocks etc. I could try a cleaner approach and capture the waves via Fraps or something and not film the screen but I'm not convinced this would work.
Does anyone know or can think of a way to distort the picture with sound?
Many thanks,
Simon Page.
I want to take this further and distort the picture slightly and subtly as the narrator speaks. This is what I tried in V5 but with poor results. It was just a rough test.
Firstly, I ran the sound through Sound Forge and recorded the wave at various magnifications on a white screen. I did this by filming the TFT screen as I figured it didn't need to be a great picture. I placed this on the first track. Second track I had some colour bars. Track 1, I introduced a mask so that only the bars were visable though the wave lines, now giving multi-colour sound waves on a white back ground. On track 2, I shifted the bars overs a few pixels and rendered the output to another track.
Then I get rid of everything but my rendered colour waves on track 1 and the colour bars on track 2. I reset the position of the bars to normal. Now, what I should have been able to do was add a mask on track 1 to show the bars through the white background but the waves to still be visable over the top. Because of the slight misalignment of the bars during render, I hoped to get a shimmering effect or distortion but leaving the waves invisible. Needless to say, it didn't work.
The result, depending on the luminance mask properties ranged from white wave linse to nasty compression blocks etc. I could try a cleaner approach and capture the waves via Fraps or something and not film the screen but I'm not convinced this would work.
Does anyone know or can think of a way to distort the picture with sound?
Many thanks,
Simon Page.