Feb 15, 2014
Well, using GPUImage to merge two videos with chroma key is quite easy as what we see in following code snippet:
Above code does work. However you probably notice that it has three problems:
- GPUImageMovie doens’t have audio playback
- The merged video only have one audio track (not both tracks from each video)
- The merged video have some color degradation problem
So I’m walking through each items to show how to fix it. Well, I’m not sure the solution is best, at least it works(somehow #_#), hopefully it could inspire you with even better approach.
Topics would cover in this post are:
- GPUImageMovie audio playback
- Movie writing with two audio tracks
- Fix the color degradation (too much brightness and exposure)
GPUImageMovie Audio Playback
Someone commented after the issue saying:
I also need this feature. I’m considering adopting a simpler work around. Play the audio of the origin file of the GPUImageMovie. Probable the sync between video and audio will be a problem since GPUImageMovie may not play at the original speed.
Then it comes an approach, which is that add a basic audio player to support playback (using AVAudioPlayer). Luckily he has uploaded a gist for reference: Add Audio Playing to GPUImageMovie.
You can set one of property (i.e. playSound) in GPUImageMovie to true when you want to have audio playback.
But someone replied to that comment saying he got some either crash or slience with new approach. I tried it little bit and found you probably need hack it little bit to get it work(as the codebase evolves so quickly, quite oftenly you need to do a merge @_@)
You can refer to my commit in github to see what exactly I did: Added Play Audio support in GPUImageMovie.
Given the fact the hack is using AVAudioPlayer to play sound of the video, you must pay attention to the format of video. So if you use .mov video, you could get some errors about initializing audio player instance. Well, that is because AVAduioPlayer doesn’t support .mov format:Play Sound of .mov file with AVAudioPlayer. However, .mp4 file is okay.