AppleScript to Mirror iPhone to QuickTime
Photo of the AppleScript and Alfred Workflow to mirror my iPhone to QuickTime
Like many, I’m guilty of playing mobile games on my iPhone. For the games that have controller support, I’ll stream the video on a larger screen. As mentioned in my previous article, I’ll sometimes play on my exercise bike. In this situation, I’ll mirror my iOS device through QuickTime so that I can play on a larger screen with a controller.
There are a number of steps that I have to complete to mirror my iPhone to QuickTime:
This GIF demonstrates the automation that covers all seven manual steps. I launch it using Alfred.
I may be biased, but the source code is organized quite well in my opinion. The first eight lines cover all necessary customization needs as they are just function calls. If you need to, you can always dive into the functions themselves. The following is the code hosted on a Public Gist.
I had to select my iPhone for the video/audio inputs in QuickTime using AppleScript. A quick search turned up this Stack Overflow question. It turns out that you should be able to do the following:
tell application "QuickTime Player" set newMovieRecording to new movie recording tell newMovieRecording set current camera of newMovieRecording to "Kevin's iPhone" set current microphone of newMovieRecording to "Kevin's iPhone" end tell end tell
Unfortunately, it doesn’t work as you get hit with
Can’t make "Kevin's iPhone" into type video recording device. This would have made things much easier.
Instead, we have to click the button to open the inputs list and then make the selections via AppleScript. This wasn’t too bad initially, as it was just iterating the list of menu items and clicking the one which matched my device’s name.
After I was able to select the video input, the next problem is selecting the audio input. The problem now is that the audio and video input share the same name and are within the same list. I would have to skip the first one (video input) to select the audio input. This wasn’t too hard but was just another hurdle to get over. Ideally, the list of inputs would have been separated by video/audio, or somehow have a different key to reference them by.
I had noticed earlier that when the inputs menu was opened it would stay open for 7-8 seconds before making the menu item selection. I wasn’t too concerned at the time, but after the whole automation was done it took just under 20 seconds to mirror my device.
It took a lot of digging but I found a Stack Overflow answer that provided the solution.
on openInputMenu() ignoring application responses tell application "System Events" to tell process "QuickTime Player" click button 2 of window 1 delay 1 end tell end ignoring do shell script "killall 'System Events'" end openDeviceMenu
This function for opening the menu is explicitly telling it to ignore the application responses (i.e., don’t wait for feedback). A manual delay of a second is injected to give time for the menu to open up. It also kills the
System Events, which ends up forcing the script to continue execution to future actions. I’ll be honest, I’m not 100% on the specifics but it worked – the menu opens and the selections are made in just over a second now.