Drone Control, the new drone controlling app from Sony, was released as open source today for Xperia™ devices and SmartEyeglass. The app works with Parrot drones (Bebop Drone & AR.Drone 2.0) to get real time flight data and battery life info, for example, superimposed on SmartEyeglass for an augmented reality (AR) experience.


SmartEyeglass development with Parrot

Sony Mobile Communication engineers have developed a drone controller application , Drone Control, that runs on an Xperia smartphone or tablet. The application connects the Xperia device with a Parrot drone and lets the operator use SmartEyeglass as a heads-up display (HUD).

The set up of SmartEyeglass with a controller, Drone Control app, and a Parrot drone.

The pilot can operate the drone using a controller for smooth operating, while basic instructions, alerts, battery and flight information are shown on the SmartEyeglass display. Drone Control uses the unique features of SmartEyeglass to add another level of engagement in AR drone controlling.

The feeling of piloting a flying device with the SmartEyeglass integration makes the experience so much more immersive”, says Sylvio Alves, Software Engineer at Sony.

Drone Control app on an Xperia device

The Drone Control app supports a number of Parrot devices, such as Bebop, Rolling Spider and Jumping Sumo. Depending on which Parrot device the pilot is operating, the communication with the device is done using Bluetooth or Wireless LAN.


Drone controlling and augmented reality

Drones are now being considered for an increasing number of business purposes such as planting trees in agricultural industries, filmmaking and photography, monitoring crops or making postal deliveries. With SmartEyeglass and Drone Control, you can preview photographs taken by the drone of crops, for example, while keeping an eye on the battery level. 

“I can imagine this set-up being used in many other different use cases, from entertainment to business. We have just started to explore the possibilities on what could be achieved using SmartEyeglass in this way”, says Sylvio Alves.

SmartEyeglass UI with Drone Control

By using AR technology to control your drone you have the best possible location awareness from the ground. This is different to the immersive VR experience with first-person view (FPV) where video from the drone is streamed onto goggles. With AR you are more connected to the overall experience of flying the drone.


Get started with SmartEyeglass and the Drone Control app

The open source code for Drone Control is published on the SonyXperiaDev GitHub where you can also submit your project improvements back to us. You can also download the Drone Control (beta) app at Google Play.

If you would like to be one of the first to use SmartEyeglass as a truly innovative heads-up display when flying your drone, you can download the SmartEyeglass SDK and start developing for SmartEyeglass.

If you have any comments or questions, drop us a line below or use the SmartEyeglass forum.


SmartEyeglass as heads-up display for an AR experience with Parrot Drones



Post navigation

3 thoughts on “SmartEyeglass as heads-up display for an AR experience with Parrot Drones

  1. I want to show great work opportunity… three to five hours of work daily… Weekly paycheck… Bonus opportunities…Payscale of $6k to $9k /a month… Just few hours of your free time, any kind of computer, elementary understanding of web and stable connection is what is required…Get informed more about it *by visiting my profile>page

  2. Here is something interesting that is worth yrs attention , a fantastic opportunity for work for those who want to utilise their free time to make some extra money using their computers… I have been working on this for last two and half years and I am earning 50-80 dollar/ hour … In the past week I have earned 13,245 dollars for almost 20 hours sitting ….

    Not any particular skills or qualification required for this, just normal typing and a reliable internet connection ….

    No time boundations … You may work on this any time when you are free ….

    you can check what I’ve been doing….view siteIink on my` profiIe` to know what I really do`


Leave a Reply

Your email address will not be published. Required fields are marked *