A team of developers from the University of Pennsylvania, the US Army Research Laboratory and New York University presented glasses for the management of drones.
The glasses are equipped with Tobii Pro Glasses 2, an eye tracking system that includes an HD camera and an inertial measuring module that detects the position of the human head in relation to the drone. With the help of a deep neural network, the system calculates the point at which to send to one or several copters at once.
Tobii Pro Glasses 2 is connected to the portable processor NVIDIA Jetson TX2. The system is autonomous and does not rely on external sensors.
According to the creators, the development works imperfectly: to calculate the point of 3D navigation, it uses a 2D coordinate, and then randomly selects the depth of the point within a predefined security zone.
In the future, developers are planning to add voice mode and gesture mode, simultaneously adjusting the depth of 3D navigation.
Researchers hope that their technology will help people with disabilities to safely manage drones.
