Aerialtronics drones fly into onboard processing

Aerialtronics are taking drone autonomy to the next level by developing a smart dual camera that packs massive onboard processing power with both digital daylight and thermal camera sensors.

Using NVIDIA embedded SOC platform, the project, led by Michele Moscaritolo, Head of Vision at Aerialtronics, is a giant step forward in onboard data analysis and processing with drones. The prototype can process both raw data streams from the day-night camera, allowing the Altura Zenith UAS to be used more effectively in a multitude of onboard computing tasks from object detection and recognition to path planning for security tasks, tower inspection and 3D mapping in mining.

Aerialtronics, a leading manufacturer of high-end unmanned aerial systems for commercial application, have developed a camera which combines an NVIDIA Tegra K1 onboard processor, to provide detailed algorithms and make autonomous devices like drones more intelligent.

Jan Wouter Kruyt, Head of R&D at Aerialtronics, said: “We have been developing dual cameras that allow users to switch between daylight and thermal video streams for some time. Now we have put these data streams into the NVIDIA chip and it means users can do some very smart things with it.”

NVIDIA, one of the biggest names in the development of chip technology, have delivered embedded modules in the Tegra family which will lead to a new generation of smart, learning devices. Kruyt said: “The great thing about working with this open chip is that we can inject any algorithm we like and, more importantly, so can the user.

“We have already gone a step further by integrating a daylight and digital thermal camera with NVIDIA’s Tegra K1 chip. No one else offers this powerful data combination. This means the user can analyse both data streams and use the information.

Right now it allows users to do smart things with the images. Eventually, we will be connecting this to the flight computer and then the whole drone will become smart enough to respond to what it is seeing.

“The Altura Zenith will use the video streams and information it observes to adjust its flight plan. For example it can fly over a parking lot, find the cars that still have the hottest engine and scan their number plates for payment or security. The video stream can recognise faces, identify and measure the speed of vehicles or locate leaks in oil and gas pipelines.” Read more