#CES2017 – Audi partners with NVIDIA for AI driven Q7 ‘deep learning concept’
At the Consumer Electronics Show (CES) in Las Vegas, Audi demonstrated its Q7 deep learning concept, a piloted driving car produced in collaboration with NVIDIA.
The car orientates itself by means of a front camera with 2 megapixel resolution, and the camera communicates with an NVIDIA Drive PX 2 processing unit, which in turn controls the steering with high precision. The high-performance controller is specially engineered for piloted driving applications.
Serving as the core of the software are deep neural networks which experts from Audi and NVIDIA have trained specifically for autonomous driving and recognition of dynamic traffic control signals.
Beginning with a human driver at the wheel, the Audi Q7 deep learning concept gains a limited familiarity with the route and the surroundings, by means of observation and with the help of additional training cameras. This establishes a correlation between the driver’s reactions and the occurrences detected by the cameras.
During the subsequent demonstration drives the car is then able to understand instructions, like from a temporary traffic signal, interpret them right away and act as the situation requires.
When a corresponding signal appears, the concept car immediately changes the driving strategy and selects either the short route or the long one. The design of the system is so robust that it can even cope with disturbance variables such as changing weather and light conditions. It masters its tasks day and night, and even in direct sunlight or harsh artificial light.
The learning methods used for the Audi Q7 deep learning concept are essentially very much like those of deep reinforcement learning. This method was the underlying principle behind the Audi presence at the Conference and Workshop on Neural Information Processing Systems (NIPS), an AI event held in Barcelona in December.
There, the neural networks – which are similar to the human brain – were also trained for a particular application.
Pushing the boundaries of AI
Artificial intelligence is a game-changing key technology for piloted driving, Audi reckons. Together with its partners, Audi is evaluating various approaches and methods for machine learning.
The aim is to always find the optimal method for the specific application being studied. Collaborative efforts by companies in the IT and automotive industries are also of tremendous value for future implementation in concepts and production cars.
Audi has been working with NVIDIA since 2005. The Audi A4 was using an NVIDIA chip as early as 2007, and two years later NVIDIA technology allowed the Audi A8 to achieve a new dimension in visual displays.
The Modular Infotainment Platform (MIB), which was introduced in 2013, featured the Tegra 2 processor from NVIDIA. And the MIB2 followed in the Audi Q7 in 2015, running with an NVIDIA T 30 processor.
The platform’s next level of development is the MIB2+ – which is premiering this year in the new generation of the Audi A8. Its key element is the Tegra K1 processor, which makes new functions possible and has the impressive computing power needed to support several high-resolution displays – including the second-generation Audi virtual cockpit.
Onboard and online information will merge, making the car part of the cloud to a greater degree than ever. Together with the MIB2+, the central driver assistance controller (zFAS) in the new Audi A8 is also making its series debut.
Another Audi key partner is Mobileye, whose image processing chip is also integrated in the zFAS. The high-tech Israeli company is the world leader in the field of image recognition for automotive applications. Mobileye is already supplying a camera for use in a range of Audi models – the Audi Q7, the A4/A5 series and the new Q5 – and the product’s image processing software can recognise a large number of objects.
These include lane markings, vehicles, traffic signs and pedestrians. Today, defining the characteristics needed to clearly classify objects is still done manually.
2017 Audi A8 – the next level of piloted driving
In the new Audi A8, Audi and Mobileye are demonstrating the next level of development – with image recognition that uses deep learning methods for the first time. This significantly reduces the need for manual training methods during the development phase.
Deep neural networks enable the system to be self-learning when determining which characteristics are appropriate and relevant for identifying the various objects. With this methodology the car can even recognise empty driving spaces, an important prerequisite for safe, piloted driving.
The traffic jam pilot function will be offered in a series production model for the first time in the new A8. This is the first piloted driving function in series production that will enable the driver to let the vehicle take over full control at times.
You can see the Audi Q7 piloted video footage (exterior and interior) in the YouTube videos below.
