Artificial intelligence opens up new application fields for camera technology and image processing. The new IDS NXT rio and rome (protection class IP65/67) product families show how a flexibly usable embedded solution for industrial purposes can look like: an AI vision app transforms these robust, powerful standard industrial cameras into high-performance inference cameras. Hardware and software are designed to allow AI-based vision tasks to be solved "on the edge" – in other words directly on the device. Inference times of only a few milliseconds are realised. As a result, the cameras are comparable to modern desktop CPUs in terms of accuracy and speed. Prototypes of the new IDS NXT cameras were presented for the first time at VISION. The AI-enabled camera models will be available from 2019.
With the IDS NXT product line, IDS Imaging Development Systems GmbH offers an industrial camera platform that enables image processing directly on the device. By installing vision apps, the user himself determines which image processing tasks his device should solve. In the future, this principle will also enable the use of neural networks, for example for object recognition or object classification. An AI vision app developed by IDS reconfigures the embedded hardware so that, for example, the FPGA serves as an AI accelerator. At the same time, it ensures that users can load pre-trained ANNs (artificial neural networks) of different architectures onto the cameras and execute them. In the future, it will also be possible to install several neural networks in parallel, which will then cover successive work steps, for example.
The camera models also provide free choice of optics thanks to a C-mount lens holder, industrial-grade M12 circular connectors, a serial RS232 interface, GigE network connection and practical PoE ("Power-over-Ethernet"). Instead of a continuous and unfiltered data stream, images, pre-processed data or results are transmitted directly to PCs or machine controls.
Kai Hartmann, Product Manager IDS NXT, summarizes: "The IDS NXT rio and IDS NXT rome models are redefining industrial cameras. They can be flexibly modified using the vision app-based concept and, in combination with the robust housing, standardized connections and powerful hardware components, enable an easily integrated embedded solution for AI tasks." From 2019, the models will not only be available with sensors from different manufacturers and resolution classes, but also as board-level variants for machine or device construction.
With the IDS NXT product line, IDS Imaging Development Systems GmbH offers an industrial camera platform that enables image processing directly on the device. By installing vision apps, the user himself determines which image processing tasks his device should solve. In the future, this principle will also enable the use of neural networks, for example for object recognition or object classification. An AI vision app developed by IDS reconfigures the embedded hardware so that, for example, the FPGA serves as an AI accelerator. At the same time, it ensures that users can load pre-trained ANNs (artificial neural networks) of different architectures onto the cameras and execute them. In the future, it will also be possible to install several neural networks in parallel, which will then cover successive work steps, for example.
The camera models also provide free choice of optics thanks to a C-mount lens holder, industrial-grade M12 circular connectors, a serial RS232 interface, GigE network connection and practical PoE ("Power-over-Ethernet"). Instead of a continuous and unfiltered data stream, images, pre-processed data or results are transmitted directly to PCs or machine controls.
Kai Hartmann, Product Manager IDS NXT, summarizes: "The IDS NXT rio and IDS NXT rome models are redefining industrial cameras. They can be flexibly modified using the vision app-based concept and, in combination with the robust housing, standardized connections and powerful hardware components, enable an easily integrated embedded solution for AI tasks." From 2019, the models will not only be available with sensors from different manufacturers and resolution classes, but also as board-level variants for machine or device construction.
