Robotics and automation applications are transforming industries worldwide, from warehouses to healthcare facilities, enhancing productivity, efficiency, safety, and operational visibility. At the core of these applications are image sensors, which enable robots to perceive and interact with their environment. This article explores the role of image sensors in robotics and highlights onsemi's advancements in imaging technology, along with its related solutions.
The role of mobile robots in modern industry
Over the past decade, automation and robotics have revolutionized many industries, making traditional processes safer and more efficient. Among these innovations, mobile robots are at the forefront of automation, helping to streamline operations across various sectors. Mobile robots can be broadly categorized into two types: Autonomous Mobile Robots (AMRs) and Automated Guided Vehicles (AGVs). AMRs are designed to operate independently, adapting to dynamic environments without human intervention. Using advanced sensing technologies like Simultaneous Localization and Mapping (SLAM), AMRs can map their surroundings, identify obstacles, and navigate autonomously, making them ideal for applications such as factory and warehouse automation.
In contrast, AGVs rely on external guidance systems, such as magnetic strips or vision tracking, to follow fixed paths. While AGVs excel in structured environments like assembly lines and inventory management, they lack the flexibility of AMRs. AGVs are akin to trains running on predetermined tracks, whereas AMRs resemble cars capable of maneuvering around obstacles. This distinction makes AMRs the preferred choice for industries requiring dynamic and adaptable solutions.
How image sensors enable AMR autonomy
AMRs operate without guidance, adapting dynamically to new environments. However, to move autonomously, they require Simultaneous Localization and Mapping (SLAM) capabilities. Through SLAM, robots create maps of their surroundings and determine their own location. AMRs rely on image sensors to perform tasks such as environmental navigation, 3D mapping, collision avoidance, and code reading - all of which demand precise and efficient sensing capabilities. For 3D mapping, AMRs use technologies like stereotype imaging, indirect Time-of-Flight (iToF), and LiDAR to measure depth and create detailed environmental maps. Depth sensing allows AMRs to detect objects, including humans, and avoid potential hazards, a critical feature for ensuring safety in environments where humans and robots work side by side.
Collision avoidance is another critical function enabled by image sensors or depth sensors. Sensors equipped with rolling shutter and/or global shutter, fast processing speeds, and High Dynamic Range (HDR) allow AMRs to identify and respond to obstacles in real time. HDR technology is particularly important in mixed-lighting environments like factories or warehouses, where reflections and shadows complicate visual perception.
Additionally, image sensors play a key role in code reading, a common task in manufacturing and logistics. Sensors with global shutters and low power consumption excel in these applications, enabling AMRs to scan and process codes quickly and accurately. The ability to operate efficiently over extended periods further enhances their value in demanding industrial environments.
While AMRs and AGVs dominate the mobile robotics space, stationary robots also play a vital role in automation. These robots, fixed in one location, perform tasks such as picking and sorting objects. Like mobile robots, stationary robots rely on image sensors for depth detection and precision control. Advanced sensing technologies ensure these robots execute tasks with high accuracy, even in complex industrial settings.
Productivity as a key driver of robotics growth
Several factors are driving the rapid adoption of robotics across industries, with productivity being a primary driver. Robots can perform repetitive tasks tirelessly for extended periods. Efficiency is another major advantage, as robots eliminate delays caused by human intervention, allowing workers to focus on higher-value activities. Safety is equally important, as robots can take over hazardous tasks that may endanger human workers.
To enhance productivity, efficiency, and safety, most customers seek comprehensive data to visualize operational rates. This data enables thorough analysis and the identification of effective strategies for improvement. By leveraging detailed visual data, customers gain valuable insights into their operations, leading to better decision-making and optimized performance.
The robotics market is currently experiencing significant growth, particularly in the AMR sector. Industry analysts predict a Compound Annual Growth Rate (CAGR) of 16% to 20% for AMRs between 2024 and 2030. This growth is fueled by advancements in Artificial Intelligence (AI) and automation technologies, which are expanding the capabilities of robots and opening new opportunities for innovation.
HDR enabled image sensors enhance visual precision
As a leader in imaging technology, onsemi has developed a range of innovative image sensors to meet the demands of robotics. Its products include rolling shutter and global shutter sensors, as well as specialized solutions for depth sensing and HDR applications. These technologies enable robots to perform tasks with greater precision, efficiency, and reliability.
Rolling shutter sensors are known for their smaller pixel size and higher sensitivity, making them ideal for applications requiring detailed imaging in low-light conditions. However, they may introduce motion artifacts, limiting their use in dynamic environments. In contrast, global shutter sensors eliminate motion artifacts by exposing all pixels simultaneously, making them well-suited for tasks involving moving objects, collision avoidance, and code reading.
Depth sensing is another area where onsemi excels. Its iToF technology measures the phase difference of reflected light to determine depth. onsemi's iToF solutions cover short distances (30 to 50 cm) and can extend up to 20 meters with exceptional accuracy.
High Dynamic Range is critical for robots operating in challenging lighting environments. HDR sensors capture multiple exposures to create a balanced and accurate image, ensuring robots can see objects clearly even in high-contrast or reflective areas. HDR can be implemented in various ways. For example, multi-exposure HDR offers excellent low-light performance but may exhibit motion artifacts. Split-diode pixel HDR reduces motion artifacts but is prone to LED flicker. One exposure with multiple gains (super-exposure mode) combines the strengths of both methods. The choice of HDR technology depends on the specific requirements of the application.
onsemi offers a diverse of Hyperlux image sensor families to meet the varied needs of industrial robots. These sensors combine low power consumption, high dynamic range, and advanced features to deliver exceptional image quality while overcoming challenging lighting conditions. The Hyperlux LP series focuses on ultra-low power consumption, making it ideal for energy-efficient applications. The Hyperlux LH series is designed for industrial and commercial environments, offering stunning 4K video quality with enhanced NIR and eHDR, along with 120 dB HDR for superior performance in mixed lighting. The Hyperlux SG series is compact and features industry-leading global shutter efficiency for precise scanning, making it perfect for scanning, AR/VR, and AMR applications. The Hyperlux ID series, with resolutions up to 1.2 MP, revolutionizes iToF technology by extending indoor/outdoor distance measurement, unlocking new possibilities for 3D sensing and contributing to advancements in industrial automation, robotics, security, and more.
In July 2024, onsemi acquired SWIR Vision Systems, which holds patents for colloidal quantum dot technology enabling CMOS-based SWIR (Short-Wave Infrared) sensors. Unlike conventional InGaAs-based SWIR (900 nm to 1700 nm), onsemi's SWIR covers a broader range (400 nm to 2100 nm). Additionally, onsemi's SWIR sensors are classified as EAR99, making them easier to export compared to ITAR-classified InGaAs SWIR sensors. Currently, SWIR is available in BGA, 1 MP, and 2 MP cameras, with more products under development.
Conclusion
The future of image sensors lies in achieving higher resolution, smaller optical formats, greater dynamic range, lower power consumption, and improved accuracy. Looking ahead, the integration of AI with advanced sensor technologies will unlock new possibilities for robotics. From healthcare to education, these advancements will enable robots to perform increasingly complex tasks in diverse environments. As the cost of robotics continues to decline, we can expect broader adoption in service industries and household applications.
Image sensors are the cornerstone of modern robotics, enabling tasks ranging from 3D mapping to collision avoidance with unparalleled precision. onsemi is actively addressing these needs through continuous innovation, ensuring its sensors remain at the industry's forefront. onsemi's cutting-edge sensor technologies, including the Hyperlux series, iToF solutions, and SWIR sensors, are driving the next wave of advancements in robotics and automation. As these technologies evolve, they will expand the capabilities of robots, creating new opportunities across industries and improving the way we work and live.