Orbbec launches out-of-the-box AMR solution with NVIDIA Isaac Perceptor at ROSCon 2024

The Orbbec Perceptor Dev Kit (OPDK) is preloaded with multi-camera NVIDIA Isaac Perceptor software in a compact form factor for outdoor/indoor conditions, and four synchronized Gemini 335L Depth+RGB cameras for 360-degree vision integrated with the NVIDIA Jetson AGX Orin system-on-module. The in-camera depth processing enables AI applications to run at reduced power consumption and cost.

Odense, Denmark, Oct 22, 2024 - Orbbec, a leading 3D camera provider, today announced the Orbbec Perceptor Developer Kit (OPDK), an out-of-the-box autonomous mobile robot (AMR) solution preloaded with NVIDIA Isaac Perceptor. The OPDK is designed for AMR developers who seek a powerful, hardware-software integrated kit to develop AI applications for dynamic and unstructured environments in warehouses and factories.

The Orbbec Gemini 335L cameras, integrated with NVIDIA Jetson AGX Orin system-on-modules, combine active and passive stereo vision technologies for seamless operations in both indoor and outdoor conditions. The Gemini 335L cameras offer in-camera depth processing powered by Orbbec's MX6800 ASIC, and a precise multi-camera sync system.
The NVIDIA Jetson AGX Orin offers up to 275 trillion operations per second (TOPS) of performance, pre-trained AI models, reference AI workflows, and vertical application frameworks in robotics, vision AI and sensor fusion.
The Gemini 335L's in-camera depth processing frees up GPU, CPU and NPU resources on the Jetson AGX Orin to run visual simultaneous localization and mapping (SLAM) and odometry for improved mapping in rapidly changing environments. This efficient system now increases resources for AI applications for dynamic object detection and pose estimation.
The out-of-the-box OPDK system solution for AMR features:
● Preloaded with NVIDIA Isaac Perceptor for robot development and control. Optimized for AMR development, enabling rapid prototyping and deployment.
● 360-degree visual SLAM with four RGB-D cameras, with in-camera depth processing and capable of indoor and outdoor operations.
● Option to use visual odometry from cuVSLAM or wheel odometry from robots.

AMR developers can leverage CUDA-accelerated libraries and AI models, streamlining the development process and accelerating time to market.

The OPDK system components include:
● Four Orbbec Gemini 335L RGB-D Cameras: Depth resolution up to 1280x800 at 30 FPS, offering high-precision depth data with a wide field of view (4*90° horizontal, 65° vertical) and USB connectivity, and IP65 rating for dust and water protection.
● Multi-Camera Synchronization: Orbbec Sync Hub enables precise camera synchronization, enabling seamless multi-angle data collection with minimal interference.
● NVIDIA Jetson AGX Orin (64GB) Developer Kit: AI-powered compute engine with up to 275 TOPS of AI performance, support from the NVIDIA JetPack software development kit, NVIDIA Isaac ROS, AI models, and tools that make it ideal for complex robotics tasks such as vision processing from multi-camera data streams, AI model inference, visual SLAM and 3D scene reconstruction.

"The Orbbec Perceptor Dev Kit gives developers a truly out-of-the-box experience with a feature-rich, comprehensive system to begin AI application development immediately," said Amit Banerjee, Head of Partnerships at Orbbec. "This collaboration with NVIDIA enables us to provide compelling advantages to AMR developers to navigate the complexities of 3D sensing and computer vision algorithms with OPDK."
Orbbec also announced today the Gemini 335Lg Stereo Vision 3D Camera, the latest addition to the Gemini 330 Series. With GMSL2 and secure FAKRA connection, the Gemini 335Lg achieves stable and smooth data transmission over longer distances and overcomes challenges from vibrations caused by movement over uneven terrain or electromagnetic interference. A version of the OPDK with GMSL cameras will be available soon.
For further information about OPDK visit https://www.orbbec.com/opdk/ or contact Orbbec for scheduling meetings at ROSCon.

About Orbbec
Founded in 2013, Orbbec is on a mission to democratize robotics and AI vision technology, offering products that deliver performance and value spanning structured light, stereo vision and ToF technologies. Orbbec's technology powers robotics, manufacturing, logistics, retail, 3D scanning, healthtech and fitness solutions. With in-house R&D, state-of-the-art factory, supply chain management and global support, Orbbec also offers ODM engagements for custom and embedded designs. Follow Orbbec on X, Facebook, and LinkedIn for the latest updates and innovations in 3D vision technology.

Featured Product

Bota Systems - The SensONE 6-axis force torque sensor for robots

Bota Systems - The SensONE 6-axis force torque sensor for robots

Our Bota Systems force torque sensors, like the SensONE, are designed for collaborative and industrial robots. It enables human machine interaction, provides force, vision and inertia data and offers "plug and work" foll all platforms. The compact design is dustproof and water-resistant. The ISO 9409-1-50-4-M6 mounting flange makes integrating the SensONE sensor with robots extremely easy. No adapter is needed, only fasteners! The SensONE sensor is a one of its kind product and the best solution for force feedback applications and collaborative robots at its price. The SensONE is available in two communication options and includes software integration with TwinCAT, ROS, LabVIEW and MATLAB®.