The Industrial Technology Research Institute (ITRI), Taiwan's largest and one of the world's leading high-tech applied research institutions, announced the introduction of AI-incorporating display and entertainment technologies along with robotics innovations at its CES 2024 booth 9255, North Hall, LVCC, and on its event website.

The Industrial Technology Research Institute (ITRI), Taiwan's largest and one of the world's leading high-tech applied research institutions, announced the introduction of AI-incorporating display and entertainment technologies along with robotics innovations at its CES 2024 booth 9255, North Hall, LVCC, and on its event website.

ITRI's AI display and entertainment innovations exhibited include the AR Interactive Vehicle Display, a transparent display for sightseeing passengers in a moving vehicle to view and interact with augmented reality (AR) content regarding their surrounding attractions; the Hyper-Realistic 3D Interactive Display, delivering 3D animations and live broadcasts with a digital avatar; and PetPet Cam, the world's first Gen AI pet camera that accurately captures our furry friends' cute moments and generates mashups for personal cherishing or easy sharing.

The AI robotics innovations ITRI presents at CES are the Detachable Joint Robot System, a highly flexible robot joint module that allows rapid assembly into a plug-and-play robotic arm with customizable axes, and RoboTwin: Metaverse Smart Factory Simulation Platform for creating a realistic virtual reality (VR) simulation of a manufacturing factory.

The AR Interactive Vehicle Display brings AR to sightseeing

The AR Interactive Vehicle Display allows passengers in a moving vehicle to view and interact with AR content regarding their surrounding attractions. When passengers spot a site of interest, the location name is presented in real time, following their line of sight. A simple touch on the screen provides detailed information, such as attraction features, local history, and geography. This versatile technology can also be applied to buses, light rail systems, cable cars, cruise ships, and more.

This technology has expanded its reach through collaboration with leading display solution provider AUO on a ferry operating in the Port of Kaohsiung. AUO has taken the infotainment concept from the water to the road, transforming it into the Interactive Transparent Window. This innovation won a CES 2024 Best of Innovation Honoree, showcasing ITRI's commitment to empowering Taiwanese companies on the global stage.

The Hyper-Realistic 3D Interactive Display interacts with your avatar

The Hyper-Realistic 3D Interactive Display is the world's first interactive system that can interact with your digital avatar and deliver 3D animations and live broadcasts. Powered by generative AI (Gen AI), the system can carry out real-time image processing, including 3D models, image matting, expression, motion generation, single 2D to 3D imaging, and 3D virtual-sense fusion, making it ideal for creative advertising and marketing campaigns.

Key features include:

Gen AI 2D to 3D imaging: Using advanced AI technology, the system swiftly converts 2D images into an intricate avatar in 3D.
Smart virtual-real 3D image fusion: The avatar appears 3D to the naked eye and can maintain eye contact with viewers from various angles.
AI expression and motion generation: Continuous expressions of the avatar can be synthesized from a single image and voice. Its movements are also lifelike and accurate because of the automatic skeleton binding technology.
PetPet Cam captures pets' "cute events"

PetPet Cam utilizes Gen AI to train a deep neural network (DNN) model to accurately capture "cute events" of pets, such as yawning, belly showing, stretching, and playful interactions with family members. It automatically generates photo and video mashups that owners can effortlessly share on social media platforms.

The onboard edge AI works like an experienced photographer, reacting instantly to the pet's actions and deftly controlling the shutter. PetPet Cam's autonomous photo capturing reaches 95% accuracy for defined events, saving the owner from searching through hours of footage to find a specific frame.

PetPet Cam identifies individual pets, tracks their drinking and feeding frequency, and provides valuable insights for pet owners and healthcare professionals. Its versatile design allows users to set it up in the pet's living area or use multiple cameras to cover various spaces.

The Detachable Joint Robot System enables rapid robotic arm assembly

The Detachable Joint Robot System can be rapidly assembled into a plug-and-play robotic arm with a customizable number of axes for real-time motion commands. It enables the customized creation of robots with high payload, multiple axes, or wide-ranging operations, catering to the demand for flexible and small-batch production.

While traditional robotic-arm repairs can take days, this innovative module can have its axis replaced in just five minutes, significantly enhancing production efficiency while reducing costs, time, and manufacturing risks. Compared to industry-standard joint modules, the Detachable Joint Robot System is not only lighter but also boasts a superior load-to-weight ratio and the world's highest torque-to-volume ratio.

RoboTwin brings virtual reality to factories

Through state-of-the-art AI and Sim2Real technologies, RoboTwin: Metaverse Smart Factory Simulation Platform creates a realistic VR simulation of a manufacturing factory based on real-world data. Engineers and operators wearing VR headsets can immerse themselves in the virtual factory, simulating production-line adjustments and performing tasks.

RoboTwin's customizable applications include industrial metaverse experiences, human-robot interactive simulation, and various applications for multi-agent collaboration, remote troubleshooting, and maintenance via teleoperation.

Leading Taiwanese manufacturers, China Steel Machinery Corporation (CSMC) and TECO Electric & Machinery Co., Ltd (TECO), have utilized RoboTwin to create virtual factories, enhancing efficiency in their production processes. RoboTwin also holds significant application potential in industries such as semiconductors, machining, and manufacturing.

These AI display and entertainment and AI robotics innovations are making their U.S. debut at CES 2024. We invite potential collaborators for technology transfers and business partnerships. Interested parties can book a meeting here.

Access ITRI's CES 2024 press kit here. Additional multimedia materials including technology videos, photos, and fact sheets are available here.

About ITRI
Industrial Technology Research Institute (ITRI) is one of the world's leading technology R&D institutions aiming to innovate a better future for society. Founded in 1973, ITRI has played a vital role in transforming Taiwan's industries from labor-intensive into innovation-driven. To address market needs and global trends, it has launched its 2035 Technology Strategy and Roadmap that focuses on innovation development in Smart Living, Quality Health, Sustainable Environment, and Resilient Society.

Over the years, ITRI has been dedicated to incubating startups and spinoffs, including well-known names such as UMC and TSMC. In addition to its headquarters in Taiwan, ITRI has branch offices in the U.S., Europe, and Japan in an effort to extend its R&D scope and promote international cooperation across the globe. For more information, please visit https://www.itri.org/eng.