Ubitus, a global leader in cloud streaming technology, is showcasing a series of AI-powered innovations at the NVIDIA AI Summit Japan 2024, held in Tokyo on 13 November. As a Gold sponsor of the event, Ubitus is presenting three major AI-driven solutions designed to enhance human interaction across various industries, from robotics and digital entertainment to the expanding field of virtual reality.
Visitors can experience these groundbreaking innovations first-hand at booth 19, where Ubitus demonstrates its latest advancements, developed using NVIDIA’s cutting-edge technology. The showcased innovations include an AI-powered robot, lifelike digital humans, and a sophisticated AI VTuber—all examples of Ubitus’ work in advancing natural human-computer interaction through artificial intelligence.
Pioneering Human-Robot Interaction with LLM-Driven Robotic AI
The centrepiece of Ubitus’ presentation is its large language model (LLM)-driven robotic AI. Utilising the NVIDIA Jetson platform as its core, this robot is further powered by the H100 GPU, enabling seamless language processing and visual recognition capabilities. Users can communicate with the robot in natural language, allowing it to respond without complex commands or programming.
Equipped with advanced visual recognition, the robot can identify specific objects upon request via its in-built camera, making it highly versatile for applications across sectors such as healthcare, security, and retail. This innovation exemplifies the potential for AI robots to perform tasks with intuitive, real-time responses, enhancing their role in various operational environments.
Digital Humans with NVIDIA ACE and Unreal Engine 5
Ubitus is also showcasing its digital human technology, developed using Unreal Engine 5 (UE5) and powered by NVIDIA’s Avatar Cloud Engine (ACE). Designed for dynamic, context-aware engagement, these digital humans are embedded with capabilities for conversation memory, background knowledge retrieval, and multilingual support, providing a lifelike virtual experience.
These virtual beings possess realistic facial expressions and can respond emotionally, offering users a highly immersive interaction. With cloud streaming capabilities, Ubitus allows seamless access to these digital humans on multiple devices, paving the way for enriched user engagement in fields like customer service, digital entertainment, and interactive media.
AI VTuber Ubi-chan with Apple Vision Pro Integration
Ubitus’ VTuber, known as Ubi-chan, demonstrates how AI can enhance virtual interactions. Powered by NVIDIA Riva’s text-to-speech and Audio-to-Face technology, Ubi-chan can lip-sync speech in real time, creating a fluid and lifelike visual performance. NVIDIA’s automatic speech recognition (ASR) and advanced hand-tracking features enable users to interact with Ubi-chan using natural voice prompts and touch-like gestures.
Ubi-chan is also integrated with Apple Vision Pro, further elevating the immersive experience by allowing users to witness realistic responses to their interactions. This development signals a new era in virtual characters, setting a higher standard for interactive, AI-powered experiences in digital entertainment.
Wesley Kuo, CEO of Ubitus, expressed enthusiasm for the summit, stating, “As a leader in AI and cloud gaming, Ubitus is committed to showcasing the future of AI-driven interactions. The NVIDIA AI Summit Japan provides an ideal platform to highlight how our solutions can drive innovation in multiple industries.”
Attendees are encouraged to visit the Ubitus booth to witness live demonstrations of these AI technologies, each one a testament to how AI is transforming the landscape of human-computer interaction across various industries.
