Hiwonder JetArm ROS1/ROS2 3D Vision Robot Arm

Multimodal Models Deployment

JetArm integrates a Multimodal Large AI Model and supports online deployment via OpenAI's API, enabling real-time access to advanced AI capabilities. It also allows seamless switching to alternative models, such as those available through OpenRouter, to support Vision Language Model applications. At its core, JetArm is designed as an all-in-one interaction hub built around ChatGPT, enabling sophisticated embodied AI use cases and creating a smooth, intuitive human-machine interaction experience! 

Large AI Model–Driven Embodied AI Applications

JetArm Ultimate Kit is equipped with a circular 6-microphone array. Going beyond the one-way command-response pattern of traditional AI models, JetArm—powered by ChatGPT—enables a cognitive leap from semantic understanding to physical execution, significantly enhancing the naturalness and fluidity of human-machine interaction. Combined with advanced machine vision, JetArm delivers outstanding capabilities in perception, reasoning, and action, making it ideal for developing sophisticated embodied AI applications.

Voice Control With ChatGPT integration, JetArm can comprehend spoken commands and carry out corresponding actions, enabling intuitive and seamless voice-controlled interaction.	Color Sorting With the support of ChatGPT, JetArm can understand user commands and, when combined with AI vision, accurately identify and sort objects based on their colors within its field of view.
Waste Sorting JetArm leverages the YOLOv8 deep learning model built into its system to recognize different types of objects in the scene. With the power of ChatGPT, it can interpret user commands and perform corresponding actions, such as waste sorting.	3D Object Sorting Equipped with a 3D depth camera, JetArm can detect objects of various shapes within its field of view. When combined with ChatGPT, it understands user instructions and carries out the required actions.

Deep Learning Model Training

JetArm integrates advanced neural network technologies, leveraging YOLOv8 for real-time multi-object detection. It enables customized deep learning model training for specific objects, producing lightweight models optimized for TensorRT acceleration, unlocking a wide range of AI-driven creative possibilities.

Gazebo Simulation

The JetArm robotic arm is developed using the ROS framework and supports GAZEBO simulation. The robotic arm is controlled and algorithm verified in a virtual environment, which reduces the requirements for the experimental environment and improves experimental efficiency.

 JetArm Configuration Selection Guide

The Jetson Nano provides essential AI inference capabilities, perfect for simple neural networks and deep learning models, making it ideal for entry-level AI applications. The Jetson Orin Nano offers 80 times the performance and computing power of the Jetson Nano, supporting more complex deep learning models and accelerated inference, making it well-suited for advanced edge AI applications. The Jetson Orin NX boosts computing power 2.5 times over the Jetson Orin Nano, offering top-tier AI inference performance for larger neural networks and real-time deep learning tasks. This performance upgrade enhances JetArm, unlocking exceptional capabilities in servo control, vision tasks, and deep learning across a wide range of applications!