Edge Vision Actuation — Voice-Controlled Autonomous Robot
A full perception-navigation-task planning integration on real hardware: an NVIDIA Jetson Orin Nano Super mounted on a mobile robot chassis, closing the loop from camera and microphone input to real motor control — no cloud dependency, all inference on-device.
Exported a YOLOv8 detector to TensorRT FP16, benchmarking a measured 27% throughput improvement (13.9 → 17.6 FPS) over baseline PyTorch inference. Built a GPU-accelerated voice pipeline (wake-word detection + Whisper transcription) driving the robot's motors over a serial Open Interface protocol, with live obstacle-safety behaviour confirmed on hardware. Diagnosed and fixed a safety-critical integration bug where obstacle-detection events silently disabled further commands.