Made a bad decision? Go to Cool Kids
Prabal Khare, robotics software engineer

Prabal Khare

Robotics Software Engineer · Brooklyn, New York

I build robot systems and study what happens when learned policies fail.

I build the whole robot — sensors, comms, localization, navigation, controls, operator tooling, and the deployment that proves it works. Now at NYU, working on whether learned policies can recover when they do not.

Current research

Ripple: An always-on site engineer for Nav2 robots

Active research2025 — present

Ripple watches a Nav2 robot, diagnoses why it stopped, and recovers inside a budget you configure — clearing costmaps, probing routes, routing around a tight spot, backing out under teleop. When the evidence says the problem is physical, it stops and asks an engineer in plain words. Every closed incident leaves a lesson attached to that place, so the same corner does not cost the same time twice. A separate research arm asks whether interventions like these actually raise task success on frozen learned policies.

ROS 2 Humble · Nav2 · PostgreSQL · GLM 5.3 · OpenRouter · Gazebo · RosScope · Node.js

Case study →Live site ↗

Policy training and evaluation on the LeRobot SO101 platform

SO101 Manipulation and SmolVLA Experiments: Policy training and evaluation on the LeRobot SO101 platform

Active research2025 — present

A manipulation direction built on the LeRobot SO101 platform: hardware bring-up, a two-camera setup, SmolVLA training, and MuJoCo evaluation. The validated work so far is infrastructural — dataset checks, action replay, camera and normalisation verification — which is what has to be true before any policy number means anything.

LeRobot · SO101 · SmolVLA · MuJoCo · Python · PyTorch

Case study →

Selected work

SMR300: 300 kg industrial autonomous mobile robot

Deployed2026 · Next Robotics Lab

The full autonomy stack — written to be reused across a fleet, not to survive one demo. Rebuilt from a legacy ROS 1 architecture into ROS 2 Humble, validated over 300 logged trials on a live factory floor.

97% shelf docking success · 2 cm shelf docking error · 3 cm point-to-point mismatch

ROS 2 Humble · Nav2 · CANopen · CiA 402 · PGV · LiDAR · C++

Case study →
Kurat — RealSense D435i and Jetson Orin Nano on a four-wheel chassis

Kurat: Autonomous conversational robot

Active development2025 — present

A companion robot built on a three-brain architecture that separates perception, cognition and action so each can fail and recover independently.

ROS 2 · PyTorch · YOLOv8 · Whisper · ORB-SLAM3 · Nav2 · Jetson

Case study →
Details
  • Three-brain split — perception, cognition, action — for modular autonomy and reliable real-time interaction.
  • Intel RealSense D435i + Jetson Orin Nano running YOLOv8, Whisper, ORB-SLAM3 and Nav2 for perception, speech, localization and navigation.
Project MIRA — extruded aluminium frame, ducted thrusters, domed pressure housings

Project MIRA: Autonomous underwater vehicle

Completed2023 — 2025

Sealed-hull AUV that took 2nd place at the TAC Challenge in Norway, 2024. I owned the electrical architecture and the MAVROS control software.

ROS · MAVROS · MAVLink · PCB · Power distribution

Case study →
Details
  • Electrical architecture and power distribution inside a sealed pressure hull.
  • Hydrophone and sensor-control subsystem integration, PCB prototyping.
  • ROS / MAVROS / MAVLink control software and cross-functional test coordination.
Detector output on held-out CODEBRIM bridge imagery — efflorescence and spallation, with confidences

OpenDroneKit: Structural inspection toolkit

Active development2025

Offline-first drone inspection desktop app: mission planning, defect analytics, and crack propagation estimation over a 3D reconstruction.

PyQt6 · YOLOv8 · U-Net · COLMAP · FEniCSx · Python

Case study →Repository ↗
Details
  • ~40,000 metal, brick and mixed defect images through YOLOv8 detection and U-Net crack segmentation.
  • Cracks projected onto COLMAP reconstructions, then fed to FEniCSx to estimate propagation and flag severity.
  • PyQt6 workflows for project setup, dataset import, analysis, reconstruction and reporting.

ROS 2 fleet diagnostics

RosScope: ROS 2 fleet diagnostics

Open source2026

An oscilloscope for ROS 2. A Qt6 desktop tool that shows you what the graph is actually doing instead of making you infer it from scrolling logs.

C++17 · Qt6 · CMake · ROS 2 Humble/Iron/Jazzy · SSH

Case study →Repository ↗
Details
  • ROS-aware Linux process monitoring mapped to nodes, domains, PIDs, executables and workspaces.
  • Graph inspection across topics, QoS, TF, Nav2 and lifecycle state, with zombie-process, conflict and missing-link detection.
  • Process control, snapshot export, session recording, and SSH-based remote fleet monitoring.
  • Dual UI: an engineer mode for diagnostics and a stripped operator mode for the floor.
The Now view — current task, decisions taken, and open questions carried between agent sessions

Continuum: Open-source AI agent memory

Open source2026

Git, but for the context your AI agent is holding. Switch from Claude Code to Codex to Gemini without re-explaining the codebase, the bug, or what you already tried.

Python · SQLite · MCP · Agent hooks · CLI

Case study →Repository ↗
Details
  • Three-layer architecture mirroring Git: an append-only SQLite event log, checkpoints as commits, and a materialized `current.md` view.
  • `continuum log / diff / blame / restore / branch / merge` — plus `note`, `ask`, and semantic `search` over recorded decisions and hypotheses.
  • Local-first: everything lives in `.continuum/`, nothing uploads by default. Ships as a Claude Code plugin and an MCP server.
  • Repo benchmark reports 100% recall accuracy with context injection versus 17–20% without, ~94% context compression, and agent response time dropping from 17–21 s to 5.5 s.

Everything else

  • Autonomous VTOL UAV · 2023

    Search and rescue

    Python · MAVROS · Pixhawk · OpenCV · TFLite

    Case study →

  • next_EKF · 2026

    Odometry + IMU fusion

    ROS 2 Humble · robot_localization · Allan variance · C++ · EKF

    Repository ↗

  • next_HI · 2026

    CANopen hardware interface

    ros2_control · CANopen · CiA 402 · SocketCAN · SLAM Toolbox

    Repository ↗

  • RobotDrawing · 2026

    Learned motion planning · ABB IRB140

    PyTorch · PyTorch Geometric · GNN · Pointer Network · RL

    Case study →Repository ↗

  • Recalibration-Free Stereo PTU · 2025

    Perception hardware

    Stereo vision · SGBM · MiDaS · EKF · UKF

    Case study →

  • Continuum Extension · 2026

    Browser control plane

    React · Vite · Tailwind · MV3 · Native messaging

    Repository ↗

  • InfrenceX CLI · 2026

    Agentic terminal + model marketplace

    Node.js · Ink · TypeScript · JSON-RPC · MCP

    Repository ↗

  • Botopsy Lab · 2026

    Robotics education platform

    ROS 2 · Browser VMs · Autograding · Curriculum design

    botopsylab.com ↗

  • FlowPilot · 2026

    AI control plane for Node-RED

    React · Vite · Express · WebSocket · SQLite

    Case study →Repository ↗

  • ContractEncrypt · 2025

    Post-quantum cryptography study

    Python · NumPy · PyCryptodome · Qiskit · LWE

    Repository ↗

Lab bench

  • FaceTrack ↗

    OpenCV face detection driving two servos through an Arduino over serial — vision to actuation in the shortest possible loop.

    Python · OpenCV · Arduino

  • Gesture-Controlled Car ↗

    IMU glove commanding a car over ESP-NOW — no pairing, no router, sub-frame latency.

    C++ · ESP-NOW · Arduino

  • smr300l_gazebo_ros2control ↗

    Gazebo simulation of the SMR300L with ros2_control, so autonomy changes could be regression-tested off the factory floor.

    Gazebo · ros2_control

  • claude-skills ↗

    Reusable agent skills packaged for Claude Code — the tooling layer under my own workflow.

    Shell · Agent skills

Experience

Robotics Software Intern · Next Robotics Lab Co., Ltd.

Jan 2026 — Jul 2026

Pathum Thani, Thailand

  • Architected a reusable ROS 2 autonomy stack for the 300 kg SMR300 AMR — integrating LiDAR, PGV, Nav2, an AI camera, CANopen and CiA 402 — replacing the company's prior ROS 1 architecture.
  • Validated navigation across 150 shelf-docking trials and 150 point-to-point runs: 97% docking success, 2 cm shelf docking error, point-to-point mismatch cut from 5 cm to a 3 cm mean.
  • Implemented reflective-marker recognition for two- and four-legged shelves using LiDAR clustering, center checks, automatic repositioning, sector safety gating, safe aborts and alerts; root-caused failures traced to sunlight reflections at open factory doors.
  • Built an operator platform for mapping, map editing, URDF and sensor configuration, Nav2 parameter tuning, mission control, monitoring and deployment validation — plus a Node-RED dashboard evaluated by 5 operators and 2 engineers.
  • Developed Python, C++, JavaScript and Web API components for path following, zone management, map handling, robot profiles, workflow management and robot bringup.

ROS 2 Humble · Nav2 · CANopen · CiA 402 · PGV · LiDAR · C++

Repository ↗

Hardware Engineering Intern · Theta Sound

Jan 2025 — Oct 2025

Remote

  • Researched smart-earphone architectures and produced multiple PCB layouts and simulated prototypes — evaluating Qualcomm audio platforms, ANC, Bluetooth, microphones, battery systems, PPG and IMU health sensing, and sensor fusion.
  • Modeled board footprint, battery life and power consumption to guide an early prototype for engineers and manufacturers; led a KiCad PCB design workshop for 50 attendees.

KiCad · PCB · ANC · PPG · IMU · Power budgeting

AI Software Development Intern · Drone Entry

Jun 2025 — Aug 2025

Thailand

  • Built OpenDroneKit — a PyQt6 structural-inspection workflow spanning ~40,000 metal, brick and other defect images, integrating YOLOv8 detection and U-Net crack segmentation.
  • Mapped detected cracks onto COLMAP 3D reconstructions and connected segmentation masks to FEniCSx simulations to estimate crack propagation over time and flag structural severity.
  • Implemented desktop workflows for project setup, dataset import, defect analysis, reconstruction and report generation.

PyQt6 · YOLOv8 · U-Net · COLMAP · FEniCSx

Repository ↗

R&D Summer Intern — Robotics & Drones · Drone Academy

May 2025 — Jun 2025

Thailand

  • Designed and fabricated 3 PCBs — an animatronic head, Raspberry Pi 4 I/O, and an RC car kit — driving eye, jaw and head servos plus a speaker through GPIO.
  • Ran text-to-speech and a 2B-parameter language model locally on an 8 GB Raspberry Pi 4; validated the RC car board for sale as a build-your-own educational product.

PCB · Raspberry Pi 4 · Animatronics · Local LLM · TTS

Resource Head · Systems Department · Dreadnought Robotics

Aug 2023 — Jun 2025

Chennai, India

  • Managed a $15K+ budget, inventory and procurement for 120 members across 4 departments — comparing alternatives on cost, availability and system fit.
  • For Project MIRA, designed electrical systems for reliable operation inside a sealed AUV pressure hull and developed ROS, MAVROS and MAVLink control software — contributing to 2nd place at TAC Challenge Norway 2024.
  • Integrated power distribution, hydrophones and sensor-control subsystems while coordinating cross-functional testing across hardware and software teams.

ROS · MAVROS · MAVLink · AUV · Power distribution

Patents

Transformation Drone — flight mode, arms deployed

Transformation Drone — Autonomous Drone-Rover System

Filed · 202641035669

One vehicle that drives and flies. Four arms carry both the propellers and geared drive wheels, so it rolls through terrain on the ground and lifts off when the ground runs out — with AI-driven visual and thermal detection for search and rescue in GPS-denied environments.

UAV-UGV · Search & rescue · GPS-denied · Thermal · Raspberry Pi

Thermoregulating bottle — Peltier loop, sealed electronics bay, pill dispenser

Thermoregulation System for Portable Water Containers

Filed · Number pending

A smart bottle that heats or cools its own contents. A Peltier stack under the body circulates water through inlet and outlet lines, with a sealed compartment for the microcontroller, battery and wiring, and an integrated pill dispenser on the side — so medication and the water to take it with travel together.

Peltier · Thermal design · BMS · Pill dispenser · Embedded

IMU

IMU Calibration and Sensor Fusion Module

Filed · Number pending

Bias, scale-factor and misalignment calibration with complementary and EKF-based fusion for stable attitude estimation under vibration.

IMU · Calibration · EKF · Attitude estimation

Media

SMR300

Autonomous shelf docking — approach, align, lift
SMR300 on the factory floor, squaring up to a shelf
SMR300 on the factory floor, squaring up to a shelf
Operator control plane — live scan, path editor, safety groups
Operator control plane — live scan, path editor, safety groups
PGV mode — tag-referenced localization run

Project MIRA

Project MIRA — extruded aluminium frame, ducted thrusters, domed pressure housings
Project MIRA — extruded aluminium frame, ducted thrusters, domed pressure housings
Second place, TAC Challenge Norway 2024 — Dreadnought Robotics
Second place, TAC Challenge Norway 2024 — Dreadnought Robotics
Project MIRA — autonomous docking run

Patents

Transformation Drone — rover mode, driving on geared hubs
Transformation Drone — rover mode, driving on geared hubs
Transformation Drone — flight mode, arms deployed
Transformation Drone — flight mode, arms deployed
Thermoregulating bottle — Peltier loop, sealed electronics bay, pill dispenser
Thermoregulating bottle — Peltier loop, sealed electronics bay, pill dispenser
Transformation Drone — driving and flying on the same four arms

UAV

VTOL search-and-rescue quadplane — plank wing, four lift rotors, exposed avionics
VTOL search-and-rescue quadplane — plank wing, four lift rotors, exposed avionics

Kurat

Kurat — RealSense D435i and Jetson Orin Nano on a four-wheel chassis
Kurat — RealSense D435i and Jetson Orin Nano on a four-wheel chassis
Kurat perception — YOLO detections with confidence, live indoor scene
Kurat perception — YOLO detections with confidence, live indoor scene

Hardware

Animatronic head — eye, jaw and head servos driven over GPIO
Animatronic head — eye, jaw and head servos driven over GPIO
Two-layer PCB, fabricated
Two-layer PCB, fabricated

Team

Dreadnought Robotics — 120 members, 4 departments
Dreadnought Robotics — 120 members, 4 departments

About

Most recently I replaced a company's ROS 1 architecture with a ROS 2 Humble stack for the SMR300, a 300 kg industrial AMR — LiDAR perception, PGV floor-tag localization, Nav2 navigation, CANopen and CiA 402 drives, and an operator platform for engineers who don't write code. It docks with 97% success and 2 cm mean error across 150 trials.

Languages: English, Hindi, Thai, Marathi, German (basic).

Skills

Programming
C++ · Python · JavaScript · TypeScript · MATLAB
Robotics & Autonomy
ROS 2 Humble · ROS 1 · Nav2 · SLAM · tf2 · URDF · RViz · Gazebo · Localization · Path planning · Robot bringup · AMRs · MAVROS · MAVLink
Controls & Embedded
CANopen · CiA 402 · RS-485 · PID control · Sensor fusion · EKF / UKF · Raspberry Pi · Arduino · Pixhawk · Motor drivers · PCB design · KiCad
Perception & Vision
OpenCV · YOLOv8 · U-Net · PyTorch · TensorFlow · ORB-SLAM3 · COLMAP · RealSense D435i · LiDAR · PGV · SGBM · MiDaS
Embodied AI & Learning
Vision-Language-Action models · LeRobot · SmolVLA · LIBERO · Robot policy evaluation · Policy recovery · Robot agents · World action models · Grasp generation · MANO · Dexterous manipulation · MuJoCo · Experiment design · Simulation-based evaluation
Tools & Platforms
Linux · Docker · Git · Node-RED · PyQt6 · FEniCSx · Jetson Orin Nano · CUDA · TensorRT · MCP servers

Education

New York University · Tandon School of Engineering

Aug 2026 — May 2028

M.S. Mechatronics and Robotics

Brooklyn, NY

Vellore Institute of Technology · VIT Chennai

2022 — Jul 2026

B.Tech Computer Engineering — Robotics & AI Specialization

Chennai, India

Honors

  • 2nd Place — TAC Challenge Norway 2024 (2024)

    International autonomous underwater vehicle competition — Project MIRA.

  • Top 5 of 400 — Smart India Hackathon 2024 (2024)

    National hardware and software innovation competition.

  • Top 30 of 500 — Smart India Hackathon 2023 (2023)

    Autonomous VTOL search-and-rescue UAV.

  • 2nd Place — GEOFEST CMU 2020 (2020)

    Carnegie Mellon University geoscience festival.

  • 50 attendees — KiCad PCB Design Workshop (2025)

    Led hands-on PCB layout training for engineering students.

  • 100+ students — Machine Learning Workshop (2024)

    Led an applied ML workshop for the university robotics community.