Summary
IntegratedFlight is a safety-first drone command and mission control platform built for the Canadian Armed Forces–themed Voice-Driven UxS Hackathon at SAIT. The system lets a single operator issue plain-English voice commands — such as "Alpha take off to 10 meters" or "Fly to the northwest watch tower" — which are parsed by an LLM-powered command brain, validated against hard mission constraints (IFF logic, no-go zones, altitude limits), and executed against a simulated drone stack. The goal was to bridge natural command UX with deterministic safety rules, so operators can act quickly under pressure without bypassing mission-critical safeguards.
Workflow
Step 1
Built a Whisper-based speech-to-text backend in FastAPI to capture and transcribe operator voice commands in real time, producing clean text input for downstream parsing.
Step 2
Developed a Groq-powered LLM command parser that resolves plain-English speech into structured drone actions, mapping spoken phrases to canonical waypoint IDs and mission parameters.
Step 3
Implemented a hard-block safety validation layer that rejects commands violating no-go zones, altitude limits, invalid waypoints, or prohibited IFF targeting patterns before any execution reaches the drone stack.
Step 4
Designed an operator confirmation flow for ambiguous or high-risk commands, with session memory supporting context-aware follow-ups such as "do that again" or "same target."
Step 5
Built a React/Vite operator UI for real-time command logging, mission state display, and voice response feedback, giving operators continuous visibility into system decisions.
Step 6
Integrated telemetry-ready MAVLink/SITL hooks and multi-waypoint route tasking, enabling validated commands to drive a live simulated drone in Gazebo.