Component
Authoring interface
The surface a non expert actually touches: a canvas to draw a motion on, a library of what they have authored, and a plan they can read and edit before anything runs. Usable in one sitting, by someone who has never programmed a robot, while being observed.
HTML / CSS / JSReactCanvas 2DSVG
Used in thesis work · EventMakAR
Component
Scenario engine
Turns a scenario written in plain English into assignments drawn from the user's own motion library. Output that does not hold up structurally is refused and regenerated rather than passed downstream, and the result is always shown to a person before it reaches hardware.
Claude APIGemini APIStructured output validationSchema repair
Used in thesis work · nursing video
Component
Augmented reality layer
Spatial overlays registered to the room, driven by the same event file a non programmer authored in the browser. The runtime parses the file and drives the physical characters, so authored stories run without anyone opening the Unity project.
UnityAR FoundationARCoreC#
Used in EventMakAR
Component
Control server
The centre of the fleet: takes an approved plan, splits it per robot, dispatches commands and watches what comes back. Also where an emergency stop lives, which matters when the robots are on the floor of a room with participants in it.
PythonWebSocketsRESTSerial
Used in thesis work · the motion study
Component
Localization
Knowing where each robot actually is, not where it was told to be. Without accurate position you cannot tell whether a robot performed the motion a person authored, which makes the whole study unanswerable. My first localization approach was not accurate enough and I replaced it.
HTC Vive TrackerSteamVRArUco markersOpenCV
Used in thesis work · the motion study
Component
Robot controllers
The robots themselves. Microcontroller firmware driving motors and servos over wifi, on a chassis built for roughly thirty dollars a unit so a study can use a fleet rather than one robot.
ESP32 / NodeMCUC++ (Arduino)PWM motor control3D printed chassis
Used in the motion study · thesis work
Component
Study instrumentation
What a session leaves behind: authoring logs, execution traces, questionnaire responses and interview recordings, captured so that what someone said while authoring can be read against what they reported once they were done.
Think aloud protocolSUSNASA-TLXSemi structured interviews
Used in thesis work · the motion study
Component
Analysis
Turning sessions into findings: counterbalanced within subjects comparison, descriptive and inferential statistics, and qualitative coding of what participants said, plus the figures that report it.
PythonpandasmatplotlibQualitative coding
Used in thesis work · the motion study