P05_personal
P05_personal
P05_personal
Keeping physical input and virtual feedback in sync
Keeping physical input and virtual feedback in sync
Keeping physical input and virtual feedback in sync
The prototype connected physical movement with a Unity-based digital environment, requiring sensor input, motion tracking, system state, and visual feedback to operate as one real-time interaction loop.
I integrated Arduino and Unity through serial communication so physical inputs could update the virtual system state and produce immediate feedback, then refined gesture recognition and interaction logic through 3 design iterations and 10 usability tests. The iterations focused on making system responses more stable and predictable, showing that spatial interaction depended not only on recognizing movement, but on maintaining a consistent relationship between physical action and digital system response.
Key decision / trade-off
Movement → Visual Output: demonstrates the interaction quickly, but gives limited control over how physical input changes system behavior.
Movement → Sensor / Tracking → System State → Feedback: requires additional integration logic, but creates a controllable and testable interaction loop.
Decision: connect physical input to an explicit Unity system state through serial communication, then use user testing to refine how that state translated into feedback.
Takeaway: Spatial interaction becomes reliable when physical actions and digital states remain synchronized throughout the feedback loop.
Unity · C# · Arduino · Serial Communication · Motion Tracking · Validation
The prototype connected physical movement with a Unity-based digital environment, requiring sensor input, motion tracking, system state, and visual feedback to operate as one real-time interaction loop.
I integrated Arduino and Unity through serial communication so physical inputs could update the virtual system state and produce immediate feedback, then refined gesture recognition and interaction logic through 3 design iterations and 10 usability tests. The iterations focused on making system responses more stable and predictable, showing that spatial interaction depended not only on recognizing movement, but on maintaining a consistent relationship between physical action and digital system response.
Key decision / trade-off
Movement → Visual Output: demonstrates the interaction quickly, but gives limited control over how physical input changes system behavior.
Movement → Sensor / Tracking → System State → Feedback: requires additional integration logic, but creates a controllable and testable interaction loop.
Decision: connect physical input to an explicit Unity system state through serial communication, then use user testing to refine how that state translated into feedback.
Takeaway: Spatial interaction becomes reliable when physical actions and digital states remain synchronized throughout the feedback loop.
Unity · C# · Arduino · Serial Communication · Motion Tracking · Validation
The prototype connected physical movement with a Unity-based digital environment, requiring sensor input, motion tracking, system state, and visual feedback to operate as one real-time interaction loop.
I integrated Arduino and Unity through serial communication so physical inputs could update the virtual system state and produce immediate feedback, then refined gesture recognition and interaction logic through 3 design iterations and 10 usability tests. The iterations focused on making system responses more stable and predictable, showing that spatial interaction depended not only on recognizing movement, but on maintaining a consistent relationship between physical action and digital system response.
Key decision / trade-off
Movement → Visual Output: demonstrates the interaction quickly, but gives limited control over how physical input changes system behavior.
Movement → Sensor / Tracking → System State → Feedback: requires additional integration logic, but creates a controllable and testable interaction loop.
Decision: connect physical input to an explicit Unity system state through serial communication, then use user testing to refine how that state translated into feedback.
Takeaway: Spatial interaction becomes reliable when physical actions and digital states remain synchronized throughout the feedback loop.
Unity · C# · Arduino · Serial Communication · Motion Tracking · Validation
