Week 15 :: Final Demo

How can we send instructions through a wearable?




Haptic Feedback for Manual Actions



Final Project Demo

What does it do?

This wearable guidance system sends haptic feedback based on coordinates in a digital model.

Who has done what beforehand?

Haptic feedback using coin vibration motors is common technology in smartphones and specifically Apple touchpads. Motion tracking in 3D is commonly done for VR applications, like in the Magic Leap 2.

What did you design?

I designed the wearable glove, onboard PCB and integrated electronics housing, and an application to perform computer vision processing using multiple cameras and openCV.

What materials and components were used?

Responsive image
Budget breakdown of non-inventory items incorporated into the final design.

What processes were used?

CAD was used to design 3D printed PCB housing.
Computer-controlled cutting was used to lasercut pieces for camera mounts.
Embedded programming was used to incorporate two RP2040 Xiaos into the design.
3D scanning and printing were used to make the mannequin arm to assist with wearable design and fabrication.
Electronics Design & Production were used to iterate circuitboards to consolidate the electronics into a small lightweight package.
Molding and casting were used to produce a silicone buffer shaped to attach the electronics comfortably to the arm.
Computer-controlled machining was used to make a camera stand from scrap MDF.
Input devices were used to read flex sensor and IMU data to gather information about gestures.
Output devices were used to send vibration pulses to the arm and display rotation vector data on the wearable.
Networking and communications were used to incorporate two remote ESP-32 cameras into the design.
Interface and application programming was used to create an interface for computer vision processing.