- Augmented Reality
- Three.js
- Mediapipe Hands
- Tensorflow
This project is based on LingDong's Handpose Demos using mediapipe handpose with tensorflow.js.
From the tracking points mediapipe delivered, I calculated two additional points that gave me a line going through the middle of the first knuckles. This creates the illusion of the beam extending a hilt held in a fist. UnrealBloomPass doesn't work on a transparent background, so I replaced it with PMNDRS Three Post Processing. It looks awkward without a prop in your hand though, so grab a pen or something!
A lightsaber is nothing without sound, so I added tone.js to create the hum. I know nothing whatsoever about synthesizers, so I had to fumble my way through with the thankfully extensive documentation.
