This morning, when I opened x.com, I came across a few really interesting posts. Some people showed creative ideas using their laptop camera, or an external webcam, to control parts of their screen with simple hand gestures. That caught my attention right away.
Since I have been spending a lot of time experimenting with Google's AI Studio lately, I thought to myself, why not try to build something similar? I imagined how cool it would be if I could scroll through the new hive.io website using only my hand. No mouse, no keyboard, just gestures in the air.
So I gave it a try. I uploaded a few lines of code, used my webcam, and asked the AI agent to help me build a simple prototype. It took a few prompts, some back and forth adjustments, and about 45 minutes in total. But finally, it worked! As you can see in the short video I made, I am able to scroll the Hive.io page just by moving my hand in front of the camera.
This simple prototype feels like a small step into something much bigger. I think there are many creative things we can build when we combine AI tools with everyday devices like a webcam. The technology behind this kind of interaction is often based on machine learning models that detect motion, key points on the hand, or even gestures like waving or pinching.
Now that I have a working version, I am excited to explore more wild and fun ideas. Maybe controlling menus, flipping through images, or even navigating Hive dApps with nothing but hand signals?
Let’s see where this goes!
▶️ 3Speak
Might be time for another cam in a hand friendly position
We have kids turning gestures on their Chromebooks and then things start acting all funky and they don't know what they did to turn it on. We have to dig through the menus and find the shortcut to shut it off for them. It happens infrequently enough that we always forget the fix and have to look it up again each time!
Next is hive's first hot thot with exotic deep German accent