Development · GitHub repo
Man-Melds-With-Machine
Open-source hand gesture and voice navigation system for macOS
Man-Melds-With-Machine is an open-source Python tool that lets you control a Mac using real-time webcam hand gestures and speech. It uses computer vision to track hand movements and map distinct gestures to cursor navigation, clicks, scrolling, browser tabs, and Mission Control. Voice input integrates via external speech-to-text apps like Wispr Flow triggered by gesture-simulated hotkeys.
What it's for
- Navigate web pages and scroll hands-free on macOS using webcam gestures
- Switch tabs and snap directly to the browser search bar without touching the keyboard
- Trigger speech-to-type input using a specific hand gesture
- Control macOS desktop functions like Mission Control with custom physical gestures
Features
- Real-time hand tracking via webcam using computer vision
- Cursor movement mapping using open-palm positioning
- Gesture controls for mouse clicks, scrolling, and dragging
- Browser navigation gestures including tab switching, new tab, and forward/back
- Instant search bar snapping gesture
- Mission Control trigger via a closed fist gesture
- Speech-to-type integration shortcut designed for tools like Wispr Flow
Pricing
Open source. Free and open source (MIT license)
Details
- Type
- GitHub repo
- Category
- Development
- Topic
- Computer Vision
- Open source
- Yes
- Platforms
- macOS
- For
- Developers and power users experimenting with gesture-based interfaces and hands-free computer control.
- Tags
- gesture control, computer vision, hand tracking, macos, python, hands free
Why it was saved
- @jbelevate: A working voice+gesture control setup for Mac: hands-free navigation plus an instant search bar, pinch+drag, page forward/back and new-tab gestures.
Related
Open-source collection of runnable AI agent, skill, and RAG templates
Open-source macOS command-line toolkit for disk cleanup, uninstallation, and system monitoring
Open-source Python library and API for prompt-based web scraping using LLMs
Lightweight open-source Python library for building code-writing and vision AI agents
Python interactive CLI toolkit for automated OSINT, network reconnaissance, and security checks
Architecture pattern for securely running code-executing agents inside isolated micro-VMs
Updated