# Man-Melds-With-Machine

> Open-source hand gesture and voice navigation system for macOS

Man-Melds-With-Machine is an open-source Python tool that lets you control a Mac using real-time webcam hand gestures and speech. It uses computer vision to track hand movements and map distinct gestures to cursor navigation, clicks, scrolling, browser tabs, and Mission Control. Voice input integrates via external speech-to-text apps like Wispr Flow triggered by gesture-simulated hotkeys.

Website: https://github.com/JBKC/Man-Melds-With-Machine

## What it is for

- Navigate web pages and scroll hands-free on macOS using webcam gestures
- Switch tabs and snap directly to the browser search bar without touching the keyboard
- Trigger speech-to-type input using a specific hand gesture
- Control macOS desktop functions like Mission Control with custom physical gestures

## Features

- Real-time hand tracking via webcam using computer vision
- Cursor movement mapping using open-palm positioning
- Gesture controls for mouse clicks, scrolling, and dragging
- Browser navigation gestures including tab switching, new tab, and forward/back
- Instant search bar snapping gesture
- Mission Control trigger via a closed fist gesture
- Speech-to-type integration shortcut designed for tools like Wispr Flow

## Pricing

Open source. Free and open source (MIT license)

## Details

- Type: GitHub repo
- Category: [Development](https://xiry.app/topics/development.md)
- Open source: yes
- Platforms: macOS
- For: Developers and power users experimenting with gesture-based interfaces and hands-free computer control.
- Tags: gesture control, computer vision, hand tracking, macos, python, hands free

## Why it was saved

- [@jbelevate, 28 February 2025](https://x.com/jbelevate/status/1895561153830613161): A working voice+gesture control setup for Mac: hands-free navigation plus an instant search bar, pinch+drag, page forward/back and new-tab gestures.

## Related

- [awesome-llm-apps](https://xiry.app/resources/awesome-llm-apps): Open-source collection of runnable AI agent, skill, and RAG templates (GitHub repo, Open source)
- [Mole](https://xiry.app/resources/mole): Open-source macOS command-line toolkit for disk cleanup, uninstallation, and system monitoring (Web app, Open source)
- [ScrapeGraphAI](https://xiry.app/resources/scrapegraphai): Open-source Python library and API for prompt-based web scraping using LLMs (GitHub repo, Freemium)
- [smolagents](https://xiry.app/resources/smolagents): Lightweight open-source Python library for building code-writing and vision AI agents (Web app, Open source)
- [Argus](https://xiry.app/resources/argus): Python interactive CLI toolkit for automated OSINT, network reconnaissance, and security checks (GitHub repo, Open source)
- [Browser Use Agent Sandbox Architecture](https://xiry.app/resources/browser-use-agent-sandbox-architecture): Architecture pattern for securely running code-executing agents inside isolated micro-VMs (Framework, Free)

Updated 10 October 2026. Page: https://xiry.app/resources/man-melds-with-machine

Make your own library: Xiry takes your saved reels, tweets, Reddit bookmarks and Watch Later videos, makes them searchable and pulls the useful stuff out, like this library. It's invite-only for now; join the waitlist at https://xiry.app/#waitlist.