AI GESTURE CONTROL SYSTEM
VOIDS VISION
Real-Time Hand Tracking & Gesture Interaction
Interface script has not initialized. If this stays visible, use Live Server and check the Console.
AI GESTURE CONTROL SYSTEM
Home / HUD
Your touchless interaction workspace.
VISION INPUT
RESOLUTION --
NOT INITIALIZED
Select Start camera to begin.
BROWSERMODELCAMERATRACKERGESTURE
NOT INITIALIZED
CAMERA OFF
Control Without Touch.
Start the camera to enable on-device hand landmark tracking.
Camera permission is required. Frames are processed on-device.
INTERACTION PAUSED
Resume from the action panel. Navigation stays available.
MODE HOME
GESTURE --
ON-DEVICE PROCESSING
Explore your workspace
HOMEQUICK STARTUse even front/side lighting · INDEX aims · pinch + release selects · pinch + drag scrolls.
Either hand can aim with INDEX ONLY. Pinch and release to select; pinch and drag an internal panel to scroll. Camera processing stays on-device.
GESTURE REFERENCEEither hand · acquire / pinch / release
- INDEX ONLY · Pointer
- PINCH · Select
- FIST · Pause
Event log 0 / 25
- No events. Waiting for initialization.
Interactive control panel
Hold INDEX ONLY to moveINDEX ONLY aims. Acquire a target, pinch, then release to select. Drag vertically while pinching to scroll the panel instead. Release frees the pointer. Either hand can operate controls; FIST pauses.
SELECT PRACTICE · 0 accepted selections
Camera and fullscreen controls use a normal click or keyboard activation. Pointer control stays inside VOIDS VISION.
Drawing workspace
READY TO DRAWRelease PINCH, position your index, then hold PINCH to draw. Release to stop. FIST pauses; TWO FINGERS opens Hand UI for tool selection. Mouse, touch, and pen also draw.
0 strokes
Art stays in this tab until it is closed or reloaded. Transparent mode exports transparent pixels. Camera mode can export the frame plus your drawing.
Presentation
SLIDE 1 / 8THUMBS UP starts. Open-palm swipes navigate. INDEX ONLY aims the laser or selects a control; PINCH confirms it. FIST pauses. Arrow keys also navigate.
01 / THE USE CASE
A new way to interact.
Point, create, and present through hand movement.
Navigate
Select large controls without reaching for the mouse.
Create
Sketch ideas on a canvas with a deliberate pinch.
Present
Move through slides while keeping your attention on the room.
02 / ARCHITECTURE
From observation to action.
- Camera
- MediaPipe
- Gesture Engine
- Action
MediaPipe detects hand landmarks. Our shared rule-based engine checks geometry, stability, and timing before a mode responds.
Both hands are observed. Each interaction has an explicitly captured hand owner.
03 / CORE GESTURES
Deliberate movement. Clear intent.
INDEX ONLY
Point & aim
PINCH
Select & draw
FIST
Pause & freeze
TWO FINGERS
Drawing tools
THUMBS UP
Start & confirm
OPEN PALM + SWIPE
Previous / next
04 / MAIN MODES
One engine. Seven workspaces.
Home
Live system overview
Pointer
In-app control
Air Draw
Sketch & save PNG
Presentation
Slides & laser
Gesture Lab
Inspect & test
Challenge
Practice timing
Spatial / Holo
Shapes & diagrams
05 / TECHNICAL HIGHLIGHTS
Built for reliable interaction.
- Smoothing for steady pointer and brush movement
- Gesture confidence / match score from real geometry
- Temporal stability before confirmation
- Cooldowns and release checks to prevent repeats
- On-device camera processing with real FPS and latency
Match scores describe rule agreement; they are not scientific probabilities.
06 / FUTURE SCOPE
A foundation to build on.
Optional Python bridge
A later local desktop integration.
Windows controls
Future system-level interaction.
Voice, later
An additional input channel.
These are future plans. This build controls the VOIDS VISION browser application.
07 / LIVE DEMO
Thank you.
Control Without Touch.
Explore Pointer, Air Draw, Gesture Lab, and Challenge.
VOIDS VISIONREADY TO PRESENT
Gesture diagnostics
NOT INITIALIZEDRuntime profile
Camera off- Camera delivery FPS
- --
- Inference FPS
- --
- Render loop FPS
- --
- Inference latency
- --
- Pipeline processing
- --
- HUD updates
- --
Frame counters have not started.
Where frame time is spent
No measurements yet.
These are measured JavaScript calls, not GPU execution times. Compare the same mode with 0, 1 and 2 hands.
Live per-hand diagnostics. Test PRIMARY, SECONDARY, or either hand. Static and swipe confirmations remain separate. Workspace diagnostics show the last Spatial interaction; this screen does not manipulate objects.
Tracking -- · FPS -- · Latency --
Gesture test
--
Choose a gesture, then start a test.
Response time starts when you press Start test. It includes your reaction, pose, and confirmation hold; it is not model latency or a scientific accuracy measure.
Recent test results (last 20)
No completed tests.
Hand --
- Tracking
- --
- Raw static gesture
- --
- Candidate
- --
- Confirmed static
- --
- Raw match score
- --
- Stability
- --
- Finger states
- --
- Palm scale (width units)
- --
- Pinch distance / scale
- --
- Pinch raw / stable / confirmed
- --
- Movement / consistency
- --
- History samples
- --
- Static cooldown
- --
- Swipe candidate / confirmed
- --
- Swipe match / progress
- --
- Swipe cooldown / release
- --
Hand --
- Tracking
- --
- Raw static gesture
- --
- Candidate
- --
- Confirmed static
- --
- Raw match score
- --
- Stability
- --
- Finger states
- --
- Palm scale (width units)
- --
- Pinch distance / scale
- --
- Pinch raw / stable / confirmed
- --
- Movement / consistency
- --
- History samples
- --
- Static cooldown
- --
- Swipe candidate / confirmed
- --
- Swipe match / progress
- --
- Swipe cooldown / release
- --
Spatial / Holo foundation · geometry only
Two stable tracked hands are required.
- Primary view position
- --
- Secondary view position
- --
- Midpoint
- --
- Relative vector (width units)
- --
- Distance (camera-width units)
- --
- Distance / mean palm scale
- --
- Angle (clockwise, degrees)
- --
- Distance change / frame
- --
- Angle change / frame
- --
- Distance velocity / second
- --
- Angular velocity (degrees/s)
- --
- Distance / reference distance
- --
- Primary pinch raw / stable / confirmed
- --
- Secondary pinch raw / stable / confirmed
- --
- Both pinching raw / stable / confirmed
- --
- Pair identity
- --
These are image-space measurements, not physical distances between people or hands. Object manipulation runs only inside Spatial / Holo.
Precision & scroll diagnostics
No current hand observation
Live per-hand input uses viewport pixels. Capture is separate from gesture recognition. Spatial values below retain the last interaction after leaving that mode.
- Raw index tip · viewport px
- --
- Filtered tip · viewport px
- --
- Input speed
- --
- Precision / smoothing
- --
- Last stable hover target
- --
- Scroll state
- IDLE
- Scroll delta · current / last
- --
- Scroll target · current / last
- --
- Last draw sample · raw → filtered
- --
Interaction ownership / per-hand precision
Open Precision & scroll diagnostics above to refresh these detailed fields. H1/H2 are tracking identities; Anchor/Manipulator are temporary roles.
No hand in this slot.
No hand in this slot.
Input not initialized.
Spatial workspace diagnostics
- Workspace state
- READY
- Selected ID / type
- --
- Manipulation
- NONE
- Zoom / grid / snap
- 100% / ON / OFF
- Objects / undo / redo
- 0 / 0 / 0
- Two-hand state
- NOT INITIALIZED
- Active target
- NONE
- Last target
- --
- Primary / secondary pinch (raw / stable / confirmed)
- --
- Both pinching (raw / stable / confirmed)
- --
- Arming / re-arm
- --
- Last pointer / baseline distance (object: document units; workspace: camera-width units)
- --
- Last filtered / applied scale ratio
- --
- Live midpoint (view-normalized)
- --
- Last midpoint delta (object: document units; workspace: view-normalized)
- --
- Live palm-pair / last cursor-vector baseline angle
- --
- Last filtered / applied rotation delta
- --
- Workspace pan
- --
- Last release reason
- --
- Primary cursor raw / filtered · viewport px
- --
- Secondary cursor raw / filtered · viewport px
- --
- Cursor hand IDs · Primary / Secondary
- --
- Latched Anchor / Manipulator IDs
- --
- Last Anchor / Manipulator IDs
- --
- Pointer visibility / tracking
- --
- Independent hover targets
- --
- Cursor pinch states · raw / stable / confirmed
- --
- Secondary join target
- --
- Last join target
- --
- Transform intent
- --
- Object translation · document units
- --
- Resize delta · document units
- --
- Dual pointer / magnetic assist / sensitivity
- --
- 3D selected / kind
- --
- 3D interaction / Anchor / Manipulator
- --
- 3D scale / yaw / pitch / roll
- --
- 3D render FPS / quality / objects
- --
Entering Gesture Lab releases Spatial control. Pair observations stay live; baseline and transform deltas describe the last grab. View pan/zoom do not add document Undo entries.
Raw landmark coordinates
No current hand observations.
Recent confirmed gestures
- No confirmed gestures.
Spatial / Holo workspace
READYEither hand grabs first = ANCHOR. The other joins = MANIPULATOR. Release the other hand to keep holding; release the Anchor to drop. Pinch-drag panels to scroll. Both pinches on empty board control workspace zoom/pan.
Load selected project? This replaces the current workspace.
Save/Load stores 2D + 3D workspace data. PNG exports the visible board; camera is included only when Camera background is ON. SVG exports the editable 2D diagram layer.
Shape / hologram library · 28 tools
SELECT0 / 120 objects
ANCHOR --MANIPULATOR --RELEASE TO ARM
First hand grabs. The other joins the same held object.
MODE NONESIZE --
Start the camera for a live background.
Hold INDEX ONLY to move
100%
Object properties
No object selected3D HOLOGRAM
- Position X/Y/Z
- --
- Rotation X/Y/Z
- --
- Scale
- --
Delete selected 3D object?
3D: first hand grabs = Anchor; second hand joins = scale + yaw + pitch + roll. Depth uses the safe +/- controls so webcam depth noise cannot throw an object toward the camera.
Stroke
Fill
--
--
Delete selected object?
--
Gesture editing pauses while typing. Apply with Ctrl+Enter; Esc discards the text draft. Connector endpoints snap to nearby block edges. Undo/Redo retains the last 40 document edits in this session.
Gesture challenge
READYTwelve prompts. Begin with a 3-second response window. Correct answers advance immediately; a wrong answer lets you keep trying. FIST is an answer here. Use Space or Pause to pause.
ROUND 0 / 12--
READY?
- Score
- 0
- Streak
- 0
- Response accuracy
- --
- High score · selected input
- --
Choose an input and start.
Gesture timing pauses while no eligible hand or gesture input is unavailable. Later prompts add swipes and shorter windows. Scores for gesture and button practice are stored separately.
Session results
--
- Total Score
- --
- Accuracy
- --
- Average Response Time
- --
- Best Streak
- --
- Correct / Total responses
- --
- Completed rounds
- --
Total responses = correct + wrong + timeouts. Average response time uses correct rounds, including your reaction and hold time, excluding paused time.