SlyPilot Feature Matrix & Capability Index
SlyPilot brings together desktop window management, touch optimization, hardware dial interfaces, local AI voice intelligence, and developer automation
SlyPilot brings together desktop window management, touch optimization, hardware dial interfaces, local AI voice intelligence, and developer automation into one unified engine. Seven of the parts below (AI dictation, natural voices, meetings with notes, live captions and a copilot, the phone remote, the screenshot editor and screen recorder, Memory and settings sync) are SlyPilot Pro, the optional one-time purchase; they are marked "SlyPilot Pro". Pro also includes Home Link (smart speakers), which is a preview, and a few extras of the Magnifier (the second-screen view, more watched areas and the Auto-Switcher). Everything else is free, including the presenter tools, the drawing board, the power tools, the file tools, the display switches, the head mouse and everything an AI assistant does on your screen. Explore each subsystem below:
🎛️ Navigation & Touch Ergonomics
1. Floating Touch Bar & Thumb Dock
A non-intrusive floating switcher engineered specifically for touchscreens and tablet 2-in-1s:
- Magnetic Edge Docking: Instantly snaps and dynamically converts between a horizontal taskbar companion and a vertical thumb dock.
- Peek Pill Drawer: Smoothly auto-collapses into an edge tab (
⮝ 1) when idle. Expands on tap, when a mouse or Surface Pen hovers near the pill (35 DIP pixels), or on a screen edge bump. - Active Window Chip: Direct tactile feedback showing the current window's icon and title, with one-tap access to window snapping, pinning, monitor flinging, and minimizing.
- Zero Focus Loss: Built with
WS_EX_NOACTIVATEandWM_MOUSEACTIVATEinterception. Tapping buttons never steals keyboard caret focus. - Button Sets Per Application: Define your own custom buttons for a program (for example Visual Studio Code) and the bar switches to that set whenever the program is in front. No sets are pre-made: you add them in Settings.
2. Radial Menu & Surface Dial
The ultimate high-speed circular pie menu designed for the Microsoft Surface Dial and touch gestures:
- GDI+ Layered Alpha Backdrop: Zero-flicker feathered radial gradient, acrylic disc, or floating dial mode.
- Center Telemetry Hub: High-contrast display showing the active desktop name, window count, and system status.
- Hardware Dial Integration: Turn the Surface Dial to step through virtual desktops, rotate pie slices, adjust master volume, brightness or window opacity, cycle through windows, or change speech listening modes.
- Surface Pen Acceleration: Removes the Windows press-and-hold right-click delay so stylus dragging starts at once.
🖥️ Desktop & Window Orchestration
3. Virtual Desktops & Workspaces
Harness Windows Virtual Desktops without sluggish system animations:
- Fast Switching: Direct Win32 COM hooks (
VirtualDesktopAccessor.dll) switch desktops at once, without the Windows slide animation. - Workspaces Engine: Snapshot complete multi-desktop window layouts to plain INI files. Restore them with one click, scaling window coordinates proportionally. Starting programs that are not open is an optional setting (off by default).
- Auto-Routing Engine: Route specific programs or window title patterns to designated virtual desktops automatically upon launch.
- Desktop Renaming & Badging: Assign custom names and choose from 12 emoji badge presets (
💻,🌐,💼,📝) with real-time synchronization across taskbars, tray icons, and OSD HUDs. - Dynamic System Tray Badging: Real-time GDI+ rendered tray icon displaying the active desktop number in 8 color palettes and 4 visual styles.
4. Snap Layouts & Window Power Tools
Advanced window layout and staging tools accessible via touch card, hotkeys, or voice:
- 18 Touch Snap Zones: Halves, thirds, 2/3 focus zones, ultra-wide 25/50/25 splits, quadrants, centered floating stages, and maximization.
- User-Defined Custom Zones (
[SnapCustomZones]): Create your own bespoke layout grids with fractional screen coordinates. - Multi-Monitor Proportional Fling: Effortlessly transfer windows between displays while maintaining relative scale and dimensions.
- Undo Snap: One-click restoration of windows back to their original dimensions and positions before snap operations.
- Window Power Tools: Auto-tiling (2, 3, 4, or 2x2 grid), even splitting, divider nudging, layout swapping/rotation, focus mode (zen isolation), boss-key window stashing, ambient background dimming, and off-screen window rescue.
5. Command Palette & Global Search
Summoned instantly via Ctrl+Alt+Space for lightning-fast keyboard-driven productivity:
- Fuzzy Search Across All Capabilities: Search all 550+ voice actions, window titles, virtual desktops, and snippets.
- Smart Prefix Modes: Jump into specialized filters with
>(commands),w(windows),d(desktops), ors(snippets). - Zero Context Loss: Closes and restores focus to your foreground window before executing actions, guaranteeing commands target your active window.
🎙️ Local AI Voice Intelligence
6. Offline AI Speech & Dictation (dictation: SlyPilot Pro)
Push-to-talk speech-to-text that runs on your PC. AI dictation is part of SlyPilot Pro (the free program opens Windows Voice Typing instead), while the speech engines that make voice commands more accurate are free. It is off until you turn it on and download a model, and your audio never leaves the PC:
- Local Neural Engine: Runs OpenAI Whisper (Large v3 Turbo, Small, Base, Tiny) on CUDA (NVIDIA), Vulkan (AMD / Intel Arc, through CrispASR) or the CPU, and NVIDIA Parakeet (0.6B / 110M) on the CPU.
- Push-to-Talk (PTT) Ergonomics: Hold a shortcut key or touch button, speak naturally, and release to inject text. Tap mode provides hands-free lock.
- Live Transcription: Sends each finished phrase to the engine while you keep talking, so the text arrives soon after you release the key.
- Spoken Punctuation & Formatting: Automatic formatting for periods, commas, questions, paragraphs, quotes, and spoken editing ("scratch that", "capitalize that", "bullet that").
- 38 Languages & Auto-Detection: English by default; other languages need a multilingual model, downloaded once with your consent.
- Custom Dictionary & "Fix a Word": Personalized phonetic corrections and domain-specific terminology learning.
7. Voice Commands & Hands-Free Control
Complete operating system voice control with over 550 built-in commands and ~7,700 spoken phrases:
- Natural Language Parsing: Flexible phrasing with conversational lead-ins ("could you please snap left").
- Voice Key Pressing: Say any keyboard shortcut ("press control shift t", "press down three times", "key mode").
- UI Automation (Click by Name): Voice-click buttons, checkboxes, tabs, and links by speaking their visible label.
- Numbered Screen Grid: Say "show grid", speak a number to zoom into a cell of the 6 by 4 grid, then say "click".
- Spoken Confirmations: Risky commands (force close an app, sleep computer, remove empty desktops) ask you to say "confirm" first.
- App Packs (
.vdspack): Modular voice command expansions for Photoshop, Blender, VS Code, Excel, Figma, and Zoom.
8. Natural Voices & Neural Read-Aloud (SlyPilot Pro)
Transform your desktop into an expressive audio environment (the free program speaks and reads aloud with the Windows voices):
- Offline Neural TTS: Integrated local speech synthesis using Kokoro-82M, Piper (Rhasspy), and Supertonic.
- 45 Natural Voices: High-fidelity American and British voices with customizable speech velocity.
- Multi-Purpose Voice Routing: Assign distinct voices to system command feedback, document reading aloud, and reminder notifications.
- Read Aloud (Selection, Clipboard, Screen): Select text or drag a box across any screen element (OCR) to have it read aloud with pause, resume, sentence skip, and speed adjustments.
🛠️ Everyday Utilities & Agent Automation
9. Everyday Power Utilities
A consolidated suite of lightweight, high-performance tools:
- In-Memory Clipboard Picker (
Ctrl+Alt+Shift+C): 25-clip ring buffer with permanent pinning, zero focus loss, and password-manager sensitivity protection. - Screen OCR Text Grab (
Ctrl+Alt+Shift+O): Drag a box around unselectable screen text to copy it directly to the clipboard. - Keep PC Awake & Delayed Timers: Prevent sleep during long renders; schedule delayed sleep/lock/screen-off.
- Pomodoro Sprint Timer & Stopwatch: Native focus timers with spoken status and audio chimes.
- Audio Presets & Per-App Volume: Granular sound levels ("spotify volume 60") and one-click acoustic profiles ("audio preset conference").
10. MCP Server & Agent Automation API
Bridge your desktop with modern AI coding assistants (Claude Code, Cursor, Gemini CLI, VS Code):
- Native Model Context Protocol (MCP): 20 structured tools enabling assistants to inspect state, capture screenshots, orchestrate windows, trigger actions, draw marks and a whiteboard on your screen and run the presenter tools, plus ready-made prompts and resources. Assistants that point and draw →
- Safety Circuit Breaker & User-Controlled Levels: Agent control is off until you switch it on in the tray menu and pick a level (read, see or control). The higher input and system levels are time-limited and never saved.
- Protected Windows: Password manager windows and private browsing windows (plus any you add) are blinded and blacked out from agent perception.
- Shared Window Scope: Limit AI agents to a specific set of shared windows or a dedicated "Agent" virtual desktop.
🧠 AI on Your Text & Your Meetings
11. AI Actions on Selected Text
Select text in any program, press Ctrl+Alt+Shift+A (or type a fix, a polish, a translate german in the command palette) and a language model of your choice answers on a small card:
- Your model, your rules: a small built-in model that SlyPilot downloads and runs on your PC, your own server (Ollama, LM Studio), Ollama's cloud, or OpenRouter's free models. Nothing leaves the PC unless you pick an outside service and tick the box that names it.
- Made for daily use: Replace / Insert after / Copy / Follow up, your own actions, a usual action and model per program,
@screen,@clipand@meetingsources, and optional polish for dictation (SlyPilot Pro). - Set it up with the AI Actions Guide.
12. Meeting Notes (SlyPilot Pro)
An offline transcript of a call, started by you every time: your microphone as "You", the sound the PC plays as "Them", a consent window and a visible indicator, plain-text files on your PC, an optional summary, and a search from the command palette (m budget).
📱 Remote Control From Your Phone
13. Phone Remote (SlyPilot Pro)
Your phone becomes a controller for the PC over your own Wi-Fi, with nothing to install on the phone (a web page in Chrome, opened by scanning a code):
- Trackpad and Keys: Tap, drag, two-finger scroll, pinch, three-finger desktop switching, pointer acceleration, sticky modifier keys and a presentation panel.
- Screen View: A remote-desktop-style picture of your monitors with the PC's pointer, View / Touch / Mouse modes, detail-on-zoom, a keyboard and a key panel, full screen, and the ability to press your own Touch Bar on the picture (hold-to-talk buttons hold while you hold).
- Voice and Typing: Hold to talk to dictate into the window in front, or speak a voice command; live typing from the phone keyboard.
- Your Touch Bar, Commands, Windows: Your per-app Touch Bar buttons, a search for every SlyPilot command, a window list with previews and snapping, volume and media.
- AI and Agents: Run AI actions on a selection, and approve or answer your AI agents' requests from the phone.
- Clipboard, Files, Power: Clipboard both ways, send photos and files, push the PC clipboard to the phone, lock / sleep / restart.
- Safe by Design: Off until you switch it on, private-network only, paired with a one-time code and encrypted, permissions per phone, protected windows stay hidden, and one hotkey pauses every phone.
🏠 Smart Speakers
14. Home Link (SlyPilot Pro, preview)
Your PC as a few devices in Google Home, Alexa and Apple Home, so the speaker you already have can switch it: “Hey Google, turn off computer display”, “Alexa, set computer volume to 30 percent”.
- Devices you choose and name: computer display, volume (mute and percentage), microphone (mute every microphone), brightness, focus mode, lock computer, next / previous desktop, play / pause, and up to 8 of your own that run any SlyPilot voice command or macro (ready-made ideas, and percentages: "set Spotify volume to 40 percent").
- The PC as a sensor: Computer in use and Computer call start automations in the app (a lamp when you sit down, an "on air" light during calls). Off until you agree; they share only "occupied" or not.
- A pairing assistant walks through each app, Google's one-time developer project included.
- Real state both ways: change the volume or focus mode on the PC and the app shows it; “is focus mode on?” gets the true answer.
- Local Matter, no cloud of ours: the hub in your home talks straight to the PC, encrypted by Matter. No sound or speech reaches the PC, nothing goes to slypilot.com.
- Safe with a speaker in the room: nothing that would ask for “confirm” can run (also inside a macro), and while the PC is locked only display, volume, media and lock work.
- Preview: built and tested with Matter's open-source test controller; checks with real hubs are still to come. Google needs a free one-time developer project, Apple shows an “uncertified” warning.
📸 Screenshots, Recording & Guides
15. Screenshots, Screen Recording & Guides (screenshots free; editor, recording, scrolling and guides SlyPilot Pro)
Say “take a screenshot” and the screen stands still while you pick an area, a window or a monitor: by voice, keys, pen or Touch Bar.
- Free: the preview, a history with Copy as file, pins that stay on top, copy text from a picture (offline OCR), a colour picker, and Quick Redact (solid boxes over e-mail addresses, numbers and keys). Protected windows can be painted black.
- Editor (Pro): arrows, numbered steps, text, callouts, blur, solid redaction, magnifier, spotlight, crop, a pressure-sensitive pen, Find secrets and Beautify. Marks stay editable later.
- Screen recording (Pro): an area, a window or a monitor as MP4, with your microphone, the PC's sound, click rings and shortcut badges (never typed letters); trim it or make a GIF.
- Scrolling screenshots (Pro): a long page or list joined into one picture, without moving your mouse.
- Guides (Pro): “record a guide”, do the task, “stop recording”: numbered steps with pictures and captions written from what you clicked, exported as one web page or Markdown. What you type is never kept.
- Nothing is uploaded. Step-by-step guide.
🔍 Magnifier, Presenting & Drawing
16. Magnifier & Zoom (free; second-screen view, more watched areas and the Auto-Switcher SlyPilot Pro)
A magnifier that fits the way you work, with one set of keys, voice words, a window and a panel of big buttons for touch and pen:
- Zoom the whole screen, a lens or a docked band with the Windows Magnifier, driven by SlyPilot (
Ctrl+Alt+G, "magnify more",SlyPilot.exe mag in). - A magnifying glass of its own: round, rounded or square, with colour filters; it follows the pointer or stays where you park it, never takes a click or the focus, and is not in screenshots.
- A typing glass above the text cursor, a strip pinned to a screen edge, a pixel loupe with the colour under the pointer, and small live windows of areas you watch.
- Six profiles (Reading, Pointing, Precision, Typing, Night reading, Presenting), several monitors, freeze and copy as a screenshot. SlyPilot Pro adds the Auto-Switcher (a profile for each program), the second-screen view and up to four watched areas.
17. Presenter Tools & Presenting Mode (free)
Everything for a talk, a lesson or a screen share, without a second program:
- Spotlight, pointer and click highlight, laser pointer, a bar that shows the shortcuts you press (never what you type) and an on-screen countdown.
- Read here: the text under the spotlight or the lens is read aloud and the line being read is outlined.
- Presenting mode: one switch that keeps the PC awake, highlights clicks, starts a countdown, can hide the Touch Bar and the desktop icons, silences notifications, and puts everything back afterwards, even after a crash.
18. The Drawing Board (free)
Draw on the screen, or on a still zoomed picture of it, with a pen, a finger or the mouse:
- Pen, marker, line, arrow, box, oval, text, numbered markers, laser, eraser, a pixel eraser and a Move tool; pen strokes follow the pressure, and hold the pen still to tidy a stroke into a line, oval or box.
- Pages, white and black boards with grid or lined paper, a page overview, paste a picture, resume the last drawing; Done saves several pages as PNGs and a PDF.
- Voice words for every tool while it is up ("red ink", "arrow tool", "next page", "undo").
⚙️ Automations & Modes
20. Automations & Modes (free)
Let the PC do the routine parts:
- Automations: when a monitor is plugged in, a program comes to the front, a call starts, the laptop goes on battery, it is 9:00 on a weekday (and more), run voice commands or macro steps, only if conditions hold. Templates, a log, and a card that asks before a risky step.
- Modes: Deep work, Meeting, Gaming or your own switch pop-ups, alert sounds, the Touch Bar, the microphone, the volume and more at once, and put back only what is still as they left it. Several can be on.
21. The SlyPilot Assistant (free)
Say it your way, with your own AI model:
- Plans of several steps: voice commands, window actions on your open programs, modes and automations, shown on a card before they run (Run, Cancel, untick a step).
- Questions about the screen: "what does this error say?" reads the window you used, on your PC (a model outside your PC only after you allow it).
- Make automations and modes by talking, follow-ups for five minutes, and a window to type into (Ctrl+Alt+Win+A).
🤝 AI Assistants That Point & Draw
19. Assistants That Point, Draw and Present (free)
An AI assistant can show you things on your own screen instead of only describing them:
- Marks that never take a click, with the assistant's name on them: boxes, rings, arrows, notes, numbered steps, a spot that dims everything but one place, and a tour of several steps.
- The drawing board as a whiteboard after your click on an approval card; the toolbar says who is drawing and your own strokes are protected from its undo and clear.
- The presenter tools, a longer text read aloud, your recorded meeting notes (you click Allow for each file) and your saved workspaces.
- You stay in charge: levels, approvals, one tray item to clear everything, and pause closes the board.
🧰 Power Tools, Files & Displays
22. Keyboard & Mouse Power Tools (free)
Seconds saved hundreds of times a day:
- Key remap: CapsLock as Ctrl, a key switched off, a combination that sends another one in one program, or a key that runs any SlyPilot command. SlyPilot's own and safety keys are never taken.
- Mouse gestures: hold the right button and draw: back, forward, maximize, minimize, next desktop, close, or your own shapes.
- Alt+drag moves and resizes a window from anywhere in it, with Shift for snap zones and undo.
- Hold Ctrl for a cheat sheet of the program in front; crosshairs through the pointer; a screen ruler that measures between edges in pixels.
23. Files & Explorer (free)
The file chores of every week, on the files you selected:
- Peek with Space: a large preview that follows the arrow keys while Explorer keeps the keyboard.
- Find a file from the palette (
f budget 2026), from Windows' own search index. - Rename Files (find and replace, patterns, case, numbers, preview, undo) and Resize Pictures (new files, never larger), by voice or from Explorer's menu.
- Tidy a folder by your rules, with a preview and undo, or by itself.
24. Displays, Sound & Headphones (free)
Two touch-sized cards that never take the focus:
- Display switches (
Ctrl+Alt+Win+B): brightness of every monitor, resolution and refresh rate, make main; kept only when you press Keep. - Volume mixer (
Ctrl+Alt+Win+X): every program's volume, the output device, and your Bluetooth headphones with connect and battery.
25. Link Router (free)
Every link to the right browser and profile: one rule per line, Shift-click to choose.
31. Sound Themer (free)
The Sound page Windows should have:
- Every event in plain words, with when it plays; the ones Windows 11 no longer plays are marked and can be checked on your PC.
- Sound packs in one click, shown on a card first: the free sound gallery of 20 packs, Sound Manager packs, Windows theme packs and Linux sound themes; MP3, OGG and FLAC converted; or make a pack From a style (12 voices, 6 moods) right on your PC.
- No gaps: events a pack leaves out borrow its closest sound, and SlyPilot's dictation cues are cut from the pack. Shorten or fade any single sound.
- Matching Sets & always a way back: put on a pointer pack and a sound pack that belong together in one click (11 built-in sets, or save your own); Undo, Restore your old sounds, quiet hours, a pack per mode or a new pack every day.
32. Cursor Themer (free)
New mouse pointers for Windows, safely:
- Every pointer in plain words, with a picture of the one in use; change one, mix from packs, the size.
- Pointer packs in one click from a zip with an
install.inf(read, never run: no administrator rights), a.slycursor, a Linux Xcursor theme or loose files; every pointer rewritten by SlyPilot before Windows sees it. - Pointers drawn by SlyPilot in sixteen styles (Classic, Neon, Sticker, Glass, Pixel, Chrome, Paper cut, Hologram, Blueprint, Puffy, Halftone ...), any colour, with a busy pointer you choose, twenty-two themes (pumpkins, snowflakes, paw prints, coffee cups ...), a left-handed option and a live preview; the free pointer gallery of 94 packs, with a filter and a search.
- Matching Sets, favourites & always a way back: 11 matching pointer-and-sound sets, favourites and a twelve-pack tray list, Surprise Me (a Pack a Day), Keep these pointers? (15 s), Undo, Restore; a pack per mode, bigger while presenting.
🧑🦽 Hands-Free & Comfort
26. Head Mouse (free)
Move the pointer with your head through the camera you have: it goes where your head points, clicks when you hold still, and works together with over 550 voice commands. Off until you switch it on; no picture is kept.
27. Comfort Helpers (free)
Starting profiles, Settings that open on the 11 things most people change, "? what can it do" in the palette, put a window back, recent notices, smart breaks and Calm mode.
💎 More in SlyPilot Pro
28. Memory (SlyPilot Pro)
Find anything you read, copied or heard on your PC again (h budget invoice), or ask your own AI model about it. Text only, never pictures; encrypted, on your PC only; off until you switch it on.
29. Live Captions & the Meeting Copilot (SlyPilot Pro)
Captions of any call or video on any monitor, translated into any language; a corner card with Summary, Action items, What did they ask? and Catch me up. No bot joins the call.
30. Settings Sync (SlyPilot Pro)
The same SlyPilot on every PC you use, through a folder you already share (OneDrive, Dropbox, a network folder). No account, no SlyPilot cloud.
Next Steps
- See how SlyPilot compares with PowerToys, Recall, meeting bots and more: Comparisons →
- Put a language model to work on your text with AI Actions →, and keep your calls with Meeting Notes → (SlyPilot Pro).
- Control your PC from your phone with the Phone Remote → (SlyPilot Pro; setup guide).
- Switch your PC from Google Home, Alexa or Apple Home with Home Link → (SlyPilot Pro, preview; setup guide).
- Make the screen bigger, show it to a room, or draw on it: Magnifier → (guide), Presenter Tools → (guide), Drawing Board → (guide).
- Say it your way: The SlyPilot Assistant →.
- Let the PC react by itself: Automations & Modes → (guide).
- Let an AI assistant point, draw and present for you: Assistants That Point and Draw → (setup guide).
- Take, mark up and record your screen, or turn a task into a guide: Screenshots, Recording & Guides → (guide).
- Drive everything from a Stream Deck or a script: Command Line & Stream Deck →.
- Dive into Floating Touch Bar & Thumb Dock Details →
- Learn how Virtual Desktops & Workspaces → transform multi-tasking.
- Explore our Offline AI Speech & Dictation (SlyPilot Pro) Architecture →.