🧠 🎮 Mission Control

NVIDIA-Powered Autonomous AI Gaming Assistant & Telemetry Platform

Next-Generation In-Game Tactical AI Co-Pilot • Sub-15ms TensorRT Vision • Zero-VRAM HUD Telemetry

⏳ Windows Package Manager (Winget) Notice: Our official package (arnab825.MissionControl) is currently undergoing Microsoft review in microsoft/winget-pkgs.
Immediate 1-Click Install: Download MissionControl-Setup.exe or install via local manifest:

# ⚡ Local Manifest Install (Windows 10 / 11 — zero waiting for CDN sync)
winget install --manifest .\Gaming\winget\arnab825.MissionControl.singleton.yaml --accept-package-agreements --accept-source-agreements --force

🎁 Developer Milestone Rewards Program: Merge 1 PR or conquer a milestone objective to unlock release notes recognition, Website Bot contributor showcase, and GitHub Collaborator status! Jump straight to Milestone Developer Benefits & Contributor Rewards.

The Future of PC Gaming Stations: Move beyond archaic overlays like MSI Afterburner & RTSS. Mission Control combines autonomous AI co-pilot reasoning (NVIDIA NIM), sub-15ms TensorRT vision, DXGI zero-copy game screen capture, and dynamic live patch search into an ultra-sleek cyberpunk HUD that operates with zero PyTorch VRAM overhead.

🥊 Feature Breakdown vs Traditional Setups

Feature	🦖 MSI Afterburner / RTSS	👾 Discord / Game Launchers	🚀 Mission Control
Tactical AI Co-Pilot	❌ None	❌ None	✅ Autonomous AI (NVIDIA NIM & Llama 3.1)
Real-Time Computer Vision	❌ None	❌ None	✅ Pure TensorRT YOLOv8 (Sub-15ms)
VRAM & Memory Penalty	Static / Clunky	1,200 MB+ RAM	✅ 0 MB PyTorch VRAM Penalty (TensorRT C++)
Live Patch & Game Intel	❌ None	❌ None	✅ Automated Multi-Source Web RAG Search
Anti-Cheat Safety	⚠️ Invasive D3D Injections	Clunky Overlay	✅ Safe DirectX Desktop Duplication Hook
Design & Aesthetics	1998 Windows Form	Heavy Webview Wrapper	✅ Cyberpunk Glassmorphic HUD with Custom Font Scale

📸 Interface & Capabilities Showcase

🖥️ Main Console & Dashboard	🤖 Autonomous AI Co-Pilot & Tactical Agent
📟 Glassmorphic HUD Overlay	🎯 TensorRT AI Vision & YOLO Detection
📊 Real-Time Hardware Telemetry	🔬 Performance Tuning Lab & Power Controls
🎮 Game Library & Auto-Sense Target Routing	⚡ AI Hardware Readiness Matrix
⚙️ System Settings & AI Neural Configuration	🔍 Deep Scanner & Library Auto-Discovery

📌 Monorepo Architecture Overview

Mission Control is an integrated platform split into three primary sub-projects designed to deliver ultra-low latency hardware monitoring, local AI vision, and high-performance gaming intelligence:

Module	Tech Stack	Role & Core Capabilities
🌐 Web Platform `Gaming/website/`		High-performance web portal, documentation station, and automated 4-tier AI Gaming Intel RSS blog pipeline.
🖥️ Desktop Client `Gaming/frontend/`		Real-time gaming dashboard, frameless glassmorphic HUD overlay, hotkey recorder, and hardware telemetry Bento UI.
🐍 AI & Telemetry Engine `Gaming/backend/`		Autonomous AI brain, zero-copy DXGI desktop frame capture at 120 FPS, YOLOv8 vision, C++ Present hook, and PyNVML.
📦 Publisher Studio `Gaming/publisher-gui/`		Internal packaging GUI, semver version bumper, installer compiler, and GitHub Releases distribution manager.
⚙️ Pipeline & Distribution `run_local.ps1` & `.woodpecker/`		Multi-platform packaging automation generating Windows (`.exe`, `.msi`, `.zip`) and Linux (`.deb`, `.AppImage`).

🧱 System Workflow Architecture

Layer	Subsystem & Technologies	Responsibilities & Capabilities
👤 Client UI	Desktop Client & Glassmorphic HUD	• Frameless titlebar IPC & `--is-auth-popup` lifecycle • Performance Lab, System Telemetry & Game Library • Adaptive `useBridge` hook with 100ms/150ms state batching
🔒 Identity	Tactical Authentication Gateway	• Signature `#0b0d13` tactical canvas & `#76b900` neon green HUD theme • Watermarks, striped dev badges & footers suppressed • Seamless multi-account switching & secondary identity linking
⚡ Protocol	Aero Real-Time WebSocket Bridge	• Origin validation (`localhost`, `127.0.0.1`, `file`, `vscode-webview`) • Clean RFC 6455 1000/1001 ("going away") graceful disconnects • Critical bypass filter for voice prompts, alerts & vision frames
🔧 Telemetry	Hardware Engine & Present Hook	• C++ DirectX presentation hook for instant FPS & 1% low metrics • PyNVML monitor for GPU clocks, VRAM MB, thermals & power Watts • WMI / CIM / PDH CPU query chain & Win32 working set RAM compaction
🎯 Vision AI	On-Demand Vision Pipeline	• `dxcam` zero-copy DirectX Desktop Duplication capture at 120 FPS • Pure TensorRT YOLOv8 inference saving ~1 GB PyTorch VRAM • RapidOCR / Tesseract dynamic dialogue and quest ROI extraction
🧠 Agent Brain	Autonomous Copilot & Web RAG	• Multi-source RAG search across Wikipedia, SteamSpy, DuckDuckGo & RAWG • Strategic NIM reasoning (`Llama 3.1 8B/70B` + `Llama 3.2 11B Vision VLM`) • Dual voice engine with Google STT and ElevenLabs / SAPI5 TTS
🌐 Node Cluster	Distributed Library Network	• Local `node_service.py` daemon with deterministic MAC-derived IDs • Multi-launcher game detection across Steam, Epic, GOG, Xbox & Riot • Byte-exact disk sizing and multi-tier cloud failover (30s/35s timeout)
📦 Packaging	Multi-Platform Release Pipeline	• Single-command `publish.ps1` with semver bumping & `uv lock` alignment • Windows NSIS (`.exe`), MSI (`.msi`), ZIP (`.zip`) & Linux archives (`.tar.gz`) • Native Debian (`.deb`) and Universal Linux (`.AppImage`) packaging

flowchart TD
    classDef client fill:#0f172a,stroke:#38bdf8,stroke-width:2px,color:#f8fafc;
    classDef bridge fill:#1e1b4b,stroke:#818cf8,stroke-width:2px,color:#f8fafc;
    classDef telemetry fill:#022c22,stroke:#10b981,stroke-width:2px,color:#f8fafc;
    classDef vision fill:#14532d,stroke:#4ade80,stroke-width:2px,color:#f8fafc;
    classDef ai fill:#3b0764,stroke:#c084fc,stroke-width:2px,color:#f8fafc;
    classDef cluster fill:#1e293b,stroke:#f59e0b,stroke-width:2px,color:#f8fafc;
    classDef release fill:#312e81,stroke:#ec4899,stroke-width:2px,color:#f8fafc;

    User(["👤 GAMER / USER"]) --> Desktop["🖥️ DESKTOP CLIENT (Electron + React 18 + Vite)<br/>HUD Overlay • Telemetry Bento • Clerk Cyberpunk Auth"]:::client
    
    Desktop <-->|"ws://127.0.0.1:8765<br/>Adaptive Throttling: 100ms idle / 150ms game"| Bridge["⚡ AERO WEBSOCKET BRIDGE (bridge_server.py)<br/>Origin Guard • Priority Bypass • Graceful 1000/1001 Close"]:::bridge

    Bridge <-->|"FPS, Temps & Power Draw"| Telemetry["🔧 HARDWARE TELEMETRY ENGINE<br/>DirectX C++ Present Hook • PyNVML • WMI/PDH Chain • RAM Compaction"]:::telemetry
    Bridge <-->|"120 FPS Frame Stream"| Vision["🎯 REAL-TIME VISION STACK<br/>dxcam Capture • Pure TensorRT 10.x YOLOv8 • RapidOCR"]:::vision
    Bridge <-->|"Tactical Voice & Chat"| Agent["🧠 AUTONOMOUS AGENT & AI BRAIN<br/>Intent Router • Gaming RAG Web Search • NVIDIA NIM Cloud VLM"]:::ai

    Desktop -.->|"Local Node Sync"| NodeDaemon["🌐 DISTRIBUTED LIBRARY NODE<br/>MAC Hardware ID • Multi-Launcher Game Scanner • Cloud Gateway"]:::cluster
    NodeDaemon <-->|"Sync Manifests"| WebPortal["🌐 WEB PLATFORM (Next.js 16 + MongoDB)<br/>Node Clustering • AI Gaming Intel RSS Pipeline"]:::cluster

    Desktop -.->|"publish.ps1"| Packaging["📦 PACKAGING & MULTI-PLATFORM DISTRIBUTION<br/>PyInstaller .exe • electron-builder NSIS/MSI • deb & AppImage"]:::release

🚀 Sub-Project Quick Links

Component	Stack	Description	Documentation
Web Platform	Next.js 16, TypeScript, Tailwind CSS, MongoDB	Live gaming intelligence web app, benchmark profiles, documentation, and RSS AI blog generator.	Website README
Desktop App	Electron, React, Vite, Tailwind CSS	Real-time desktop application with glassmorphic HUD overlay, hardware telemetry, & keybindings.	Frontend README
Publisher GUI	Electron, Vite, Tailwind CSS	Release packaging, installer generation, release manifest sync & asset publisher client.	Publisher GUI README
Python Backend	Python 3.12, FastAPI, C++, PyNVML, TensorRT	High-frequency telemetry service, native DirectX frame queue monitoring, and NVIDIA AI models.	Backend README
Complete System	Architecture & Versioning	Detailed technical patch notes, agentic logic, and system overview.	System Manual

🎯 Key Features

⚡ Zero-Latency C++ DirectX FPS Tracking: Native C++ DLL (fps_counter.dll) hooking into low-level presentation queues for 1% lows and instantaneous FPS telemetry without Python overhead.
🟢 NVIDIA TensorRT & NIM Acceleration: Pure TensorRT inference for YOLOv8 vision detection with 0 MB PyTorch VRAM waste, paired with NVIDIA NIM (Llama 3.1 & 3.2 Vision) cloud reasoning.
🖥️ Glassmorphic HUD Overlay: Dynamic desktop overlay displaying real-time FPS, CPU/GPU temperatures, wattage, and active AI co-pilot tactical suggestions.
📰 Automated AI Gaming Intel Blog: Vercel cron-scheduled RSS aggregator (IGN, Kotaku, Eurogamer, AnandTech, Tom's Hardware) running a 3-tier failover LLM pipeline to generate daily technical news saved directly to MongoDB Atlas.
🔒 Motherboard UUID Security & HW Telemetry: Cryptographic Motherboard UUID locking, Win32 working set RAM flushing, and hardware telemetry via PyNVML, WMI, and PDH.

🛠️ Prerequisites & Requirements

Operating System: Windows 10 / 11 (64-bit) or Linux (Ubuntu 22.04+, Arch, Fedora x86_64).
GPU: NVIDIA GeForce GTX / RTX series card (RTX 20, 30, 40, or 50 series recommended for TensorRT & DLSS telemetry).
Node.js: v18.x or v20.x+
Python: v3.12 (managed via uv)
Drivers: NVIDIA Display Drivers R580+ & CUDA Toolkit 12.x+
Download Packages: Windows (.exe, .msi, .zip) & Linux (.AppImage, .deb, .rpm, .tar.gz) available via GitHub Releases and the web platform.

⚡ Quick Start / Local Development

1. Repository Setup

# Clone the repository
git clone https://github.com/arnab825/Mission-Control.git
cd Mission-Control

2. Contributor Environment Setup (Zero-Secrets Policy)

To protect production infrastructure and let developers work without sharing credentials, Mission Control provides an automated setup command that initializes safe local environment templates:

# Initialize local development environment files (.env / .env.local)
cd Gaming/website
npm run setup

Security Note: All created .env and .env.local files are strictly gitignored. Real production API keys remain securely configured in deployment platforms (Vercel, Render, Azure) and are never committed.

3. Running the Next.js Web Platform

cd Gaming/website
npm install
npm run dev
# Web app runs at http://localhost:3000

4. Running the Electron Desktop App & Backend

# Terminal 1: Run Python Backend
cd Gaming/backend
uv sync
uv run main.py --dev

# Terminal 2: Run Electron Desktop App
cd Gaming/frontend
npm install
npm run dev

4. Running Automated Packaging & Deployment Pipeline

# Run the single-command multi-platform release script
.\Gaming\scripts\publish.ps1 -Type "patch" -Title "Release Title" -Changes "Feature description 1; Feature description 2"

📅 Roadmap Progress

🤝 Community, Contributing & Developer Perks

We actively welcome contributions from developers, gamers, and open-source enthusiasts! Whether you are optimizing a Direct3D swapchain, adding AMD/Intel telemetry drivers, writing Python sensor daemons, or building Next.js web benchmarks, your work is recognized and rewarded.

🎁 Milestone Developer Benefits & Contributor Rewards

To recognize and engage external developers and community contributors who help achieve project milestones, Mission Control offers the following milestone benefits and official profile badges:

🎯 Community-First Eligibility: Milestone benefits and contributor rewards are designed exclusively to recognize and empower new and community developers. Founding maintainers (@arnab825, @Ani0811) and automated bots (dependabot[bot]) are excluded from claiming milestone reward tiers to ensure all perks, registry spots, and badges go directly to community contributors!

Tier	Requirement	Milestone Benefits & Perks
🥉 First-Time Contributor	1 merged PR on any `good-first-issue`	• Listed in the official GitHub Release Notes. • Featured in the Website Support Bot Contributor Registry. • `@Contributor` role in community discussions.
🥈 Milestone Builder	2+ merged PRs tied to an active GitHub Milestone	• Co-author credits (`Co-authored-by:`) on the major version tag. • Permanent shoutout in `docs/changes_summary.md`. • Fast-track review on future Pull Requests.
🥇 Core Subsystem Maintainer	Lead author on a core milestone objective (e.g. AMD ADLX telemetry, DirectStorage hook, or AI model integration)	• GitHub Triage / Collaborator invitation. • Core Team badge on your GitHub profile. • Direct influence on the upcoming System Roadmap. • Professional technical recommendation on LinkedIn / GitHub.

⚡ 100% Automated Recognition: No manual claim required! Our Contributor Milestone Workflow automatically detects merged milestone PRs, resolves your Full Name and GitHub @Username, posts your custom badge on your PR, and registers you in CONTRIBUTORS.json and the Website Support Bot registry.

🛡️ Anti-Bypass & Verified Credential Issuance

🔒 Tamper-Proof Contributor Badges: To protect milestone integrity and prevent unauthorized badge claiming, raw copy-paste badge markdown is strictly not provided in this public README.

Official contributor badges and personalized markdown snippets are generated and issued exclusively by GitHub Actions directly inside your merged Pull Request comment. Each issued badge is cryptographically linked to your specific merged Pull Request (#PR_NUMBER) and indexed in the Official Contributor Registry (CONTRIBUTORS.json). Badges displayed without a valid merged PR link or registry record are unverified.

👥 Contributor Hall of Fame

A heartfelt thank you to everyone pushing code, improving documentation, and reporting benchmarks for Mission Control:

🚀 Get Involved & Claim Your Perks

Ready to contribute and build your developer portfolio? Here is how to dive in right away:

🎯 Browse Active GitHub Milestones — Track upcoming sprint objectives and claim issues tagged to current targets.
🏷️ Good First Issues Guide — Curated bite-sized tasks across Web, Desktop, and Backend (also browse Open Good-First-Issues on GitHub).
🗺️ System Architecture Roadmap — Explore strategic milestones including AMD RDNA telemetry, DirectStorage I/O hooks, and local AI vision co-pilot.
🛠️ Full Contributing Guide & Rewards Policy — Complete step-by-step local environment setup (npm run setup), coding standards, and PR submission checklist.
💬 Community Discussions & Ideas — Connect with the team, pitch new game benchmark profiles, and propose architectural RFCs.

📄 License

This repository and open-source codebase are licensed under the Apache License 2.0. See the root LICENSE file and Desktop App EULA for details.

Name		Name	Last commit message	Last commit date
.agents		.agents
.github/workflows		.github/workflows
.vs		.vs
.vscode		.vscode
.woodpecker		.woodpecker
Gaming		Gaming
Microsoft/Windows/PowerShell		Microsoft/Windows/PowerShell
config		config
data		data
supabase		supabase
.env.example		.env.example
.gitignore		.gitignore
.vercelignore		.vercelignore
CODE_OF_CONDUCT.md		CODE_OF_CONDUCT.md
CONTRIBUTING.md		CONTRIBUTING.md
CONTRIBUTORS.json		CONTRIBUTORS.json
GOOD_FIRST_ISSUES.md		GOOD_FIRST_ISSUES.md
LICENSE		LICENSE
README.md		README.md
ROADMAP.md		ROADMAP.md
SECURITY.md		SECURITY.md
package-lock.json		package-lock.json
planning_website.md		planning_website.md
run_local.ps1		run_local.ps1
run_local.sh		run_local.sh

Navigation Menu

Repository files navigation

🧠 🎮 Mission Control

NVIDIA-Powered Autonomous AI Gaming Assistant & Telemetry Platform

🥊 Feature Breakdown vs Traditional Setups

📸 Interface & Capabilities Showcase

📌 Monorepo Architecture Overview

🧱 System Workflow Architecture

🚀 Sub-Project Quick Links

🎯 Key Features

🛠️ Prerequisites & Requirements

⚡ Quick Start / Local Development

1. Repository Setup

2. Contributor Environment Setup (Zero-Secrets Policy)

3. Running the Next.js Web Platform

4. Running the Electron Desktop App & Backend

4. Running Automated Packaging & Deployment Pipeline

📅 Roadmap Progress

🤝 Community, Contributing & Developer Perks

🎁 Milestone Developer Benefits & Contributor Rewards

🛡️ Anti-Bypass & Verified Credential Issuance

👥 Contributor Hall of Fame

🚀 Get Involved & Claim Your Perks

📄 License

About

Releases

Contributors

Languages

Latest commit

History

Folders and files

Repository files navigation

🧠 🎮 Mission Control

NVIDIA-Powered Autonomous AI Gaming Assistant & Telemetry Platform

🥊 Feature Breakdown vs Traditional Setups

📸 Interface & Capabilities Showcase

📌 Monorepo Architecture Overview

🧱 System Workflow Architecture

🚀 Sub-Project Quick Links

🎯 Key Features

🛠️ Prerequisites & Requirements

⚡ Quick Start / Local Development

1. Repository Setup

2. Contributor Environment Setup (Zero-Secrets Policy)

3. Running the Next.js Web Platform

4. Running the Electron Desktop App & Backend

4. Running Automated Packaging & Deployment Pipeline

📅 Roadmap Progress

🤝 Community, Contributing & Developer Perks

🎁 Milestone Developer Benefits & Contributor Rewards

🛡️ Anti-Bypass & Verified Credential Issuance

👥 Contributor Hall of Fame

🚀 Get Involved & Claim Your Perks

📄 License

About

Topics

Resources

Code of conduct

Contributing

Security policy

Stars

Watchers

Forks

Releases

Contributors

Languages