Docs  /  _AugmentedIntelligence System Map

_AugmentedIntelligence System Map

High-level operator/developer map for _AugmentedIntelligence v11 (typed commands). Not a replacement for source code — first place to look when deciding what to run, configure, train, or extend.

Evolution / history: ProgramEvolution.md · RL hub: ReinforcementLearning.md

Core Runtime

  • SpeechCommands.cpp / AugmentedActions* route typed and spoken commands.
  • DeveloperExtensibility.cpp registers discoverable command patterns.
  • Settings.*, SettingsMySQL.* store local and MySQL settings.
  • Sockets.*, Networking*, WebServer.*, remote command modules provide local/network control.

Common checks:

settings show
socket status
developer commands

Agents And Autonomy

  • AgentRuntime.* — native, Lua-backed, and spreadsheet simple agents.
  • RSIAgent.* + lua_scripts/RSI-*.lua — recursive self-improvement loops.
  • HumanAgent.*, DesktopSupportAgent.*, CyberneticAgent.*, WindowsServerAgentFleet.*, Application Support agents.
  • Executive Functions.* — multi-step plans (plan … / executive …) used by RSI and Minecraft RL for high-level setup (not frame motor control).
docs/AGENT_ORCHESTRATION.md
docs/SimpleAgents.md

RSI + executive:

rsi agent goal <text>
rsi agent plan status|detail|sync|next
rsi agent on profile StrategicOnly dry run

Reinforcement Learning

Start here: ReinforcementLearning.md

Substrate

Module Role
RLCore, RLAlgorithms, RLExplore Transitions, algorithms, exploration/shields
RLFeatures Top-level rl … dispatch (curriculum, real, net, cartpole, life)
RLCurriculumOrchestrator Domain catalog + synthetic smoke
RLDeployment, RLReal, RLRealEnvs Real-world stages and gates
RLDistributed Remote/deep training hooks

In-process neural (MathNN)

Module Role
MathNN, MathNNLayers, MathNNFeatures Dense nets, layers, nn commands
RLNeural DQN, dueling, A2C, bandit, hierarchical, multi-head, reward/world models
RLAgentNet Per-agent registry: enable/mode/save/load/q/loss/feedback
MathNNAgentBridge, MathNNIntegration Agent profiles + vision/speech features
LifeRL Advisory life-domain policies 
docs/MathNN.md
docs/LifeRL.md
docs/RLCurriculum.md
docs/RLDomains.md
docs/GamingRL.md
docs/DrivingRL.md
docs/KnowledgeRL.md
docs/CHILD_PSYCHOLOGY_PARENTING_RL.md

Quick checks:

nn demo
rl cartpole 50
rl net status
rl curriculum smoke all 8 96
life rl smoke all 8

Minecraft

  • Native: MineCraft.*, MinecraftDQN.*, MinecraftClientController.*, MinecraftSpigotBridge.*, MinecraftTextureVision.*
  • Server: minecraft_spigot_plugin/ (TCP JSON-lines bridge)
  • Control: Spigot actions, RCON fallback, optional client keyboard/mouse
  • Learning: tabular + MathNN (minecraft dqn net … / rl net enable minecraft)
  • Planning: minecraft dqn plan … (Executive Functions; setup steps only)
docs/MinecraftIntegration.md
docs/MinecraftPluginOperations.md
docs/MinecraftPluginTrainingGuide.md
minecraft_spigot_plugin/README.md

minecraft bridge start
minecraft dqn plan on
minecraft dqn goal mine iron_ore
minecraft dqn net on
minecraft dqn train 1000

Gaming And Game-Mod Bridges

  • GamingRL.*, GamingSimulation.*, GamingStrategyRL.*
  • GameModBridge.* + game_mods/ (Source, Quake, GMod, Civilization)
docs/GamingRL.md
docs/GamingRLFPS.md
docs/GameModBridges.md

Perception And Multimodal I/O

  • Vision/screen: Computers.*, Vision.*, SpatialAwareness.*, DepthOccupancyEstimator.*, PerceptionBus.*, VisualAidGenerator.*
  • Audio/speech: SpeechRecognition.*, SpeechSynthesis.*, GoogleSpeech.*, Whisper*, Sound.*, Android audio ingest

LLM And Model Serving

  • Routing: LLMOrchestration.*, Large Language Models*, LocalModelRegistry.*
  • TF/TRT/TFLite: TFModels.*, TFServe.*, Tensorflow.*, TensorRT.*
  • Generative: GenerativeModels.* — see docs/GenerativeImages.md
  • llama.cpp notes: docs/llama_cpp_cpu_ram_cuda.md
  • ML life templates: MLApp.*, MLAppFeatures.* — ML_APPLICATIONS.md

Filesystem Inventory (Windows + MySQL)

  • FileSystemUpdate.* — background thread scanning configured roots
  • Tracks add/modify/remove; optional MySQL tables in ai_settings
  • Commands: fs start, fs add, fs scan, fs mysql init|sync|status
docs/FileSystemUpdate.md

fs mysql init
fs add D:/ai_training
fs start 120
fs scan

Desktop, Windows, And Adobe

  • windows_integration/ PowerShell catalogs
  • Adobe bridges (Premiere, Photoshop, Illustrator, After Effects, …)
  • Desktop automation: DesktopSupportAgent.*, ComputerBot.*, Computers.*, mouse/keyboard modules (always dry-run first)

Robotics And Simulation

  • ROS.*, OpenClaw bridges, robot curriculum entries
  • Physics/game simulators via RL curriculum smoke (non-actuating)

Knowledge, Memory, And Reasoning

  • Memory: Working / Short-Term / Long-Term, episodic embedders
  • Reasoning: Thought.*, fallacy/bias modules, ReasoningEngine.*
  • Executive planning: Executive Functions.* (plan create|next|detail)
  • Knowledge RL: claim labeling + reward models

Safety And Policy

  • Ethics.*, EthicsActionClassifier.*, SafetyEthicsTrust.*
  • docs/RiskMitigationPlan.md, docs/EnterprisePolicy.md
  • Kill-switch / safe-mode via networking features
  • High-stakes domains (medical, legal, finance, parenting, live bots): smoke and dry-run first; human approval before live actuation

Extensibility

  • Lua in RSI and agents (ai_* globals)
  • Plugin SDK: docs/Plugin-SDK.md
  • Developer patterns: docs/Developer-Extensibility.md
  • Command catalog seeding in AugmentedActions* / SeedCatalog

Build And Test

Project files (must list every new .cpp/.hpp):

_AugmentedIntelligence.vcxproj
_AugmentedIntelligence.vcxproj.filters

Isolated math/NN tests (MinGW, no full deps):

./tests/run_math_tests.ps1
./tests/run_all_tests.ps1              # math + bridges + fuzzer + batch
./tests/run_all_tests.ps1 -CompileGate # + MSVC SelectedFiles gate

tests/README_MATH_TESTS.md
docs/Testing.md
docs/DearImGuiFeatures.md   # ImGui dashboard panels (GuiDashboard)
docs/PluginBridges.md       # Plugin SDK host + unified bridges
docs/RemoteCUDA.md          # Remote CUDA client + worker
docs/EnvironmentVariables.md # ENV vars and defaults
docs/MathDE.md

GUI: launch --gui; View menu layouts; Ctrl+K palette; Math Lab / Bridges / Ops strip via GuiDashboard.cpp.

Plugins/bridges: plugins list, bridge status, bridge replay minecraft tests/fixtures/..., builtins greet / bridgekit / mathkit / creokit / blenderkit / c4dkit / reasonkit / weatherkit.

Reasoning hygiene: offline fallacy/bias heuristics + optional deep LLM (fallacy check, bias check, reasoning audit, reasoning equilibrium) — ReasoningFallacyBias.md.

Weather / multi-hazard disasters: Open-Meteo + NWS + USGS + NASA EONET + GDACS + NOAA SWPC (weather now, storm watch, earthquake recent, disaster all, disaster monitor on) — WeatherHazards.md.

Body equilibrium: body *, day brief, watchdesk — BodyEquilibrium.md.

NeMo (NVIDIA): nemo rails check|chat, profiles mock/guardrails/nim — NemoIntegration.md.

TF train from C++: tftrain ways|pipeline|finetune|native — TFTrainCpp.md.

Creative desk: creative status|dry-run fans out Creo/Blender/C4D.

Cognitive layers: attention / curiosity / drives stack (layers, attention, curiosity) — CognitiveLayers.md, MathNN+RL map CognitiveLayersMathNNRL.md.

Command from chat: neural hybrid suggest (suggest …, do …) — CommandSuggest.md.

Discovery → WordPress: journal + post every discovery (discovery seed|post|wordpress on) — DiscoveryWordPress.md.

Space Engineers is the Minecraft RL successor (se smoke, se rl …, bridge :8766) — see SpaceEngineersRL.md.

Creo Parametric CAD bridge (creo profiles|demo|param|recipe|selftest, bridge start creo) — CreoIntegration.md.

Blender + Cinema 4D DCC bridges (blender / c4d, bridge start blender|c4d) — BlenderCinema4DIntegration.md.

Tensor builds: Release-GPU-AVX2-Tensor / Release-GPU-AVX512-Tensor enable AI_USE_TENSORRT — see BuildConfigurations.md · TensorRT.md.

CUTLASS façade: cutlass status|bench|check — see Cutlass.md.

Semantic vectors: GloVe + Wikipedia/Wiktionary MySQL — see SemanticVectors.md.

Recommended verification:

  1. Compile touched C++ (MSVC) or tests/run_compile_gate.ps1.
  2. Run tests/run_math_tests.ps1 when touching Math/NN/DE cores.
  3. Status/dry-run before bridges or actuation; use tests/fixtures/** for protocol shapes.
  4. Checkpoint before long training.
  5. Prefer synthetic rl curriculum smoke before real domains.
  6. Import tests/eval_tasks_seed.sql for EvalHarness pass-rate tracking.

Documentation Index (selected)

Topic Path
System map (this file) docs/AugmentedIntelligenceSystems.md
RL hub docs/ReinforcementLearning.md
MathNN docs/MathNN.md
Life RL docs/LifeRL.md
RL curriculum docs/RLCurriculum.md
Minecraft training docs/MinecraftPluginTrainingGuide.md
Filesystem + MySQL docs/FileSystemUpdate.md
Sample workflows AugmentedIntelligence_Sample_Workflows.md (repo root)
Install (Windows) docs/Windows-Install.md

Version note

Updated for MathNN multi-learner registry, Life RL, unified rl dispatch, Minecraft/RSI executive planning hooks, and MySQL-backed filesystem inventory (2026).

Generated from the project markdown docs on 2026-07-24. This is a static, self-contained site.