_AugmentedIntelligence System Map
High-level operator/developer map for _AugmentedIntelligence v11 (typed
commands). Not a replacement for source code — first place to look when deciding
what to run, configure, train, or extend.
RL hub: ReinforcementLearning.md (ReinforcementLearning.md)
Core Runtime
- SpeechCommands.cpp / AugmentedActions* route typed and spoken commands.
- DeveloperExtensibility.cpp registers discoverable command patterns.
- Settings.*, SettingsMySQL.* store local and MySQL settings.
- Sockets.*, Networking*, WebServer.*, remote command modules provide
local/network control.
Common checks:
[text]
settings show
socket status
developer commands
Agents And Autonomy
- AgentRuntime.* — native, Lua-backed, and spreadsheet simple agents.
- RSIAgent.* + lua_scripts/RSI-*.lua — recursive self-improvement loops.
- HumanAgent.*, DesktopSupportAgent.*, CyberneticAgent.*,
WindowsServerAgentFleet.*, Application Support agents.
- Executive Functions.* — multi-step plans (plan … / executive …) used by
RSI and Minecraft RL for high-level setup (not frame motor control).
[text]
docs/AGENT_ORCHESTRATION.md
docs/SimpleAgents.md
RSI + executive:
[text]
rsi agent goal <text>
rsi agent plan status|detail|sync|next
rsi agent on profile StrategicOnly dry run
Reinforcement Learning
Start here: ReinforcementLearning.md (ReinforcementLearning.md)
Substrate
| Module | Role |
| RLCore, RLAlgorithms, RLExplore | Transitions, algorithms, exploration/shields |
| RLFeatures | Top-level rl … dispatch (curriculum, real, net, cartpole, life) |
| RLCurriculumOrchestrator | Domain catalog + synthetic smoke |
| RLDeployment, RLReal, RLRealEnvs | Real-world stages and gates |
| RLDistributed | Remote/deep training hooks |
In-process neural (MathNN)
| Module | Role |
| MathNN, MathNNLayers, MathNNFeatures | Dense nets, layers, nn commands |
| RLNeural | DQN, dueling, A2C, bandit, hierarchical, multi-head, reward/world models |
| RLAgentNet | Per-agent registry: enable/mode/save/load/q/loss/feedback |
| MathNNAgentBridge, MathNNIntegration | Agent profiles + vision/speech features |
| LifeRL | Advisory life-domain policies |
[text]
docs/MathNN.md
docs/LifeRL.md
docs/RLCurriculum.md
docs/RLDomains.md
docs/GamingRL.md
docs/DrivingRL.md
docs/KnowledgeRL.md
docs/CHILD_PSYCHOLOGY_PARENTING_RL.md
Quick checks:
[text]
nn demo
rl cartpole 50
rl net status
rl curriculum smoke all 8 96
life rl smoke all 8
Minecraft
- Native: MineCraft.*, MinecraftDQN.*, MinecraftClientController.*,
MinecraftSpigotBridge.*, MinecraftTextureVision.*
- Server: minecraft_spigot_plugin/ (TCP JSON-lines bridge)
- Control: Spigot actions, RCON fallback, optional client keyboard/mouse
- Learning: tabular + MathNN (minecraft dqn net … / rl net enable minecraft)
- Planning: minecraft dqn plan … (Executive Functions; setup steps only)
[text]
docs/MinecraftIntegration.md
docs/MinecraftPluginOperations.md
docs/MinecraftPluginTrainingGuide.md
minecraft_spigot_plugin/README.md
[text]
minecraft bridge start
minecraft dqn plan on
minecraft dqn goal mine iron_ore
minecraft dqn net on
minecraft dqn train 1000
Gaming And Game-Mod Bridges
- GamingRL.*, GamingSimulation.*, GamingStrategyRL.*
- GameModBridge.* + game_mods/ (Source, Quake, GMod, Civilization)
[text]
docs/GamingRL.md
docs/GamingRLFPS.md
docs/GameModBridges.md
Perception And Multimodal I/O
- Vision/screen: Computers.*, Vision.*, SpatialAwareness.*,
DepthOccupancyEstimator.*, PerceptionBus.*, VisualAidGenerator.*
- Audio/speech: SpeechRecognition.*, SpeechSynthesis.*, GoogleSpeech.*,
Whisper*, Sound.*, Android audio ingest
LLM And Model Serving
- Routing: LLMOrchestration.*, Large Language Models*, LocalModelRegistry.*
- TF/TRT/TFLite: TFModels.*, TFServe.*, Tensorflow.*, TensorRT.*
- Generative: GenerativeModels.* — see docs/GenerativeImages.md
- llama.cpp notes: docs/llama_cpp_cpu_ram_cuda.md
- ML life templates: MLApp.*, MLAppFeatures.* — ML_APPLICATIONS.md
Filesystem Inventory (Windows + MySQL)
- FileSystemUpdate.* — background thread scanning configured roots
- Tracks add/modify/remove; optional MySQL tables in ai_settings
- Commands: fs start, fs add, fs scan, fs mysql init|sync|status
[text]
docs/FileSystemUpdate.md
[text]
fs mysql init
fs add D:/ai_training
fs start 120
fs scan
Desktop, Windows, And Adobe
- windows_integration/ PowerShell catalogs
- Adobe bridges (Premiere, Photoshop, Illustrator, After Effects, …)
- Desktop automation: DesktopSupportAgent.*, ComputerBot.*, Computers.*,
mouse/keyboard modules (always dry-run first)
Robotics And Simulation
- ROS.*, OpenClaw bridges, robot curriculum entries
- Physics/game simulators via RL curriculum smoke (non-actuating)
Knowledge, Memory, And Reasoning
- Memory: Working / Short-Term / Long-Term, episodic embedders
- Reasoning: Thought.*, fallacy/bias modules, ReasoningEngine.*
- Executive planning: Executive Functions.* (plan create|next|detail)
- Knowledge RL: claim labeling + reward models
Safety And Policy
- Ethics.*, EthicsActionClassifier.*, SafetyEthicsTrust.*
- docs/RiskMitigationPlan.md, docs/EnterprisePolicy.md
- Kill-switch / safe-mode via networking features
- High-stakes domains (medical, legal, finance, parenting, live bots): **smoke
and dry-run first**; human approval before live actuation
Extensibility
- Lua in RSI and agents (ai_* globals)
- Plugin SDK: docs/Plugin-SDK.md
- Developer patterns: docs/Developer-Extensibility.md
- Command catalog seeding in AugmentedActions* / SeedCatalog
Build And Test
Project files (must list every new .cpp/.hpp):
[text]
_AugmentedIntelligence.vcxproj
_AugmentedIntelligence.vcxproj.filters
Isolated math/NN tests (MinGW, no full deps):
[powershell]
./tests/run_math_tests.ps1
./tests/run_all_tests.ps1 # math + bridges + fuzzer + batch
./tests/run_all_tests.ps1 -CompileGate # + MSVC SelectedFiles gate
[text]
tests/README_MATH_TESTS.md
docs/Testing.md
docs/DearImGuiFeatures.md # ImGui dashboard panels (GuiDashboard)
docs/PluginBridges.md # Plugin SDK host + unified bridges
docs/RemoteCUDA.md # Remote CUDA client + worker
docs/EnvironmentVariables.md # ENV vars and defaults
docs/MathDE.md
GUI: launch –gui; View menu layouts; Ctrl+K palette; Math Lab / Bridges / Ops strip via GuiDashboard.cpp.
Plugins/bridges: plugins list, bridge status, bridge replay minecraft tests/fixtures/…, builtins greet / bridgekit / mathkit / creokit / blenderkit / c4dkit / reasonkit / weatherkit.
Reasoning hygiene: offline fallacy/bias heuristics + optional deep LLM (fallacy check, bias check, reasoning audit, reasoning equilibrium) — ReasoningFallacyBias.md (ReasoningFallacyBias.md).
Weather / storm / quake: Open-Meteo + NWS + USGS (weather now, storm watch, earthquake recent) — WeatherHazards.md (WeatherHazards.md).
Body equilibrium: body *, day brief, watchdesk — BodyEquilibrium.md (BodyEquilibrium.md).
NeMo (NVIDIA): nemo rails check|chat, profiles mock/guardrails/nim — NemoIntegration.md (NemoIntegration.md).
TF train from C++: tftrain ways|pipeline|finetune|native — TFTrainCpp.md (TFTrainCpp.md).
Creative desk: creative status|dry-run fans out Creo/Blender/C4D.
Cognitive layers: attention / curiosity / drives stack (layers, attention, curiosity) — CognitiveLayers.md (CognitiveLayers.md), MathNN+RL map CognitiveLayersMathNNRL.md (CognitiveLayersMathNNRL.md).
Command from chat: neural hybrid suggest (suggest …, do …) — CommandSuggest.md (CommandSuggest.md).
Discovery → WordPress: journal + post every discovery (discovery seed|post|wordpress on) — DiscoveryWordPress.md (DiscoveryWordPress.md).
Space Engineers is the Minecraft RL successor (se smoke, se rl …, bridge :8766) — see SpaceEngineersRL.md (SpaceEngineersRL.md).
Creo Parametric CAD bridge (creo profiles|demo|param|recipe|selftest, bridge start creo) — CreoIntegration.md (CreoIntegration.md).
Blender + Cinema 4D DCC bridges (blender / c4d, bridge start blender|c4d) — BlenderCinema4DIntegration.md (BlenderCinema4DIntegration.md).
Tensor builds: Release-GPU-AVX2-Tensor / Release-GPU-AVX512-Tensor enable AI_USE_TENSORRT — see BuildConfigurations.md (BuildConfigurations.md) · TensorRT.md (TensorRT.md).
CUTLASS façade: cutlass status|bench|check — see Cutlass.md (Cutlass.md).
Semantic vectors: GloVe + Wikipedia/Wiktionary MySQL — see SemanticVectors.md (SemanticVectors.md).
Recommended verification:
- Compile touched C++ (MSVC) or tests/run_compile_gate.ps1.
- Run tests/run_math_tests.ps1 when touching Math/NN/DE cores.
- Status/dry-run before bridges or actuation; use tests/fixtures/** for protocol shapes.
- Checkpoint before long training.
- Prefer synthetic rl curriculum smoke before real domains.
- Import tests/eval_tasks_seed.sql for EvalHarness pass-rate tracking.
Documentation Index (selected)
| Topic | Path |
| System map (this file) | docs/AugmentedIntelligenceSystems.md |
| RL hub | docs/ReinforcementLearning.md |
| MathNN | docs/MathNN.md |
| Life RL | docs/LifeRL.md |
| RL curriculum | docs/RLCurriculum.md |
| Minecraft training | docs/MinecraftPluginTrainingGuide.md |
| Filesystem + MySQL | docs/FileSystemUpdate.md |
| Sample workflows | AugmentedIntelligence_Sample_Workflows.md (repo root) |
| Install (Windows) | docs/Windows-Install.md |
Version note
Updated for MathNN multi-learner registry, Life RL, unified rl dispatch,
Minecraft/RSI executive planning hooks, and MySQL-backed filesystem inventory
(2026).
Filed under: Uncategorized - @ July 18, 2026 6:07 am