{"id":1968,"date":"2026-07-18T06:29:24","date_gmt":"2026-07-18T13:29:24","guid":{"rendered":"http:\/\/macdaddy4sure.ai\/?p=1968"},"modified":"2026-07-18T06:29:24","modified_gmt":"2026-07-18T13:29:24","slug":"dear-imgui-fitting-more-features","status":"publish","type":"post","link":"http:\/\/macdaddy4sure.ai\/index.php\/2026\/07\/18\/dear-imgui-fitting-more-features\/","title":{"rendered":"Dear ImGui \u2014 Fitting More Features"},"content":{"rendered":"\n

Brainstorm for expanding the Win32 + DirectX 11 dashboard (Gui.cpp \/ Gui.hpp)<\/p>\n\n\n\n

without turning the main thread into an unmaintainable monolith.<\/p>\n\n\n\n

Current surface (already sketched in code): camera\/OD panes, audio waveform,<\/p>\n\n\n\n

thread terminals, HUD, command palette, timeline, node graph, inspector,<\/p>\n\n\n\n

profiles, plugin panels, quick controls.<\/p>\n\n\n\n

Design principles<\/h2>\n\n\n\n
    \n
  1. One data bus, many views<\/strong> \u2014 widgets only read thread-safe snapshots; never<\/li>\n<\/ol>\n\n\n\n

       call long work on the ImGui thread.<\/p>\n\n\n\n

      \n
    • Commands stay commands<\/strong> \u2014 GUI buttons enqueue the same strings as typed \/<\/li>\n<\/ul>\n\n\n\n

         speech (SubmitCommandFromGui \/ CommandQueue).<\/p>\n\n\n\n

        \n
      • Docking + layouts<\/strong> \u2014 use ImGui docking (and optional imgui.ini layouts)<\/li>\n<\/ul>\n\n\n\n

           so dense features stay discoverable.<\/p>\n\n\n\n

          \n
        • Lazy panels<\/strong> \u2014 register panels in a catalog; only tick visible windows.<\/li>\n\n\n\n
        • Feature flags<\/strong> \u2014 match build configs (AI_CPU_ONLY, CUDA, etc.) so panels<\/li>\n<\/ul>\n\n\n\n

             hide when subsystems are absent.<\/p>\n\n\n\n

          Information architecture<\/h2>\n\n\n\n
          Zone<\/strong><\/td>Role<\/strong><\/td>Examples<\/strong><\/td><\/tr>
          Ops strip<\/strong><\/td>Always-on status<\/td>CPU\/GPU, queue depth, RSI, MySQL, agent count<\/td><\/tr>
          Command center<\/strong><\/td>Input + history<\/td>Palette, autocomplete, favorites, macros<\/td><\/tr>
          Perception<\/strong><\/td>Sensors<\/td>Cameras, OD table, audio, depth grid<\/td><\/tr>
          Cognition<\/strong><\/td>AI state<\/td>MathNN nets, Life RL, curriculum, eval pass rate<\/td><\/tr>
          Worlds<\/strong><\/td>External sims<\/td>Minecraft, SE, RealityConstruct voxels<\/td><\/tr>
          Math lab<\/strong><\/td>DE\/calc\/algebra<\/td>Catalog runner, trajectory plots, PINN loss<\/td><\/tr>
          Agents<\/strong><\/td>Runtime<\/td>Lua agents, red\/blue, terminals per thread<\/td><\/tr>
          Dev<\/strong><\/td>Diagnostics<\/td>Logs, metrics, compile-test launcher, settings<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n

          Suggested top-level: dockspace<\/strong> with named layouts: Ops, Train, World, Math, Debug.<\/p>\n\n\n\n

          Feature ideas by density ROI<\/h2>\n\n\n\n

          A. Command & control (high ROI)<\/h3>\n\n\n\n
          Feature<\/strong><\/td>Fit<\/strong><\/td><\/tr>
          Command bar with autocomplete<\/strong><\/td>Fuzzy match SeedCatalog \/ command_batch verbs; Tab complete<\/td><\/tr>
          Macro buttons<\/strong><\/td>User-defined rows of de catalog run decay etc.<\/td><\/tr>
          Command history ring<\/strong><\/td>Up\/down + search; re-run; pin<\/td><\/tr>
          Queue visualizer<\/strong><\/td>CommandQueue depth, in-flight, worker state when threading on<\/td><\/tr>
          Dry-run toggle<\/strong><\/td>Global \u201cdon\u2019t actuate bots\u201d mirror of policy flags<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n

          B. Live telemetry (high ROI)<\/h3>\n\n\n\n
          Feature<\/strong><\/td>Fit<\/strong><\/td><\/tr>
          Sparkline strip<\/strong><\/td>Loss, reward, residual_rms, FPS, audio level<\/td><\/tr>
          RSI traffic light<\/strong><\/td>Green\/yellow\/red from _RsiStabilityMonitor<\/td><\/tr>
          EvalHarness pass-rate gauge<\/strong><\/td>Last run_label from MySQL or file<\/td><\/tr>
          Device probe panel<\/strong><\/td>MathNNDevice CPU\/GPU\/NPU placement<\/td><\/tr>
          Thread heat map<\/strong><\/td>Which threads wrote last; stuck detection<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n

          C. Math lab panels (medium ROI, unique)<\/h3>\n\n\n\n
          Feature<\/strong><\/td>Fit<\/strong><\/td><\/tr>
          ODE catalog browser<\/strong><\/td>List models; Run; plot y(t) with ImPlot<\/td><\/tr>
          Phase portrait<\/strong><\/td>2D state scatter for van der Pol \/ Lotka<\/td><\/tr>
          PINN training card<\/strong><\/td>Steps, data loss, residual, checkpoint path<\/td><\/tr>
          Calc playground<\/strong><\/td>Expr input \u2192 derivative\/integral numeric table<\/td><\/tr>
          Algebra matrix pad<\/strong><\/td>Small matrix edit \u2192 expm \/ eig \/ cond<\/td><\/tr>
          Sensitivity readout<\/strong><\/td>de sensitivity results as table<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n

          Use ImPlot<\/strong> (companion to ImGui) for trajectories; keep samples capped<\/p>\n\n\n\n

          (e.g. 2k points) from ring buffers filled by worker threads.<\/p>\n\n\n\n

          D. RL \/ Life \/ curriculum<\/h3>\n\n\n\n
          Feature<\/strong><\/td>Fit<\/strong><\/td><\/tr>
          Curriculum board<\/strong><\/td>Domains, smoke status, last reward<\/td><\/tr>
          Life RL dashboard<\/strong><\/td>Focus\/energy twin gauges (from catalog twins)<\/td><\/tr>
          Checkpoint browser<\/strong><\/td>List checkpoints\/*.net, load\/compare<\/td><\/tr>
          Experience store peek<\/strong><\/td>MathNNExperience counts by domain<\/td><\/tr>
          Shadow vs promote<\/strong><\/td>Learning-function pipeline status<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n

          E. Worlds & bridges<\/h3>\n\n\n\n
          Feature<\/strong><\/td>Fit<\/strong><\/td><\/tr>
          Minecraft bridge card<\/strong><\/td>Port 8765, last status_response fixture fields<\/td><\/tr>
          SE bridge card<\/strong><\/td>Energy\/mass\/thrust dry-run buttons<\/td><\/tr>
          RealityConstruct slice view<\/strong><\/td>2D slice of voxels + DDA ray overlay<\/td><\/tr>
          Protocol fixture viewer<\/strong><\/td>Load tests\/fixtures\/** for offline UI demos<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n

          F. Perception upgrades<\/h3>\n\n\n\n
          Feature<\/strong><\/td>Fit<\/strong><\/td><\/tr>
          Multi-cam tabs<\/strong><\/td>Already partial; add picture-in-picture<\/td><\/tr>
          OD filter chips<\/strong><\/td>Class \/ score threshold sliders<\/td><\/tr>
          Depth occupancy grid<\/strong><\/td>Heatmap from DepthOccupancyEstimator<\/td><\/tr>
          Spectrogram zoom<\/strong><\/td>Click-to-cue audio buffer<\/td><\/tr>
          Snapshot gallery<\/strong><\/td>Recent stills with OCR\/OD annotations<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n

          G. Agent & Lua studio<\/h3>\n\n\n\n
          Feature<\/strong><\/td>Fit<\/strong><\/td><\/tr>
          Agent list<\/strong><\/td>Runtime profiles, start\/stop, script path<\/td><\/tr>
          Lua scratch pad<\/strong><\/td>Run snippet with ai_* globals (sandboxed)<\/td><\/tr>
          Red\/blue exercise panel<\/strong><\/td>Scenario picker + log<\/td><\/tr>
          Plugin panel host<\/strong><\/td>Dynamic ImGui callbacks from plugins (ABI careful)<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n

          H. Accessibility & UX density<\/h3>\n\n\n\n
          Feature<\/strong><\/td>Fit<\/strong><\/td><\/tr>
          Docking layouts<\/strong><\/td>Save\/load layouts\/ops.ini<\/td><\/tr>
          Command-centric search (Ctrl+K)<\/strong><\/td>Single palette for commands, panels, docs<\/td><\/tr>
          Font scale \/ high-contrast theme<\/strong><\/td>Operator preference<\/td><\/tr>
          Notification toast stack<\/strong><\/td>Errors, eval fails, RSI trips<\/td><\/tr>
          Help drawer<\/strong><\/td>Embed snippets from docs\/*.md (truncated)<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n

          How to fit without clutter<\/h2>\n\n\n\n

          1. Panel registry<\/h3>\n\n\n\n

          [text]
          <\/em>struct GuiPanel {
            id, title, category, default_open, draw_fn, enabled_fn
          };<\/p>\n\n\n\n

          DrawPluginPanelsWindow already leans this way via _UiRuntime::GetPanels() \u2014<\/p>\n\n\n\n

          extend that registry for first-party panels too.<\/p>\n\n\n\n

          2. Background workers only<\/h3>\n\n\n\n
            \n
          • ODE runs, PINN fit, RL smoke \u2192 CommandQueue<\/strong> or std::async<\/li>\n\n\n\n
          • UI reads shared_ptr<const Snapshot> updated under mutex<\/li>\n\n\n\n
          • Never block RenderFrame on MySQL or network<\/li>\n<\/ul>\n\n\n\n

            3. Progressive disclosure<\/h3>\n\n\n\n
              \n
            • Collapsed \u201cAdvanced\u201d trees for matrix pads \/ raw JSON<\/li>\n\n\n\n
            • Novice layout: Command + Camera + Status<\/li>\n\n\n\n
            • Expert layout: Math lab + Agents + Bridges<\/li>\n<\/ul>\n\n\n\n

              4. ImPlot + tables over free text<\/h3>\n\n\n\n

              Prefer:<\/p>\n\n\n\n

                \n
              • ImGui::BeginTable for OD \/ catalog \/ eval results\u00a0<\/li>\n\n\n\n
              • ImPlot::PlotLine for trajectories\u00a0<\/li>\n\n\n\n
              • Color-coded chips for status\u00a0<\/li>\n<\/ul>\n\n\n\n

                over multi-kilobyte TextUnformatted log dumps (keep those in Terminals).<\/p>\n\n\n\n

                5. Time budgets<\/h3>\n\n\n\n

                Per frame:<\/p>\n\n\n\n

                  \n
                • UI logic &lt; 2 ms\u00a0<\/li>\n\n\n\n
                • Texture upload budget for cameras\u00a0<\/li>\n\n\n\n
                • Defer spectrogram FFT to audio thread\u00a0<\/li>\n<\/ul>\n\n\n\n

                  6. Optional modules<\/h3>\n\n\n\n

                  Compile-time:<\/p>\n\n\n\n

                    \n
                  • AI_GUI_MATHLAB \u2014 math panels\u00a0<\/li>\n\n\n\n
                  • AI_GUI_WORLDS \u2014 MC\/SE\/RC\u00a0<\/li>\n\n\n\n
                  • AI_GUI_IMPLOT \u2014 plot dependency\u00a0<\/li>\n<\/ul>\n\n\n\n

                    Keeps Linux\/headless builds free of DX11.<\/p>\n\n\n\n

                    Implementation phases (suggested)<\/h2>\n\n\n\n
                    Phase<\/strong><\/td>Deliverable<\/strong><\/td><\/tr>
                    P0<\/strong><\/td>Dockspace + layout save; unified Ctrl+K palette; ops strip (queue, RSI, device)<\/td><\/tr>
                    P1<\/strong><\/td>Command history + macros; EvalHarness pass-rate; checkpoint list<\/td><\/tr>
                    P2<\/strong><\/td>ImPlot math lab (catalog run + plot); PINN card<\/td><\/tr>
                    P3<\/strong><\/td>Bridge cards + fixture viewer; RealityConstruct 2D slice<\/td><\/tr>
                    P4<\/strong><\/td>Agent\/Lua scratch; plugin ImGui host; toast notifications<\/td><\/tr>
                    P5<\/strong><\/td>Theme pack, help drawer, accessibility<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n

                    Risks<\/h2>\n\n\n\n
                    Risk<\/strong><\/td>Mitigation<\/strong><\/td><\/tr>
                    UI thread deadlock with CoutCapture<\/td>GUI never holds locks while printing; drain logs async<\/td><\/tr>
                    Stale snapshots<\/td>Version counters; \u201cupdated Xs ago\u201d labels<\/td><\/tr>
                    Too many windows<\/td>Layout presets; max 1 auto-popup<\/td><\/tr>
                    Plugin ABI breaks<\/td>C-style draw callback table with version field<\/td><\/tr>
                    GPU texture thrash<\/td>Cap camera resolution in UI; throttle refresh<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n

                    Implementation status (shipped)<\/h2>\n\n\n\n

                    Implemented in GuiDashboard.hpp \/ GuiDashboard.cpp, wired from Gui::RunGui:<\/p>\n\n\n\n

                    Feature<\/strong><\/td>Status<\/strong><\/td><\/tr>
                    Main menu + layout presets (Ops\/Train\/World\/Math\/Debug\/All)<\/td>Done<\/td><\/tr>
                    Ops strip (RSI, queue, device, eval, model count)<\/td>Done<\/td><\/tr>
                    Math lab (catalog plot via ImGui::PlotLines, PINN residual, calc\/algebra)<\/td>Done<\/td><\/tr>
                    World bridges + protocol fixture viewer<\/td>Done<\/td><\/tr>
                    RealityConstruct XZ slice view<\/td>Done<\/td><\/tr>
                    Agents \/ Lua scratch enqueue<\/td>Done<\/td><\/tr>
                    Checkpoints browser<\/td>Done<\/td><\/tr>
                    Macros + command history<\/td>Done<\/td><\/tr>
                    Command queue panel<\/td>Done<\/td><\/tr>
                    EvalHarness pass-rate gauge<\/td>Done<\/td><\/tr>
                    Learning \/ experience commands<\/td>Done<\/td><\/tr>
                    Theme \/ font scale \/ high-contrast<\/td>Done<\/td><\/tr>
                    Help drawer<\/td>Done<\/td><\/tr>
                    Toast stack<\/td>Done<\/td><\/tr>
                    Extended palette verbs (de\/calc\/algebra\/\u2026)<\/td>Done<\/td><\/tr>
                    imgui_ai_dashboard.ini layout persistence<\/td>Done<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n

                    Not in this ImGui build:<\/strong> docking branch (ImGuiConfigFlags_DockingEnable). Layouts are presets + free-floating windows instead of a dockspace.<\/p>\n\n\n\n

                    How to use<\/h3>\n\n\n\n
                      \n
                    • Launch with –gui (or existing GUI thread path).\u00a0<\/li>\n\n\n\n
                    • View<\/strong> menu \u2192 pick a layout.\u00a0<\/li>\n\n\n\n
                    • Ctrl+K<\/strong> \u2192 command palette (includes math\/de verbs).\u00a0<\/li>\n\n\n\n
                    • Math Lab<\/strong> \u2192 pick model \u2192 Run catalog integrate (short in-process plot) or Enqueue.\u00a0<\/li>\n\n\n\n
                    • Toasts appear top-right for RSI\/eval\/math events.<\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"

                      Brainstorm for expanding the Win32 + DirectX 11 dashboard (Gui.cpp \/ Gui.hpp) without turning the main thread into an unmaintainable monolith. Current surface (already sketched in code): camera\/OD panes, audio waveform, thread terminals, HUD, command palette, timeline, node graph, inspector, profiles, plugin panels, quick controls. Design principles    call long work on the ImGui thread. […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-1968","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"_links":{"self":[{"href":"http:\/\/macdaddy4sure.ai\/index.php\/wp-json\/wp\/v2\/posts\/1968","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/macdaddy4sure.ai\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/macdaddy4sure.ai\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/macdaddy4sure.ai\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/macdaddy4sure.ai\/index.php\/wp-json\/wp\/v2\/comments?post=1968"}],"version-history":[{"count":1,"href":"http:\/\/macdaddy4sure.ai\/index.php\/wp-json\/wp\/v2\/posts\/1968\/revisions"}],"predecessor-version":[{"id":1969,"href":"http:\/\/macdaddy4sure.ai\/index.php\/wp-json\/wp\/v2\/posts\/1968\/revisions\/1969"}],"wp:attachment":[{"href":"http:\/\/macdaddy4sure.ai\/index.php\/wp-json\/wp\/v2\/media?parent=1968"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/macdaddy4sure.ai\/index.php\/wp-json\/wp\/v2\/categories?post=1968"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/macdaddy4sure.ai\/index.php\/wp-json\/wp\/v2\/tags?post=1968"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}