Android companion — Pixel 7 Pro capability brainstorm

Status: Design brainstorm (builds on shipping pixel7pro flavor)
Hardware target: Google Pixel 7 Pro (cheetah) · Tensor G2 · Mali-G710 · 12 GB RAM · Android 13+
Package: ai.crockett.augmentedintelligence.pixel7pro
Related: Pixel7Pro-Install.md · UbuntuOnPixelRooted.md · PhpPluginPanelsBrainstorm.md · MinecraftClientBridge.md

1. What ships today

Native: libai_native_bridge.so (request/header builders).
Profile knobs: vision interval, JPEG quality, TFLite threads, GPU delegate.

Implemented (2026-07) — companion → perception bus

Desktop:

perception companion status
perception companion publish device:cheetah lens:back thermal:light objects:person:0.9 summary:…
companion publish …   # alias

Publishes into _PerceptionBus::CompanionSense and mirrors objects onto camera2 for fusion.

Phone: Vision Publish to bus / auto-publish every ~2.5s when detections run.

2. Why Pixel 7 Pro is a special tier

Design rule: edge intelligence on phone, heavy orchestration on desktop — unless offline mode is required.

Pixel 7 Pro companion
  sense → (optional on-device ML) → compress/stream → desktop _AI
  ← commands / coach TTS / dashboard URL / ethics deny

3. New product pillars (brainstorm)

A. Perception suite (Tensor + cameras)

B. Audio & speech

C. Agent & remote control

D. Dashboard & PHP portal twin

E. On-device MathNN / RL (edge)

F. Security & identity (Pixel strength)

G. Context sensors (phone as body)

H. Termux / Ubuntu companion bridge (your rooted devices)

I. Minecraft + games (mobile ops)

J. Accessibility & UX density

4. New app surfaces (IA brainstorm)

Bottom nav (6 max): Ops · Agent · Sense · Worlds · Lab · Settings (Dashboard folds into Worlds or Ops WebView).

5. Capability matrix (use the silicon)

6. Data / protocol extensions (desktop + phone)

Align tokens with remote commands / android audio already used.

7. Privacy & ethics (Pixel-class)

1. Mic/camera hard switches on every Sense screen.
2. Default: no cloud upload of frames — only to your desktop token endpoint.
3. Ethics deny surfaces as clear UI (not silent fail).
4. No child-directed exploitation features; LegalShield path on desktop remains authority for high-risk text.
5. Health / location opt-in with plain language.
6. Root features hidden unless Magisk detected and user enables “Lab mode.”

8. Implementation phases

P0 — Polish what exists (1 week)

• Keystore-backed token storage
• Connection health + reconnect
• Thermal-aware vision FPS
• Command history + favorites
• Biometric app lock

P1 — Sense 2.0 (2 weeks)

• Lens switcher (wide/UW/tele)
• QR pair desktop
• Pose or document mode (one new TFLite)
• Push-to-talk mic

P2 — Ops remote (2 weeks)

• Minecraft / portal status cards
• Macro tiles + Quick Settings
• Offline command queue
• Confirm high-risk commands

P3 — Edge ML + Lab (ongoing)

• Ethics classifier TFLite
• Math tutor offline pack
• Termux/Ubuntu deep links
• Multi-host dashboard

9. Success metrics (P7 Pro)

10. Explicit non-goals (for this companion)

• Full Minecraft Java client on phone
• Replacing desktop CUDA training
• Covert surveillance modes
• Bypassing desktop AD / LegalShield

11. Bottom line

The Pixel 7 Pro companion should become a field ops + edge perception remote for _AI:

• Sense harder (multi-cam, pose, OCR, thermal-aware TFLite)
• Command safer (biometrics, macros, offline queue)
• Observe worlds (MC + PHP panels)
• Optional lab (Termux/Ubuntu) on your rooted fleet

…while leaving heavy cognition, AD, and high-risk gates on the Windows host.

When you want implementation, start with P0 Keystore + history + thermal vision or P1 QR pair + lens switcher.