Architecture
Layers and pipeline from signal inputs to short prompts that plug into the Codmir fabric.
Architecture
The Codec SDK evolves as a layered pipeline designed to be swappable as research matures.
Layers
- N0 Signal IO
- Current: text/voice/gesture
- Future: EEG/ECoG/MEG (research)
- N1 Feature Bank
- Extract time-frequency and envelope features; normalize inputs
- N2 Phoneme Head
- Map features → phoneme/posterior probabilities
- N3 Language Head
- Phonemes → tokens (subword units) with LM prior
- N4 Semantic Head
- Tokens → intents, constraints, structured short prompt
- SPG (Short Prompt Generator)
- Compact, role-aware prompt delivered to fabric
Pipeline Diagram
flowchart TD
N0[N0 Signal IO] --> N1[N1 Feature Bank]
N1 --> N2[N2 Phoneme Head]
N2 --> N3[N3 Language Head]
N3 --> N4[N4 Semantic Head]
N4 --> SPG[Short Prompt Generator]
SPG --> Fabric[AGI Fabric (Codmir, Roles, Proctor)]Execution Modes
- Simulation: text/ASR input → SPG
- Research: plug-in neural feature extractors
- Production (future): BMI device integration