Purpose: define exactly how the 6 new models (Framework Meta-Model, 3 Horizon Model, ISO 31000 Risk Process, Change Integration Model, I→T→E→Comb-Shaped Growth Model, Understanding Learners / Honey & Mumford + Integrated L&D) plug into Attune’s existing scoring pipeline — as context/enrichment layers injected before the 19 utterance-level frameworks score, not as competing scorers.
This matches the real architecture shown on the Model card & arch page: a 3-encoder fusion transformer (text/audio/video) → cross-modal fusion → framework-grounded heads (Attune · 8 competencies, Attune Classified, psych-safety framework, NVC · GROW, Custom). The 6 new models become an additional pre-fusion context head whose output is passed alongside the transcript into the framework-grounded heads, the same way a “Custom” head already works today.
TEXT / AUDIO / VIDEO → [existing 3 encoders] → Cross-modal fusion transformer
│
┌────────────────────────────────────┴───────────────────────┐
│ │
[NEW] Structural Context Head Framework-grounded heads (existing)
──────────────────────────── ──────────────────────────────────
• Framework Meta-Model (schema validator) Attune · 8 competencies
• 3 Horizon Model (H0–H3 classifier) ──context──▶ Attune Classified
• ISO 31000 (risk-stage classifier) injection psych-safety framework
• Change Integration Model (context tagger) NVC · GROW
• I→T→E→Comb Growth Model (maturity classifier) Custom
• Understanding Learners (style + L&D-stage classifier)
│ │
└────────────────────────────────────┬───────────────────────┘
▼
OUTPUTS (existing, per utterance & session)
+ 4 NEW session/team-level tags (below)
The structural context head does not produce its own 0–100 utterance score. Instead it emits tags that get concatenated into the framework-grounded heads’ input context — the same mechanism the model card already documents for “Framework citation” (e.g. “Attune Comp #7 · Evokes”). This is additive, not a retrain of the existing 355M-param text encoder.
Per the model card’s current output list:
· 10 dimension scores (0–100)
· Intuition confidence (0–1)
· Utterance tags w/ framework citation
· Intuition read (natural language)
· Intent-impact gap %
· Next-best-action suggestion
· Bias flags with severity
· Modality-agreement breakdown
New fields appended:
· Horizon tag (H0/H1/H2/H3) — 3 Horizon Model
· Risk-stage tag (identify/analyze/evaluate/treat/monitor, or "none") — ISO 31000
· Change-context tag (swift/disruptive vs. planned/deliberate) — Change Integration Model
· Growth-shape tag (I/T/E/Comb) with trajectory delta vs. last session — I→T→E→Comb model
· Framework-schema trace (technique→practice→model→principle chain) — Meta-Model, powers "Framework citation" links
· Learning-style mix (Activist/Reflector/Theorist/Pragmatist %) + L&D-stage tag — Understanding Learners model
| New model | Existing framework it improves | Mechanism | Expected effect on model-card metrics |
|---|---|---|---|
| Change Integration Model | Nonviolent Communication (#4), Primal Leadership (#11), Dare to Lead (#16) | Tags session as swift/disruptive vs. deliberate before tone scoring runs, so urgent language in a genuine crisis isn’t penalized the same as urgency during routine work | Directly targets a documented failure mode: model card lists “Silence-heavy exec styles” as a failure mode for Active listening (F1 0.81, “slightly under”) — context tagging should reduce false-negative empathy/safety scores during high-tempo change conversations |
| ISO 31000 Risk Process | Psychological Safety (#3), Radical Candor (#7), Crucial Conversations (#17) | Classifies whether a raised concern was ever resolved (monitor/review step) vs. just raised and dropped | Improves the “Intent-impact gap” dimension (currently F1 0.81, flagged “▲ above” — i.e. currently over-triggering) by giving it a formal avoidance/escalation taxonomy instead of a blunt gap score |
| 3 Horizon Model | Guided Growth model (#5), Growth Mindset framework (#6) | Classifies growth-plan actions by strategic horizon (H0–H3) instead of scoring language tone alone | Improves “Growth mindset” dimension (F1 0.84, “on par”) by adding a structural label Cohere can aggregate team-wide without new individual scoring |
| I→T→E→Comb Growth Model | Trust trajectory (#5/#6 support), The Emotionally Intelligent Manager (#13) | Adds a validated maturity-stage classifier so trajectory scoring has a taxonomy to plot against instead of a raw 0–100 trend line | Directly targets “Trust trajectory” dimension (currently F1 0.76, “slightly under”, failure mode “Needs 3+ sessions”) — a stage classifier can produce a usable signal from session 1 instead of waiting for 3+ data points |
| Framework Meta-Model | All 19 | Standardizes how every framework’s technique→practice→model→principle chain is encoded, so “Framework citation” links (e.g. “Attune Comp #7 · Evokes”) are consistent and auditable across all 19 | Reduces citation drift as frameworks are added/updated; improves ablation-study interpretability (“Full + framework heads” currently +4 F1 — meta-schema should make future framework additions cheaper to validate |
| Understanding Learners (Honey & Mumford + Integrated L&D) | Psychological Safety (#3), Nonviolent Communication (#4), Guided Growth model (#5), Growth Mindset framework (#6), The Emotionally Intelligent Manager (#13) | Classifies each learner’s dominant style (Activist/Reflector/Theorist/Pragmatist) from language patterns and flags style↔︎delivery mismatches; also tags whether low psych-safety or unclear communication is suppressing accurate style signal (both named explicitly as cross-stage enablers in the source framework) | Directly powers the “Next-best-action suggestion” output field with a style-matched recommendation instead of a generic one; feeds Meridian’s per-learner session-prep view and Cohere’s team-level learning-style distribution for L&D program design |
The I→T→E→Comb Growth Model (#24) and Understanding Learners (#25) both write to the same “Next-best-action suggestion” output field, but along independent axes: - #24 answers: what depth/breadth stage is this person at (I/T/E/Comb)? - #25 answers: how does this person learn best (Activist/Reflector/Theorist/Pragmatist)?
These can genuinely conflict — e.g. a Comb-shaped senior leader can still be a strong Activist learner who wants hands-on piloting, not a theory briefing, even though their growth stage says “senior.” The next-best-action generator must treat #24 and #25 as two inputs to reconcile (e.g. “Comb-shaped + Activist → sponsor them to pilot a cross-domain initiative hands-on” rather than a generic Comb-shaped suggestion), not let one silently override the other. This is called out explicitly so it isn’t built as an implicit precedence rule during implementation without a product decision.
Stakeholder decision: all 6 models ship
Live · citable from day one. This overrides the
earlier staged-rollout recommendation (Research preview → Live).
Implementation steps:
model_studio_extension.json) — schema, signals, weight
defaults. Done — all 6 now flagged
Live · citable.Framework Meta-Model and I→T→E→Comb Growth Model are low-risk to ship live — they map onto data Attune already collects (framework citations, trust trajectory) and don’t introduce new unvalidated inference.
3 Horizon Model, ISO 31000 Risk Process, Change Integration Model, and Understanding Learners are going live without the held-out-eval validation the model card holds the other 19 frameworks to. Concretely this means: their horizon/risk/change-context/learning-style tags will influence Cohere’s team-health aggregation, Meridian’s session-prep view, and Attune’s shadow-coach whispers and next-best-action suggestions in production before anyone has measured their F1/Cohen’s κ against the 12,000-session external-coach-annotated eval set. Recommend: - Tag these 4 outputs internally as “provisional” in logs/telemetry so a fast-follow eval can be diffed against real usage data. - Set a concrete eval checkpoint (e.g. first 2–4 weeks of production data) rather than letting “fast-follow” drift indefinitely. - Do not publish F1/κ numbers for these 4 in the public Model card until that eval completes — the model card’s existing credibility rests on every published number being externally verified; publishing unvalidated numbers for the new 4 would undermine that standard even though the shipping decision itself is fine.
Full validation plan: see
fast_follow_eval_plan.md for the complete fast-follow eval
design covering these 4 models — scope/out-of-scope, why the existing
12k held-out set can’t be reused as-is per model, per-model ground-truth
annotation design (including the flagged Change Integration Model data
gap), metrics & pass thresholds (including the new MAE-based metric
for Understanding Learners’ style-mix output), sample size &
annotator plan, a 5-week timeline anchored to the “2–4 weeks” checkpoint
above, the per-model (not all-or-nothing) go/no-go decision rule,
live-production-data handling during the gap, and the reporting format
matching the Model card page’s Evaluation table.