Substrate Thinking: Why Engineering Orgs Need a Living Data Layer
#substrate#engineering#documentation#AI#daanaa
David OlssonDaanaa Resolution has a 10-phase Product Development Process. It has formal gates, RACI matrices, DAR (Development Approval Request) review decks, CDR templates, and project priority tiers. On paper, the process is excellent.
In practice, the gap between process design and process execution is where value leaks.
The documentation paradox
Engineering teams face a paradox: the better your process is designed, the more documentation it demands — and the harder it becomes to actually follow. A well-structured PDP with 10 phases and formal gates requires:
- Gate review decks assembled from scattered data
- Status reports compiled manually from spreadsheets
- Traceability matrices maintained by hand
- Lessons learned captured after the fact (if at all)
Engineers spend their time producing documents about work instead of doing work that produces knowledge.
What is a substrate?
A substrate is a structured data layer that sits beneath everything else. It captures knowledge as it's created — not as a reporting exercise, but as a natural byproduct of the work itself.
Think of it this way:
| Traditional | Substrate |
|---|---|
| Engineer fills out a template | Engineer works; substrate captures the state |
| Status report assembled from emails | Dashboard renders current state automatically |
| Gate review deck built from scratch | Gate pack generated from accumulated intelligence |
| Lessons learned doc written at closeout | Lessons captured continuously in structured logs |
The key insight: documents are views, not sources. The substrate is the source. Documents, dashboards, reports, and review decks are all rendered from the substrate.
What Daanaa wants — and what we're building
Daanaa's engagement with Atomic47 is itself a demonstration of substrate thinking. Our .project-state/ facility captures:
- Intelligence layers — what we know about Daanaa's domain, organized by phase
- Decisions — every gate decision with question, answer, rationale, and decision-maker
- Stakeholders — the people map on both sides, with influence and sentiment
- KPIs — metrics that matter at each phase of the engagement
- Activity logs — an append-only record of everything that happens
From this substrate, we render a live dashboard that shows the current state of the engagement. No manual assembly. No stale slide decks. The dashboard is the status report.
The Daanaa opportunity
For a company with ~100+ engineers, ~12 active projects across P1/P2/P3 tiers, and a 10-phase PDP, the leverage is enormous:
- Gate readiness in hours, not days. DAR decks generated from substrate state instead of assembled from scratch.
- Portfolio visibility. Leadership sees real-time project health across all 12 projects, not monthly Excel summaries.
- Knowledge that compounds. Every project enriches the substrate. Lessons from Project A inform Project B's feasibility analysis.
- AI-native. The substrate is structured data — YAML, JSON, Markdown. LLMs can read it, reason about it, and generate from it without any special integration.
The pilot
We're designing a pilot around a P2 customer project. The goal isn't to replace Daanaa's PDP — it's to make it actually work at the speed the business needs. A small cohort of engineers (2-8) will build alongside us, learning the substrate pattern by using it.
By retro 2, the cohort should be fluent. By retro 3, they should be teaching others. That's the real measure of success — not whether we built a cool tool, but whether the knowledge transferred.
Substrate thinking isn't a product. It's a capability. And capabilities compound.