Vertical AI systems · Public reference implementation

Construction Intelligence Workbench

A cloud-native, auditable multimodal AI reference system for turning BIM models, engineering drawings and viewer context into verified, evidenced answers through typed planning, controlled execution and an inspectable audit trail.

MaturityPublic ARMIE AI reference implementation · local + Azure slice
Confirmed baselineTyped plans, deterministic IFC/PDF tools, evidence and independent verification
Current validationFour isolated fixtures, two openly licensed buildings, V2 investigations and cloud provenance
Control boundaryAgent proposes; a human approves or rejects; source files are never edited automatically

Why this exists

Construction information is fragmented across BIM models, drawings, schedules and visual project context. A fluent chat response can hide where a fact came from or silently join the wrong sources. This workbench keeps natural language as the interaction layer while controlled domain execution remains the factual layer.

Evidence beats fluent guesses.Language models may interpret intent or choose among bounded tools. Python and IfcOpenShell calculate engineering facts; evidence, verification and audit state travel with the answer.

System architecture

Natural language→Typed plan→Capability gate→IFC / drawing / retrieval tools→Evidence→Independent verification→Decision Trace

The same codebase runs a fully local profile and a deployed Azure profile. A shared QueryPlan/MultiQueryPlan contract keeps heuristic and semantic planning inside bounded capabilities. Deterministic IFC and drawing tools produce the engineering facts; a vision model is a constrained fallback for visual context, not a replacement for structured BIM computation.

Planning stays typed.Execution stays capability-gated.Answers keep source and verification context.

What the workbench can inspect

Deterministic BIM facts

Counts, grouping and bounded quantity/height queries are computed from IFC data rather than guessed by the model.

Drawing evidence

PDF schedules and source regions remain attached to the result, with honest clarification or refusal when a field is ambiguous.

Cross-source reconciliation

A deliberately narrow capability compares door and window quantities and dimensions by shared tags, reporting matched, mismatched and missing records.

Multimodal context

BIM models, engineering drawings and viewer snapshots are explicit source modes, not an undifferentiated prompt.

Bounded V2 agent

A tool-calling path can investigate a flagged discrepancy through a fixed read-only toolbox and return its own evidence-backed basis.

Human-review workflow

Findings move through reviewable states; approval or rejection is explicit and the agent never edits the model or drawing.

Cloud provenance

On the Azure slice, project/source-set context and a request's trace remain available alongside the answer.

Inspectable audit trail

Planning, execution, evidence, verification and final disposition are rendered as a Decision Trace rather than hidden behind a chat bubble.

Finding resolution is a controlled loop

When reconciliation identifies a non-match, the system can persist it as an EngineeringFinding. A V2 investigation may gather more evidence, but the consequential step remains a human decision and a fresh re-check of the underlying sources.

Open finding→Acknowledge→Action required→Agent investigation→Human approve / reject→Re-check sources→Verified close
Explicit boundary. The agent can propose a disposition such as confirmed dimension, genuine omission or an inconclusive result. It cannot self-approve, overwrite IFC/PDF files or turn a hypothesis into a verified fact without the source re-check.

Public data, not private project material

The public demo combines synthetic fixtures with two unmodified, openly licensed building models. Their attribution records remain in the source repository; the schedules used for reconciliation are ARMIE-generated from each building's own IFC values and include deliberately planted discrepancies for evaluation.

Synthetic fixturesARMIE Demo + Westgate

Controlled models and documents used for repeatable walkthroughs, capability gates and regression tests.

Openly licensedDuplex Apartment

buildingSMART Community Sample Test Files, CC BY 4.0; approximately 38 real door/window openings.

Openly licensedRWTH DigitalHub

RWTH Aachen E3D Institute, MIT; a larger institutional model with 111 real openings.

Implementation evidence

The screenshots below are the public repository's current visual evidence. The first group comes from synthetic fixtures; the final two were captured from the deployed Azure profile against the openly licensed RWTH DigitalHub model. They show the inspectable reference surface, not a hosted enterprise-product promise.

Construction Intelligence Workbench overview with BIM viewer, conversation and evidence inspector
Workbench overview. BIM viewer, conversation workspace and Evidence Inspector share one bounded operator surface.
Construction Intelligence deterministic BIM query with evidence and verification
Deterministic query. A typed IFC query returns a data-derived result with element citations and independent verification.
Construction Intelligence engineering drawing evidence alongside a grounded answer
Drawing evidence. A synthetic schedule question keeps the source page visible beside the grounded answer.
Construction Intelligence V2 viewer selection on the openly licensed RWTH DigitalHub building
Live viewer selection. A selected RWTH DigitalHub window is resolved through the bounded V2 path with its own model identity and trace.
Construction Intelligence viewer selection showing real door or window dimensions
Viewer dimensions. Door and window dimensions remain visible for cross-checking an IFC-to-drawing finding.
Construction Intelligence Decision Trace showing audit and verification stages
Decision Trace. Planning, tool execution, evidence, verification and final disposition remain inspectable step by step.

Engineering progression

FoundationTyped planning and deterministic toolsIFC counts, bounded properties, PDF extraction, capability gates and explicit refusal paths.
Evidence surfaceMultimodal context and reconciliationViewer/drawing evidence, source locators, narrow IFC↔drawing joins and independent verification.
Cloud-native sliceAzure execution and project isolationContainer Apps, managed identities, persistent state, evidence storage, telemetry and source-set provenance.
Current directionV2 finding investigationReal model calls choose from a fixed toolbox; findings remain human-reviewable and re-verified against source.

Current scope and maturity

This is a public ARMIE AI reference implementation with local and live Azure profiles, bounded multimodal workflows, openly licensed demonstration data and an inspectable human-review loop. The latest mainline has been exercised against the two real building models in the public dataset pack, not only the smallest synthetic fixture.

It is not production SaaS, a compliance engine, an unrestricted BIM reasoning system, a multi-tenant platform or a guarantee of arbitrary document-layout or visual-model correctness. Cross-source reconciliation remains intentionally narrow to door/window quantities and dimensions; unsupported operations are declined by design. The live Azure slice is evidence of an engineering reference path, not a claim of enterprise production readiness.

Related infrastructure

Retrieval infrastructure and vertical execution share a discipline, not a claimed unified platform.

Explore Healthcare AI · Azure ↗