⚙️ Harness Engineering Sequence
The engineered loop that runs and evaluates the X-Ray Underwriting Agent — a disciplined sequence from objective to stored result, with a verifier, tiered human gates and dynamic feedback at every stage. Pick any of the 56 industry profiles and the Demo runs the whole thing live on that profile's own numbers (no backend required).
61 industry profiles11 archetypes10-stage sequenceColour-coded feedbackSuccess · Warning · Failure
CompletedIn progressWarningFailed / criticalNot started
1
🎯 Define the objective / task Pending
State the decision-relevant goal and success criteria for this run.
2
⚙️ Configure the harness environment Pending
Ephemeral sandbox, egress allowlist, scoped credentials, audit chain.
3
🧠 Select the model / agent under evaluation Pending
Pick the system-under-test and its role, model tier and permissions.
4
🧩 Prepare input, prompt, tools & test data Pending
Assemble the case: captured evidence, prompt, tool allowlist, test fixture.
5
▶️ Execute the harness Pending
Kick off the planner → executor → verifier loop against the case.
6
📡 Monitor execution in real time Pending
Stream planner decisions, tool calls and verifier verdicts as they happen.
7
📥 Capture output & intermediate actions Pending
Record the evidence graph, tool I/O and the final scenario produced.
8
🧪 Evaluate output against criteria Pending
Score against the gates: interval width ≤±20%, IRI floor, concordance.
9
💬 Generate feedback, errors & recommendations Pending
Produce scores, flag issues and propose concrete improvements.
10
🗄️ Store results for comparison & reporting Pending
Persist the run to the registry for A/B, dashboards and future iterations.
Execution panel
Empty — start the demo to stream the harness execution here.
Feedback & evaluation
Feedback appears when the run reaches the evaluation stage.
Harness coverage — all 56 industry profiles
Every profile is wired into the same harness: its own drivers, evidence ladder, benchmark floors and turnover band. Filter the list, then click a row (or Run) to load that profile into the Demo and watch the harness execute it.
4Food & Beverage
13Retail
10Manufacturing
19Services
4Transport
5Warehouse & Trade
1Scrap & Recycling
2Livestock
1Agriculture
1Contracting & Projects
1Bulk Building Materials
| Fixture | Profile | Type | Turnover band | Key driver | Primary evidence (Eq-7 next) | Validation | |
|---|---|---|---|---|---|---|---|
| P01-CAT-001 | Catering Services event/order batch, seasonal | Food & Beverage | ₹1–2 L/mo | Events / serving day | Event order/booking register (12 months) | Validated · n=30 hedonic full −3% error vs trade median | |
| P02-RES-002 | Restaurant & Fast Food dine-in + takeaway + aggregator | Food & Beverage | ₹1–3 L/mo | Covers (seats) | Timed peak-hour occupancy count | Validated · n=53 hedonic field −12% error vs trade median | |
| P03-TEA-003 | Tea Stall micro cart / kiosk, cash-heavy | Food & Beverage | ₹1–2 L/mo | Customers / spot / day (very high) | Timed cups-per-hour count (morning + evening peaks) | Validated · n=19 hedonic full −0% error vs trade median | |
| P04-TIF-004 | Tiffin Services subscription meals, recurring | Food & Beverage | ₹1–2 L/mo | Subscribers / meals dispatched per day | Subscriber / route roster (current month) | Validated · n=10 trade median kept | |
| P15-AUT-015 | Auto Spare Parts Dealer automotive spares (2W/4W/CV) — counter retail + garage trade credit | Retail | ₹11–24 L/mo | Transactions / day | Counter bill/challan sequence sample | Prior only | |
| P16-FOO-016 | Footwear Store footwear retail (family/branded/fashion), seasonal & discount-driven | Retail | ₹8–19 L/mo | Transactions / day | POS/Z-report day-total | Prior only | |
| P17-GAR-017 | Garment – Readymade Cloth Store readymade apparel retail (family/ethnic/fashion), seasonal | Retail | ₹11–24 L/mo | Transactions / day | POS/Z-report day-total | Prior only | |
| P18-HAR-018 | Hardware, Paint & Sanitaryware Store building-material trade + retail (hardware, paint tinting, sanitaryware) | Retail | ₹20–43 L/mo | Transactions / day | Counter bill/challan sequence sample | Prior only | |
| P19-JEW-019 | Jewellery Making & Retail gold/silver jewellery retail + making, hallmarked | Retail | ₹2–4 L/mo | Average ticket | Making/wastage-charge bill sample | Validated · n=33 hedonic photo −17% error vs trade median | |
| P20-KIR-020 | Kirana Shop grocery / daily-needs | Retail | ₹4–10 L/mo | Transactions / day | POS / day-book Z-total | Validated · n=78 hedonic field −28% error vs trade median | |
| P21-MOB-021 | Mobile & Electronics Dealer handsets, accessories & consumer electronics with EMI/finance mix | Retail | ₹46–89 L/mo | Transactions / day | Financier/EMI activation register | Prior only | |
| P22-NUR-022 | Nursery & Floriculture plant nursery + on-site production | Retail | ₹2–6 L/mo | Sales / day | Grow-area / polyhouse extent photo | Insufficient · n=1 | |
| P23-PAN-023 | Pan Shop micro-retail kiosk (pan / tobacco / confectionery) | Retail | ₹1–2 L/mo | Sales / day | Cigarette/pan-masala restock slip | Validated · n=6 trade median kept | |
| P24-PHA-024 | Pharmacy regulated chemist / medical store | Retail | ₹5–10 L/mo | Bills / day | Billing-software Z-report | Validated · n=13 hedonic field −17% error vs trade median | |
| P25-RET-025 | Retail Store general small-format retail | Retail | ₹4–7 L/mo | Bills / day | POS Z-report / bill book | Validated · n=85 hedonic field −12% error vs trade median | |
| P26-STA-026 | Stationery & Photocopy stationery retail + copy/print service | Retail | ₹2–4 L/mo | Transactions / day | Photocopier page-counter reading | Insufficient · n=1 | |
| P27-VEG-027 | Vegetable Shop fresh produce / perishable | Retail | ₹1–2 L/mo | Sales / day | Mandi purchase slip (kacha) | Validated · n=48 trade median kept | |
| P05-AGR-005 | Agri Processing Unit (Dal / Spice / Oil Mill) dal / spice / edible-oil processing | Manufacturing | ₹2–4 L/mo | Finished output / hr | Mill/expeller nameplate rating | Validated · n=8 hedonic full −22% error vs trade median | |
| P06-CAR-006 | Carpentry Business made-to-order wood furniture & fittings, semi-skilled labour | Manufacturing | ₹1–2 L/mo | Order-fill utilisation | Order pad / advance-booking register | Validated · n=35 hedonic field −2% error vs trade median | |
| P07-ENG-007 | Engineering Works general fabrication / machining job-shop (lathes, CNC, milling) | Manufacturing | ₹3–7 L/mo | Order-fill utilisation of capacity | Open order book / job register | Validated · n=51 trade median kept | |
| P08-FAB-008 | Fabrication – Welding Works steel gates / grills / structures, per-kg or per-job, workshop + site | Manufacturing | ₹3–7 L/mo | Order-fill utilisation | Job order book / site work orders | Prior only | |
| P09-FLO-009 | Flour Mill / Rice Mill grain milling (atta / rice) with by-products | Manufacturing | ₹90 L–1.6 Cr/mo | Milled output / hr | Roller-body/huller nameplate (TPH) | Prior only | |
| P10-FOO-010 | Food Processing – Snacks / Namkeen namkeen / snacks batch manufacturing (FSSAI, branded) | Manufacturing | ₹44–78 L/mo | Packed output / hr | Auto-packing machine pouch counter | Prior only | |
| P11-FUR-011 | Furniture Manufacturing batch + custom furniture, RM (wood/board/foam), showroom + FG inventory | Manufacturing | ₹13–22 L/mo | Capacity utilisation (batch + order) | Production plan / order + dealer book | Prior only | |
| P12-GAR-012 | Garment Manufacturing – Job-work job-work stitching / CMT at scale (per-piece rate) | Manufacturing | ₹15–28 L/mo | Pieces stitched / hr (all lines) | Installed machines × occupied operator seats | Prior only | |
| P13-PLA-013 | Plastic & Packaging Unit injection / extrusion / blown-film converting | Manufacturing | ₹50–88 L/mo | Converted output / hr | Injection/extruder shot/output counter | Prior only | |
| P14-SPI-014 | Spinning & Weaving Plant textile spinning / weaving (spindles & looms) | Manufacturing | ₹1.1–1.7 Cr/mo | Yarn/fabric-equiv output / hr | Installed spindle/loom count + machine nameplate | Insufficient · n=1 | |
| P29-ARC-029 | Architect Firm small architecture/design practice (residential + small commercial) | Services | ₹6–14 L/mo | Projects billed / month | Signed engagement letters / proposals | Insufficient · n=2 | |
| P30-BEA-030 | Beauty Salon unisex / ladies salon & grooming | Services | ₹1–2 L/mo | Clients served / day (chairs × turns) | Chair/station photo (installed capacity) | Validated · n=63 hedonic photo −15% error vs trade median | |
| P31-CAC-031 | Chartered Accountant / Company Secretary Practice CA/CS professional practice (compliance retainers + audit/tax/filing fees) | Services | ₹3–8 L/mo | Clients billed / month | Client / filing register (portal login count) | Prior only | |
| P32-COA-032 | Coaching / Training Institute competitive-exam / skills coaching (classroom) | Services | ₹9–21 L/mo | Enrolled students (classrooms × batch size) | Admission / enrolment register (term) | Prior only | |
| P33-CON-033 | Consultancy management/IT/engineering advisory (retainers + projects) | Services | ₹2–6 L/mo | Active engagements / month | Retainer agreements / SOWs on file | Validated · n=9 hedonic field −47% error vs trade median | |
| P34-DIA-034 | Diagnostic Lab / Pathology pathology / diagnostic collection & testing | Services | ₹4–11 L/mo | Tests / day | Test register / LIS day-count | Prior only | |
| P35-EVE-035 | Event Management & Decoration weddings / corporate events / decor & production | Services | ₹10–18 L/mo | Avg event value | Signed event contracts (last 6) | Prior only | |
| P36-FIT-036 | Fitness Center / Gym membership gym & group fitness | Services | ₹3–7 L/mo | Active members | Active-member register / app dashboard | Insufficient · n=3 | |
| P37-GEN-037 | Generic G2 — Self-Employed Professional fallback: professional not otherwise listed (lawyer, small consultant, freelance pro) | Services | ₹1–2 L/mo | Clients / month | Appointment/client register (3 mo) | Insufficient · n=4 | |
| P38-GEN-038 | Generic G3 — Self-Employed Non-Professional fallback: small non-professional self-employed (operator/vendor not otherwise listed) | Services | ₹2–3 L/mo | Jobs / day | Cash day-book / job tally (2 wk) | Validated · n=12 hedonic full −42% error vs trade median | |
| P39-INS-039 | Insurance Agency commission-based agency (life / health / motor / general) | Services | ₹2–4 L/mo | Policies issued / month | Policy issuance register / portal count | Insufficient · n=1 | |
| P40-INT-040 | Interior Designer / Decorator turnkey interior design + execution studio | Services | ₹9–14 L/mo | Projects handed over / month | Signed project contracts + advance receipts | Prior only | |
| P41-MOB-041 | Mobile & Appliance Repair mobile / electronics / small-appliance repair counter | Services | ₹2–5 L/mo | Jobs / day | Repair job-ticket register (7-day) | Prior only | |
| P42-REA-042 | Real Estate Agency property brokerage (resale + rental + primary-sales channel) | Services | ₹4–7 L/mo | Deals closed / month | Deal register / agreement-to-sell records | Prior only | |
| P43-REG-043 | Registered Medical Practitioner / Clinic solo/small OPD clinic (GP/specialist) with dispensing add-on | Services | ₹1–2 L/mo | Consults / day | Appointment/OP register day-count | Validated · n=9 hedonic field −30% error vs trade median | |
| P44-TAI-044 | Tailoring Services stitching / alterations / boutique job-work | Services | ₹1–2 L/mo | Garments / day | Order/job-ticket book tally | Validated · n=49 hedonic field −4% error vs trade median | |
| P45-TOU-045 | Tour & Travel Agency air / hotel / package booking & ticketing | Services | ₹2–3 L/mo | Bookings / day | GDS/PNR issuance summary (monthly) | Validated · n=41 hedonic photo −7% error vs trade median | |
| P46-TUI-046 | Tuition Agency school tuition / home & small-premises coaching | Services | ₹1–3 L/mo | Enrolled students (batches × students) | Enrolment / attendance register | Validated · n=12 hedonic full −29% error vs trade median | |
| P47-VEH-047 | Vehicle Service car/two-wheeler workshop & garage | Services | ₹2–4 L/mo | Jobs / day (bays × throughput) | Workshop bay & lift photo (capacity) | Validated · n=40 hedonic photo −15% error vs trade median | |
| P48-CAB-048 | Cab / Taxi Operator (aggregator) owned cars on Ola/Uber aggregator platforms | Transport | ₹2–4 L/mo | Trips / vehicle / day | Aggregator earnings dashboard (weekly trips) | Prior only | |
| P49-COM-049 | Commercial Vehicles Business fleet operator running commercial vehicles on hire / contract | Transport | ₹2–6 L/mo | Trips / vehicle / day | Trip sheet / contract log | Validated · n=48 hedonic full −18% error vs trade median | |
| P50-COU-050 | Courier / Last-mile Logistics bike/van fleet + riders on hub / franchise model | Transport | ₹4–6 L/mo | Parcels / rider / day | Hub manifest / parcels-scanned report | Prior only | |
| P51-GOO-051 | Goods Transport Operator owned trucks / tempos on B2B freight | Transport | ₹9–15 L/mo | Loads / vehicle / day | Trip register / lorry receipts (LR) | Prior only | |
| P52-COL-052 | Cold Storage refrigerated storage rental (agri / perishables) | Warehouse & Trade | ₹6–12 L/mo | Effective rent yield / sq ft / day (net of vacancy) | DISCOM bill (12-month kWh profile) | Prior only | |
| P53-FMC-053 | FMCG Distributor – Stockist fast-moving stockist / super-distributor | Warehouse & Trade | ₹26–44 L/mo | Dispatch value / sq ft / day | Daily beat / van load-out sheet | Prior only | |
| P54-GOD-054 | Godown Owner dry storage rental / warehousing | Warehouse & Trade | ₹2–3 L/mo | Effective rent yield / sq ft / day (net of vacancy) | Occupancy read (bays/racks filled vs total) | Prior only | |
| P55-TRA-055 | Trader (General Goods) wholesale / buy-sell trading | Warehouse & Trade | ₹9–17 L/mo | Sales / sq ft / day | Dispatch register / outward invoices | Prior only | |
| P56-WHO-056 | Wholesale Business C&F carrying & forwarding agent / super-stockist | Warehouse & Trade | ₹24–42 L/mo | Throughput value / sq ft / day | Dispatch / GRN register | Validated · n=21 hedonic field −35% error vs trade median | |
| P28-SCR-028 | Scrap Dealer Shop mixed-scrap buy-sell (shop scale) | Scrap & Recycling | ₹1–3 L/mo | Tonnage / day | Weighing-scale / kanta slips | Validated · n=13 hedonic field −20% error vs trade median | |
| P57-DAI-057 | Dairy milch cattle and buffalo, milk sale | Livestock | ₹1–2 L/mo | Milch animals | Herd count photo (each animal, tag visible) | Validated · n=156 hedonic field −9% error vs trade median | |
| P58-POU-058 | Poultry layer farm, egg sale | Livestock | ₹2–9 L/mo | Birds in lay | Shed photo with cage rows counted | Prior only | |
| P59-AGR-059 | Agricultural Activity crop cultivation, seasonal | Agriculture | ₹2–4 L/mo | Cultivated acres | 7/12 extract or patta for the cultivated land | Validated · n=43 hedonic field −8% error vs trade median | |
| P60-CON-060 | Construction Contractor civil and labour contracts | Contracting & Projects | ₹3–5 L/mo | Running contracts per year | Work orders or contracts for the last 12 months | Validated · n=200 hedonic photo −7% error vs trade median | |
| P61-SAN-061 | Sand & Brick Supplier building materials yard | Bulk Building Materials | ₹3–5 L/mo | Tonnes sold per day | Load challans or royalty passes (3 months) | Validated · n=10 trade median kept |
What the harness is
The harness wraps the model in eight cooperating components, each with one job, a typed contract and its own failure behaviour — so a fault is contained and observable, not silently corrupting the case. It acquires, estimates, reconciles and recommends across all 56 profiles; a human decides.
🧭Planner
Chooses the next objective by expected uncertainty reduction per unit cost/time (Eq-7).
⚡Executor
Runs one planned step via the Tool Router or the capture sub-agent. Deliberately thin.
🛡️Verifier
Independently checks every output — schema, business rules, guardrails — before it enters memory.
🧠Memory
Four tiers: working state, human-confirmed facts, append-only audit log, cross-case priors.
🔀Tool Router
The only path out. Allowlist, scoped short-lived creds the model never sees, retries, logging.
✋Approval Gate
Blocks human-required steps until a named human approves. Tiered by risk × impact.
📝Logger / Tracer
One trace_id per case, span_id per step — every prompt, tool call and decision.
🔗X-Ray Integrator
Typed adapter to the Business X-Ray engine: pulls diagnostics per profile, proposes new signals.
Governing objective. Minimise credit risk while keeping TAT under 48 hours, with full regulator-grade auditability and human-only sanction. Every stage below is justified against it — for every industry profile.
The 10-stage workflow
A short, mostly-fixed plan made adaptive: the loop chooses whether to acquire more evidence, ask, pull an external signal or stop — by what most reduces decision-relevant uncertainty, given the TAT budget. The plan is identical across profiles; the profile decides which evidence and floors bind.
1
Define the objective / task
State the decision-relevant goal and success criteria for this run.
2
Configure the harness environment
Ephemeral sandbox, egress allowlist, scoped credentials, audit chain.
3
Select the model / agent under evaluation
Pick the system-under-test and its role, model tier and permissions.
4
Prepare input, prompt, tools & test data
Assemble the case: captured evidence, prompt, tool allowlist, test fixture.
5
Execute the harness
Kick off the planner → executor → verifier loop against the case.
6
Monitor execution in real time
Stream planner decisions, tool calls and verifier verdicts as they happen.
7
Capture output & intermediate actions
Record the evidence graph, tool I/O and the final scenario produced.
8
Evaluate output against criteria
Score against the gates: interval width ≤±20%, IRI floor, concordance.
9
Generate feedback, errors & recommendations
Produce scores, flag issues and propose concrete improvements.
10
Store results for comparison & reporting
Persist the run to the registry for A/B, dashboards and future iterations.
Harness configuration
The environment, permissions and gates this run executes under. Read-only sample; production values come from the versioned policy registry at decision time.
| Profile suite | 61 industry profiles across 11 archetypes, each validated against officer-assessed cases where the case library holds them — each with its own drivers, evidence ladder & floors |
| Execution context | Ephemeral sandbox container · one per case · destroyed at close |
| Isolation | Network egress allowlist · Router-issued scoped, short-lived credentials · tenant isolation |
| System under test | X-Ray Underwriting Agent · role underwriting.first_pass |
| Model | claude-opus-4-8 · reasoning: high |
| Tool allowlist | xray.assess · gstn.get_filings · udyam.lookup · aa.fetch_inflows · bureau.pull · los.attach_package (+5) |
| Stop / quality gates | interval half-width ≤ ±20% · IRI ≥ profile floor · concordance C · no unresolved conflict |
| Approval tiers | T0 auto · T1 review · T2 maker-checker · T3 committee (by risk × impact) |
| Governing objective | Minimise credit risk · TAT < 48h · full auditability · human-only sanction |
| Posture | Sandbox / mock external pulls · redacted · no funds movement · abstention is valid |
Test cases
A representative, blinded slice of the 56-profile fixture set, with expected criteria and the latest actual result. The full suite runs one fixture per profile.
| Fixture | Profile | Expected | Actual | Result |
|---|---|---|---|---|
| P24-PHA-024 | Pharmacy | ±20% width, IRI≥0.75 | ±18%, IRI 0.71 | Warn |
| P02-RES-002 | Restaurant & Fast Food | ±20% width | ±12% | Pass |
| P28-SCR-028 | Scrap Dealer Shop | cash-share flagged | flagged ✓ | Pass |
| P56-WHO-056 | Wholesale Business C&F | concordance ≥0.8 | 0.86 | Pass |
| P47-VEH-047 | Vehicle Service | tool-use ≥90% | 95% | Pass |
| P12-GAR-012 | Garment Manufacturing – Job-work | ±20% width | ±14% | Pass |
| P51-GOO-051 | Goods Transport Operator | utilisation observed | FASTag ✓ | Pass |
| P18-HAR-018 | Hardware, Paint & Sanitaryware Store | consent valid | EXPIRED → escalate | Fail |
Feedback & logs
Append-only, timestamped trace of the most recent run. Colour-coded by severity. Run the Demo to populate this live.
CompletedIn progressWarningFailed / criticalNot started
| Time | Level | Stage | Event |
|---|---|---|---|
| No events yet — start the Demo. | |||
Reports
Profiles wired56 / 56
Pass rate88%
Avg quality89%
Median TAT2.6 s
Output quality — last 5 runs
Recent runs
| Run | Profile | Result | Quality |
|---|---|---|---|
| #241 | Pharmacy | warning | 86% |
| #240 | Restaurant & Fast Food | success | 93% |
| #239 | Scrap Dealer Shop | success | 90% |
| #238 | Hardware, Paint & Sanitaryware Store | failure | — |
| #237 | Wholesale Business C&F | success | 91% |
Illustrative sample data for demonstration. Production reports draw from the run registry (per-run trace, scores, gate outcomes) for A/B tests, drift and fairness slices — sliced by industry profile and archetype.