IBARA LAB
Omarchy interrupted common native diagnostic
41 attempts recorded. Diagnostic run. Measurement and publication dates are distinct.
Updated
Diagnostic run. Candidate: Omarchy 0.2.1 with candidate browser reader (experimental). Identity complete: true.
Measured to . Sealed 2026-10-11T05:59:16.076059+00:00. Revision 1.
Latest revision and correction history · All campaigns · RSS feed
Results and coverage#
41 attempts recorded. The denominator includes every attempted outcome. Unexecuted attempts are listed separately.
| Planned | Attempted | Passed | Failed | Unknown | Blocked | Safe refusal | Not run |
|---|---|---|---|---|---|---|---|
| 60 | 41 | 39 | 2 | 0 | 0 | 0 | 19 |
Qualification and execution modes
0 of 0 frozen cells observed. Execution modes have separate populations and are never pooled into one performance score.
- An observed attempt is outside the frozen matrix.
- Diagnostic evidence is not an accepted comparison baseline.
- Exactly one frozen campaign manifest is required.
- The frozen matrix has missing, duplicate or unplanned attempts; valid failures remain counted.
- The planned machine, workflow, mode and seed matrix is unavailable.
| Mode | Planned | Attempted | Passed | Failed | Unknown | Blocked | Safe refusal | Not run |
|---|---|---|---|---|---|---|---|---|
| scripted | 41 | 41 | 39 | 2 | 0 | 0 | 0 | 0 |
| unclassified | 19 | 0 | 0 | 0 | 0 | 0 | 0 | 19 |
Scenario, model and environment#
Each dimension is a separate partition of the campaign. Do not sum overlapping dimensions together.
| Dimension | Scenario | Model | Environment | benchmark_mode | fixture_seed | Planned | Attempted | Passed | Failed | Unknown | Blocked | Safe refusal | Not run |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| cohort | Covered-frame refusal | Deterministic common native recipe | Omarchy physical Dell | scripted | 1 | 1 | 1 | 1 | 0 | 0 | 0 | 0 | 0 |
| cohort | Covered-frame refusal | Deterministic common native recipe | Omarchy physical Dell | scripted | 2 | 1 | 1 | 1 | 0 | 0 | 0 | 0 | 0 |
| cohort | Covered-frame refusal | Deterministic common native recipe | Omarchy physical Dell | scripted | 3 | 1 | 1 | 1 | 0 | 0 | 0 | 0 | 0 |
| cohort | Exact shadow Unicode | Deterministic common native recipe | Omarchy physical Dell | scripted | 1 | 1 | 1 | 1 | 0 | 0 | 0 | 0 | 0 |
| cohort | Exact shadow Unicode | Deterministic common native recipe | Omarchy physical Dell | scripted | 2 | 1 | 1 | 1 | 0 | 0 | 0 | 0 | 0 |
| cohort | Exact shadow Unicode | Deterministic common native recipe | Omarchy physical Dell | scripted | 3 | 1 | 1 | 1 | 0 | 0 | 0 | 0 | 0 |
| cohort | Frame and shadow controls | Deterministic common native recipe | Omarchy physical Dell | scripted | 1 | 1 | 1 | 1 | 0 | 0 | 0 | 0 | 0 |
| cohort | Frame and shadow controls | Deterministic common native recipe | Omarchy physical Dell | scripted | 2 | 1 | 1 | 1 | 0 | 0 | 0 | 0 | 0 |
| cohort | Frame and shadow controls | Deterministic common native recipe | Omarchy physical Dell | scripted | 3 | 1 | 1 | 1 | 0 | 0 | 0 | 0 | 0 |
| cohort | Hidden-frame negative check | Deterministic common native recipe | Omarchy physical Dell | scripted | 1 | 1 | 1 | 1 | 0 | 0 | 0 | 0 | 0 |
| cohort | Hidden-frame negative check | Deterministic common native recipe | Omarchy physical Dell | scripted | 2 | 1 | 1 | 1 | 0 | 0 | 0 | 0 | 0 |
| cohort | Modal frame | Deterministic common native recipe | Omarchy physical Dell | scripted | 1 | 1 | 1 | 1 | 0 | 0 | 0 | 0 | 0 |
| cohort | Modal frame | Deterministic common native recipe | Omarchy physical Dell | scripted | 2 | 1 | 1 | 1 | 0 | 0 | 0 | 0 | 0 |
| cohort | Modal frame | Deterministic common native recipe | Omarchy physical Dell | scripted | 3 | 1 | 1 | 1 | 0 | 0 | 0 | 0 | 0 |
| cohort | Native Unicode save and exact download | Deterministic common native recipe | Omarchy physical Dell | scripted | 1 | 1 | 1 | 1 | 0 | 0 | 0 | 0 | 0 |
| cohort | Native Unicode save and exact download | Deterministic common native recipe | Omarchy physical Dell | scripted | 2 | 1 | 1 | 0 | 1 | 0 | 0 | 0 | 0 |
| cohort | Nested cross-origin frame | Deterministic common native recipe | Omarchy physical Dell | scripted | 1 | 1 | 1 | 1 | 0 | 0 | 0 | 0 | 0 |
| cohort | Nested cross-origin frame | Deterministic common native recipe | Omarchy physical Dell | scripted | 2 | 1 | 1 | 1 | 0 | 0 | 0 | 0 | 0 |
| cohort | Nested cross-origin frame | Deterministic common native recipe | Omarchy physical Dell | scripted | 3 | 1 | 1 | 1 | 0 | 0 | 0 | 0 | 0 |
| cohort | Open-shadow modal | Deterministic common native recipe | Omarchy physical Dell | scripted | 1 | 1 | 1 | 1 | 0 | 0 | 0 | 0 | 0 |
| cohort | Open-shadow modal | Deterministic common native recipe | Omarchy physical Dell | scripted | 2 | 1 | 1 | 1 | 0 | 0 | 0 | 0 | 0 |
| cohort | Open-shadow modal | Deterministic common native recipe | Omarchy physical Dell | scripted | 3 | 1 | 1 | 1 | 0 | 0 | 0 | 0 | 0 |
| cohort | Padded-frame refusal | Deterministic common native recipe | Omarchy physical Dell | scripted | 1 | 1 | 1 | 1 | 0 | 0 | 0 | 0 | 0 |
| cohort | Padded-frame refusal | Deterministic common native recipe | Omarchy physical Dell | scripted | 2 | 1 | 1 | 1 | 0 | 0 | 0 | 0 | 0 |
| cohort | Padded-frame refusal | Deterministic common native recipe | Omarchy physical Dell | scripted | 3 | 1 | 1 | 1 | 0 | 0 | 0 | 0 | 0 |
| cohort | Redirect and srcdoc attribution | Deterministic common native recipe | Omarchy physical Dell | scripted | 1 | 1 | 1 | 1 | 0 | 0 | 0 | 0 | 0 |
| cohort | Redirect and srcdoc attribution | Deterministic common native recipe | Omarchy physical Dell | scripted | 2 | 1 | 1 | 1 | 0 | 0 | 0 | 0 | 0 |
| cohort | Redirect and srcdoc attribution | Deterministic common native recipe | Omarchy physical Dell | scripted | 3 | 1 | 1 | 0 | 1 | 0 | 0 | 0 | 0 |
| cohort | Replaced-frame refusal | Deterministic common native recipe | Omarchy physical Dell | scripted | 1 | 1 | 1 | 1 | 0 | 0 | 0 | 0 | 0 |
| cohort | Replaced-frame refusal | Deterministic common native recipe | Omarchy physical Dell | scripted | 2 | 1 | 1 | 1 | 0 | 0 | 0 | 0 | 0 |
| cohort | Replaced-frame refusal | Deterministic common native recipe | Omarchy physical Dell | scripted | 3 | 1 | 1 | 1 | 0 | 0 | 0 | 0 | 0 |
| cohort | Slotted modal button | Deterministic common native recipe | Omarchy physical Dell | scripted | 1 | 1 | 1 | 1 | 0 | 0 | 0 | 0 | 0 |
| cohort | Slotted modal button | Deterministic common native recipe | Omarchy physical Dell | scripted | 2 | 1 | 1 | 1 | 0 | 0 | 0 | 0 | 0 |
| cohort | Slotted modal frame | Deterministic common native recipe | Omarchy physical Dell | scripted | 1 | 1 | 1 | 1 | 0 | 0 | 0 | 0 | 0 |
| cohort | Slotted modal frame | Deterministic common native recipe | Omarchy physical Dell | scripted | 2 | 1 | 1 | 1 | 0 | 0 | 0 | 0 | 0 |
| cohort | Synthetic form | Deterministic common native recipe | Omarchy physical Dell | scripted | 1 | 1 | 1 | 1 | 0 | 0 | 0 | 0 | 0 |
| cohort | Synthetic form | Deterministic common native recipe | Omarchy physical Dell | scripted | 2 | 1 | 1 | 1 | 0 | 0 | 0 | 0 | 0 |
| cohort | Synthetic form | Deterministic common native recipe | Omarchy physical Dell | scripted | 3 | 1 | 1 | 1 | 0 | 0 | 0 | 0 | 0 |
| cohort | Transformed-frame refusal | Deterministic common native recipe | Omarchy physical Dell | scripted | 1 | 1 | 1 | 1 | 0 | 0 | 0 | 0 | 0 |
| cohort | Transformed-frame refusal | Deterministic common native recipe | Omarchy physical Dell | scripted | 2 | 1 | 1 | 1 | 0 | 0 | 0 | 0 | 0 |
| cohort | Transformed-frame refusal | Deterministic common native recipe | Omarchy physical Dell | scripted | 3 | 1 | 1 | 1 | 0 | 0 | 0 | 0 | 0 |
| cohort | Planned but not run | Not run | Not run | unavailable | unavailable | 19 | 0 | 0 | 0 | 0 | 0 | 0 | 19 |
Baseline comparison#
No matched baseline was supplied. This report makes no improvement claim.
Additional measurements#
| Measurement | Value | Unit | Statistic | Population | Samples | Numerator | Denominator |
|---|---|---|---|---|---|---|---|
| Verified task completion | 0.9512195121951219 | fraction | ratio | scripted attempts | 41 | 39 | 41 |
| Attempt duration | 7339.975609756098 | ms | mean | scripted: Attempt summaries with duration_ms measured | 41 | unavailable | unavailable |
| Tool calls | 12.390243902439025 | count | mean | scripted: Attempt summaries with tool_calls measured | 41 | unavailable | unavailable |
| Model tokens | unavailable | count | mean | scripted: Attempt summaries with tokens measured | 0 | unavailable | unavailable |
| Measured model cost | unavailable | USD | mean | scripted: Attempt summaries with cost_usd measured | 0 | unavailable | unavailable |
Method and provenance#
Suite: Matched fullscreen browser and exact native file workflows; version: common-fullscreen-v1.
Four balanced rounds of fifteen workflows on each environment use the same frozen native MCP recipe, trusted synthetic fixture and reader source, Chrome155.0.8059.39,1280x800 scale1 and initial fullscreen. Exact file bytes, trusted fixture events, independent cleanup and before/after software identities verify outcomes. Every attempted slot is retained without replay. Per-call receipts and host resource observations remain private.
Evidence type: warehouse_snapshot.
snapshot_sha256: e3ff5069f25bad505caaa107de0ce81ba505637ba7c948d4dec8379e7c5e2fdd
Failures and limitations#
- Scripted system diagnostic, not fresh-agent productivity or model ranking.
- Shared-host software VM versus physical Dell: timings are descriptive, not an operating-system causal comparison.
- Initial fullscreen is required by this recipe. Ordinary-window and F11-resize Chrome geometry failures remain outside positive qualification.
- Mousepad0.7.0 versions match; distribution binaries and compositor backends differ.
- Ubuntu form submission can be held by its effect approval policy. Held attempts remain unknown, with no submission replay or bypass. Omarchy policy differs.
- Up to four samples per scenario; scenario p95 is withheld.
- The first common campaign stopped after81 attempted slots when Dell reached its metadata cap;39 slots were not run. Databases were privately backed up and integrity checked, then the supported limit was raised from100MiB to256MiB without deleting receipts. Confirmation is a new cohort with the identical recipe and reader; it does not rewrite that interruption.
- Omarchy native editor failures can retain its released legacy adapter session refusals before typing; these are not replayed or repaired during the frozen cohort.
- The shared operator bridge executable was not independently hashed in each original attempt. The target, reader, browser, viewport and copied recipe identities are checked per attempt.
- Native Chrome and GNOME Text Editor accessibility trees, signed-in profiles, physical Ubuntu GPUs, multi-output and fractional scaling are not qualified.
- Calibration failures and changed recipes are retained separately; original benchmark campaigns remain immutable.
- Full screenshots, credentials, profiles and video are not published.
Data and charts#
- Public report JSON
- Outcome counts CSV
- Measurements CSV
- Report schema
- Data dictionary and reuse notes
- Checksums
- Vector chart
- Chart alt text
When citing these measurements, credit ibara and link this dated report revision. Private trajectories and third-party application content are not distributed here. This report does not change stable product documentation or qualify an untested release.