Open workbench

What is being tested

This page separates measured progress from ideas still under investigation.

Working signal

Row maps make misses visible

A test schedule contains 17 door rows after its headers and footer are excluded. Image-guided extraction previously returned 15 unique records in a row-by-row run. The current batched experiment attaches source-row-band identifiers so a missing record can be traced to its specific image band. This is promising, not a benchmark claim: field-level verification and repeatable evaluation remain required.

Current benchmark target

Door and frame schedules

Testing began with sheet A8.2 and focuses on door rows, dimensions, materials, hardware groups, frame types, ratings, and remarks. Merged cells and hardware-group blocks remain important stress cases.

Evaluation principle

“Almost 100%” needs a precise definition

Table detection, row count, field extraction, normalized values, and final reviewed records are separate measures. The next benchmark should report each one so improvements remain meaningful.

Long-term asset

The schema and verified dataset matter most

Models will change. A collection of hand-verified construction schedules, paired with clear schemas and source evidence, makes future models easier to compare and replace.

Roadmap

The next useful milestones

Small, measurable steps before broad automation.

Now

Repeatable single-sheet extraction

Document the exact model, prompt, settings, output, review, and score.

Next

Source-linked validation

Connect every extracted field to its sheet region and review state.

Then

Drawing-set routing

Use the drawing index to route likely schedule sheets to the right schema.

Later

Cross-source reconciliation

Compare schedules, specifications, BIM records, and drawing revisions.

Planned working example

The RealEyesVR Test Lab

Live research prototype

The Test Lab lets authenticated Hugging Face users try one focused version of the pipeline themselves. Shared ZeroGPU infrastructure supplies the temporary GPU; the user only needs a browser and a safe test image. Capacity is shared, so a GPU queue or time limit can occur during active testing.

01

Sign in

Use a Hugging Face account so RealEyesVR does not store passwords.

02

Upload safely

Submit one public, synthetic, or otherwise authorized schedule image.

03

Run Qwen

ZeroGPU temporarily allocates shared GPU capacity for extraction.

04

Check the result

Review structured rows, source-row-band warnings, evidence, and raw JSON.

Open the Test Lab ↗

First test case

Door and frame schedules

One image, one known schema, and one measurable result. Broader drawing types come only after this workflow proves repeatable.

What it measures

Real-world behavior

Processing time, row count, source-row coverage, field accuracy, validation warnings, corrections, and whether the result was useful without expert guidance.

Privacy boundary

No confidential drawings

The Test Lab will use cloud processing. Visitors must not upload client, employer, personal, or otherwise restricted information.

Follow the prototype

Built in public, tested carefully.

The first release will favor a small, understandable experiment over a broad claim of construction-document automation.

Follow the build