Tsokotukha-PTO

Tsokotukha - PTO

<p align="center"> <a href="https://huggingface.co/kuklev9797/Tsokotukha-PTO/resolve/main/Tsokotukha-PTO-full.zip?download=true"><strong>Download full offline package</strong></a> &nbsp;&nbsp;|&nbsp;&nbsp; <a href="https://huggingface.co/kuklev9797/Tsokotukha-PTO/resolve/main/Tsokotukha-PTO-model-only.zip?download=true"><strong>Download compact package</strong></a> &nbsp;&nbsp;|&nbsp;&nbsp; <a href="https://huggingface.co/kuklev9797/Tsokotukha-PTO/resolve/main/model.safetensors?download=true"><strong>Download weights</strong></a> </p>

Tsokotukha is a small research model that reads construction drawings through a fly visual circuit. It does not look at a crop once. It moves across 25 overlapping views, passes each view through the 721-column fly eye and joins the responses into one wall probability map.

This repository contains the best saved pure-flyvis checkpoint from our experiments, q16_z3_flyvis_pre_s1.

<p align="center"> <img src="assets/white-fly-room.png" alt="A white fly inspecting a room drawing" width="100%"> </p>

How the model sees a drawing

The input is a 192 x 192 crop. Each of the 25 local views is 64 x 64. The same visual circuit processes every view, then a spatial readout returns the local evidence to its place on the drawing.

<p align="center"> <img src="assets/model-overview.svg" alt="Tsokotukha 25-view visual sampling pipeline" width="100%"> </p>

Human plan and fly-eye view

The animation shows one pass through the visual demo. The plan stays visible on the left while the fly-eye representation changes beside it.

<p align="center"> <img src="assets/human-plan-vs-fly-eye.gif" alt="Animated comparison of a floor plan and its fly-eye representation" width="100%"> </p>

Best saved result

<p align="center"> <img src="assets/model-metrics.svg" alt="Average precision, ROC-AUC and best IoU for the saved checkpoint" width="100%"> </p>

The evaluation used 64 synthetic ResPlan source plans with four fixed crops per source. This was a development and model-selection split, not a sealed final test. The result should be quoted with that limitation.

The checkpoint has 1,876 trainable parameters. The flyvis circuit contains 45,669 nodes, 1,513,231 edges and 721 retinal columns. The readout uses 57 non-input cell types.

Why this checkpoint

There are higher numbers elsewhere in the project, but they come from different setups. One uses partial labels. Another adds a CNN decoder. This is the strongest saved result that keeps the flyvis circuit and its spatial readout as the model.

The hatch-recognition experiment below is a separate branch. It uses frozen upstream flyvis model 001 and reaches 0.910 with an extended legend. It has no separately trained checkpoint. Its configuration is included as article_hatch_config.json so the two results stay separate.

A second experiment: hatch recognition

The project also asked whether a frozen fly visual model can describe drawing hatches. The first diagram shows what was compared. The second shows how a moving 64 x 64 patch becomes a 1,368-value descriptor. These are manuscript figures from the hatch branch, not results from the q16 wall checkpoint.

<p align="center"> <img src="assets/paper_overview.png" alt="Hatch-recognition study overview" width="100%"> </p> <p align="center"> <img src="assets/paper_pipeline.png" alt="Frozen hatch-descriptor pipeline" width="100%"> </p>

Install

Use Python 3.12. A clean virtual environment is recommended.

pip install -r requirements.txt

The flyvis dependency is pinned to the same commit used in the experiment.

Run

For the complete 25-view setup:

python inference.py drawing_crop.png --output prediction.npz --preview probability.png

For one 64 x 64 view:

python inference.py patch.png --single --output single_view.npz

The output file contains logits, probabilities and a binary mask. The included threshold came from the development split. Recalibrate it before using the model on another dataset.

To check the package:

python verify_package.py

What is in the download

• model.safetensors contains the checkpoint tensors.
• config.json records the eye, temporal sequence, readout and 25-view plan.
• metrics.json contains the saved run metrics.
• inference.py runs either one view or the full 25-view plan.
• provenance/ contains the original run result and configuration.
• Tsokotukha-PTO-model-only.zip is the compact package.
• Tsokotukha-PTO-full.zip also contains the generated connectome cache for offline use.

Limits

This is a research checkpoint trained and evaluated on synthetic wall-segmentation data. It is not a complete drawing reader and it is not a BIM system. Production drawings contain text, tables, symbols, changing scales and drawing styles that were not covered by this result.

No customer drawing, private dataset or real project file is included in this repository.

Project citation

@misc{kuklev2026tsokotukha,
  title  = {Tsokotukha - PTO},
  author = {Kuklev, Dmitry},
  year   = {2026},
  note   = {Research checkpoint for active visual sampling on architectural drawings}
}

<p align="center"> <img src="assets/closing-fly.png" alt="Close view of a fly compound eye" width="100%"> </p>