A NEW WAY INTO ARTArthaus / Academy / Marketplace ↗
← Research & methods
THE ARTIST GENOME PROJECT / METHOD NOTE 05

What the evidence can—and cannot—say

Reproducibility, reconstruction, source support, visual review and artist-style validity each require a different test.

25 OCTOBER 2026 · TECHNICAL NOTE
Evidence framework implemented · independent style validity unresolved

Use separate axes of evaluation.

Replay integrity asks whether the stored instructions reconstruct the expected state. Image reconstruction asks how closely an output matches an admitted reference. Source support asks whether a cited passage supports a particular interpretation. Aesthetic review and artist-style validity ask different questions again.

A study can pass replay checks and still produce an unattractive painting. It can improve an image metric while weakening a source-scoped property. A concept inventory can grow without demonstrating explanatory coverage or an artist-wide style model.

Bind each result to what was actually executed.

Useful records include the engine revision, program and input hashes, dependency and numeric conventions, budgets, seeds, output identities and verification receipts. Lossless pixel comparisons should use the declared decoding and quantization rules rather than screenshots or compressed films.

Authoring and replay have different dependencies. Some paintings, model caches and large experiment outputs exist outside Git. A source checkout or small summary does not establish that a new machine has the artifacts needed to reproduce the study.

Publish a result with its limits.

A technical publication should identify its question, method, exact cohort and comparator, then report failures and abstentions alongside successes. Extra compute or paint should be stated, rather than presented as a matched-budget improvement.

The current research does not establish independently accepted artist-wide style, recovered historical gestures or calibrated physical pigment behavior. These remain research questions. The Academy technical notes summarize inspected repository evidence; they are not peer-reviewed papers or fresh replications of the experiments.

A CLOSER LOOK AT THE ARTIFACTS

What the records carry

Artifact contents and interpretation boundaries
RecordWhat it carriesHow to interpret it
Reproduction receiptPinned source, inputs, outputs, conventions and executed checksHash agreement proves identity, not semantic correctness.
Visual reviewReview conditions, compared images and stated observationsDeveloper inspection is not independent aesthetic acceptance.
PublicationMethod, evidence, comparators, limitations and reproducibility scopeA technical note is not a peer-reviewed result.

Methods summary from the inspected research snapshot. Findings described here belong to their stated experiments; this note is not a fresh replication or a peer-reviewed publication.