Thought Leadership

Who audits an experiment no human ever ran?

Nature corrected a landmark autonomous-lab result two years on. What survived made it possible. Why the agent's record is now the science itself.

Published on

Subscribe to our newsletter

By submitting your email, you agree to our Privacy Policy and consent to receiving updates from us

The Autonomous Laboratory Audit Trail: Who Audits an Experiment No Human Ran?

Autonomous labs now design, run and interpret their own experiments. The record of what the machine did has stopped being paperwork and started being the evidence.

On 19 January 2026, Nature published an Author Correction to one of the most cited demonstrations of autonomous science. The A-Lab, a robotic laboratory at Lawrence Berkeley National Laboratory, had reported 40 successful syntheses from 57 targets. More than two years later, that figure was revised. What allowed anyone to check was the autonomous laboratory audit trail: the surviving record of what the machine did.

That is the shift. When a person runs an experiment, the audit trail is administrative overhead. When an agent designs and runs it, the audit trail is the experiment.

What an Autonomous Laboratory Actually Does Today

An autonomous laboratory plans an experiment, performs it with robotics, measures the product, interprets the measurement and decides what to run next, with little human intervention between steps. The A-Lab, reported in Nature in 2023, did this for solid-state chemistry. Over 17 days of continuous operation it performed 353 experiments against 57 targets, synthesising 36 of them, a 63% success rate. Each of those steps is a decision somebody may later need to reconstruct.

The decision-making matters more than the robot arms. Recipes came from machine-learning models trained on text mined from the literature. Where they failed, an active-learning algorithm proposed different reaction pathways. Diffraction patterns were interpreted by neural networks and confirmed by automated Rietveld refinement.

Language models have since entered the same loop. Coscientist, reported in Nature in December 2023, is a GPT-4 driven system that, in its authors’ words, autonomously designs, plans and performs complex experiments. One of its six demonstrated tasks was executing high-level commands in a cloud laboratory.

Why Reproducibility Becomes an Audit-Trail Problem

Reproducibility depends on knowing precisely what was done, in what order, with what inputs, and on what basis each choice was made. For a human-run study that lives in a methods section. For an agent-run study the execution record is the methods section, and its completeness caps what anyone can verify.

The A-Lab correction shows the mechanism working, slowly. After publication, concerns were raised about the unambiguous identification of compound structures using diffraction, and about the original claims of material novelty. The authors clarified that the materials were “new to the prediction platform, not necessarily new to science”.

The team then re-analysed the diffraction patterns manually. That re-analysis confirmed the platform reached the correct conclusion in 36 of its 40 reported successes, with four inconclusive, and it was peer-reviewed after publication. One compound was removed from the discussion because it had been included in the training data by mistake. The standing figure is 36 successes from 57 targets, not the 40 first reported.

That last point deserves a second read. A training-data contamination surfaced more than two years after the run, and it was findable only because the artefacts survived: the paper states that all data generated during the study are included in the Supplementary Information, and it publishes the screening, recipe-selection, diffraction-analysis and active-learning code on GitHub.

Of the 353 recipes the A-Lab tested, only 30% produced their target. Most of what an autonomous laboratory does is fail, and the failures carry the information. A record that captures only successful runs destroys the context needed to interpret them.

The Difference Between a Log and a Tamper-Evident Record

A log is a description of what a system says it did. A tamper-evident record is that description plus cryptographic evidence that the entries have not been altered, reordered or removed since they were written. The difference is invisible on a good day and decisive on a bad one.

Ordinary application logs are written by the same system whose behaviour is in question, stored in mutable form, and often editable by anyone with administrative access. That is fine for debugging and weak in a dispute, because the file cannot prove that today’s copy matches the original.

The table below sets out what an experimental record must do once the experimenter is an agent.

Requirement

What a conventional application log gives you

What a tamper-evident attested record adds

Completeness

Captures whatever the developer chose to instrument

Captures the session’s governance events, with the event count fixed inside the proof certificate

Ordering

Timestamps that can be edited, or skewed by clock drift

Order fixed by the hash structure at the moment of signing

Decision context

Usually records the action, rarely the reason

Records the governance decision per operation, with a denial reason where an action was blocked

Integrity

A file can be altered afterwards without leaving a trace

Any alteration changes the hash and invalidates the signature

Independent check

Requires trusting the operator’s copy of the file

Signature and Merkle root can be verified by a third party

Reconstruction

Rebuilt by hand from fragments across systems

Session replayed operation by operation from the stored record

The mechanics are not exotic. In OpenBox, an AI agent governance platform, each governance event in a session is hashed with SHA-256. Those hashes are combined into a Merkle tree, which uses sorted-pair hashing “to ensure consistent tree construction regardless of processing order”, per OpenBox (docs.openbox.ai).

The session root is then digitally signed. By default that uses ECDSA NIST P-256 through AWS Key Management Service, with one key per agent. Organisations signing inside their own infrastructure, such as a Trusted Execution Environment or an HSM-backed service, can point an agent at an external attestation endpoint instead. Each completed session yields one proof certificate carrying the Merkle root, the signature and the event count.

What this buys is narrow. It does not prove the science was right. It proves the record examined today is the record written at the time, and that an outsider can check it.

Accountability for Agent-Designed Experiments

Accountability for an agent-designed experiment needs a decision record, not only a data record. Knowing a reaction was run is not the same as knowing why the system chose to run it, whether that choice was permitted, and whether a person was asked before it proceeded.

A governance layer answers that by evaluating each agent operation and returning a verdict. OpenBox returns one of four governance decisions: ALLOW, REQUIRE_APPROVAL, BLOCK and HALT. ALLOW lets the operation proceed normally. REQUIRE_APPROVAL pauses it for human review. BLOCK rejects the operation while the session continues. HALT terminates the entire agent session. Where several policies apply, precedence runs HALT > BLOCK > REQUIRE_APPROVAL > ALLOW.

That verdict is the artefact a laboratory needs when somebody asks who authorised a step. In an approval flow the request enters a queue, a named reviewer approves or rejects it, and the operation proceeds or stops on that decision. The approver, the decision and the timing enter the record, not a recollection.

Reconstruction after the fact belongs to the Verify phase of the OpenBox Trust Lifecycle, whose stated purpose is validating goal alignment through drift detection and attestation. Session Replay, which sits in that phase, plays a session back operation by operation with the governance decision attached to each one. That is the difference between asserting what an agent did and showing it.

Governance as an Enabler of Regulated-Science Adoption

In regulated research the binding constraint is usually evidence rather than capability. A laboratory can automate a workflow long before it can satisfy a reviewer that the workflow produced trustworthy results. Obligations differ by jurisdiction, sector and claim, so confirm your record-keeping duties with your own regulatory function rather than infer them from a vendor.

Still, evidence produced at the moment of the action is stronger and cheaper than evidence reconstructed later from server logs and memory.

Autonomy also has to be graded rather than granted. OpenBox scores an agent as (Risk Profile Score x 40%) + (Behavioral x 35%) + (Alignment x 25%), then maps that score to Trust Tiers that set how strictly it is governed. Tier 1, at 90 to 100, carries minimal constraints and high autonomy; the lowest band is suspended from operating. An agent characterising well-understood compounds and one designing a novel construct should not inherit the same latitude.

The lifecycle itself runs Assess, Authorize, Monitor, Verify and Adapt. Adapt is the phase a long research programme leans on, because it holds the agent’s trust timeline, its violation patterns, and policy suggestions a human accepts, rejects or modifies. Governance stops being a gate at the start of a project and becomes a record that travels with it, as set out in OpenBox’s complete AI agent governance guide for enterprise teams.

Conclusion: Discovery at Machine Speed Needs Evidence at Machine Speed

The A-Lab ran 353 experiments in 17 days. Checking that one campaign took correspondents, the original authors, manual re-analysis and post-publication peer review, and concluded more than two years later. Discovery moved at machine speed; verification moved at human speed, and the gap is where trust leaks out.

Closing that gap does not mean slowing the science down. It means producing the autonomous laboratory audit trail as the run happens: every governed action recorded with its decision, each session sealed so an outsider can verify it, and the run replayable without asking the machine to describe itself.

OpenBox, an AI agent governance platform, is built around that principle, and the mechanics are documented at docs.openbox.ai. The question underneath it reaches any organisation putting agents into a laboratory: not whether the machine can run the experiment, but whether anyone can prove what it did.

Frequently Asked Questions

What is an autonomous laboratory audit trail?

An autonomous laboratory audit trail is the record of every action an automated research system took, in sequence, with its inputs, outputs and decisions attached. When the experimenter is software rather than a person, that record replaces the laboratory notebook as the primary evidence of what actually happened.

What makes an audit record tamper-evident rather than just a log?

Cryptographic sealing. Each event is hashed, the hashes are combined into a Merkle tree, and the session root is digitally signed. Any later change to an entry alters the hash and invalidates the signature, so tampering becomes detectable by a third party instead of invisible.

Does cryptographic attestation prove the science is correct?

No. Attestation proves the record is intact, not that the conclusion is right. It shows that what is examined today is what the system recorded at the time. Scientific validity still rests on characterisation, replication and peer review, as the A-Lab correction demonstrates.

What should a research team put in place before deploying autonomous experimentation?

Record every governed action with its decision and reason, require human approval for defined high-risk operations, retain raw instrument data and analysis code, and seal each session so it can be verified later. Confirm domain-specific record-keeping duties with your own regulatory function first.

Sources

Szymanski, N. J. et al., “An autonomous laboratory for the accelerated synthesis of inorganic materials,” Nature 624, 86-91 (2023), https://www.nature.com/articles/s41586-023-06734-w, accessed 21 July 2026.

Szymanski, N. J. et al., “Author Correction: An autonomous laboratory for the accelerated synthesis of inorganic materials,” Nature 650, E1 (2026), https://www.nature.com/articles/s41586-025-09992-y, accessed 21 July 2026.

Boiko, D. A., MacKnight, R., Kline, B. and Gomes, G., “Autonomous chemical research with large language models,” Nature 624, 570-578 (2023), https://www.nature.com/articles/s41586-023-06792-0, accessed 21 July 2026.

OpenBox, “Attestation & Cryptographic Proof,” https://docs.openbox.ai/administration/attestation-and-cryptographic-proof, accessed 21 July 2026.

OpenBox, “Governance Decisions,” https://docs.openbox.ai/core-concepts/governance-decisions, accessed 21 July 2026.

OpenBox, “Trust Lifecycle,” https://docs.openbox.ai/trust-lifecycle, accessed 21 July 2026.

OpenBox, “Adapt,” https://docs.openbox.ai/trust-lifecycle/adapt, accessed 21 July 2026.

Trustworthy AI
Starts Here

By submitting your email, you agree to our Privacy Policy and consent to receiving updates from us

Trustworthy AI
Starts Here

By submitting your email, you agree to our Privacy Policy and consent to receiving updates from us

Trustworthy AI
Starts Here

By submitting your email, you agree to our Privacy Policy and consent to receiving updates from us

Trustworthy AI
Starts Here

By submitting your email, you agree to our Privacy Policy and consent to receiving updates from us