The brand appeared in more sampled AI answers. At the same time, the team rewrote the service page, repaired several technical issues and changed the way enquiries were handled. Someone would like to call the whole thing an AEO win before lunch.

I would like lunch too. I would also like the experiment note to retain a passing resemblance to the experiment.

The following is a fictional review log. It uses no client results; the observations describe the kind of evidence a team might need to assess.

Original question

Can a clearer explanation of the service help relevant visitors understand its scope and begin a useful enquiry? The team also wants to observe how the brand appears in a defined sample of AI answers.

Those are related interests. They are not the same outcome. Keep them as separate lines in the note.

Changes made

The service explanation was revised, a technical issue affecting access was repaired and the notification sent to the receiving team was improved. Record the dates and scope of each change.

This is a combined intervention. It may be sensible work, particularly when the original journey had several problems. It does not allow the report to assign every later improvement to the sentence that looked best in the content presentation.

What was observed

The sampled answers mentioned the brand more often. Record which engine, prompts, dates and conditions produced that observation. Save the distinction between a mention and a source link. Check whether the answer accurately describes the offer.

The enquiry team also reports that more requests arrive with the context needed for a first reply. Establish how that assessment was made and whether the compared groups had similar time to progress. A useful operational observation still needs an intelligible definition.

What remains uncertain

The sample may be too small or variable to support a stable visibility conclusion. A changed offer or different visitor mix may affect the enquiry comparison. The simultaneous technical and content changes limit what can be attributed to either one alone.

Write those points beside the encouraging result. They are not evidence that the work was pointless. They describe how far the result can travel before it becomes a more ambitious story than the evidence supports.

The joint paid-and-organic positioning on groas's business page is one example of connected delivery. A connected programme still benefits from separate definitions for visibility, visits and useful business outcomes.

What the business can support

Ask the people receiving and fulfilling the work whether the next increase is manageable. A clearer page may produce enquiries the team is pleased to receive while exposing a response bottleneck. The packing table and the reply queue belong in this review as much as the discovery chart.

An operational improvement may be the sensible next investment. That is not an embarrassing detour from growth. It gives the next round of acquisition somewhere reliable to land.

Decision and next trigger

Keep the verified page improvements. Continue the defined observation for a suitable period. If a later test is needed to examine one specific explanation, design it around that question rather than reconstructing this combined change as a clean experiment after the event.

Name the next review trigger and the person responsible for it. “Inconclusive” should not become a polite storage label for work that nobody will revisit.

The note can end with an encouraging observation and an unfinished conclusion. That is a perfectly respectable result. I would rather carry one damn honest question into the next month than spend the next month defending a victory the original experiment never actually established.

Mark Crossan
About the author

Growth Marketing Manager

My experiment notes include candid uncertainty and a reminder that the packing table belongs in the growth plan.

A thought worth keeping?