← All posts

A 30-Day Visitor Identification Pilot With Clear Pass-or-Fail Criteria

Define a 30-day visitor identification pilot before starting. Set eligible records, match review, outcome windows, selected costs and proposed pass-or-fail gates.

Ospry Team
6 min read

A visitor identification pilot should end with a decision your team can defend. More names in a dashboard are not enough.

Before starting, define the eligible activity, the evidence you will review, the business outcome, the costs and the conditions that would stop the test. Then give the contacts enough time to reach the outcome you intend to measure.

A 30-day pilot can be useful without pretending it proves every future result. Its job is to answer a small set of questions well enough to decide whether to continue, change the process or stop.

Name the decision and the owner

Write down what the pilot is meant to decide.

For example: should the business continue using appropriately identified visitor context to help its sales team review eligible inquiries? That is more specific than “see whether identification works.”

Name the person who can accept the result, the person reviewing match evidence and the person owning the sales response. If an agency and client share the work, agree on the responsibilities before the first record arrives.

For agencies evaluating visitor identification, this protects the final conversation from changing definitions after the numbers are visible.

Define eligible traffic before calculating a yield

Write the inclusion and exclusion rules for the group you will evaluate.

Specify the site, pages, acquisition dates, measurement unit and relevant market conditions. Decide how you will treat known automated activity, internal testing, existing contacts, repeated records and unresolvable associations.

Use information the business can appropriately establish. Do not infer a person's identity or service location from an IP address to make the group look more complete.

Keep the denominator literal. A count of eligible observed visitor records is not automatically a count of all people who visited. If the measurement cannot establish distinct people, do not give it that label.

When exploring what identity information can add, ask which eligible group the reported result actually describes.

Make match review inspectable

Decide what evidence must accompany a proposed identity association and how a reviewer can challenge it.

Keep the source, relevant timestamps, known limitations and correction route available to the people responsible. A populated contact card should not be the only evidence that the association is suitable for the pilot's purpose.

Choose a review sample before looking for success stories. Include uncertain cases and records the process rejected where the review permits it. State how the sample was selected.

A sample can reveal a problem or support a limited check. Finding no unresolved errors in a small sample does not establish a zero-error rate across the entire population.

Record which claims the review can support and which remain untested.

Set stop conditions before success targets

Keep restrictions outside the performance arithmetic.

If a record should not enter outreach, a high match count cannot compensate for sending it there. If an association cannot be resolved, do not let it repeatedly trigger tasks while the review is open.

Define the conditions that pause the pilot, the owner who investigates and the evidence needed before restarting. Include mistaken associations, duplicate outreach and a missing way to carry a relevant restriction into the receiving system.

Review consent and recorded data choices alongside those conditions. Identification does not create a contact permission, and the pilot should not expand collection merely to make its result more attractive.

Choose proposed business gates

Set targets from the business's actual capacity and economics. Do not borrow a threshold without understanding what it measures.

For a hypothetical business, a proposed starting rule might require:

  • At least 1,000 eligible observed records, so the planned operating review can be completed.
  • Inspectable match evidence for a predefined sample of 20 named records, with no unresolved wrong association in that sample.
  • At least 10 sales-accepted contacts and two completed qualified conversations within the chosen outcome window.
  • Selected pilot cost per sales-accepted contact no higher than $75.
  • No known violation of the agreed stop conditions.

These are illustrative design choices, not industry benchmarks, statistical guarantees or OSPRY performance promises.

Give insufficient evidence its own result. If the eligible group never reaches the planned size, the business question may remain inconclusive. That is different from meeting the sample requirement and failing the agreed outcome target.

Give every contact the same outcome window

A 30-day collection period does not give its last entrant 30 days of follow-up by the end of the period.

Choose the outcome window separately. If qualified conversations are the target, define how long each accepted contact has to reach one and what qualifies as a completed conversation.

For an illustrative calendar, collection from August 15 through September 13 covers 30 calendar dates. If each contact receives 14 elapsed days for the defined outcome, the last September 13 entrant can complete that window on September 27. A final review on September 28 can include the full window.

Those dates describe a proposed schedule, not results already known on August 15. Stop adding new entrants at the agreed collection cutoff and keep the original group fixed for the later review.

Count the costs you selected

Include the costs relevant to the decision and name the exclusions.

Consider a hypothetical pilot with $300 in tool charges, $200 in operating work and $100 in match review. The selected pilot cost is $600. These invented prices do not describe OSPRY's pricing.

Suppose the eligible group produces 12 sales-accepted contacts and three completed qualified conversations within the agreed window. Selected cost per accepted contact is $600 divided by 12, or $50. Selected cost per completed conversation is $600 divided by three, or $200.

The first ratio meets the illustrative $75 gate. That does not establish profit or additional sales caused by the pilot. Delivery costs, later outcomes and the process you would have used otherwise need their own evidence.

Keep known existing relationships separate so a familiar contact is not quietly counted as a newly created opportunity.

Test the receiving workflow too

Trace a controlled record from the website observation through review, ownership and the next task. Check a corrected association and a record that should be held back.

Review the integrations delivering those records. Confirm that the receiving person can see the relevant evidence, restriction and reason for the action.

Measure the work involved. A result that requires more review than the team can sustain may need a process change even when the cost ratio looks acceptable.

Keep failed deliveries and unresolved records visible. A pilot should expose the operating work needed for the result, not hide it behind the number of names.

Make the final decision against the original rule

At the agreed review, show the eligible group, sample checks, stop-condition results, accepted contacts, completed conversations and selected costs. Keep pending outcomes outside metrics whose windows have closed.

Use the rule you wrote before the pilot. If the business changes it, preserve the earlier version and explain why the new rule is a different test.

A pass can support a limited continuation with the same evidence boundaries. A failure can identify a specific cost, quality or workflow problem. An inconclusive result should name the missing evidence.

The useful result is a clear decision with its reasons intact. Define the test before it starts, inspect the difficult records and let the evidence decide what deserves a larger commitment.