First-party research protocol

Dealer technology benchmark and operator survey program

A publication standard for collecting implementation, adoption, support, integration and outcome evidence without inventing benchmarks or allowing vendors to buy conclusions.

01

Define the population

Record dealer type, OEM, market, rooftop count, department, product, edition, implementation date and respondent role before comparing results.

02

Use common measures

Collect baseline, adoption, operational outcome, quality guardrail, cost and elapsed-time fields with the same definitions for every participant.

03

Verify context

Confirm dealership and role while protecting nonpublic dealer information. Record vendor, consultant, incentive and commercial relationships.

04

Set publication thresholds

Do not publish a benchmark until the sample, completeness and comparability thresholds are met. Small or skewed samples remain labeled observations.

05

Separate fact and interpretation

Publish the question, denominator, exclusions, time period and method beside every result. Do not imply causation from an uncontrolled association.

06

Maintain corrections

Preserve dated versions, correction notes and methodological changes so a revised result cannot silently replace the record used by dealers.

Core survey modules

What the program is designed to measure

Implementation duration and dealer staffing

Data migration completeness and reconciliation

Integration availability and failure handling

Role-level adoption and workarounds

Support severity, response and resolution

Workflow outcome and quality guardrails

Three-year cost and unplanned charges

Renewal, export and offboarding experience

Dealer context and configuration

Relationship and incentive disclosure

Publication boundary

No benchmark result is displayed until sufficient verified data exists. This protocol creates the collection and publication system; it does not manufacture first-party findings.

Why a protocol exists before any data does

Dealership technology is full of figures with no denominator: a percentage improvement with no baseline, an average implementation time with no population, a satisfaction score with no response rate. Those numbers are easy to produce and impossible to check, and once published they get cited back by people who cannot see how they were made. Writing the collection and publication rules first, in public, is what makes a later result auditable — and it commits this directory to the same standard it asks of the providers it lists.

What would disqualify a result from publication

A result is withheld, or published only as a labelled observation, when any of the following applies. These are stated in advance so that a disappointing sample cannot be reinterpreted after the fact.

  • The sample is below the threshold set for that question before collection began
  • Respondents are concentrated in one dealer group, one OEM or one vendor’s customer base
  • The comparison population is not like-for-like on rooftop count, product edition or implementation age
  • A material share of responses is incomplete on the fields the result depends on
  • The question wording changed during collection

How participants are protected

Operator research fails when respondents believe a candid answer will reach their vendor or their group. Participation is therefore designed so that no individual response is identifiable in anything published: results are reported at population level, free-text is quoted only with explicit permission and with identifying detail removed, and no participant list is shared with any vendor. Nonpublic financial and operational detail is collected only where a specific question requires it, and is not retained afterwards.

What a dealer gets for taking part

The intended exchange is comparison, not compensation. A participant receives the aggregate result for their own segment ahead of publication and can see where their configuration sits against it. Nothing about participation affects any record in this directory, and no vendor can purchase visibility, question inclusion or influence over how a result is framed. If that ever changed, it would be disclosed here first and dated.

Corrections and versioning

Every published result keeps its question wording, denominator, exclusions and collection window beside it, and every revision is dated rather than replacing the earlier figure silently. A dealer who cited a result should be able to establish what it said on the day they cited it, and what changed since.