1. Framing the compliance–rating gap

Framing the compliance–rating gap 学习卡片

In regulated consumer markets, a product can be fully compliant with every applicable statute, standard, and certification requirement and still receive mediocre or poor ratings from the people who buy it. This divergence is the compliance–rating gap: the measurable distance between what a legal or regulatory framework requires and what consumers actually experience, value, and reward with their ratings. Understanding this gap is the foundation of the entire analysis discipline covered in this course, because it determines what we measure, whom we ask, and how we interpret the result.

Defining the two sides precisely

Legal conformity is a binary, externally adjudicated status. A product either meets a requirement or it does not, and the judgment is made against a written specification by an authority, a notified body, or an internal quality function acting on documented criteria. Conformity is evidenced by test reports, declarations of conformity, certificates, and audit records. Its scope is bounded: it covers only what the regulation chose to regulate.

Consumer rating, by contrast, is a continuous, self-selected, perception-driven signal. It aggregates individual judgments expressed on a scale (commonly 1–5 stars) and is shaped by expectation, price context, ease of use, aesthetics, support experience, and the comparison set the consumer carries in their head. A rating is not a measurement of a property; it is a summary of a relationship between expectation and delivered experience.

These two constructs differ along several dimensions that matter operationally:

Dimension Legal conformity Consumer rating
Nature Binary pass/fail against a specification Continuous score from aggregated perception
Who judges Regulator, notified body, internal QA Self-selected end users
Scope Only regulated attributes Whole experience, including unregulated attributes
Evidence Test reports, certificates, declarations Reviews, star distributions, return reasons
Time horizon Point-in-time, at type approval or audit Continuous, post-purchase, cumulative
Failure mode Non-conformity, recall, market withdrawal Low stars, churn, negative word of mouth

The critical asymmetry is scope. Regulation is a floor, not a specification of delight. A standard may mandate that a battery not exceed a surface temperature of 45 °C under defined load; it says nothing about whether the device feels slow, whether the app pairing takes four attempts, or whether the packaging is frustrating to open. Those unregulated attributes dominate ratings, which is precisely why conformity cannot predict satisfaction.

Stakeholders and what each one optimizes

The gap exists because different stakeholders are optimizing different objective functions, and the analysis only becomes actionable when those functions are made explicit.

  • Regulators and market-surveillance authorities optimize for minimum safety, environmental, and information-integrity thresholds across the whole market. Their instrument is the requirement; their success metric is the absence of harm and the rate of non-conformity detected.
  • Compliance and quality functions inside the manufacturer optimize for defensible evidence of conformity at acceptable cost. Their success metric is audit pass rate and the absence of findings, not star rating.
  • Product and engineering teams optimize for feature delivery and performance against internal targets, which may or may not be derived from consumer research.
  • Consumers optimize for perceived value relative to price and expectation. Their instrument is the review and the star; their success metric is whether the product did what they hoped, easily.
  • Retailers and marketplaces optimize for conversion and return rate, and therefore weight ratings heavily because ratings drive both.

A gap opens wherever the compliance function's success metric and the consumer's success metric are not linked by any shared measurement. In many organizations they are not: the conformity dossier and the review corpus live in different systems, are owned by different teams, and are never joined.

Why legal conformity does not guarantee satisfaction

Four mechanisms account for most of the gap observed in practice.

1. The floor-versus-expectation mechanism. Requirements are set at a level that protects the population, not at a level that pleases the individual. Meeting a minimum threshold is, by construction, compatible with a mediocre experience. A product that just passes an acoustic limit may still be perceived as unacceptably loud relative to a competitor that passes comfortably.

2. The scope mechanism. Ratings are driven by attributes the regulation never addressed — onboarding friction, documentation clarity, app stability, spare-part availability, support responsiveness. These are frequently the top drivers in review text and are invisible in conformity evidence.

3. The expectation mechanism. Ratings are relative to expectation, and expectation is set by marketing, price, and prior category experience. A compliant product marketed with superlatives will be rated against those superlatives. The same physical performance yields different ratings at different price points and different promise levels.

4. The population mechanism. Conformity is assessed on a sample against a specification; ratings are produced by a self-selected, non-representative population that skews toward extreme experiences. A small subpopulation with an unregulated but severe pain point can dominate the visible score while remaining entirely outside the conformity sample.

A useful working definition for the rest of the course: the compliance–rating gap is not evidence of non-compliance, and it is not automatically evidence of a bad product. It is evidence that the two measurement systems are answering different questions. The analytical task is to determine which unregulated attributes, expectations, or subpopulations are producing the divergence.

How the two signals relate in practice

The diagram below places the two measurement systems side by side and shows where the gap is generated. On the left, the regulated attribute set is tested against the requirement and produces a conformity verdict. On the right, the full experience — regulated and unregulated attributes plus expectation — is filtered through a self-selected consumer population to produce a rating. The gap band in the middle is where analysis work happens.

Compliance–rating gap: two measurement systems and the divergence band Left path shows regulated attributes tested against requirements producing a conformity verdict. Right path shows the full experience including unregulated attributes and consumer expectation, filtered by a self-selected population, producing a star rating. The middle band marks the gap where analysis occurs. Compliance system Regulated attribute set safety · EMC · energy · labelling Test against requirement sample · defined load · lab conditions Verdict: pass / fail binary, point-in-time Evidence produced test report · DoC · certificate audit record scope = regulated only Rating system Full experience regulated + unregulated attributes Expectation filter price · marketing promise · prior category Aggregated star rating continuous, cumulative Population producing it self-selected reviewers skewed to extreme experience scope = whole experience GAP BAND where analysis happens Unregulated attributes onboarding · app · support Expectation mismatch promise vs. delivered Population skew extreme voices dominate Floor vs. delight minimum ≠ pleasing conformity ≠ satisfaction

Reading the gap correctly: a worked framing example

Consider a hypothetical connected kettle used to illustrate the framing, with all figures treated as illustrative assumptions rather than measured results. The conformity dossier shows the appliance passes the applicable electrical safety standard, meets the standby-power limit, and carries correct energy labelling. The conformity verdict is pass. The marketplace rating, however, sits at 3.1 stars, with the one- and two-star reviews clustering around three themes: the app loses the pairing after a router restart, the lid is stiff for users with limited grip strength, and the beep at boil completion is louder than expected at night.

None of these three themes is a non-conformity. Pairing persistence, lid actuation force, and audible alert level at night are either unregulated or regulated only in ways the product satisfies. Yet they account for the majority of negative reviews. The framing exercise is therefore to classify each theme against the four gap mechanisms: pairing persistence is an unregulated attribute (scope mechanism); the beep is a floor-versus-expectation issue because it passes the applicable limit but exceeds the expectation set by the quiet-kitchen marketing imagery; the lid is a subpopulation issue concentrated among a specific user group. This classification, not the star score itself, is the deliverable of the framing stage.

A common framing error is to treat a low rating as a compliance signal and launch a conformity investigation. This wastes effort and can trigger unnecessary corrective action. Equally, treating a high rating as evidence of conformity is unsafe: a product can be well-loved and still non-compliant on an attribute consumers never notice. The two signals must be kept analytically separate before any causal claim is made.

What the framing stage must produce

Before moving into measurement and analysis, the framing stage should leave behind four explicit artifacts: a defined regulated attribute list with the requirement and evidence source for each; a defined experience attribute list drawn from review text and support data, including attributes with no regulatory counterpart; a stakeholder map naming whose success metric each attribute serves; and a classification of each observed gap theme against the four mechanisms above. With these in place, the subsequent chapters can quantify the gap, attribute it to specific drivers, and decide whether the correct response is a compliance action, a product change, an expectation-management change, or no action at all.