Home / Knowledge Base / Glossary / Deduplication
Tracking & analytics · Glossary

Deduplication Removal of duplicate conversions and leads

In plain words

Deduplication means counting the same thing only once. If one sale is reported twice, the same person signs up twice, or two marketing channels both claim one customer, deduplication rules decide what counts and who, if anyone, gets paid.

Definition

Deduplication is the removal of duplicate records before conversions are counted or paid. In affiliate tracking it happens on several levels. A platform can reject a second conversion that arrives with the same click ID or the same transaction ID, so a reloaded thank-you page or a repeated postback does not create a second payout. Lead offers add rules about the person: the same email address or phone number submitted again within a set period counts as a duplicate lead and is not paid.

Advertisers also deduplicate across channels. A retailer that buys search ads, sends its own email and works with several affiliate networks will see one customer touch several of them; to avoid paying twice it credits a single source, usually by last click, and the losing affiliate’s conversion is rejected or never confirmed. Programs describe this in their terms, often as last-click, cross-channel deduplication, and it is one of the main reasons a sale visible in an affiliate’s tracker never turns into a commission.

Ad platforms clean their own event streams the same way. When one purchase is reported both by a browser pixel and by a server API, Meta keeps a single copy if both carry the same event name and event ID and arrive within 48 hours of the first; Google Ads ignores conversions that repeat a transaction ID already recorded. Trackers apply similar logic when a network fires several postbacks for one click, keeping the first and flagging the rest.

Deduplication is legitimate and necessary, but the rules should be explicit. Before running an offer, check how a duplicate is defined (click ID, transaction ID, email, phone or device), the time window, whether cross-channel deduplication applies and which channels win. When a large share of conversions is rejected as duplicates, the cause is usually technical, such as a postback firing twice or a missing unique ID, or it lies in the traffic, for example incentivised users signing up repeatedly.

In practice

Worked example — illustrative numbers

A lead offer with a 30-day duplicate rule

An affiliate sends 1,000 leads to an insurance-quote offer paying 12 USD per unique lead. The advertiser treats a lead as a duplicate if the email or phone is already in its database from the past 30 days.

GroupLeads
Submitted1,000
Already in the advertiser’s database within 30 days140
Same person submitted twice through the affiliate on one day25
Unique leads paid835 (10,020 USD)

The 140 database duplicates are not fraud: these people had already asked another partner for a quote, which is the cost of a crowded vertical. The 25 same-day repeats are different; they point to a form without validation or to incentivised traffic, and should be fixed at the source before the advertiser starts to doubt the rest. Numbers are illustrative.

Common mistakes

  • Firing the postback on page load, so every refresh of the thank-you page sends another conversion.
  • Generating event IDs separately in the browser and on the server, which defeats platform deduplication.
  • Skipping the program’s cross-channel rules, then disputing every rejected sale.
  • Ignoring duplicate rates by source; a jump on one sub ID often means repeated submissions or incentive abuse.
  • Using a non-unique value, such as the campaign ID, as the transaction ID, so real conversions are merged into one.

Go deeper

FAQ

What is deduplication in affiliate marketing?

Removing duplicate conversions or leads so each sale or person is counted and paid once, based on click ID, transaction ID, email or phone.

What is cross-channel deduplication?

An advertiser rule that credits one marketing channel per sale, usually the last click, so a customer who touched both an affiliate and a paid search ad is paid to only one of them.

Why were my leads rejected as duplicates?

The person was already in the advertiser’s database within the duplicate window, submitted twice, or the conversion was sent twice because of a technical fault.

Is deduplication the same as scrubbing?

No. Deduplication removes repeated records of the same conversion or person; scrubbing rejects conversions for quality or rule violations. Both lower the paid count, for different reasons.

Sources

  1. Handling Duplicate Pixel and Conversions API Events — Meta for Developers (developers.facebook.com)
  2. Use a transaction ID to minimize duplicate conversions — Google Ads Help (support.google.com)
  3. Advertiser Tracking Guide: De-duplication — Awin Wiki (wiki.awin.com)
  4. Deduplication and Affiliate Marketing — impact.com (impact.com)

References are listed as plain text on purpose; look them up by title and publisher. Updated: 2026-10-09.

Terms are the easy part.

Run them inside a network with real tracking, roughly 48-hour payouts and a dedicated manager.

Join the network