Why does the row count in my SFTP source file differ from the Sites tab in the CDIF validation report?

• When customers upload a source file via SFTP and compare its row count to what appears in the Site List tab of the validation report, they may notice a difference. This is expected behaviour and does not mean that any sites are missing.
• Why the counts differ:
  • The total row count in your source file may be higher than the validation report because the system automatically deduplicates contact records during data processing. Specifically, when a site has multiple rows in the source file for the same contact (matched by name, email, and site number), the system keeps only the more complete record and removes the duplicate.
  • A common scenario where this occurs is when the phone number field is blank in one row for a contact, but another row for the same contact has a value in the phone field (such as "Not Available in SuperG"). The system retains the row with the populated phone value and removes the one with the blank phone field.
• How to verify no data is missing:
  • The best way to confirm all your data was loaded correctly is to check the unique site count, not the total row count. If the number of unique site numbers in your source file matches the count in the validation report, all your sites have been loaded successfully.
• How to avoid this in future uploads:
  • To prevent this deduplication from reducing your row count, ensure that each contact appears only once per site in the source file, with all fields populated consistently. If a phone number is not available, use a consistent placeholder value such as "Not Available" rather than leaving the field blank. Leaving it blank may cause the system to treat two rows for the same contact as separate records, resulting in one being removed.

Summary:

        A difference in total row count between your source file and the validation report does not indicate missing data. All unique sites are loaded. The difference is caused by automatic deduplication of contact records where one row has incomplete data compared to another row for the same contact.