Onboarding Data

Two-stage process

Onboarding external user attributes, for example, from a CRM system or a third-party provider, is when you have data about users identified with a cross platform ID such as an e-mail address, a phone number, a subscriber id or another CRM ID of any kind. To make this data usable on other platforms (Browsers, Mobile apps, etc) you must first have built a pool of cross-channel matches in order to make the connection at the individual user level between the CRM ID and the platform ID (such as a cookie).

Load external attribute data files

For confidentiality, safety and security reasons, CRM data files should be uploaded to a dedicated location for each partner, from where it is picked up for processing. This location is normally a unique Amazon S3 bucket. Files can be uploaded using any Amazon S3 compatible software, including Amazon’s own AWS CLI. Authentication details are provided separately and consist of an access key and a password. When uploading files to S3, files can be uploaded to the root folder of the S3 bucket. Multiple files might reside in the same folder, if needed.

Amazon S3 secures transmitted data using HTTPS and most tools have encryption enabled by default.

Data types

Event Data

ShiftForward DMP can receive periodic data uploads with data from events collected from users, such as page views, in-app activity or e-commerce behaviour. These types of data files should always contain a timestamp of the event including time-zone information, as well as the event details (more information about Events and standard naming conventions is available in the Collect documentation)

CRM Data

ShiftForward DMP accepts CRM data of various kinds, such as age (DoB or Age bands), gender, household income, location or any data that might be relevant to leverage with ShiftForward DMP.

Data Serialization

AVRO is the recommended format for uploading static data, since it ensures that all lines in the file are properly serialized. Alternatively, other formats are accepted, such as CSV files with headers or fixed-length formats. There is no limit to the number of fields per entry.