Integration Status
DataGrail's Integrations power and automate processing of Privacy Requests against your organization's systems. There are four types of integrations within DataGrail:
- Synchronous API: This integration type facilitates automated data retrieval and deletion and processes almost instantly.
- Asynchronous API: This integration type facilitates automated data retrieval and deletion, but the third-party API does not respond to DataGrail immediately (Ex: Shopify takes up to 6 months, Klayvio takes up to 14 days)
- Whole-Record Deletion API: This integration type facilitates automated data retrieval and deletion, but differs from Synchronous and Asynchronous API integrations because the third-party API is not capable of extracting data first on a deletion request.
- Direct Contact: This integration type uses an integrated email workflow that includes internal or external parties to process requests and can be connected for vendors without a workable API and/or for customers that prefer an alternate option to a fully automated approach.
There are two DataGrail workflow states in which your integrations will be run on a Privacy Request: Extracting Personal Data and Pending Delete. The workflow state and status of each integration is located in the top section of every Privacy Request.
To better understand when different integrations are run based on the type of Privacy Request, please reference Request Lifecycle by Privacy Right.
Extracting Personal Data
In the Extracting Personal Data state, integrations will query connected systems to identify if PII exists for the Data Subject. The table below shows all possible integration states for each integration type on a Privacy Request in the Extracting Personal Data state.
| Integration State | Integration Type | Description |
|---|---|---|
| Not Started | All | Integration has not yet begun processing. |
| Not Started Will process in a workflow | All | Integration is deferred to process in a workflow. |
| Pending | All | Integration is ready for processing and has been enqueued by DataGrail. Processing will begin automatically once DataGrail's queue clears. |
| Processing Request submitted | Synchronous API, Asynchronous API | API request successfully submitted. DataGrail waiting for API to complete request. |
| Processing Due in # days | Direct Contact | Direct Contact Email sent to the Processor. Awaiting their response. |
| Processing Due # days ago | Direct Contact | The Direct Contact Processor did not respond within 14 days and the integration is configured to block the request. |
| Error | All | Integration encountered an issue that could not be resolved programmatically. See Integration Errors. |
| Complete Access skipped | All |
|
| Complete Access skipped (no response) | Direct Contact | The Direct Contact Processor did not respond within 14 days and the integration is configured to skip. |
| Complete No records found | Synchronous API, Asynchronous API | Data retrieval completed and no records were returned. |
| Complete No files uploaded | Direct Contact | Direct Contact Processor has replied and indicated no records were found. |
| Complete Stopped processing | All | A user has manually stopped processing the integration in DataGrail. |
| Complete # records found | Synchronous API, Asynchronous API | Data retrieval completed and records were returned. |
| Complete # of files uploaded | Direct Contact | Direct Contact Processor has replied and uploaded data. |
Pending Delete
In the Pending Delete state, selected integrations will delete or anonymize PII associated with the Data Subject. The table below shows all possible integration states for each integration type on a Privacy Request in the Pending Delete state.
| Integration State | Integration Type | Description |
|---|---|---|
| Not Started | All | Integration has not yet begun processing. |
| Not Started Will process in a workflow | All | Integration is deferred to process in a workflow. |
| Pending | All | Integration is ready for processing and has been enqueued by DataGrail. Processing will begin automatically once DataGrail's queue clears. |
| Processing Request submitted | All API | API request successfully submitted. DataGrail waiting for API to complete request. |
| Processing Due in # days | Direct Contact | Direct Contact Email sent to the Processor. Awaiting their response. |
| Processing Due # days ago | Direct Contact | The Direct Contact Processor did not respond within 14 days and the integration is configured to block the request. |
| Error | All | Integration encountered an issue that could not be resolved programmatically. See Integration Errors. |
| Complete Deletion skipped | All |
|
| Complete Deletion skipped (no response) | Direct Contact | The Direct Contact Processor did not respond within 14 days and the integration is configured to skip. |
| Complete Nothing to delete | Direct Contact | The Direct Contact Processor responded with "No, we do not hold personal data about the data subject." |
| Complete No records deleted | Synchronous API, Asynchronous API | No data found in "Extracting Personal Data". Nothing to delete. |
| Complete Stopped processing | Direct Contact | A user has manually stopped processing the integration in DataGrail. |
| Complete Deletion done | Whole-Record Deletion API | Data has been successfully deleted. |
| Complete # records deleted | Synchronous API, Asynchronous API | All selected records have been deleted successfully. |
| Complete Deletion done | Direct Contact | The Direct Contact Processor responded with "Yes, we have deleted any applicable data belonging to the data subject." |
| Complete Data found, not deleted | Direct Contact | The Direct Contact Processor responded with "No, we could not delete data for the data subject." |
Integration Errors
The most common issue you may encounter when processing a Privacy Request is an integration error. The table below outlines the 9 types of integration errors, what they mean, and what you can do to help resolve them.
DataGrail retries all unfinished integrations daily. If an integration encounters an error, it may be resolved when it is rerun the next day.
Disconnected Integration
This integration is disconnected from DataGrail. This often occurs when a credential has expired.
Action to Remediate
- Generate new credentials in the third-party system and Reconnect the Integration to DataGrail.
Authorization Error
Error Codes: 401
The original System Admin credentials provided to DataGrail are now invalid (Ex: admin left the company, was promoted, etc.)
Action to Remediate
- Identify a new admin for the disconnected system.
- Grant the new admin access to DataGrail.
- Have the new admin generate new credentials in the third-party system and Reconnect the Integration to DataGrail.
Insufficient Permissions
Error Codes: 403
Unable to process request because DataGrail does not have required permissions to take action (Ex: a deletion action can't be completed with read-only permissions)
Action to Remediate
- Locate the integration in DataGrail.
- Select View Connection Instructions.
- Review the required permissions and scopes and ensure they are granted in the third-party system.
Rate Limit Error
Error Codes: 429
DataGrail has exceeded the API call limit (within the last 48 hours) for the third-party system.
Action to Remediate
No action required. DataGrail will retry indefinitely and the request should process once the rate limit allows. Alternatively, contact a system admin or the third party directly to increase your API limits.
Internal Server Error
Error Codes: 5xx
Integration API server is not ready to handle the request. It can be a temporary error that may be resolved automatically.
Action to Remediate
Wait 24 hours as 5xx errors are often transient and likely to resolve when the integration is retried. If the error persists, reach out to support@datagrail.io.
Unprocessable Request
Error Codes: 404
Integration API server cannot find the requested resource.
Action to Remediate
Please reach out to support@datagrail.io to investigate further.
Request Timeout
Error Codes: 408
Processing has been interrupted due to request timeout.
Action to Remediate
Wait 24 hours as 408 errors are often transient and likely to resolve when the integration is retried. If the error persists, reach out to support@datagrail.io.
Request Error
Integration API server cannot process the request due to a request error.
Error Codes: 400, 422
Action to Remediate
Please reach out to support@datagrail.io to investigate further.
DataGrail Error
We’re experiencing a problem with this integration.
Action to Remediate
Please reach out to support@datagrail.io to investigate further.
Disclaimer: The information contained in this message does not constitute as legal advice. We would advise seeking professional counsel before acting on or interpreting any material.