Skip to main content

Deployment Overview

After configuring the environment variable, you're ready to configure the container that will run within your network.

Sourcing the Docker Image​

The datagrail-rdd-agent Docker image is hosted in DataGrail's container repositories (e.g. AWS ECR), which you will be granted access to. Ask your engagement manager or CSM for this information.

Agent Version

When retrieving the image, make sure to use a specific version tag.

Running the Service​

DataGrail recommends running the agent with your preferred container orchestration platform, such as Kubernetes or serverless via AWS ECS, Google Cloud Run, etc.

Using Terraform

If you would prefer to deploy the agent using Terraform, scripts are available for some cloud platforms.

Service Configuration​

Below are general guidelines to ensure that the service is able to run with proper roles and permissions. Your onboarding specialist will be supporting you with recommendations tailored to your needs.

Network Settings​

DataGrail designed data discovery agents with flexibility and security in mind, allowing you to deploy agents where your data sources are hosted to minimize security and privacy risks.

Recommended Configuration:

  1. One or more agents per virtual private network or data center where data sources are readily reachable and no bridged or proxied connections are necessary.
  2. Run in a private subnet with no ingress.
  3. Egress rules set to only allow connections to your DataGrail domain and the source of the Docker image.

Minimum System Requirements​

Each agent should be configured with at least the following requirements:

  • Cores: 4+
  • Memory: 8 GB+
  • Disk storage: 20 GB
Variable Scan Duration

The duration of each scan can range from minutes to a few hours depending on the volume of your data sources, the number of data elements (columns), and more. Please consult with DataGrail support for more tailored recommendations as needed.

Logging​

Persisting logs for up to 30 days is strongly recommended for debugging purposes. You can use logs to identify configuration issues during setup. For other errors or exceptions, reach out to DataGrail support with detailed error messages and stack traces.

Confirm Connection​

Once the containerized service is running, you will see a green check mark in DataGrail confirming a successful connection.

Successful Connection

 

Need help?
If you have any questions, please reach out to your dedicated CSM or contact us at support@datagrail.io.

Disclaimer: The information contained in this message does not constitute as legal advice. We would advise seeking professional counsel before acting on or interpreting any material.