Dify Enterprise Edition Deployment Guide (AWS)
This document describes how to deploy Dify Enterprise Edition in an AWS cloud environment. You can choose any of the following methods to complete the deployment:- Via Terraform (Recommended)
- Via CDK
- Manually create infrastructure and deploy (Not recommended)
Option 1: Build via Terraform
Please contact the Dify technical support team to obtain Terraform-related scripts and documentation.
Prerequisites
kubectl,helm, andaws cliare installed locally.- An AWS account with permissions to create the following resources.
- AWS EKS (Elastic Kubernetes Service): For deploying Dify core services; nodes need internet access or NAT Gateway configuration
- AWS S3 (Simple Storage Service): For persistent storage
- AWS ECR (Elastic Container Registry): For Dify plugin installation; can also host Dify images and Helm Charts
- AWS RDS Aurora Postgres: Relational database for storing application data and audit records
- AWS OpenSearch: Vector database for RAG (Retrieval Augmented Generation) related features
- Amazon ElastiCache: Managed Redis caching service for accelerating data access
Option 2: Build via CDK
Please refer to AWS CDK Deployment.Option 3: Manually Create Infrastructure and Deploy
1. Create Infrastructure
Please refer to the recommended configurations in the table below and create infrastructure according to your actual needs. (Replace content in double brackets with actual values)Version note (important): The versions in the table below are provided as “available ranges/version families” for reference. Before deployment, please make sure to verify in the AWS Console of your target AWS Region (or via AWS CLI) which versions are currently supported (EKS Kubernetes, Aurora PostgreSQL, OpenSearch, ElastiCache Redis, etc.) to avoid resource creation failures caused by regional differences or version deprecations.
Testing Environment Infrastructure Configuration Reference
Note: If enabling the unstructured service on a single node, increase disk capacity to 40 GB.
Production Environment Infrastructure Configuration Reference
Additionally, you need to create appropriate Virtual Private Cloud (VPC) and Security Groups (SG) to ensure infrastructure security.
2. Configure values.yaml
After creating the database, S3, and other infrastructure, please refer to the following example to configurevalues.yaml (replace content in double brackets with actual values). Before this, you need to create four databases in the database: dify, enterprise, audit, dify_plugin_daemon, and replace the corresponding configuration items such as rds_main_database_name in values.yaml.
3. Configure S3 and ECR Permissions
To ensure Dify services start properly and the plugin system functions correctly, theapi, worker, workerBeat, plugin_daemon, and plugin_connector services require S3 access permissions, and the plugin_connector service also requires ECR access permissions. The specific reasons why the plugin_connector service needs these permissions will be explained in detail later.
You can configure permissions in one of the following two ways:
- IRSA Mode: IAM Roles for Service Accounts, enabling secure and fine-grained permission control (Recommended)
- Access Key (AK/SK) Mode: Provide credentials via environment variables
IRSA Mode Configuration
Dify recommends using IRSA to configure ServiceAccount permissions. You can contact the Dify technical support team forone-click IRSA deployment scripts.
IRSA establishes a trust relationship between the EKS cluster and IAM through an OIDC Provider, allowing Pods to securely obtain AWS permissions via ServiceAccounts without configuring Access Keys in the Pod. The overall architecture is as follows:
💡 Special Note About CRD Installation Dify Enterprise Edition only requires namespace-level permissions during installation. However, since CRD itself is a cluster-level resource, appropriate cluster permissions are required during installation. If you don’t have cluster-level permissions, you can install the CRD separately first, then install the remaining components. The CRD itself is just an API structure declaration registered in Kubernetes. When its corresponding Controller is namespace-level, it cannot access or modify resources across namespaces.
Step 1: Verify IAM OIDC Provider
Before configuring IRSA, ensure the cluster has IAM OIDC Provider enabled. If the cluster was created manually, it’s recommended to enable or verify using theeksctl command-line tool. The IAM OIDC Provider establishes a trust relationship that allows the EKS cluster to prove Pod identity to IAM, enabling Pods to securely obtain AWS permissions.
Step 2: Create AWS IAM Policies
You need to create the following three IAM policies: Policy 1: S3 Access Policy (name is customizable, e.g.DifyS3Policy)
DifyECRPolicy)
Used for plugin image push and management, including ECR authentication, repository management, image push, and audit logging permissions:
Policy 3: ECR Pull-Only Policy (name is customizable, e.g.{your_ecr_repo_prefix}is the name prefix of your ECR repositories. For example, if you configureimageRepoPrefixin Step 5 as123456789.dkr.ecr.us-east-1.amazonaws.com/dify-ee, then the ECR repository prefix here isdify-ee, and the Resource should bearn:aws:ecr:us-east-1:123456789:repository/dify-ee*.
DifyECRPullOnlyPolicy)
Used only for pulling plugin runtime images:
Step 3: Create AWS IAM Roles
Create the following three roles and attach the policies from Step 2 to the corresponding roles (role names can be customized):
Obtain the corresponding role ARNs:
Replace{oidc_id}with the OIDC Provider ID of your EKS cluster. You can obtain it with the following command:
Step 4: Bind Roles to EKS ServiceAccounts
ServiceAccount (SA) is a mechanism that allows Pods in EKS to obtain specific AWS permissions to access cloud resources (such as S3).Create the following four ServiceAccounts and add the corresponding role ARN to the
eks.amazonaws.com/role-arn annotation:
Example commands to create ServiceAccounts (replace
$DIFY_EE_* with the role ARNs obtained in Step 3):
Step 5: Configure ServiceAccount in values.yaml
Modify Helm’svalues.yaml and add the following configuration (only ServiceAccount and ECR-related configurations are shown below, other configurations are omitted). imageRepoPrefix can be customized:
‼️dify-plugin-connector-sawill be automatically assigned to theplugin_connectorservice through Helm Chart templates;dify-plugin-crd-saanddify-plugin-runner-sawill be used for Pods that build and run plugins.
Access Key Mode Configuration
Step 1: Prepare Credentials
Create an IAM user with only S3 and ECR permissions, and obtain its Access Key and Secret Key.Step 2: Create Kubernetes Secret
plugin_connector service via imageRepoSecret in values.yaml in the next step.
Step 3: Configure values.yaml
4. Install AWS ALB (Application Load Balancer)
To make Dify Enterprise Edition accessible via domain name, you need to install AWS ALB (Application Load Balancer). You can also choose to use Nginx Ingress Controller or other Ingress Controllers. AWS ALB is recommended because it integrates seamlessly with Dify Enterprise Edition and provides better performance and scalability. Please visit https://docs.aws.amazon.com/eks/latest/userguide/lbc-manifest.html for the AWS ALB installation guide.If you cannot install AWS ALB, you can use Nginx Ingress Controller as an alternative:After AWS ALB installation is complete, you can confirm whether the service is running properly with the following command:
values.yaml:
global configuration. You can verify the domain and create a certificate through AWS Certificate Manager.
5. Execute Installation
Please visit https://langgenius.github.io/dify-helm/#/ for detailed installation instructions.
‼️ It is not recommended to install Dify in the default namespace.
6. Verify Service Status
- Update kubectl access credentials:
- Verify EKS nodes are running properly:
- Verify Dify service status:
- Confirm ALB is working properly:
‼️ Please configure the DNSName from the above command output as a CNAME record, resolving to the various domains required by Dify.