Member since
09-26-2021
1
Post
0
Kudos Received
0
Solutions
10-20-2023
12:51 AM
Hey Everyone, We installed CDP Private Cloud Data Services i.e. ECS 1.4.1. After registering environment through management console, when we are trying to create CDE (Cloudera Data Engineering) cluster we are getting aws_key_id error although we have not deployed servers through AWS. Please find the logs below. 2023-10-18 08:06:48: Create: Cluster: Data-engineering-1, user: <admin@cdp.example>, event: Create, properties: [internal-actor-crn=crn:altus:iam:us-west-1:altus:user:__internal__actor__] 2023-10-18 08:07:04: Log: Cluster provisioning initiated, cloud platform: STANDARD 2023-10-18 08:07:04: Log: Started provisioning a managed cluster, provisionerID: liftie-9bylvhxh 2023-10-18 08:07:04: LogDebug: Updating cluster status from ClusterProvisioningInitiated to ClusterProvisioningInProgress 2023-10-18 08:07:04: LogDebug: Checking underlying cluster status 2023-10-18 08:07:04: Log: Cluster provisioning completed 2023-10-18 08:07:04: LogDebug: Updating cluster status from ClusterProvisioningInProgress to ClusterProvisioningCompleted 2023-10-18 08:07:04: Log: Creating and syncing cluster access groups 2023-10-18 08:07:04: LogDebug: Updating cluster status from ClusterProvisioningCompleted to ClusterAccessGroupCreationCompleted 2023-10-18 08:07:04: Log: Creating Filesystem 2023-10-18 08:07:04: LogDebug: Updating cluster status from ClusterAccessGroupCreationCompleted to FSProvisioningInProgress 2023-10-18 08:07:04: Log: Filesystem creation completed successfully 2023-10-18 08:07:04: LogDebug: Updating cluster status from FSProvisioningInProgress to FSProvisioningCompleted 2023-10-18 08:07:04: LogDebug: Updating cluster status from FSProvisioningCompleted to FSMountTargetsCreated 2023-10-18 08:07:04: Log: Provisioning database 2023-10-18 08:07:04: LogDebug: Updating cluster status from FSMountTargetsCreated to DBProvisioningInProgress 2023-10-18 08:07:04: Log: Database provisioning completed 2023-10-18 08:07:04: LogDebug: Updating cluster status from DBProvisioningInProgress to DBProvisioningCompleted 2023-10-18 08:07:04: Log: TLS certificate not required by config, skipping 2023-10-18 08:07:04: LogDebug: Updating cluster status from DBProvisioningCompleted to ClusterTLSCertCreationCompleted 2023-10-18 08:07:04: Log: Skipping service mesh install and configuration 2023-10-18 08:07:04: LogDebug: Updating cluster status from ClusterTLSCertCreationCompleted to ClusterServiceMeshProvisioningCompleted 2023-10-18 08:07:04: Log: Installing dex-base charts for CDE 1.17.1 2023-10-18 08:07:25: LogDebug: Found JWT signing keys with issuer=https://console-cdp.apps.hostname-i0355.hostname.co.in/authenticate/e9df8270-bc8a-4f64-91fe-c1ab998dc182, audience=https://de._NA_.apps.hostname-i0355.hostname.co.in, URL=https://console-cdp.apps.hostname-i0355.hostname.co.in/authenticate/oauth2/keys?accountId=e9df8270-bc8a-4f64-91fe-c1ab998dc182 2023-10-18 08:07:25: Log: unable to find logging configurations from environment, error: unable to retrieve aws_key_id from the env service 2023-10-18 08:07:25: LogError: Could not add shared cluster overrides, error: unable to retrieve aws_key_id from the env service 2023-10-18 08:07:25: LogError: Chart installation failed, dex base overrides: unable to retrieve aws_key_id from the env service 2023-10-18 08:07:25: Failure: {"StartState":"ClusterServiceMeshProvisioningCompleted","EndState":"ClusterChartInstallationFailed","Attempt":1} 2023-10-18 08:08:04: Log: Installing dex-base charts for CDE 1.17.1 2023-10-18 08:08:19: LogDebug: Found JWT signing keys with issuer=https://console-cdp.apps.hostname-i0355.hostname.co.in/authenticate/e9df8270-bc8a-4f64-91fe-c1ab998dc182, audience=https://de._NA_.apps.hostname-i0355.hostname.co.in, URL=https://console-cdp.apps.hostname-i0355.hostname.co.in/authenticate/oauth2/keys?accountId=e9df8270-bc8a-4f64-91fe-c1ab998dc182 2023-10-18 08:08:19: Log: unable to find logging configurations from environment, error: unable to retrieve aws_key_id from the env service 2023-10-18 08:08:19: LogError: Could not add shared cluster overrides, error: unable to retrieve aws_key_id from the env service 2023-10-18 08:08:19: LogError: Chart installation failed, dex base overrides: unable to retrieve aws_key_id from the env service 2023-10-18 08:08:19: Failure: {"StartState":"ClusterServiceMeshProvisioningCompleted","EndState":"ClusterChartInstallationFailed","Attempt":2} 2023-10-18 08:09:04: Log: Installing dex-base charts for CDE 1.17.1 2023-10-18 08:09:25: LogDebug: Found JWT signing keys with issuer=https://console-cdp.apps.hostname-i0355.hostname.co.in/authenticate/e9df8270-bc8a-4f64-91fe-c1ab998dc182, audience=https://de._NA_.apps.hostname-i0355.hostname.co.in, URL=https://console-cdp.apps.hostname-i0355.hostname.co.in/authenticate/oauth2/keys?accountId=e9df8270-bc8a-4f64-91fe-c1ab998dc182 2023-10-18 08:09:25: Log: unable to find logging configurations from environment, error: unable to retrieve aws_key_id from the env service 2023-10-18 08:09:25: LogError: Could not add shared cluster overrides, error: unable to retrieve aws_key_id from the env service 2023-10-18 08:09:25: LogError: Chart installation failed, dex base overrides: unable to retrieve aws_key_id from the env service 2023-10-18 08:09:25: Failure: {"StartState":"ClusterServiceMeshProvisioningCompleted","EndState":"ClusterChartInstallationFailed","Attempt":3} 2023-10-18 08:09:25: LogDebug: Updating cluster status from ClusterServiceMeshProvisioningCompleted to ClusterChartInstallationFailed ----------------------------------------------------------------------------------------- Cluster version details :- CM version - 7.8.1 CDP Private Cloud Base Version - 7.1.7 Data services (ECS) - 1.4.1-b741 Any help or inputs would be appreciated.
... View more