Member since
05-14-2020
1
Post
0
Kudos Received
0
Solutions
05-14-2020
11:53 AM
Hi Seth As described in the document you linked, I added the following entries to my core-site.xml <property>
<name>fs.s3a.access.key</name>
<value>your_access_key</value>
</property>
<property>
<name>fs.s3a.secret.key</name>
<value>your_secret_key</value>
</property> I then restarted Impala and hive services. But when i issue impala shell command to create a table whose files are stored on S3 i am still getting an error about S3 credentials not being available. This is the command - impala-shell -i serverName -d schemaName -q "CREATE TABLE s3_test_tbl( \ yr_mnth STRING , \ p_id DOUBLE , \ p_full_na STRING ) \ STORED AS PARQUET \ LOCATION 's3a://bucketname/path/'" And this is the error i get - No AWS Credentials provided by BasicAWSCredentialsProvider EnvironmentVariableCredentialsProvider SharedInstanceProfileCredentialsProvider : com.amazonaws.SdkClientException: Unable to load credentials from service endpoint CAUSED BY: InterruptedIOException: doesBucketExist on biapps-snowflake-sbx-ascap: com.amazonaws.AmazonClientException: No AWS Credentials provided by BasicAWSCredentialsProvider EnvironmentVariableCredentialsProvider SharedInstanceProfileCredentialsProvider : com.amazonaws.SdkClientException: Unable to load credentials from service endpoint CAUSED BY: AmazonClientException: No AWS Credentials provided by BasicAWSCredentialsProvider EnvironmentVariableCredentialsProvider SharedInstanceProfileCredentialsProvider : com.amazonaws.SdkClientException: Unable to load credentials from service endpoint CAUSED BY: SdkClientException: Unable to load credentials from service endpoint CAUSED BY: SocketTimeoutException: connect timed out
... View more