Can NOT select from external tables on S3 after upgrading to CDH 5.3.2

[#1]

After I upgrade from CDH 5.3.1 to CDH 5.3.2, and then run "select" SQL queries, it gives me some errors:

select * from my_table limit 10;

FAILED: SemanticException Unable to determine if s3n://my-bucket/is encrypted: java.lang.IllegalArgumentException: Wrong FS: s3n://my-bucket/, expected: hdfs://us0701aohc172018080109.tangome.gbl:8020

I tryied to drop my table and re-create it again add partitions to it, then run select queries, still the same error. Before upgrading everything is OK.

Does anybody happen to know why?

[#2 · Accepted solution]

Hi,

You just hit a bug related with the encryption changes added to CDH 5.3.2. This happens because an internal function is trying to check if the table location is encrypted or not. This works only for HDFS files, but not for external locations.

I'm afraid the only way to make it work is to downgrade to CDH 5.3.1. I don't see a workaround to bypass this error.

The next CDH 5.4.0 version will include this bugfix.

[#3]

It should be fixed in CDH5.4.5