Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Does hortonworks support hive internal managed table on s3?

Does hortonworks support hive internal managed table on s3?

Super Guru

I have a new HDP on prem cluster and want make hive internal storage location to s3 instead of hdfs. Is this supported or is this only supported with cloudbreak/HDC?

4 REPLIES 4

Re: Does hortonworks support hive internal managed table on s3?

@sunile.manjee

Per the docs, Hive on S3 should be using external tables with the Cloud Data Connectors: https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.1/bk_cloud-data-access/content/hive.html

Re: Does hortonworks support hive internal managed table on s3?

Super Guru

@Michael Young Thanks for that. I am aware of external tables on s3. What specifically I am looking for is internally managed tables. If you come across any information please share.

Highlighted

Re: Does hortonworks support hive internal managed table on s3?

@sunile.manjee I don't believe internal managed tables are supported on S3 currently.

Re: Does hortonworks support hive internal managed table on s3?

Super Guru

@Michael Young I found the answer here: https://wiki.apache.org/hadoop/AmazonS3

“You cannot use any of the S3 filesystem clients as a drop-in replacement for HDFS.”    So not only is this not recommended and not supported.  
Don't have an account?
Coming from Hortonworks? Activate your account here