I have a new HDP on prem cluster and want make hive internal storage location to s3 instead of hdfs. Is this supported or is this only supported with cloudbreak/HDC?
Per the docs, Hive on S3 should be using external tables with the Cloud Data Connectors: https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.1/bk_cloud-data-access/content/hive.html
@Michael Young Thanks for that. I am aware of external tables on s3. What specifically I am looking for is internally managed tables. If you come across any information please share.
@sunile.manjee I don't believe internal managed tables are supported on S3 currently.
@Michael Young I found the answer here: https://wiki.apache.org/hadoop/AmazonS3
“You cannot use any of the S3 filesystem clients as a drop-in replacement for HDFS.” So not only is this not recommended and not supported.