It is recommended to disable the cron in zeppelin as there is no validation if the user is allowed to run as the hive/hdfs or any other user specified in the cron field, meaning any user can set it to be run as any user. disbale is possible from 2.6.5, for previous versiosn please engage the hortonworks support. ... View more

Stack trace points to "s3native.NativeS3FileSystem" which is pretty much deprecated. Suggest to use "s3a://" in table location "(show create table ex_httpvendorstats" would reveal the details) ... View more

@Predrag Minovic Have deployed the cluster with 3 data nodes. YARN/MapReduce2/HDFS version is 2.7.3 on HDP. While running teragen and Gobblin the following Yarn errors get reported in the logs. Errors get reported only when the map tasks defined for the job less than or equals to the number of data nodes in the cluster. For Teragen -Dmapreduce.job.maps=4 For Gobblin mr.job.max.mappers=4 There are no errors if the map tasks(splits) are <= number of data nodes. 2018-08-16 06:54:05,681 ERROR [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Container complete event for unknown container id container_1534394833079_0012_01_000006 2018-08-16 05:00:50,138 ERROR [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Container complete event for unknown container id container_1534394833079_0001_01_000055 2018-08-16 05:00:50,138 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Received completed container container_1534394833079_0001_01_000054 2018-08-16 05:00:50,138 ERROR [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Container complete event for unknown container id container_1534394833079_0001_01_000054 2018-08-16 05:00:50,138 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Received completed container container_1534394833079_0001_01_000053 2018-08-16 05:00:50,138 ERROR [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Container complete event for unknown container id container_1534394833079_0001_01_000053 Please let me know how to avoid these error in the YARN logs. ... View more

Now in 2.6, I understand Hive LLAP is production ready but it still only allows a single HSI which becomes a SPOF There was a patch contributed but it was never accepted: https://issues.apache.org/jira/browse/AMBARI-18917 Do you have any information about why something as important yet apparently trivial hasn't been addressed? ... View more