I am using HDP-3.1 and YARN 3.1.1. The YARN application type is TEZ. The hive mapreduce job used to work fine. But no mapduce job can run after a complete restart of the HDP. The MR job just hanged and I had to kill them. The job diagnosis show that Application is added to the scheduler and is not yet activated. Skipping AM assignment as cluster resource is empty. Details : AM Partition = <DEFAULT_PARTITION>; AM Resource Request = <memory:4096, vCores:1>; Queue Resource Limit for AM = <memory:0, vCores:0>; User AM Resource Limit of the queue = <memory:0, vCores:0>; Queue AM Resource Usage = <memory:0, vCores:0>; I changed the configuration of yarn.scheduler.capacity.maximum-am-resource-percent from 0.2 to 0.5 but still got the same result. Another issue is that I do not know how to restart YARN. From Ambari UI, I used the menu button YARN - Actions - Restart All, and then clicked the "CONFIRM RESTART ALL" button to confirm. But nothing happens. ... View more

I am following the instruction at links below to add users to Hive admin role. https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.2/bk_dataintegration/content/hive-013-feature-sql-standard-based-grant-revoke.html and https://community.hortonworks.com/articles/4568/sql-based-authorization-in-hive.html However, I could not find this configuration "hive.users.in.admin.role" via Ambari UI (Hive - Configs - Advanced). I downloaded the hive_site.xml (via Ambria's Download Client Configs button) and found no such configuration in the xml file either. What did I miss? Below is my current Hive security settings. Authorization: SQL-Standard Based (SQLStdAuth) Authentication: None Run as end user instead of Hive user: False ... View more

Basically, I am trying to analyze SQL server log files using Hive. The layout is the log file is char(23) - for timestamp char(1) - space char(12) - source the rest of the row, and the length varies. The row delimiter is CR+LF. Below are some entries in the log. 2019-05-28 07:29:55.03 Server      UTC adjustment: -7:00 2019-05-28 07:29:55.03 Server      (c) Microsoft Corporation. 2019-05-28 07:29:55.03 Server      All rights reserved. 2019-05-28 07:29:55.03 Server      Server process ID is 3368. There are several posts here regarding fixed-width column layout. But in my case, the last column is identified not by the width but by the row delimiter. ... View more