Member since
04-03-2019
89
Posts
5
Kudos Received
5
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
3139 | 01-21-2022 04:31 PM | |
5616 | 02-25-2020 10:02 AM | |
3286 | 02-19-2020 01:29 PM | |
2446 | 09-17-2019 06:33 AM | |
5376 | 08-26-2019 01:35 PM |
09-17-2019
06:56 AM
So the job is waiting for resources so I would check to make sure the resource is available. Check all nodes on whether all node managers have been started. I use HDP and it has a cluster overview page showing how much resources are available for MapReduce applications.
... View more
09-17-2019
06:33 AM
The "Ask a Question" button is back. I am not sure what happened yesterday when all buttons and links above the "Welcome to the Cloudera Community" banner weregone.
... View more
09-16-2019
05:25 PM
I tried logging out and then logging back in several times but could not find the button to ask a question. Does this happen to anyone else?
... View more
09-16-2019
08:28 AM
@denloe Thanks for the reply. Apparently I got confused with the two Profile icons - one is the MyCloudera Profile icon at the top right corner of the page, and the other is the Community Avatar icon (the community profile icon) you referred to.
... View more
09-12-2019
09:29 AM
Where can I see the list of questions I posted? I tried the two buttons - My Account and My Profile. They do not have a list of questions. Also, I actually got the same "My Profile" page from the two buttons. Is it supposed to be like that? In addition, I am from HCC and I could not find my list of questions posted in HCC either. Thanks.
... View more
09-11-2019
06:59 AM
Can I access HDP Atlas without Ranger? I am new to HDP and so far I can use Hive, HBase, and Sqoop without Ranger installed. Now I am trying Atlas and following this link. https://docs.cloudera.com/HDPDocuments/HDP3/HDP-3.1.0/configuring-atlas/content/configure_atlas_security.html It looks like I have to use Ranger for accessing Atlas, and communication between Ranger and other services like Hive and HBase. Is this correct? Thanks.
... View more
Labels:
- Labels:
-
Apache Atlas
-
Apache Ranger
08-26-2019
01:35 PM
My mistake. For some reason, the reboot of HDP did not restart YARN NodeManagers and I missed it from the Ambari UI. After I manually started each NodeManager, the MR job runs without an issue.
... View more
08-26-2019
09:26 AM
I am using HDP-3.1 and YARN 3.1.1. The YARN application type is TEZ. The hive mapreduce job used to work fine. But no mapduce job can run after a complete restart of the HDP. The MR job just hanged and I had to kill them. The job diagnosis show that
Application is added to the scheduler and is not yet activated. Skipping AM assignment as cluster resource is empty. Details : AM Partition = <DEFAULT_PARTITION>; AM Resource Request = <memory:4096, vCores:1>; Queue Resource Limit for AM = <memory:0, vCores:0>; User AM Resource Limit of the queue = <memory:0, vCores:0>; Queue AM Resource Usage = <memory:0, vCores:0>;
I changed the configuration of yarn.scheduler.capacity.maximum-am-resource-percent from 0.2 to 0.5 but still got the same result.
Another issue is that I do not know how to restart YARN. From Ambari UI, I used the menu button YARN - Actions - Restart All, and then clicked the "CONFIRM RESTART ALL" button to confirm. But nothing happens.
... View more
Labels:
08-01-2019
06:44 PM
The problem went away after I changed my script adding "order by field1". select row_number() over (order by Field1) as Key1 from mytable;
... View more
08-01-2019
12:21 AM
I got the same problem. I have a table with over 3k records. I ran the following query in Hive and see the Key1 column recycling the number from 1 to 1024. select row_number() over () as Key1 from mytable;
... View more