Member since
01-12-2022
6
Posts
0
Kudos Received
0
Solutions
04-18-2022
10:06 PM
Hi,every one: I have a question.I found there are many "cmd=get_database" log in hadoop-cmf-hive-HIVEMETASTORE.out file.But I haven't done this much.Is it because there are so many other actions that trigger it?
... View more
Labels:
- Labels:
-
Apache Hive
01-21-2022
12:43 AM
I think the DataNode is restarting and scan blocks? It will return to normal when hen the block scan is complete. You can test it again w hen the following content appears in the log 2022-01-17 22:41:56,564 INFO org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.FsDatasetImpl: Time to add replicas to map for block pool BP-1115033092-xx.xx.xx.xx-1532155849771 on volume /data4/xxx/hdfs/dfs/data/current: 5270395ms
... View more
01-18-2022
12:12 AM
Thanks!It works!
... View more
01-16-2022
05:56 PM
Are you make sure your Datanodes are all started and working properly? When I restarted the cluster earlier,there are also many missingBlocks before the DataNode restarts completely.
... View more
01-16-2022
05:48 PM
Thanks,too sad. So,Is there another way to do that? I want to track the resource status of the container execution
... View more
01-12-2022
11:15 PM
Hello, I use yarn (base on HDP3.1.5.0-152),when I view the nodemanager log,I found the log doesn't note the log likes: INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 28532 for container-id container_e51_1637148502450_21618293_01_000024: 4.1 GB of 4.5 GB physical memory used; 6.3 GB of 9.4 GB virtual memory used I don't remember there are some conf in yarn-site.xml can control this. Any one help?
... View more
Labels: