Member since
07-30-2020
189
Posts
31
Kudos Received
55
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
202 | 08-25-2023 06:04 AM | |
202 | 08-17-2023 12:51 AM | |
358 | 07-28-2023 09:57 AM | |
218 | 07-25-2023 01:46 AM | |
235 | 07-21-2023 04:11 AM |
09-13-2023
06:56 AM
@newtocm you can't pause the Balancer. You can kill it and start it again and it will try to balance the rest of the DFS data remaining to be balanced.
... View more
08-25-2023
06:04 AM
Generally, the size of data blocks would be 128mb across all the Datanodes. But, if you have small files then you might see smaller blocks on some Datanodes as well. So Datanodes with different disk spaces would have uneven "Number of Blocks" and the Balancing happens based on the difference in the DFS usage and not by the difference in block count.
... View more
08-24-2023
04:57 AM
Did you make any changes at the KDC end prior to seeing this issue? Are there any other services hosted on this node that are working fine?
... View more
08-24-2023
03:33 AM
@Crash you can set up load balance at a disk level for the Datanodes. Refer : https://docs.cloudera.com/documentation/enterprise/5-16-x/topics/admin_dn_storage_balancing.html
... View more
08-17-2023
12:51 AM
Hi @Ben1996, As this is very specific use case, I don't see any Cloudera doc which could cover this. The basic requirements would be to import the hdfs module and provide the HDFS configs. For ex, https://tahiriamine9.medium.com/python-hdfs-cd822199799e#:~:text=Let's%20have%20an%20example%20of,into%20HDFS%20with%20CSV%20format.
... View more
08-07-2023
05:42 AM
I would suggest keeping one jar file at a time and checking. 1) /home/hadoop/hbase/hbase-2.5.5/lib/hbase-shaded-netty-4.1.4.jar!/META-INF/native/liborg_apache_hbase_thirdparty_netty_transport_native_epoll_x86_64.so 2) /home/hadoop/hbase/hbase-2.5.5/lib/phoenix-client-hbase-2.5-5.1.3.jar!/META-INF/native/liborg_apache_hbase_thirdparty_netty_transport_native_epoll_x86_64.so
... View more
08-04-2023
12:38 AM
1 Kudo
https://docs.cloudera.com/documentation/enterprise/6/6.3/topics/phoenix_installation.html#concept_ysq_t4n_c3b
... View more
08-04-2023
12:36 AM
@Noel_0317 Do you have rack awareness configured for the Datanodes? Also, check for any disk-level issues on the datanode. Try enabling Debug for block placement : log4j.logger.org.apache.hadoop.hdfs.server.blockmanagement. BlockPlacement Policy= DEBUG
log4j.logger.org.apache.hadoop.hdfs.protocol. Block StoragePolicy= DEBUG
... View more
07-30-2023
10:00 AM
1 Kudo
It requires Hbase cluster as its a SQL layer on top of Hbase
... View more
07-28-2023
10:09 AM
1 Kudo
@sra_vis For CDP, In Cloudera Manager, click Home Click to the right of the cluster name and select Add Service . A list of service types display. Select Phoenix from the list and click Continue . Follow the wizard to add the Phoenix service. For HDP : https://docs.cloudera.com/HDPDocuments/HDP2/HDP-2.6.1/bk_command-line-installation/content/ch_install_phoenix_chapter.html
... View more