I need to find the files/directories that are occupying the maximum space in HDFS. so that i can ask the owners of those directories to clean up the spaces. what is the command that can provide the results for this purpose. Also i do notice the namenode heap size is increasing and is around 80 - 90%. IS there a way to find which files cause this . i.e which directory has too many small files or how to identify the small files which might cause this . Or is there any other reason thaat is causing the namenode heapsize to increase. My name node memory is 3 GB. ... View more

I have set up a primary and secondary KDC manually. I am not using any AD. How do i specify the secondary in ambari. if it is just a primary, i can specify in ambari directly. any example or thoughts would be great. ... View more

I am trying to run a phoenix query, which scans millions of rows and does some processing. The problem is the entire data is being pulled to the client and the client runs out of memory. Is there a way to push down the query to the server side. IS it a setting that needs to be done for achieving this. ... View more

I want to use a few jars for executing some hive queries. I can do this by adding those jars in the beeline session. But is there a way of doing it permanently by specifying the HIVE_AUX_JARS. If so how can i do it in ambari. Also do these jars need to be present in all the nodes of the cluster? I am using ambari 2.2.1 ... View more

I am trying to run a phoenix query which has to fetch about 1.5 millions rows. the query times out. Is there any config parameter, i need to set up. Any thoughts would be of great help SELECT COUNT(1) FROM TABLE +------------------------------------------+ | COUNT(1) | +------------------------------------------+ java.lang.RuntimeException: java.sql.SQLTimeoutException: Operation timed out at sqlline.IncrementalRows.hasNext(IncrementalRows.java:73) at sqlline.TableOutputFormat.print(TableOutputFormat.java:33) at sqlline.SqlLine.print(SqlLine.java:1653) at sqlline.Commands.execute(Commands.java:833) at sqlline.Commands.sql(Commands.java:732) at sqlline.SqlLine.dispatch(SqlLine.java:808) at sqlline.SqlLine.begin(SqlLine.java:681) at sqlline.SqlLine.start(SqlLine.java:398) at sqlline.SqlLine.main(SqlLine.java:292) ... View more

Can a RDBMS table be imported to a phoenix hbase table using Sqoop? IS there a direct way of doing this and if so can anyone point out the required resources. ... View more