Issue with hadoop on HDP 2.4 and instance is launched with oracle virtual box on centos7

[#1]

Hi,

I am facing performance issues with hadoop sandbox instance which is launched on top of centos7 with oracle virtual box.

System resources are fine as it is 16GB RAM, 160GB hard disk. Out of that 12GB RAM and dynamic hard disk memory is allocated to Sandbox HDP 2.4 instance.

However when I run the simple command "sudo -u hdfs hadoop fs -ls /user/" is taking about one minute to give the result.

other operations like mkdir, rm etc are also taking time. I also observed that running spark-shell or spark-submit etc take lot of time than usual time on this environment.

I would like to know if there are any performance issues with HDP 2.4 sandbox if it is launched on centos7.

[#2]

@Anil Reddy

Can you try to check enabling debug on console using below command -

export HADOOP_ROOT_LOGGER=DEBUG,console

and now execute any command here [eg hadoop fs -ls /user]

You might see debug logs on console.