About ravi1

ravi1 · ‎04-30-2016

I can run sandbox running on virtualbox with 2222. No reason to think of why its working from vmware and not virtualbox. Both use NAT.

ravi1 · ‎04-30-2016

If this is sandbox, you can ssh to localhost on port 2222. ssh root@localhost -p 2222 if you are on mac/linux or use putty if you are on windows. Default password for root is hadoop. More details here

ravi1 · ‎04-30-2016

ulimit -n 8096 Try this and restart DN and NN and see if this works. I haven't seen your DN logs but it looks like you are running into max open files issue.

ravi1 · ‎04-29-2016

NN has stopped with this 'java.io.IOException: All datanodes DatanodeInfoWithStorage[10.0.2.15:50010,DS-c63e2550-a18a-4035-8bb3-7f8f2b4dd607,DISK] are bad. Aborting...' One possible reason is that you are hitting ulimit. Please post ulimit -a output and datanode log (from the same folder as NN log)

ravi1 · ‎04-29-2016

Check if the nodemanager service is running on the nodes that you are expecting. ps -ef | grep nodemanager should show if it is running. If it is running, take a look to see if resourcemanager is running. ps -ef | grep resourcemanager on resourcemanager node. Please also paste resourcemanager and nodemanager logs (from /var/log/hadoop-yarn/yarn folder on those nodes)

ravi1 · ‎04-29-2016

It means namenode is not running. You need to paste the full NN log to see why it hasn't started. Please upload either the full NN log or the last 20 lines from there.

ravi1 · ‎04-29-2016

From the third screenshot, I see that NN hasn't restarted (which was running before the restart). You can take a look at /var/log/hadoop/hdfs/hadoop-hdfs-datanode-sandbox.hortonworks.com.log which is your NN log. This should have some information on why hasn't started back up.

ravi1 · ‎04-29-2016

Yes. Output will be ORC file(s).

ravi1 · ‎04-29-2016

As @nyadav pointed out, you need to use the URL as jdbc:sqlserver://xx.xx.x.xxx:1433;databaseName=sample instead of the way that you are entereing for SQL Server. List databases worked since you haven't used a database in the jdbc URL there.

ravi1 · ‎04-29-2016

/var/log/hadoop/hdfs/hadoop-hdfs-datanode-<hostname>.log has datanode log and /var/log/hadoop-yarn/yarn/yarn-yarn-nodemanager-<hostname>.log has nodemanager on each node. You can also look at .out files with same name in the same directories.

Online	Offline
Last Visited	‎12-18-2021 05:54 PM

Member Since	‎01-09-2019 05:01 PM
Last Visited	‎12-18-2021 05:54 PM
Posts	401
Kudos received	163

Cloudera Community

Re: 2 hosts not running master services

Re: ambari restart and service restart updating kr...

Re: How to automate sqoop incremental import using...

Re: Path to core-site.xml in sandbox?

Re: Curious to know why majority of the people are...

Re: Where can i run the hdfs commands

Re: Where can i run the hdfs commands

Re: Ambari's HDFS service on ambari not running on...

Re: Ambari's HDFS service on ambari not running on...

Re: YARN command not working

Re: Ambari's HDFS service on ambari not running on...

Re: Ambari's HDFS service on ambari not running on...

Re: Sqoop Import to Hive with Compression

Re: hi, i am able to list the databases but i am u...

Re: hadoop 3 nodes configuration issues: Datanode ...