Member since
05-04-2016
60
Posts
5
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
896 | 01-17-2017 11:36 AM |
01-18-2019
06:09 AM
@Jay Kumar SenSharma sure , i will check and update. Thanks!!
... View more
01-18-2019
04:58 AM
@Jay Kumar SenSharma can you plz help me with that?
... View more
01-17-2019
02:47 PM
We are trying to fetch file from HDFS (hdfs://10.140.176.148:9000/),we are able to list the files on HDFS however while fetching the file we are getting below error : hdfs.DFSClient: Failed to connect to /192.168.20.8:50010 for block, add to deadNodes and continue. org.apache.hadoop.net.ConnectTimeoutException: 60000 millis timeout while waiting for channel to be ready for connect. ch : java.nio.channels.SocketChannel[connection-pending remote=/192.168.20.8:50010] it seems the IP to which the request is internally redirected is not reachable from our client servers : Client server : 10.141.80.117 10.141.80.119 10.141.80.128 10.141.80.129 10.143.168.75 Could you please help us to resolve the issue .
... View more
Labels:
- Labels:
-
Apache Hadoop
10-29-2018
04:56 AM
@Geoffrey Shelton Okot the activiy got finished & balancer started as soon as i stopped my data node but it took so much time to finish the activity. Is there any way by which i can perform this activity more faster? Thanks,
... View more
10-24-2018
01:13 PM
@Geoffrey Shelton Okot thanks for the reply. we have a setup of 6 data nodes in this cluster with 2TB data on each node. also while shutting down the datanode, is re-balancing start auto or we have to initiate the same? Thanks,
... View more
10-24-2018
08:10 AM
I need to remove 1 faulty data node from the cluster and want to shut it down permanently to get all the data replicated on other data nodes. so will it auto start the re-balance if i stop the faulty data node?also what is the best way to do it? @Jay Kumar SenSharma
... View more
Labels:
- Labels:
-
Apache Hadoop
11-01-2017
07:58 AM
what is the possibility / what are the steps for Swift Object Storage in Hadoop ? How feasible is it to use swift object storage in hadoop environment?
... View more
Labels:
- Labels:
-
Apache Hadoop
08-24-2017
04:56 AM
@Jay SenSharma, thanks for prompt reply. i have checked this error & this is what i found. deb http://10.140.179.252/AMBARI/ubuntu14/2.2.1.1-70/ Ambari main ( ambari server ) deb http://10.140.179.252/AMBARI-2.4.1.0/ubuntu14/2.4.1.0-22/ Ambari main (ambari agent)
... View more
08-24-2017
04:44 AM
kindly find the attached file ambari-agent-log.txt fo log details of ambari-agent. ambari-agent not started on all nodes with below message. Verifying ambari-agent process status...
ERROR: ambari-agent start failed. For more details, see /var/log/ambari-agent/ambari-agent.out:
====================
2017-08-24 10:09:11,210 - call[['test', '-w', '/']] {'sudo': True, 'timeout': 5}
2017-08-24 10:09:11,215 - call returned (0, '')
2017-08-24 10:09:11,215 - call[['test', '-w', '/sys/fs/cgroup']] {'sudo': True, 'timeout': 5}
2017-08-24 10:09:11,219 - call returned (0, '')
2017-08-24 10:09:11,219 - call[['test', '-w', '/run/lock']] {'sudo': True, 'timeout': 5}
2017-08-24 10:09:11,224 - call returned (0, '')
2017-08-24 10:09:11,224 - call[['test', '-w', '/run/shm']] {'sudo': True, 'timeout': 5}
2017-08-24 10:09:11,228 - call returned (0, '')
2017-08-24 10:09:11,228 - call[['test', '-w', '/run/user']] {'sudo': True, 'timeout': 5}
2017-08-24 10:09:11,232 - call returned (0, '') kindly look into this if possible. @Jay SenSharma\ Thanks in advance..
... View more
Labels:
- Labels:
-
Apache Ambari
08-05-2017
02:29 PM
@Jay SenSharma i have tried with these commands and executed it 3 times. It worked everytime now. I suppose it is due to that bug only which you have shared.
... View more
08-05-2017
02:18 PM
@Jay SenSharma thank you for your reply... To let you know that it happened with each request every time. I have checked from network end also by using telnet and tcpdump but still not sure about the cause of the error.
... View more
08-05-2017
01:37 PM
sqoop-error.txt Hi all, i am getting this connection reset everytime i run any simple select sqoop command also. kindly find attached file to look int the error. plz do the needful if possible. @Jay SenSharma
... View more
Labels:
- Labels:
-
Apache Sqoop
06-08-2017
05:42 AM
Jay SenSharma thanks, i will check the logs to find out why it is dropping the connections and let you know...
... View more
06-08-2017
05:24 AM
Jay SenSharma, thanks for the reply... I am able to telnet as you mentioned. Trying to fetch data from oracle DB to HDFS using the script mentioned here. Also note that this is running every hour and i am able to run it successfully in few attempts( 4-5 times a day ) but all the other times its got failed with the erorr given here. Can you plz provide any more troubleshooting help if possible? thanks ....
... View more
06-05-2017
06:53 AM
While running a spark job i have found the error as mentioned below. py4j.protocol.Py4JJavaError: An error occurred while calling o42.load.
: java.sql.SQLRecoverableException: Io exception: Broken pipe This is the file sparkrun.txt which i am running as shell from name-node. spark-err1.txt- this is the error log which i am getting while running the spark job. stest-py.txt - this is the python file which i have mentioned in my shell file called sparkrun.txt plz help in this , as i am not able to find any clue in this. Jay SenSharma
... View more
Labels:
- Labels:
-
Apache Spark
05-25-2017
10:03 AM
Hi Jay SenSharma, thanks for respond. its not kerberized cluster. I have attached the screenshot here, plz find it. view.png I am not able to run service check for Hive as the hiveserver2 is not working constantly. also find attached file of hiveserver2 error logs.hiveserver2log.txt It was working fine till now.
... View more
05-25-2017
08:14 AM
Hive view is not loading and giving error for ATS test & Hiveserver test. It was working fine previously Its HDP2.4 version. Also hiveserver2 is not working for the cluster. kindly find the attached file for reference.hiveview.png plz help if possible. @Jay SenSharma
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache Hive
05-17-2017
04:22 AM
kindly find the attached files for reference.. zklogs1.txt datanode-logs.txt while trying to restart all the services with new configurations after enabling kerberos,failed to start services.
... View more
Labels:
- Labels:
-
Apache Hadoop
05-16-2017
11:16 AM
Jay SenSharma thanks for the respond... kindly find the atatched file for reference.error-kerb.png Here i have tried entering kadmin credentials , which i have also stored as per the article given by you. still it is giving the same error and not taking the kadmin credentials even though it is properly checked. plz help if possible.
... View more
05-16-2017
09:12 AM
1 Kudo
I am facing mentioned error while trying to enable kerberos in Ubuntu setup. Invalid KDC administrator
credentials. Please enter admin principal and password. Although i have known admin credentials still it is giving me error. any kind of help is appreciated. @kkulkarni @Jay SenSharma
... View more
Labels:
- Labels:
-
Kerberos
05-12-2017
04:24 AM
@Vaisakh Sundaram thanks for your reply. We have not configured namenode HA here. Services like HDFS, YARN,MR failed to start after enabling kerberos.
... View more
05-11-2017
01:05 PM
plz find attached log file for further reference.traceback-log.txt After finished deployment & installation of Kerberos, while editing the parameters "hadoop.security.authentication" & "hadoop.security.authorization" in core-site.xml file, all the mentioned services failed to start with the given logs. It is not going to start after the kerberos implementation. plz look into the same & do the needful if possible. @kkulkarni
... View more
Labels:
04-11-2017
09:43 AM
Most of the services in the cluster are failed to restart & here i have attached the error logs for one of the services. Also find the attached image of the summary of cluster. I have finished the process of roll back of namenode HA and after that only i am facing this issue. kindly help if possible.
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache Hadoop
03-07-2017
06:46 AM
kerb-namenode-logs.txt Tried to enable kerberos manual way using HDP security guide. After enabling kerberos while following steps , it stopped all services but failed to start any service and giving error. Kindly find the attached file for reference. P.S: in a kerberos installation step while giving the credentials of admin principal its working fine. plz help if possible... @kkulkarni
... View more
Labels:
03-03-2017
09:46 AM
Sami Ahmad, i am also facing the same error and i have successfully installed the kerberos but while kerberos service check , it is giving me the same error as mentioned below and it is not resolved yet.
... View more
03-03-2017
08:14 AM
It doesnt work for me even though i faced same problem and i did same steps mentioned..
... View more
02-17-2017
07:55 AM
Bipinkumar Algubelli first try to upgrade ambari version to 2.4.1.0 & then try to upgrade HDP to 2.4. There are manual steps which you can follow to upgrade to 2.4 as well as the docs provided at https://docs.hortonworks.com/index.html
... View more
02-16-2017
01:33 PM
@Sagar Shimpi i have checked the property & it has the value= /etc/hadoop/conf/dfs.exclude. when i checked the file from the slave node , it is an empty file.Nothing inside it.
... View more