Member since
07-25-2020
16
Posts
0
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
43 | 02-15-2021 04:30 AM |
02-17-2021
03:09 AM
I'm working on Cloudera Quickstart VM 5.13 and I'm trying to start hadoop; But i'm getting these errors: Failed to start Hadoop proxyserver. Return value: 1 [FAILED] Failed to start Hadoop secondarynamenode. Return value: 1 [FAILED] In the log file for the secondarynamenode i have this exception: HttpServer.start() threw a non Bind IOException java.net.BindException: Port in use: 0.0.0.0:50090 at org.apache.hadoop.http.HttpServer2.openListeners(HttpServer2.java:959) at org.apache.hadoop.http.HttpServer2.start(HttpServer2.java:895) at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.startInfoServer(SecondaryNameNode.java:488) at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.main(SecondaryNameNode.java:691) Caused by: java.net.BindException: Address already in use at sun.nio.ch.Net.bind0(Native Method) at sun.nio.ch.Net.bind(Net.java:444) at sun.nio.ch.Net.bind(Net.java:436) at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:214) at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74) at org.mortbay.jetty.nio.SelectChannelConnector.open(SelectChannelConnector.java:216) at org.apache.hadoop.http.HttpServer2.openListeners(HttpServer2.java:954) ... 3 more Failed to start secondary namenode java.net.BindException: Port in use: 0.0.0.0:50090 at org.apache.hadoop.http.HttpServer2.openListeners(HttpServer2.java:959) at org.apache.hadoop.http.HttpServer2.start(HttpServer2.java:895) at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.startInfoServer(SecondaryNameNode.java:488) at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.main(SecondaryNameNode.java:691) Caused by: java.net.BindException: Address already in use at sun.nio.ch.Net.bind0(Native Method) at sun.nio.ch.Net.bind(Net.java:444) at sun.nio.ch.Net.bind(Net.java:436) at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:214) at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74) at org.mortbay.jetty.nio.SelectChannelConnector.open(SelectChannelConnector.java:216) at org.apache.hadoop.http.HttpServer2.openListeners(HttpServer2.java:954) ... 3 more Exiting with status 1 And this for the proxyserver: Service org.apache.hadoop.yarn.server.webproxy.WebAppProxy failed in state INITED; cause: org.apache.hadoop.yarn.exceptions.YarnRuntimeException: yarn.web-proxy.address is not set so the proxy will not run. org.apache.hadoop.yarn.exceptions.YarnRuntimeException: yarn.web-proxy.address is not set so the proxy will not run. at org.apache.hadoop.yarn.server.webproxy.WebAppProxy.serviceInit(WebAppProxy.java:76) at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107) at org.apache.hadoop.yarn.server.webproxy.WebAppProxyServer.serviceInit(WebAppProxyServer.java:73) at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) at org.apache.hadoop.yarn.server.webproxy.WebAppProxyServer.startServer(WebAppProxyServer.java:132) at org.apache.hadoop.yarn.server.webproxy.WebAppProxyServer.main(WebAppProxyServer.java:115) Service org.apache.hadoop.yarn.server.webproxy.WebAppProxyServer failed in state INITED; cause: org.apache.hadoop.yarn.exceptions.YarnRuntimeException: yarn.web-proxy.address is not set so the proxy will not run. org.apache.hadoop.yarn.exceptions.YarnRuntimeException: yarn.web-proxy.address is not set so the proxy will not run. at org.apache.hadoop.yarn.server.webproxy.WebAppProxy.serviceInit(WebAppProxy.java:76) at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107) at org.apache.hadoop.yarn.server.webproxy.WebAppProxyServer.serviceInit(WebAppProxyServer.java:73) at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) at org.apache.hadoop.yarn.server.webproxy.WebAppProxyServer.startServer(WebAppProxyServer.java:132) at org.apache.hadoop.yarn.server.webproxy.WebAppProxyServer.main(WebAppProxyServer.java:115) Stopping WebAppProxyServer metrics system... WebAppProxyServer metrics system stopped. WebAppProxyServer metrics system shutdown complete. Exiting with status -1
... View more
Labels:
02-15-2021
04:30 AM
I found my log4j.properties file (my case ./workspace/training/conf/log4j.properties) and i and added these two lines and it solved the problem : log4j.appender.RFA=org.apache.log4j.ConsoleAppender log4j.appender.RFA.layout=org.apache.log4j.PatternLayout
... View more
02-13-2021
04:23 AM
I installed Cloudera Quickstart VM 5.13 on virtualbox and I'm trying to start hadoop server with the command sudo service hadoop-hdfs-namenode start But i'm getting these two errors: log4j:ERROR Could not find value for key log4j.appender.RFA log4j:ERROR Could not instantiate appender named "RFA" This is the full output of the command: [root@quickstart etc]# sudo service hadoop-hdfs-namenode start starting namenode, logging to /var/log/hadoop-hdfs/hadoop-hdfs-namenode-quickstart.cloudera.out log4j:ERROR Could not find value for key log4j.appender.RFA log4j:ERROR Could not instantiate appender named "RFA". log4j:WARN No appenders could be found for logger.(org.apache.hadoop.hdfs.server.namenode.NameNode). log4j:WARN Please initialize the log4j system properly. log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info. Failed to start Hadoop namenode. Return value: 1 [FAILED] Can anyone can help me with this issue?
... View more
Labels:
10-12-2020
06:51 AM
I installed Hortonworks Sandbox via Virtualbox. And when i started ambari every service is stopped like you can see in this screenshot . I tried to start manually each of the services but nothing happens when i click the start button. And plus, i have many erros in my notifications section as you can see in this folder . Also this is waht my ambari agent logs looks like. Any idea on how i can resolve this?
... View more
10-12-2020
06:10 AM
Here is what my amabri agent logs look like. I don't understand anything.
... View more
09-30-2020
08:53 AM
I installed Hortonworks Sandbox via Virtualbox. And when i started ambari every service is stopped like you can see in this screenshot . I tried to start manually each of the service but nothing happens when i click the start button. And plus, i have many erros in my alert section as you can see in this folder. Any idea on how i can resolve this?
... View more
09-29-2020
07:30 AM
I already had many alerts for errors before even trying to start the services. Here is a folder with screenshots of all the alerts.
... View more
09-29-2020
06:48 AM
Nothing happens when I click on the action button and then on start all services. I even tried to start each service alone but still nothing is happening.
... View more
09-28-2020
09:09 AM
I installed Hortonworks Sandbox via Virtualbox. And when i start ambari every service is red like you can see in this screenshot . Have i missed something or what? i cannot do anything... i'm a beginner with hadoop.
... View more
- Tags:
- HDP
- Sandbox
- virtualbox
08-20-2020
04:26 PM
I did a trial installation using cloudera-manager-installer.bin. I have been looking for a solution of this problem for weeks now, without being able to find one. Any ideas on how i can resolve this?
... View more
08-11-2020
07:20 AM
i did the trial installation using cloudera-manager-installer.bin. My database is up and running? How can i connect to it from CM host? Sorry for all the questions i'm a beginner.
... View more
08-09-2020
02:09 PM
I succesfully installed Cloudera CDP Data Center on my CentOS7 virtual machine and after installing PostgreSQL i was unable to start the Cloudera Manager Server. I ran the follwing command: "sudo service cloudera-scm-server start" When i tried to access the Cloudra Manager on localhost:7180 and received: "Firefox can’t establish a connection to the server at localhost:7180". I checked the server status with the command: "service cloudera-scm-server status -l". I received the following lines: " Redirecting to /bin/systemctl status -l cloudera-scm-server.service ● cloudera-scm-server.service - Cloudera CM Server Service Loaded: loaded (/usr/lib/systemd/system/cloudera-scm-server.service; enabled; vendor preset: disabled) Active: active (running) since Sun 2020-08-09 22:53:58 WAT; 13s ago Process: 6088 ExecStartPre=/opt/cloudera/cm/bin/cm-server-pre (code=exited, status=0/SUCCESS) Main PID: 6090 (java) Tasks: 17 CGroup: /system.slice/cloudera-scm-server.service └─6090 /usr/java/jdk1.8.0_232-cloudera/bin/java -cp .:/usr/share/java/mysql-connector-java.jar:/usr/share/java/oracle-connector-java.jar:/usr/share/java/postgresql-connector-java.jar:lib/* -server -Dlog4j.configuration=file:/etc/cloudera-scm-server/log4j.properties -Dfile.encoding=UTF-8 -Dcmf.root.logger=INFO,LOGFILE -Dcmf.log.dir=/var/log/cloudera-scm-server -Dcmf.log.file=cloudera-scm-server.log -Dcmf.jetty.threshhold=WARN -Dcmf.schema.dir=/opt/cloudera/cm/schema -Djava.awt.headless=true -Djava.net.preferIPv4Stack=true -Dpython.home=/opt/cloudera/cm/python -XX:+HeapDumpOnOutOfMemoryError -Xmx4G -XX:MaxPermSize=256m -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/tmp -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:OnOutOfMemoryError=kill -9 %p com.cloudera.server.cmf.Main Aug 09 22:54:11 localhost.localdomain cm-server[6090]: Caused by: java.net.ConnectException: Connexion refusée (Connection refused) Aug 09 22:54:11 localhost.localdomain cm-server[6090]: at java.net.PlainSocketImpl.socketConnect(Native Method) Aug 09 22:54:11 localhost.localdomain cm-server[6090]: at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) Aug 09 22:54:11 localhost.localdomain cm-server[6090]: at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) Aug 09 22:54:11 localhost.localdomain cm-server[6090]: at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) Aug 09 22:54:11 localhost.localdomain cm-server[6090]: at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) Aug 09 22:54:11 localhost.localdomain cm-server[6090]: at java.net.Socket.connect(Socket.java:607) Aug 09 22:54:11 localhost.localdomain cm-server[6090]: at org.postgresql.core.PGStream.<init>(PGStream.java:68) Aug 09 22:54:11 localhost.localdomain cm-server[6090]: at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:144) Aug 09 22:54:11 localhost.localdomain cm-server[6090]: ... 13 more " Any ideas how i can fix this?
... View more
08-05-2020
06:05 AM
I just installed trial version of CDP Data Center on my CentOS7 virtual machine; I was able to connect to the cloudera manager and the first thing that was asked of me was to install a working KDC and I chose to install MIT KDC. After the installation i proceed the configuration of Kerberos and at the end i received the following error: kinit: KDC has no support for encryption type while getting initial credentials.
This is the complete error message:
/opt/cloudera/cm/bin/import_credentials.sh failed with exit code 1 and output of << + export PATH=/usr/kerberos/bin:/usr/kerberos/sbin:/usr/lib/mit/sbin:/usr/sbin:/usr/lib/mit/bin:/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin + PATH=/usr/kerberos/bin:/usr/kerberos/sbin:/usr/lib/mit/sbin:/usr/sbin:/usr/lib/mit/bin:/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin + KEYTAB_OUT=/var/run/cloudera-scm-server/cmf4648265406807175091.keytab + USER=USERNAME-REDACTED + passwd=BUNDLE-REDACTED KVNO=1 + SLEEP=0 + RHEL_FILE=/etc/redhat-release + '[' -f /etc/redhat-release ']' + set +e + grep Tikanga /etc/redhat-release + '[' 1 -eq 0 ']' + '[' 0 -eq 0 ']' + grep 'CentOS release 5' /etc/redhat-release + '[' 1 -eq 0 ']' + '[' 0 -eq 0 ']' + grep 'Scientific Linux release 5' /etc/redhat-release + '[' 1 -eq 0 ']' + set -e + '[' -z /var/run/cloudera-scm-server/krb53377829653236465405.conf ']' + echo 'Using custom config path '\''/var/run/cloudera-scm-server/krb53377829653236465405.conf'\'', contents below:' + cat /var/run/cloudera-scm-server/krb53377829653236465405.conf + IFS=' ' + read -a ENC_ARR + ktutil + for ENC in '"${ENC_ARR[@]}"' + echo 'addent -password -p USERNAME-REDACTED -k 1 -e rc4-hmac' + '[' 0 -eq 1 ']' + echo PASSWORD-REDACTED + echo 'wkt /var/run/cloudera-scm-server/cmf4648265406807175091.keytab' + chmod 600 /var/run/cloudera-scm-server/cmf4648265406807175091.keytab + kinit -k -t /var/run/cloudera-scm-server/cmf4648265406807175091.keytab USERNAME-REDACTED kinit: KDC has no support for encryption type while getting initial credentials
Any ideas what I should try?
... View more
08-02-2020
02:03 AM
Thank you for your support, it worked.
... View more
07-25-2020
03:40 PM
Im trying to install the trial version of CDP Data Center on my linux (ubuntu 18.04) virtual machine. So i followed the instructions/commands provided on the Cloudera website. 1- $ wget https://archive.cloudera.com/cm7/7.1.1/cloudera-manager-installer.bin 2- $ chmod u+x cloudera-manager-installer.bin 3- $ sudo ./cloudera-manager-installer.bin Once i have executed the 3rd instruction, the installation starts then i get the following error: Refreshing repository metadata failed. See /var/log/cloudera-manager-installer/2.refresh-repo.log for details. Click OK to revert this installation. And this is what's on that log file: Atteint :1 http://fr.archive.ubuntu.com/ubuntu bionic InRelease Atteint :2 http://fr.archive.ubuntu.com/ubuntu bionic-updates InRelease Atteint :3 http://security.ubuntu.com/ubuntu bionic-security InRelease Atteint :4 http://fr.archive.ubuntu.com/ubuntu bionic-backports InRelease Ign :5 https://archive.cloudera.com/cm7/7.1.1/ubuntu1804/apt bionic-cm7.1.1 InRelease Err :6 https://archive.cloudera.com/cm7/7.1.1/ubuntu1804/apt bionic-cm7.1.1 Release 404 Not Found [IP : 151.101.240.167 443] Lecture des listes de paquets… E: Le dépôt https://archive.cloudera.com/cm7/7.1.1/ubuntu1804/apt bionic-cm7.1.1 Release n'a pas de fichier Release. Any ideas what I should try?
... View more
Labels: