Hello,   I'm working on Cloudera Quickstart VM 5.13 with CentOS 6.7. I want to use mongodb but the service won't start, i have this error: Starting mongod: [FAILED]   Here is what i did; I downloaded the rpm files from the Mongo DB Repository  (  https://repo.mongodb.org/yum/redhat/6/mongodb-org/4.4/x86_64/RPMS/  ). Then installed each file with the following command:  sudo   rpm  -i / tmp /mozilla_cloudera0 /fileName;   After that, i  created the MongoDB data and log directories like so: sudo mkdir -p /var/lib/mongo sudo mkdir -p /var/log/mongodb   Then I have set the owner and group of these directories to mongod: sudo chown -R mongod: mongod /var/lib/mongo ​ sudo chown -R mongod: mongod /var/log/mongodb ​   And i finally checked if MongoDB was installed, with this command: mongod --version Here is the result: Build Info: { "version": "4.4.4", "gitVersion": "8db30a63db1a9d84bdcad0c83369623f708e0397", "openSSLVersion": "OpenSSL 1.0.1e-fips 11 Feb 2013", "modules": [], "allocator": "tcmalloc", "environment": { "distmod": "rhel62", "distarch": "x86_64", "target_arch": "x86_64" }   Can anyone help me? ... View more

I'm trying to stream data from twitter to hdfs with Flume, i'm using Cloudera Quickstart VM 5.13, i don't have any error but the destination directory is empty. This is my flume.conf file: TwitterAgent.channels = MemChannel TwitterAgent.sinks = HDFS TwitterAgent.sources.Twitter.type = org.apache.flume.source.twitter.TwitterSource TwitterAgent.sources.Twitter.channels = MemChannel TwitterAgent.sources.Twitter.consumerKey = Sp0ti7peTvFPDJSWMGk2ChMZM TwitterAgent.sources.Twitter.consumerSecret = Cncmq5b6rKxWPb6qNSPkqpzIR7L3EcQ8WUCeG0gX4L9sPIzflN TwitterAgent.sources.Twitter.accessToken = 1370386818609377287-IsLuhCt54wK4T2Ua9Cb0TC14rrs1c5 TwitterAgent.sources.Twitter.accessTokenSecret = AL7oYsVUQXz5KXtQSj0tu36R85MyvAsBjcgktdZD63Ou6 TwitterAgent.sources.Twitter.keywords = hadoop, big data, analytics, bigdata, cloudera, data science, data scientist, business intelligence, mapreduce, data warehouse, data warehousing, mahout, hbase, nosql, newsql, businessintelligence, cloudcomputing TwitterAgent.sinks.HDFS.channel = MemChannel TwitterAgent.sinks.HDFS.type = hdfs TwitterAgent.sinks.HDFS.hdfs.path = hdfs://quickstart.cloudera:8020/user/flume/tweets/ TwitterAgent.sinks.HDFS.hdfs.fileType = DataStream TwitterAgent.sinks.HDFS.hdfs.writeFormat = text TwitterAgent.sinks.HDFS.hdfs.batchSize = 1000 TwitterAgent.sinks.HDFS.hdfs.rollSize = 0 TwitterAgent.sinks.HDFS.hdfs.rollCount = 10000 TwitterAgent.sinks.HDFS.hdfs.rollInterval = 600 TwitterAgent.channels.MemChannel.type = memory TwitterAgent.channels.MemChannel.capacity = 10000 TwitterAgent.channels.MemChannel.transitionCapacity = 100 I'm invoking this command to stream: flume-ng agent --conf ./conf/ -f /home/cloudera/flume.conf -n TwitterAgent​ Please i want to know on which part i'm doing it wrong. Any valuable suggestion is much appreciated. Thanks in advance. ... View more

I'm working on Cloudera Quickstart VM 5.13 and I'm trying to start hadoop; But i'm getting these errors:  Failed to start Hadoop proxyserver. Return value: 1 [FAILED] Failed to start Hadoop secondarynamenode. Return value: 1 [FAILED]   In the log file for the secondarynamenode i have this exception:   HttpServer.start() threw a non Bind IOException java.net.BindException: Port in use: 0.0.0.0:50090 at org.apache.hadoop.http.HttpServer2.openListeners(HttpServer2.java:959) at org.apache.hadoop.http.HttpServer2.start(HttpServer2.java:895) at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.startInfoServer(SecondaryNameNode.java:488) at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.main(SecondaryNameNode.java:691) Caused by: java.net.BindException: Address already in use at sun.nio.ch.Net.bind0(Native Method) at sun.nio.ch.Net.bind(Net.java:444) at sun.nio.ch.Net.bind(Net.java:436) at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:214) at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74) at org.mortbay.jetty.nio.SelectChannelConnector.open(SelectChannelConnector.java:216) at org.apache.hadoop.http.HttpServer2.openListeners(HttpServer2.java:954) ... 3 more Failed to start secondary namenode java.net.BindException: Port in use: 0.0.0.0:50090 at org.apache.hadoop.http.HttpServer2.openListeners(HttpServer2.java:959) at org.apache.hadoop.http.HttpServer2.start(HttpServer2.java:895) at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.startInfoServer(SecondaryNameNode.java:488) at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.main(SecondaryNameNode.java:691) Caused by: java.net.BindException: Address already in use at sun.nio.ch.Net.bind0(Native Method) at sun.nio.ch.Net.bind(Net.java:444) at sun.nio.ch.Net.bind(Net.java:436) at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:214) at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74) at org.mortbay.jetty.nio.SelectChannelConnector.open(SelectChannelConnector.java:216) at org.apache.hadoop.http.HttpServer2.openListeners(HttpServer2.java:954) ... 3 more Exiting with status 1   And this for the proxyserver: Service org.apache.hadoop.yarn.server.webproxy.WebAppProxy failed in state INITED; cause: org.apache.hadoop.yarn.exceptions.YarnRuntimeException: yarn.web-proxy.address is not set so the proxy will not run. org.apache.hadoop.yarn.exceptions.YarnRuntimeException: yarn.web-proxy.address is not set so the proxy will not run. at org.apache.hadoop.yarn.server.webproxy.WebAppProxy.serviceInit(WebAppProxy.java:76) at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107) at org.apache.hadoop.yarn.server.webproxy.WebAppProxyServer.serviceInit(WebAppProxyServer.java:73) at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) at org.apache.hadoop.yarn.server.webproxy.WebAppProxyServer.startServer(WebAppProxyServer.java:132) at org.apache.hadoop.yarn.server.webproxy.WebAppProxyServer.main(WebAppProxyServer.java:115) Service org.apache.hadoop.yarn.server.webproxy.WebAppProxyServer failed in state INITED; cause: org.apache.hadoop.yarn.exceptions.YarnRuntimeException: yarn.web-proxy.address is not set so the proxy will not run. org.apache.hadoop.yarn.exceptions.YarnRuntimeException: yarn.web-proxy.address is not set so the proxy will not run. at org.apache.hadoop.yarn.server.webproxy.WebAppProxy.serviceInit(WebAppProxy.java:76) at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107) at org.apache.hadoop.yarn.server.webproxy.WebAppProxyServer.serviceInit(WebAppProxyServer.java:73) at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) at org.apache.hadoop.yarn.server.webproxy.WebAppProxyServer.startServer(WebAppProxyServer.java:132) at org.apache.hadoop.yarn.server.webproxy.WebAppProxyServer.main(WebAppProxyServer.java:115) Stopping WebAppProxyServer metrics system... WebAppProxyServer metrics system stopped. WebAppProxyServer metrics system shutdown complete. Exiting with status -1 ... View more

I installed Hortonworks Sandbox via Virtualbox. And when i started ambari every service is stopped like you can see in this  screenshot  . I tried to start manually each of the services but nothing happens when i click the start button. And plus, i have many erros in my notifications section as you can see in this  folder . Also this is waht my ambari agent logs looks like. Any idea on how i can resolve this? ... View more

I installed Hortonworks Sandbox via Virtualbox. And when i started ambari every service is stopped like you can see in this screenshot . I tried to start manually each of the service but nothing happens when i click the start button. And plus, i have many erros in my alert section as you can see in this folder. Any idea on how i can resolve this? ... View more

I installed Hortonworks Sandbox via Virtualbox. And when i start ambari every service is red like you can see in this screenshot . Have i missed something or what? i cannot do anything... i'm a beginner with hadoop. ... View more

I succesfully installed Cloudera CDP Data Center on my CentOS7 virtual machine and after installing PostgreSQL i was unable to start the Cloudera Manager Server.   I ran the follwing command: "sudo service cloudera-scm-server start" When i tried to access the Cloudra Manager on localhost:7180 and received: "Firefox can’t establish a connection to the server at localhost:7180".   I checked the server status with the command: "service cloudera-scm-server status -l". I received the following lines: " Redirecting to /bin/systemctl status -l cloudera-scm-server.service ● cloudera-scm-server.service - Cloudera CM Server Service Loaded: loaded (/usr/lib/systemd/system/cloudera-scm-server.service; enabled; vendor preset: disabled) Active: active (running) since Sun 2020-08-09 22:53:58 WAT; 13s ago Process: 6088 ExecStartPre=/opt/cloudera/cm/bin/cm-server-pre (code=exited, status=0/SUCCESS) Main PID: 6090 (java) Tasks: 17 CGroup: /system.slice/cloudera-scm-server.service └─6090 /usr/java/jdk1.8.0_232-cloudera/bin/java -cp .:/usr/share/java/mysql-connector-java.jar:/usr/share/java/oracle-connector-java.jar:/usr/share/java/postgresql-connector-java.jar:lib/* -server -Dlog4j.configuration=file:/etc/cloudera-scm-server/log4j.properties -Dfile.encoding=UTF-8 -Dcmf.root.logger=INFO,LOGFILE -Dcmf.log.dir=/var/log/cloudera-scm-server -Dcmf.log.file=cloudera-scm-server.log -Dcmf.jetty.threshhold=WARN -Dcmf.schema.dir=/opt/cloudera/cm/schema -Djava.awt.headless=true -Djava.net.preferIPv4Stack=true -Dpython.home=/opt/cloudera/cm/python -XX:+HeapDumpOnOutOfMemoryError -Xmx4G -XX:MaxPermSize=256m -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/tmp -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:OnOutOfMemoryError=kill -9 %p com.cloudera.server.cmf.Main Aug 09 22:54:11 localhost.localdomain cm-server[6090]: Caused by: java.net.ConnectException: Connexion refusée (Connection refused) Aug 09 22:54:11 localhost.localdomain cm-server[6090]: at java.net.PlainSocketImpl.socketConnect(Native Method) Aug 09 22:54:11 localhost.localdomain cm-server[6090]: at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) Aug 09 22:54:11 localhost.localdomain cm-server[6090]: at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) Aug 09 22:54:11 localhost.localdomain cm-server[6090]: at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) Aug 09 22:54:11 localhost.localdomain cm-server[6090]: at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) Aug 09 22:54:11 localhost.localdomain cm-server[6090]: at java.net.Socket.connect(Socket.java:607) Aug 09 22:54:11 localhost.localdomain cm-server[6090]: at org.postgresql.core.PGStream.<init>(PGStream.java:68) Aug 09 22:54:11 localhost.localdomain cm-server[6090]: at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:144) Aug 09 22:54:11 localhost.localdomain cm-server[6090]: ... 13 more "   Any ideas how i can fix this? ... View more

I just installed trial version of CDP Data Center on my CentOS7 virtual machine; I was able to connect to the cloudera manager and the first thing that was asked of me was to install a working KDC and I chose to install MIT KDC. After the installation i proceed the configuration of Kerberos and at the end i received the following error: kinit: KDC has no support for encryption type while getting initial credentials.   This is the complete error message: /opt/cloudera/cm/bin/import_credentials.sh failed with exit code 1 and output of << + export PATH=/usr/kerberos/bin:/usr/kerberos/sbin:/usr/lib/mit/sbin:/usr/sbin:/usr/lib/mit/bin:/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin + PATH=/usr/kerberos/bin:/usr/kerberos/sbin:/usr/lib/mit/sbin:/usr/sbin:/usr/lib/mit/bin:/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin + KEYTAB_OUT=/var/run/cloudera-scm-server/cmf4648265406807175091.keytab + USER=USERNAME-REDACTED + passwd=BUNDLE-REDACTED KVNO=1 + SLEEP=0 + RHEL_FILE=/etc/redhat-release + '[' -f /etc/redhat-release ']' + set +e + grep Tikanga /etc/redhat-release + '[' 1 -eq 0 ']' + '[' 0 -eq 0 ']' + grep 'CentOS release 5' /etc/redhat-release + '[' 1 -eq 0 ']' + '[' 0 -eq 0 ']' + grep 'Scientific Linux release 5' /etc/redhat-release + '[' 1 -eq 0 ']' + set -e + '[' -z /var/run/cloudera-scm-server/krb53377829653236465405.conf ']' + echo 'Using custom config path '\''/var/run/cloudera-scm-server/krb53377829653236465405.conf'\'', contents below:' + cat /var/run/cloudera-scm-server/krb53377829653236465405.conf + IFS=' ' + read -a ENC_ARR + ktutil + for ENC in '"${ENC_ARR[@]}"' + echo 'addent -password -p USERNAME-REDACTED -k 1 -e rc4-hmac' + '[' 0 -eq 1 ']' + echo PASSWORD-REDACTED + echo 'wkt /var/run/cloudera-scm-server/cmf4648265406807175091.keytab' + chmod 600 /var/run/cloudera-scm-server/cmf4648265406807175091.keytab + kinit -k -t /var/run/cloudera-scm-server/cmf4648265406807175091.keytab USERNAME-REDACTED kinit: KDC has no support for encryption type while getting initial credentials   Any ideas what I should try? ... View more