Member since
02-14-2017
11
Posts
5
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1563 | 02-14-2017 02:36 PM |
02-15-2018
03:52 PM
I am trying to update my hbase under ambari from version 1.1.2 to 1.1.4 after several searches, i concluded that it s not possible to upgrade only hbase but all the ambari should be upgraded. some articles are talking about a patch to apply to do the upgrade. what are these patches and where to apply it? if it is possible can i have the one to perform hbase upgrade?
... View more
Labels:
01-22-2018
10:31 AM
I am facing the same problem listed above, but i couldn't solve it. i have the same error output. i want to mention that i am assigning FQDN to the hosts. i visited all links but it was not helpful
... View more
11-16-2017
09:13 AM
Hello, i am executing a storm topology in which i have two hbase bolt to insert data. In storm UI, hbase bolt has a process latency (normally it is the write latency) bigger then the value shown in hbase ambari metrics. see pictures below. is this difference normal?
... View more
Labels:
10-27-2017
02:53 PM
Hello, i am using 3 virtual server (16 core / 56 Go Ram / 1 TO ) to setup a kafka cluster. i installed a broker on two of them. i have created a topic with two partitions. my objectif is to attend 1 000 000 messages / second. until now i am between 150 000 m/s and 204 000 m/s batch size: 8k (8192) message size: 300b (0.3 ko) compression codec: none thread num: 1 please find bellow producer configuration: request.required.acks=1 queue.buffering.max.ms=0 compression.codec=none queue.buffering.max.messages=100000 send.buffer.bytes=100000000 Any help will be appreciated to get 1 000 000 m / s thank you
... View more
Labels:
05-15-2017
08:09 PM
I have a Storm topology running in a distributed environment across 5 linux nodes. i have one nimbus and 4 supervisors. I have a Kafka Spout that receives a message and then forwards it into a ParseBolt that will parse the raw message and send it to a prediction bolt then to a hbase bolt. the prediction bolt is a python 2.7 bolt. my major problem is that this topology takes lot of time to execute prediction bolt and the latency reach 30 minutes sometimes. i have:
24 workers 96 topology.worker.shared.thread.pool.size 6 supervisor ports 40 parallelism_hint (for prediction bolt) 40 num task (for prediction bolt) nimbus.childopts -Xmx2048m supervisor.childopts -Xmx512m ui.childopts -Xmx4096m drpc.childopts -Xmx4096m worker.childopts -Xmx8196m logviewer.childopts -Xmx128m how can i reduce latency and reach a real time prediction bolt. Any help will be appreciated
... View more
Labels:
02-28-2017
04:11 PM
Hello, how can i upgrade phoenix in my ambari cluster? ambari version 2.2.2 hadoop version 2.4.3.0-227 Thank you
... View more
Labels:
02-14-2017
02:36 PM
4 Kudos
I found the source of the problem and i solved it! i was using public ip in my hosts file. as Azure doesn't allow binding on public ip so it was impossible to start services. i changed all to private IP and the issue is solved. thanks for your help
... View more
02-14-2017
01:19 PM
@Sagar Shimpi Hello, - that bug was solved in the version i am using (2.2.2) - iptables are disabled and so selinux - hostname and hostname -f have the same output "namenode". - i restarted the machine but the issue is the same.
... View more
02-14-2017
11:22 AM
1 Kudo
Hello, i have installed ambari 2.2.2 on Centos 6.8 Azure platform. i ve installed services i need successfully, but when i want to start them, zookeeper starts fine, but HDFS does not! here is the log of /var/log/hadoop/hdfs/hadoop-hdfs-namenode-namenode.log: 2017-02-14 11:00:21,714 ERROR namenode.NameNode (NameNode.java:main(1714)) - Failed to start namenode.
java.net.BindException: Port in use: namenode:50070
at org.apache.hadoop.http.HttpServer2.openListeners(HttpServer2.java:919)
at org.apache.hadoop.http.HttpServer2.start(HttpServer2.java:856)
at org.apache.hadoop.hdfs.server.namenode.NameNodeHttpServer.start(NameNodeHttpServer.java:156)
at org.apache.hadoop.hdfs.server.namenode.NameNode.startHttpServer(NameNode.java:892)
at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:720)
at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:951)
at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:935)
at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1641)
at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1709)
Caused by: java.net.BindException: Cannot assign requested address
at sun.nio.ch.Net.bind0(Native Method)
at sun.nio.ch.Net.bind(Net.java:433)
at sun.nio.ch.Net.bind(Net.java:425)
at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)
at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
at org.mortbay.jetty.nio.SelectChannelConnector.open(SelectChannelConnector.java:216)
at org.apache.hadoop.http.HttpServer2.openListeners(HttpServer2.java:914)
... 8 more
2017-02-14 11:00:21,715 INFO util.ExitUtil (ExitUtil.java:terminate(124)) - Exiting with status 1
2017-02-14 11:00:21,718 INFO namenode.NameNode (LogAdapter.java:info(47)) - SHUTDOWN_MSG: i want to mention that the port 50070 is not in use, cause the following command does not return any line. netstat -tulpn | grep :50070 Also, i have changed the port number to 50071, restarted everything, but the issue was not solved. Any help will be appreciated thank you
... View more
Labels: