About oussema

oussema · ‎02-15-2018

I am trying to update my hbase under ambari from version 1.1.2 to 1.1.4 after several searches, i concluded that it s not possible to upgrade only hbase but all the ambari should be upgraded. some articles are talking about a patch to apply to do the upgrade. what are these patches and where to apply it? if it is possible can i have the one to perform hbase upgrade?

oussema · ‎01-22-2018

I am facing the same problem listed above, but i couldn't solve it. i have the same error output. i want to mention that i am assigning FQDN to the hosts. i visited all links but it was not helpful

oussema · ‎11-16-2017

Hello, i am executing a storm topology in which i have two hbase bolt to insert data. In storm UI, hbase bolt has a process latency (normally it is the write latency) bigger then the value shown in hbase ambari metrics. see pictures below. is this difference normal?

oussema · ‎10-27-2017

Hello, i am using 3 virtual server (16 core / 56 Go Ram / 1 TO ) to setup a kafka cluster. i installed a broker on two of them. i have created a topic with two partitions. my objectif is to attend 1 000 000 messages / second. until now i am between 150 000 m/s and 204 000 m/s batch size: 8k (8192) message size: 300b (0.3 ko) compression codec: none thread num: 1 please find bellow producer configuration: request.required.acks=1 queue.buffering.max.ms=0 compression.codec=none queue.buffering.max.messages=100000 send.buffer.bytes=100000000 Any help will be appreciated to get 1 000 000 m / s thank you

oussema · ‎05-15-2017

I have a Storm topology running in a distributed environment across 5 linux nodes. i have one nimbus and 4 supervisors. I have a Kafka Spout that receives a message and then forwards it into a ParseBolt that will parse the raw message and send it to a prediction bolt then to a hbase bolt. the prediction bolt is a python 2.7 bolt. my major problem is that this topology takes lot of time to execute prediction bolt and the latency reach 30 minutes sometimes. i have: 24 workers 96 topology.worker.shared.thread.pool.size 6 supervisor ports 40 parallelism_hint (for prediction bolt) 40 num task (for prediction bolt) nimbus.childopts -Xmx2048m supervisor.childopts -Xmx512m ui.childopts -Xmx4096m drpc.childopts -Xmx4096m worker.childopts -Xmx8196m logviewer.childopts -Xmx128m how can i reduce latency and reach a real time prediction bolt. Any help will be appreciated

oussema · ‎02-28-2017

Hello, How can we connect superset to hbase database. thank you

oussema · ‎02-28-2017

Hello, how can i upgrade phoenix in my ambari cluster? ambari version 2.2.2 hadoop version 2.4.3.0-227 Thank you

oussema · ‎02-14-2017

thanks for the interest, but i ve solved the issue 🙂

oussema · ‎02-14-2017

I found the source of the problem and i solved it! i was using public ip in my hosts file. as Azure doesn't allow binding on public ip so it was impossible to start services. i changed all to private IP and the issue is solved. thanks for your help

oussema · ‎02-14-2017

@Sagar Shimpi Hello, - that bug was solved in the version i am using (2.2.2) - iptables are disabled and so selinux - hostname and hostname -f have the same output "namenode". - i restarted the machine but the issue is the same.

oussema · ‎02-14-2017

Hello, i have installed ambari 2.2.2 on Centos 6.8 Azure platform. i ve installed services i need successfully, but when i want to start them, zookeeper starts fine, but HDFS does not! here is the log of /var/log/hadoop/hdfs/hadoop-hdfs-namenode-namenode.log: 2017-02-14 11:00:21,714 ERROR namenode.NameNode (NameNode.java:main(1714)) - Failed to start namenode. java.net.BindException: Port in use: namenode:50070 at org.apache.hadoop.http.HttpServer2.openListeners(HttpServer2.java:919) at org.apache.hadoop.http.HttpServer2.start(HttpServer2.java:856) at org.apache.hadoop.hdfs.server.namenode.NameNodeHttpServer.start(NameNodeHttpServer.java:156) at org.apache.hadoop.hdfs.server.namenode.NameNode.startHttpServer(NameNode.java:892) at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:720) at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:951) at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:935) at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1641) at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1709) Caused by: java.net.BindException: Cannot assign requested address at sun.nio.ch.Net.bind0(Native Method) at sun.nio.ch.Net.bind(Net.java:433) at sun.nio.ch.Net.bind(Net.java:425) at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223) at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74) at org.mortbay.jetty.nio.SelectChannelConnector.open(SelectChannelConnector.java:216) at org.apache.hadoop.http.HttpServer2.openListeners(HttpServer2.java:914) ... 8 more 2017-02-14 11:00:21,715 INFO util.ExitUtil (ExitUtil.java:terminate(124)) - Exiting with status 1 2017-02-14 11:00:21,718 INFO namenode.NameNode (LogAdapter.java:info(47)) - SHUTDOWN_MSG: i want to mention that the port 50070 is not in use, cause the following command does not return any line. netstat -tulpn | grep :50070 Also, i have changed the port number to 50071, restarted everything, but the issue was not solved. Any help will be appreciated thank you

Online	Offline
Last Visited	‎02-28-2018 03:25 PM

Date Registered	‎02-14-2017 08:28 AM
Last Visited	‎02-28-2018 03:25 PM
Total Messages Posted	11
Total Kudos Received	5

Re: Failed to startup HDFS NameNode

hbase upgrade in ambari 2.6.4 - patch request

Re: Decommissioning Region Server through ambari f...

incoherence values in ambari metrics and storm

How can i improuve kafka performance

storm 1.0.1 - python 2.7 execution latency

Re: Superset (by Airbnb)

Upgrading phoenix from 4.4 to 4.7 ?

Re: Failed to startup HDFS NameNode

Re: Failed to startup HDFS NameNode

Re: Failed to startup HDFS NameNode

Failed to startup HDFS NameNode