Member since
02-03-2016
119
Posts
55
Kudos Received
8
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1332 | 07-04-2018 07:11 AM | |
2529 | 07-04-2018 06:48 AM | |
686 | 06-30-2018 06:50 PM | |
1145 | 04-04-2018 03:07 AM | |
967 | 06-06-2016 07:28 AM |
06-02-2016
06:21 AM
1 Kudo
Hi! I've setup a HDP-2.3.4.7-4 cluster with Ambari 2.2.1. I want to install Hue, but i'm using ubuntu 14.04 OS, and based on this guide, Ubuntu is not supported. But we had an HDP-2.2.0 before installed on Ubuntu 12.04, we have Hue installed and working. Is there a way to install Hue on Ubuntu 14? Thanks in advance!
... View more
Labels:
05-19-2016
07:27 AM
Hi Guys,
I have an issue on Ambari Metrics displaying kafka metrics. It doesnt show kafka metrics but it does have host metrics.
Upon checking on API, it doesn't show any compare to other components.
Please help where to start to fix it. Thank you!
Ambar 2.2.0
HDP-2.3.2
http://metric.server.com:8080/api/v1/clusters/MyCluster/services/KAFKA/components/KAFKA_BROKER {"href": "http://metric.server.com:8080/api/v1/clusters/MyCluster/services/KAFKA/components/KAFKA_BROKER","ServiceComponentInfo": {"category": "MASTER","cluster_name": "MyCluster","component_name": "KAFKA_BROKER","installed_count": 0,"service_name": "KAFKA","started_count": 1,"state": "STARTED","total_count": 1},"host_components": [{"href": "http://metric.server.com:8080/api/v1/clusters/MyCluster/hosts/kafka.server.com/host_components/KAFKA_BROKER","HostRoles": {"cluster_name": "MyCluster","component_name": "KAFKA_BROKER","host_name": "r6r41kafka.manila.exist.com"}}]}
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache Kafka
05-19-2016
03:14 AM
Thanks @yusaku! Tried it and it's working. Just had some issues with some components. They're not working (eg KAFKA). Thanks for the guide!
... View more
05-19-2016
03:10 AM
I'm using kafka-graphite now (still exploring it. :] ). I'm also using grafana to fetch the graphs from graphite. 🙂 http://docs.grafana.org
🙂
... View more
05-19-2016
01:17 AM
I had a same issue yesterday, and it was fixed by changing mode from embedded to distributed as mentioned by @Pradeep kumar, except I did not change the hbase.zookeeper.property.clientPort to 2181. http://docs.hortonworks.com/HDPDocuments/Ambari-2.2.0.0/bk_ambari_reference_guide/content/ams_collector_modes.html
... View more
05-13-2016
01:06 AM
@ovidiu Your kafka version is actually 0.9.0 only. On my cluster, our kafka version is 0.9.0.2.3. It's Kafka 0.9.0 + HDP 2.3
... View more
04-27-2016
08:46 AM
We're currently using HDP 2.3.2. How can we manually upgrade the kafka to 0.9.x? Thank in advance!
... View more
Labels:
- Labels:
-
Apache Kafka
03-23-2016
12:31 AM
Thank you @mclark, for the very detailed answer-recommendation.
We'll try your recommendation today and will post results. Kudos!
... View more
03-23-2016
12:29 AM
Kafka version on HDP 2.3.2 is v0.8.2 as confirmed by Subhasis, Ratish and Dev from Hortonworks.
... View more
03-22-2016
07:41 AM
1 Kudo
Hi All! We're having error logs (see below) on our Nifi 0.4.0 on PutKafka Processor. See our config Mode: Synchronous Memory Max Buffer: 2GB Batch: 50 2016-03-21 23:00:08,269 ERROR [Timer-Driven Process Thread-10] o.apache.nifi.processors.kafka.PutKafka PutKafka[id=7709ebdc-07df-4469-a5a3-2b2ec9b35c26] Successfully sent 2 messages to Kafka but failed to send 1 messages; the last error received was org.apache.kafka.clients.producer.BufferExhaustedException: You have exhausted the 4294967296 bytes of memory you configured for the client and the client is configured to error rather than block when memory is exhausted.: org.apache.kafka.clients.producer.BufferExhaustedException: You have exhausted the 4294967296 bytes of memory you configured for the client and the client is configured to error rather than block when memory is exhausted. Any help is highly appreciated! Thanks in advance!
... View more
Labels:
- Labels:
-
Apache Kafka
-
Apache NiFi
03-15-2016
01:45 AM
Hi @Shishir Saxena I Have 3 brokers. Another info: When 2 brokers are down (logs with ISR Shrinking), the remaining broker will have OOM error. I adjusted the Heap to 2GB.
... View more
03-14-2016
01:22 AM
1 Kudo
Thanks @Neeraj Sabharwal, Will the config I posted will help? I'm still looking for other reasons why my brokers are going down.
... View more
03-10-2016
06:13 AM
4 Kudos
Is there a way to check what user was used to restart/start/stop services on ambari 2.2? I can see events on operations but unable to see which user was used. THanks in advance!
... View more
Labels:
- Labels:
-
Apache Ambari
03-09-2016
02:06 AM
1 Kudo
Sorry for the confusion @Artem Ervits. Thanks for pointing that out. I understand that the new file or sub-dir will automatically copies the default acl. After the upgrade, when creating a new file or subdirectory, parent folder acl were not being copied.
... View more
03-09-2016
01:36 AM
Thanks @Artem Ervits, I'm also reading that guide. I already applied ACL on some hdfs dir, and working properly. Is there a way for the new generated files/dir that will be saved on that dir will also inherit the ACLs without reapplying it? Thanks!
... View more
03-09-2016
01:14 AM
2 Kudos
Is there a way for the new hdfs files/dirs to inherit the parent folder permission and acl? Before we upgrade to HDP-2.3.2, it's perfectly working. Thanks! -MD
... View more
- Tags:
- acl
- Hadoop Core
- HDFS
Labels:
- Labels:
-
Apache Hadoop
03-08-2016
08:02 AM
2 Kudos
I'm seeing a lot in kafka logs with Shrinking and Expanding ISR for partition [TOPIC]. Causing some of the brokers (and partitions) unavailable to producer and consumer clients. I'm now looking at these configs replica.fetch.wait.max.ms=500 replica.lag.time.max.ms=10000 replica.lag.max.messages=4000 Should I set these to higher value? What is the best value for these param? Help is really appreciated. Thanks!
... View more
Labels:
- Labels:
-
Apache Kafka
03-08-2016
12:41 AM
Exactly! Will open another one. Thanks!
... View more
03-08-2016
12:36 AM
It worked! Thanks!
... View more
03-07-2016
09:13 AM
1 Kudo
Thanks again, @Neeraj Sabharwal! I'll try it and will post the result.
... View more
03-07-2016
08:38 AM
2 Kudos
I found this hive conf for 1.2 version. hive.support.sql11.reserved.keywords=false Where should I put it on my Ambari>Hive? Thanks!
... View more
- Tags:
- Hadoop Core
- Hive
Labels:
- Labels:
-
Apache Hive
03-07-2016
05:49 AM
1 Kudo
Thanks @Shishir Saxena. advertised.host.name really helped. Right now, I'm facing another issue when suddenly brokers are not registered on zookeeper. Producers/Consumers are unable to access topics giving errors. I'm still not sure if it's zk and kafka version issue on hdp-2.3.2.
... View more
03-07-2016
03:13 AM
1 Kudo
All brokers are all updated. r6r41kafka.xxx | >>
kafka-broker - 2.3.2.0-2950 r7r41kafka.xxx | >>
kafka-broker - 2.3.2.0-2950
r8r41kafka.xxx | >>
kafka-broker - 2.3.2.0-2950
Thanks again @Neeraj Sabharwal!
... View more
03-07-2016
02:55 AM
1 Kudo
How can I verify if kafka is successfully updated after HDP rolling upgrade?
... View more
03-07-2016
02:05 AM
1 Kudo
Thanks for this post. kudos!
... View more
03-07-2016
01:59 AM
1 Kudo
Thanks @Neeraj Sabharwal! You the man! Do I still need to run the command manually? Sorry just need to clear it out. 🙂
... View more
03-04-2016
11:47 AM
3 Kudos
Fix was to use advertised.host.name instead host.name. THanks!
... View more
03-04-2016
02:29 AM
2 Kudos
Hi ALL! After upgrading to HDP-2.3.2, we're having problems on Kafka. I have 3 brokers. My question is, what should I put on Broker Config "Listeners=?" If I put PLAINTEXT://0.0.0.0:6667 - hostname is not registered to ZK.
If I put PLAINTEXT://host3:6667,PLAINTEXT://host2:6667,PLAINTEXT://host1:6667 - Kafka won't start because it wont access port 6667 being used by other brokers (conflict). The problem, I can't produce and consume messages from kafka. I can create topics and list them okay.
... View more
Labels:
- Labels:
-
Apache Kafka
- « Previous
- Next »