Member since
01-19-2017
3679
Posts
632
Kudos Received
372
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 923 | 06-04-2025 11:36 PM | |
| 1526 | 03-23-2025 05:23 AM | |
| 756 | 03-17-2025 10:18 AM | |
| 2715 | 03-05-2025 01:34 PM | |
| 1802 | 03-03-2025 01:09 PM |
12-18-2018
09:56 AM
@Ankita Ghate The values look correct, I guess you are running ubuntu that's why the path differs a bit from my centos ! Can you start the equivalent of these services and retry service krb5kdc start
service kadmin start Can you share the screenshot of the parameters you are using in the Enabling kerberos wizard ?
... View more
12-17-2018
05:38 PM
@Ankita Ghate Find attached the tokenized version of my files.
... View more
12-17-2018
01:59 PM
@Bhushan Kandalkar I have just validated the process and it works, especially the sqoop import please see attached pdf. I suspect you don't have kafka installed if yes it isn't started HDP 2.6.5.0-292 Ranger plugins all enable except kafka (no kerberos) Kafka running Validate that you have Kafka running I didn't see the below output 18/12/17 13:37:08 INFO kafka.KafkaNotification: ==> KafkaNotification()
18/12/17 13:37:08 INFO kafka.KafkaNotification: <== KafkaNotification()
18/12/17 13:37:08 INFO hook.AtlasHook: Created Atlas Hook
18/12/17 13:37:12 INFO kafka.KafkaNotification: ==>
KafkaNotification.createProducer()
18/12/17 13:37:12 INFO producer.ProducerConfig: ProducerConfig values:
acks = 1
batch.size = 16384
bootstrap.servers = [nanyuki.kenya.ke:6667] Hope that helps, please revert
... View more
12-15-2018
09:03 AM
@haco fayik Can you validate with the below command which will run sequentially the process # sudo yum clean all && yum repolist && sudo yum install -y ambari-server HTH
... View more
12-13-2018
12:01 AM
In the above Architecture, there is no nifi !! Apache NiFi and Apache Kafka are two different tools with different use-cases that may slightly overlap. Combining tools may appear wasteful, as it seems to introduce some overlap in functionality. For example, both NiFi and Kafka provide brokers to connect producers and consumers. However, they do so differently: in NiFi, the bulk of the data flow logic lays not inside the producer/consumer, but lives in the broker, allowing for centralized control. NiFi was built to do one important thing well: data flow management. With both tools combined, NiFi can take advantage of Kafka’s reliable stream data storage, while taking care of the data flow challenges that Kafka was not designed to solve. HTH If you found this answer addressed your question, please take a moment to log
in and click the "accept" link on the answer.
... View more
12-12-2018
11:33 PM
@max mouse YES, you can use Kafka connectors to read from or write to external systems, manage data flow, and scale the system—all without writing new code. The most popular use case is ETL pipelines. Kafka is a perfect tool for building data pipelines as it’s reliable, scalable, and efficient. Check https://www.confluent.io/product/confluent-platform/
... View more
12-12-2018
09:51 PM
@Lior Sela What's your Nifi version? Could you be encountering this issue Issue with the MergeContent Processor when processing Avro files
... View more
12-12-2018
06:26 PM
@Andreas Kühnert You will need to have HBase installed because the error snippet "details=row 'prod.timelineservice.entity' on table 'hbase:meta' at region=hbase:meta," YARN Timeline Service v.2 uses a set of collectors (writers) to write data to the backend storage it uses Apache HBase as the primary backing storage, as Apache HBase scales well to a large size while maintaining good response times for reads and writes. The collectors are distributed and co-located with the application masters to which they are dedicated. On the nodes running the region servers, you should be able to see the software installed on that node. HTH
... View more
12-12-2018
12:14 PM
@Andreas Kühnert Can you share your current architecture single /multi-node? Is your hbase master and regions server up and running? If multi-node havd you installed YARN client of the region server? If not please install the YARN client and retry.
... View more
12-12-2018
09:10 AM
1 Kudo
@Vinay Can you disable the HDP* repos by changing the path enable from 1 to zero see below [HDP-2.6-repo-51]
name=HDP-2.6-repo-51
baseurl=http://10.26.35.16/iso/2.6.5/HDP/centos7/2.6.5.0-292
path=enabled=0
gpgcheck=0'} Then run # yum clean all And try restarting the services through Ambari ,
... View more