Member since
03-23-2017
110
Posts
2
Kudos Received
5
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1456 | 06-01-2017 09:30 AM | |
1152 | 05-31-2017 08:41 AM | |
2093 | 05-15-2017 06:15 AM | |
2063 | 05-11-2017 02:40 AM | |
1087 | 05-11-2017 02:36 AM |
07-26-2023
06:51 AM
@SAMSAL This looks like a plausible solution. Let me try it out.
... View more
07-25-2023
07:20 AM
Hi, I have a nifi flow which has 1000's of flow files. Each of the flow file has an impala/hive statement and each of them have different execution times. How do i use control rate processor to trigger next flow file only if the previous flow file has been processed (success/failure of the flow file doesn't matter)?
... View more
07-21-2023
03:37 AM
Hi, Is there any processor to add some text/characters to each line in the flowfile in Nifi. Replace text seems to be more complicated given that the partiton value keeps changing. compute incremental stats mydb.mytable partition (date=2023-07-21); compute incremental stats mydb.mytable partition (name=abc); to compute incremental stats mydb.mytable partition (date='2023-07-21'); compute incremental stats mydb.mytable partition (name='abc'); Note: date=2023-07-21 comes as a complete string from the sys.partitions.part_name table in hive. We will need to add '' to the date.
... View more
Labels:
- Labels:
-
Apache NiFi
05-16-2023
05:04 AM
I have a flowfiles that contains few impala statements and are executed through ExecuteSQL processor in Nifi. When i the flowfile has one statement, it goes fine but when there are multiple statements, nifi processor errors out with invalid syntax. An example of the flow file with multiple
statements is below. Is execute sql the right processor for my requirement?
compute incremental stats raw_db.source_table (ingest_date=2022-12-13); compute incremental stats raw_db.source_table (ingest_date=2023-01-09); compute incremental stats raw_db.source_table (ingest_date=2023-01-10); compute incremental stats raw_db.source_table (ingest_date=2023-01-13); compute incremental stats raw_db.source_table (ingest_date=2023-01-14); compute incremental stats raw_db.source_table (ingest_date=2023-01-18); compute incremental stats raw_db.source_table (ingest_date=2023-01-19); compute incremental stats raw_db.source_table (ingest_date=2023-01-20); compute incremental stats raw_db.source_table (ingest_date=2023-01-22); compute incremental stats raw_db.source_table (ingest_date=2023-01-23); compute incremental stats raw_db.source_table (ingest_date=2023-05-09); compute incremental stats raw_db.source_table (ingest_date=2023-01-11); compute incremental stats raw_db.source_table (ingest_date=2023-01-12); compute incremental stats raw_db.source_table (ingest_date=2023-01-15); compute incremental stats raw_db.source_table (ingest_date=2023-01-16); compute incremental stats raw_db.source_table (ingest_date=2023-01-17); compute incremental stats raw_db.source_table (ingest_date=2023-01-24); compute incremental stats raw_db.source_table (ingest_date=2023-01-25); compute incremental stats raw_db.source_table (ingest_date=2023-01-26); compute incremental stats raw_db.source_table (ingest_date=2023-05-11); compute incremental stats raw_db.source_table (ingest_date=2023-05-12); compute incremental stats raw_db.source_table (ingest_date=2023-05-15); compute incremental stats raw_db.source_table (ingest_date=2023-05-16);
... View more
Labels:
- Labels:
-
Apache Impala
-
Apache NiFi
12-19-2022
08:17 AM
Hi, I'm using CDP Public cloud(7.2.15) with CML (2.0.34-b116) and have a Team created. However, we now want to rename the team name but dont have any option in the UI. Is there any option available through API??
... View more
Labels:
10-31-2022
06:21 AM
@Ninja Try below. The login using credentials: root / hadoop Type the following commands: ambari-admin-password-reset
... View more
10-31-2022
06:11 AM
@Sunilkumarks There is no such monitoring in CDP Public cloud. In CDP Private Cloud maybe you could use cloudera manager and then build your own grafana and dashboards.
... View more
06-01-2018
10:16 AM
Thanks @William Brooks will try that. From my initial checks, it seems working
... View more
05-31-2018
03:27 PM
I'm using kafka 0.11. I'm trying to reset the offset of a topic in a consumer group but don't see consistency among the option. How is the offset calculated for different options in kafka-consumer-groups ? user1@xxxxxxxxxxxx:~$ kafka-consumer-groups.sh --bootstrap-server xxxxxxxxxxxx.devkafka.com:9092 --group testgroup --reset-offsets--by-duration PT1H30M0S--topic Test_Upgrade --export --command-config client.properties 2>/dev/null Test_Upgrade,1,615 Test_Upgrade,0,625 user1@xxxxxxxxxxxx:~$ dateThu May 31 15:30:45 BST 2018 user1@xxxxxxxxxxx:~$ kafka-consumer-groups.sh --bootstrap-server xxxxxxxxxxxx.devkafka.com:9092 --group testgroup --reset-offsets--to-datetime 2018-05-31T14:00:00.000--topic Test_Upgrade --export --command-config client.properties 2>/dev/null Test_Upgrade,1,754 Test_Upgrade,0,772
... View more
Labels:
- Labels:
-
Apache Kafka
05-22-2018
02:25 PM
I had to clean my zookeeper data directory and recreate the __consumer_offsets topic
... View more