Member since
02-07-2019
2690
Posts
235
Kudos Received
30
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1115 | 04-15-2025 10:34 PM | |
3300 | 10-28-2024 12:37 AM | |
1419 | 09-04-2024 07:38 AM | |
3257 | 06-10-2024 10:24 PM | |
1385 | 02-01-2024 10:51 PM |
09-21-2021
10:41 PM
2 Kudos
English Translation:
Question:
How to transform a JSON into multiple flow files?
Ex: how to generate through this Json below and generate 4 flow files?
[ { "ID_WA_REcipient" : "5599999999999", "DES_MENS_NMO" : "You are receiving the 1st copy of your invoice.", "COD_IDEN_MENS_ENV_NMO" : "xptoqwerzxcv" }, { "ID_WA_REcipient" : "5599999999999", "DES_MENS_NMO" : "You are receiving the 1st copy of your invoice.", "COD_IDEN_MENS_ENV_NMO" : "xptoqwerzxcvb" }, { "ID_WA_REcipient" : "5599999999999", "DES_MENS_NMO" : "You are receiving the 1st copy of your invoice.", "COD_IDEN_MENS_ENV_NMO" : "xptoqwerzxcvc" }, { "ID_WA_REcipient" : "5599999999999", "DES_MENS_NMO" : "You are receiving the 1st copy of your invoice.", "COD_IDEN_MENS_ENV_NMO" : "xptoqwerzxcvd" }]
Solution
You will use the SplitJson processor and in the property "JsonPath Expression" you will put "$" (without quotes).
... View more
09-21-2021
03:23 AM
Here are some highlights from the month of August:
Top Activities
350+ new support questions
9 new community articles
800+ new members
Top Trending Labels
Rank
Top Labels
No. of Views
1
Apache Hive
233,001
2
Apache NiFi
186,354
3
Apache Hadoop
138,748
4
Apache Spark
131,459
5
Hortonworks Data Platform (HDP)
65,042
Top Trending Community Articles
Rank
Community Article
Author
Components/ Labels
#1
Autoscale File Processing - A Disciplined Approach
@sunile_manjee
Apache Spark
Cloudera Data Engineering (CDE)
Cloudera DataFlow (CDF)
#2
Spark Ozone Integration in CDP
@RangaReddy
Apache Spark
#3
Browse ADSL storage in CML
@ledel
Cloudera Data Science Workbench (CDSW)
#4
Cloud in a Big Data world
@DennisJaheruddi
Cloudera Essentials
#5
Using Fine-Grained Authorization in Kudu with Ranger and Impala/Kudu integration
@rblough
Apache Impala
Apache Kudu
Apache Ranger
Cloudera Data Platform (CDP)
Our Leaderboards
We would like to recognize the below community members and employees for their efforts over the last month to provide community solutions.
See all our top participants at Top Solution Authors leaderboard and all the other leaderboards on our Leaderboards and Badges page.
Rank
Community Member
Solutions Authored
Employee
Solutions Authored
#1
@Shelton
3
@MattWho
7
#2
@Green_
1
@Shifu
7
#3
@tarekabouzeid91
1
@GangWar
5
#4
@RonyA
1
@ask_bill_brooks
3
Community Member Spotlight
Congratulations to @hegdemahendra for being the Community Member Spotlight on the Cloudera LinkedIn Channel. Thank you for your contributions Mahendra!
Also, Congratulations to our own employee members @DennisJaheruddi being featured on the Cloudera LinkedIn channel:
Unanswered Questions
Share your expertise and answer some of the below open questions. Also, be sure to bookmark the unanswered question page to find additional open questions.
Unanswered Post
Components/ Labels
Copy between clusters - multiple fault with using distcp command
Cloudera Data Platform (CDP) Cloudera Data Platform Private Cloud (CDP-Private)
Control Ranger User Exclude/Deny Conditions in Hue Hive Query on CDP Issue.
Apache Hive Apache Ranger Cloudera Data Platform (CDP) Cloudera Enterprise Data Hub Cloudera Hue
Storing dataframe into HBase using Spark
Apache HBase Apache Spark
Parquet to Oracle using NiFi replace NaN
Apache NiFi
Connection to Kafka on CDH 6.2.1 with .net confluent drivers
Apache Kafka Cloudera Enterprise Data Hub
... View more
09-21-2021
12:55 AM
Hi @dv_conan Has any of the replies helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future. If you are still experiencing the issue, can you provide the information that is requested?
... View more
09-21-2021
12:42 AM
1 Kudo
English Translation:
HI
I install Java after nifi. In nifi properties, edit the nifi.web.https.host field with the instance's private IP. I start Nifi. I look at the log that popped up. And I put the public IP in the browser. And this error message appears:
Could not establish a this site
... View more
09-19-2021
02:24 PM
This time we did show table stats and show column stats on the table before the issue ( just after the restart and before running invalidate metadata) and then after the restart and we do not notice any difference in output but problem reoccurred this time also. To understand the sequence of events : (1) Admin team does patching and restart the cluster (2) application team run a distinct year query and sees out of 31 only 27 rows are present and 4 of the partitions are missing. (3) as a support team, I run show stats which shows all 31 partitions and number of rows in partitions is correct and size also. (4) we run invalidate metadata and refresh (5) support team takes show stats which has same result (6) app team runs they query again and they able to see all 31 partitions. we will work with vendor to get further help.
... View more
09-16-2021
10:06 AM
1 Kudo
@Sayed016 This error occurs if the HDFS files are under replicated. Did you see HDFS is under replicated when the issue occurred? Wait for the HDFS to gets replicated and you can query
... View more
09-15-2021
11:15 PM
1 Kudo
@Ronman as this is an older post, you would have a better chance of receiving a resolution by starting a new thread. This will also be an opportunity to provide details specific to your environment that could aid others in assisting you with a more accurate answer to your question. You can link this thread as a reference in your new post.
... View more
09-15-2021
03:40 AM
1 Kudo
Often this happens as there is a "hidden" character at the end of the file or folder name. For example a line break (\n, \r, etc). If you list the files you can get a clue that is the case as usually the output will look strange with an extra line or something there. You can try running a few commands like the following to see if it matches a file: hdfs dfs -ls $'/path/to/folder\r' hdfs dfs -ls $'/path/to/folder\n' hdfs dfs -ls $'/path/to/folder\r\n' If any of those match, then you can delete the incorrect one with a similar command. If you get no luck with that, then pipe the ls output into "od -c" and it will show the special characters hdfs dfs -ls /path/to/folder | od -c
... View more
09-14-2021
11:38 PM
1 Kudo
Hi @Seaport As you know, resource managers like yarn, standalone, kubernets will create containers. Internally RMs will use shell script to create containers. Based on resources, it will create one or more containers in the same node.
... View more
09-14-2021
10:34 PM
@manikala as this is an older post, you would have a better chance of receiving a resolution by starting a new thread. This will also be an opportunity to provide details specific to your environment that could aid others in assisting you with a more accurate answer to your question. You can link this thread as a reference in your new post.
... View more