About VidyaSargur

VidyaSargur · ‎09-28-2021

@roshanbi Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future.

VidyaSargur · ‎09-27-2021

@nareshbattula, Has any of the replies helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future.

MattWho · ‎09-22-2021

@wbivp I created a community article long ago that details the Ranger based "NiFi Resource Identifier" policy strings you would use in Ranger to provide various levels of authorization within NiFi. https://community.cloudera.com/t5/Community-Articles/NiFi-Ranger-based-policy-descriptions/ta-p/246586 For example, it you want to grant access so that users can access and create components within a PG: /process-groups/<uuid of PG> . Grant Read and Write for your "group" and/or "user" to allow them to view configurations and added components (processors, controller services, child PGs, etc...) within this PG /data/process-groups/<uuid of PG> Granting Read and Write for your "group" and/or "user" to allow user to view and delete content (flowfiles) queued within connection within this PG. Keep in mind that child PGs will inherit the access granted to the parent PG unless explicit policies have been set on the child PG. Hope this helps, Matt

VidyaSargur · ‎09-21-2021

English Translation: Question: How to transform a JSON into multiple flow files? Ex: how to generate through this Json below and generate 4 flow files? [ { "ID_WA_REcipient" : "5599999999999", "DES_MENS_NMO" : "You are receiving the 1st copy of your invoice.", "COD_IDEN_MENS_ENV_NMO" : "xptoqwerzxcv" }, { "ID_WA_REcipient" : "5599999999999", "DES_MENS_NMO" : "You are receiving the 1st copy of your invoice.", "COD_IDEN_MENS_ENV_NMO" : "xptoqwerzxcvb" }, { "ID_WA_REcipient" : "5599999999999", "DES_MENS_NMO" : "You are receiving the 1st copy of your invoice.", "COD_IDEN_MENS_ENV_NMO" : "xptoqwerzxcvc" }, { "ID_WA_REcipient" : "5599999999999", "DES_MENS_NMO" : "You are receiving the 1st copy of your invoice.", "COD_IDEN_MENS_ENV_NMO" : "xptoqwerzxcvd" }] Solution You will use the SplitJson processor and in the property "JsonPath Expression" you will put "$" (without quotes).

VidyaSargur · ‎09-21-2021

Here are some highlights from the month of August: Top Activities 350+ new support questions 9 new community articles 800+ new members Top Trending Labels Rank Top Labels No. of Views 1 Apache Hive 233,001 2 Apache NiFi 186,354 3 Apache Hadoop 138,748 4 Apache Spark 131,459 5 Hortonworks Data Platform (HDP) 65,042 Top Trending Community Articles Rank Community Article Author Components/ Labels #1 Autoscale File Processing - A Disciplined Approach @sunile_manjee Apache Spark Cloudera Data Engineering (CDE) Cloudera DataFlow (CDF) #2 Spark Ozone Integration in CDP @RangaReddy Apache Spark #3 Browse ADSL storage in CML @ledel Cloudera Data Science Workbench (CDSW) #4 Cloud in a Big Data world @DennisJaheruddi Cloudera Essentials #5 Using Fine-Grained Authorization in Kudu with Ranger and Impala/Kudu integration @rblough Apache Impala Apache Kudu Apache Ranger Cloudera Data Platform (CDP) Our Leaderboards We would like to recognize the below community members and employees for their efforts over the last month to provide community solutions. See all our top participants at Top Solution Authors leaderboard and all the other leaderboards on our Leaderboards and Badges page. Rank Community Member Solutions Authored Employee Solutions Authored #1 @Shelton 3 @MattWho 7 #2 @Green_ 1 @Shifu 7 #3 @tarekabouzeid91 1 @GangWar 5 #4 @RonyA 1 @ask_bill_brooks 3 Community Member Spotlight Congratulations to @hegdemahendra for being the Community Member Spotlight on the Cloudera LinkedIn Channel. Thank you for your contributions Mahendra! Also, Congratulations to our own employee members @DennisJaheruddi being featured on the Cloudera LinkedIn channel: Unanswered Questions Share your expertise and answer some of the below open questions. Also, be sure to bookmark the unanswered question page to find additional open questions. Unanswered Post Components/ Labels Copy between clusters - multiple fault with using distcp command Cloudera Data Platform (CDP) Cloudera Data Platform Private Cloud (CDP-Private) Control Ranger User Exclude/Deny Conditions in Hue Hive Query on CDP Issue. Apache Hive Apache Ranger Cloudera Data Platform (CDP) Cloudera Enterprise Data Hub Cloudera Hue Storing dataframe into HBase using Spark Apache HBase Apache Spark Parquet to Oracle using NiFi replace NaN Apache NiFi Connection to Kafka on CDH 6.2.1 with .net confluent drivers Apache Kafka Cloudera Enterprise Data Hub

VidyaSargur · ‎09-21-2021

Hi @dv_conan Has any of the replies helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future. If you are still experiencing the issue, can you provide the information that is requested?

npr20202 · ‎09-19-2021

This time we did show table stats and show column stats on the table before the issue ( just after the restart and before running invalidate metadata) and then after the restart and we do not notice any difference in output but problem reoccurred this time also. To understand the sequence of events : (1) Admin team does patching and restart the cluster (2) application team run a distinct year query and sees out of 31 only 27 rows are present and 4 of the partitions are missing. (3) as a support team, I run show stats which shows all 31 partitions and number of rows in partitions is correct and size also. (4) we run invalidate metadata and refresh (5) support team takes show stats which has same result (6) app team runs they query again and they able to see all 31 partitions. we will work with vendor to get further help.

asish · ‎09-16-2021

@Sayed016 This error occurs if the HDFS files are under replicated. Did you see HDFS is under replicated when the issue occurred? Wait for the HDFS to gets replicated and you can query

sodonnell · ‎09-15-2021

Often this happens as there is a "hidden" character at the end of the file or folder name. For example a line break (\n, \r, etc). If you list the files you can get a clue that is the case as usually the output will look strange with an extra line or something there. You can try running a few commands like the following to see if it matches a file: hdfs dfs -ls $'/path/to/folder\r' hdfs dfs -ls $'/path/to/folder\n' hdfs dfs -ls $'/path/to/folder\r\n' If any of those match, then you can delete the incorrect one with a similar command. If you get no luck with that, then pipe the ls output into "od -c" and it will show the special characters hdfs dfs -ls /path/to/folder | od -c

RangaReddy · ‎09-14-2021

Hi @Seaport As you know, resource managers like yarn, standalone, kubernets will create containers. Internally RMs will use shell script to create containers. Based on resources, it will create one or more containers in the same node.

Online	Online
Last Visited	‎09-16-2026 11:03 PM

Member Since	‎02-07-2019 09:20 PM
Last Visited	‎09-16-2026 11:03 PM
Posts	2,756
Kudos received	224

Cloudera Community

Re: kinit: Preauthentication failed while getting ...

Re: 账号邮箱。之前的被注销了，现在无法接受验证码，无法登录，请问怎么更改账号绑定邮箱

Re: How to change my Account Email Address?

Re: Admin access on cloudera public cloud trial

Re: Change in company name

Re: varchar kudu

Re: How do we identify hive metastore performance ...

Re: Nifi Failed authorization

Re: Como tranformar um JSON em varios flow files?

Sept 2021 Community Highlights

Re: Hue Not working with hive on tez

Re: Impala does not show data accurately after clu...

Re: yRe: [Hive] IOException: Fail to get checksum,...

Re: hdfs has two folder with same names

Re: Do I need to install Python3 on every CDP node...