Member since
03-04-2020
6
Posts
0
Kudos Received
0
Solutions
11-17-2020
04:45 AM
@stevenmatison Thanks for your reply! In my use case, I will not be updating/uploading any nifi templates. I will be only updating my custom processor to include a controller service(which is already present as part of the existing template at the root level) and deploy the NAR. I need to find a way to pass this controller service name to the custom processor as a default value, so that after the NAR deployment, already existing templates automatically picks the controller services without any need to modify the existing templates to include the controller services. Is it possible to do it? Thanks & Regards, R.Rohit
... View more
11-16-2020
01:08 AM
Hi Team,
I have template running in production. This template has some controller services enabled. I also have some custom processors as part of the template. My requirement is to update the custom processor to include an existing controller service to it. I am able to achieve this requirement, but I have to go and manually select the controller service in the custom processor in order to use it. Below is an example,
First it will show as below Hive Database Connection Pooling Service -> Incompatible Controller Service Configured.
I have to manually go & select controller service from drop down to use , Hive Database Connection Pooling Service -> HiveConnectionPool
Hence I wanted to know if there any mechanism by which I will be able to pass the controller service name by default from the custom processor, so that it can automatically use it, instead of manual intervention?
Thanks,
... View more
Labels:
- Labels:
-
Apache Hive
-
Apache NiFi
03-04-2020
08:34 PM
Any help on the above query?
... View more
03-04-2020
10:04 AM
Hi,
I have a CSV file(Pipe Delimited fields) with 3 columns. The value in the 2nd column has some new lines & quoted string in it as shown below,
"2020-02-23 11:15:39"|"
Hi Craig,
Please approve the standard pricing.
No further amendments made "Legal System."
Justification
-XXX is the sole owner in China
Thank you.
"|"Approved"
I am trying to read the file using "spark read csv" API, but it is not able to read/parse the file correctly. I am using spark 2.3.0 version. Below are the commands used,
val path = "/user/1234/abc.csv"
val inputDf = spark.read.option("delimiter","|").option("wholeFile",true).option("multiline",true).option("header",false).option("inferSchema",false).csv(path)
Could please help me out?
Note:- There is a word within quotes in the second field("Legal System.")
Thanks
... View more
Labels:
- Labels:
-
Apache Spark