Member since
07-03-2018
64
Posts
2
Kudos Received
0
Solutions
07-28-2022
07:31 AM
We are getting this below errors all the time in Hbase Could some give me the suggestions ?
... View more
Labels:
- Labels:
-
Apache HBase
06-12-2019
08:07 PM
I am trying to create the directory with current timestamp as the name of the folder in hdfs what should I use to get the desire output ? Right now my flow is : ListHDFS -----> Updateattribute ----->PutHDFS. any suggestions please ?
... View more
Labels:
- Labels:
-
Apache NiFi
-
Cloudera DataFlow (CDF)
06-12-2019
08:02 PM
Hi @Shu I am trying to create the directory with current time stamp in hdfs and as above I tried but did not work since it doesnt have extract_date what should I use to get the desire output ? Right now my flow is : ListHDFS -----> Updateattribute ----->PutHDFS. any suggestions please ?
... View more
10-12-2018
01:57 PM
@ Jonathan Sneep Thank you so much for help it is working now.....
... View more
10-11-2018
04:47 PM
@Jonathan Sneep https://community.hortonworks.com/articles/87217/change-nifi-flow-using-rest-api-part-1.html as per step 7 I used the below command : curl -X PUT -H 'Content-Type: application/json' -d '{"component":{"id":"1ffd1b86-0165-1000-ffff-ffffe8f36d71","name":"GetFile","config":{"Input Directory":"/tmp/hortontest","Keep Source File":"false"},"revision":{"clientId":"5f10fbca-0166-1000-ae68-13829a991131","version":2}}' http://nifinode:9090/nifi-api/processors/1ffcfa18-0165-1000-ffff-ffffa779f243 Output: Unrecognized field "Input Directory" (class org.apache.nifi.web.api.dto.ProcessorConfigDTO), not marked as ignorable (17 known properties: "yieldDuration", "descriptors", "runDurationMillis", "concurrentlySchedulableTaskCount", "schedulingStrategy", "autoTerminatedRelationships", "customUiUrl", "lossTolerant", "properties", "comments", "schedulingPeriod", "defaultConcurrentTasks", "annotationData", "executionNode", "penaltyDuration", "defaultSchedulingPeriod", "bulletinLevel"]) at [Source: (org.glassfish.jersey.message.internal.ReaderInterceptorExecutor$UnCloseableInputStream); line: 1, column: 105] (through reference chain: org.apache.nifi.web.api.entity.ProcessorEntity["component"]->org.apache.nifi.web.api.dto.ProcessorDTO["config"]->org.apache.nifi.web.api.dto.ProcessorConfigDTO["Input Directory"])
... View more
10-11-2018
03:44 PM
Thanks for quick response Jon. Is the only way I could do that or are any other ways I can modify the processor properties with rest api calls ?
... View more
10-11-2018
02:02 PM
1 Kudo
I have been trying to change the GetFile processor properties (Input Directory,keep resource file...etc) using rest api call but getting below response : Command: curl -i -X PUT -H 'Content-Type: application/json' -d '{"revision":{"version":3,"clientId":"5f10fbca-0166-1000-ae68-13829a991131"},"processor":{"id":"1ffcfa18-0165-1000-ffff-ffffa779f243","parentGroupId":"1fe8ebbf-0165-1000-0000-00003595dafd","config":{"properties":{"Input Directory":"/tmp/hortontest"}}}}' http://node1:9090/nifi-api/controller/process-groups/1fe8ebbf-0165-1000-0000-00003595dafd/processors/1ffcfa18-0165-1000-ffff-ffffa779f243 Output: HTTP/1.1 404 Not Found
Date: Thu, 11 Oct 2018 13:48:40 GMT
X-Frame-Options: SAMEORIGIN
Content-Type: text/plain
Vary: Accept-Encoding
Content-Length: 42
Server: Jetty(9.4.3.v20170317)
The specified resource could not be found.
... View more
Labels:
- Labels:
-
Apache NiFi
-
Cloudera DataFlow (CDF)
09-06-2018
07:37 PM
@Sharath V Yeah sure sharath. Here I have attached the screen shot of my current workflow which is running in the production to get email whenever any processor fails it will alert you with email and the reason.nifi-email-alert.png In attached flow I was tailing my nifi-app.log file with current time and then routing the content if it contains with ERROR. Then I am executing the script for getting the process group name wherever particular processor failed below is the script : def flowFile = session.get()
if(!flowFile) return
processGroupName = context.procNode?.getProcessGroup().getName()
processGroupId = context.procNode?.processGroupIdentifier ?: 'unknown'
flowFile = session.putAttribute(flowFile, 'processGroupName', processGroupName)
flowFile = session.putAttribute(flowFile, 'processGroupId', processGroupId)
session.transfer(flowFile, REL_SUCCESS) And finally I am sending both error message and process group name in the email with attached file.
... View more
08-21-2018
02:15 PM
@Steven Matison Thanks for your quick response and It is working fine now but I have two concerns here: 1.I am getting bunch of emails with same error message rather I would only need one email with all error message. 2.If I include all error message in message body it looks so weird so I am planning to message body contains only "Process Group Name" & "Process Group ID". For process group name I found in HWX blog that ExcuteScript processor will do with below code:
def flowFile = session.get() if(!flowFile)return processGroupName = context.procNode?.getProcessGroup().getName() flowFile = session.putAttribute(flowFile,'processGroupName', processGroupName) session.transfer(flowFile, REL_SUCCESS) Where should I have ExcuteScript processor in my current flow ? (my current flow is :TailFile--->RouteOnContent-->ExtractText-->PutEmail.) How would I configure that my message body contains only "Process Group Name" & "Process Group ID" ? Thanks, Jasthi.
... View more