I understand I need to use ExtractText but it does not output anything to executeSQL processor. How do I do that? I have not added anything additional in the config of the ExtractText processor but mapped both matched and unmatched queue to the executSQL processor. WHat do I pass in SQL select query in executeSQL processor? Please suggest. ... View more

I need to have a URL that would be a listener to a web hook. I will register a URL with them and they will be sending GET requests that look like this Fri Aug 11 17:24:13 IST 2017:Code:405, URL:http://serverURL:port/gushupsmslistener?externalId=3380112592180823371-525731073514300237&deliveredTS=1502452450000&status=SUCCESS&cause=SUCCESS&phoneNo=919977545965&grpName=&errCode=000, timetaken:577, EntityId:1014907793, CauseId:3380112592180823371, InternalId:525731073514300237, PhoneNo:919971295965, globalErrCode:000 What is the best way in Nifi to get data from a GET request? Edit: I've set up HandleHttpRequests processor and started it. Gave it an allowed path and the port. Now, I need to get whatever values are there in the query parameters and store those in HDFS. HOw do I extract and store them? If I directly point handleHTTPrequest to putHDFS, It creates an empty file. Besides, what exactly is upstream connection in handlehttpresponse and how do I set it up? ... View more

Starting yesterday, I have faced this problem multiple times with difference queries: What seems wrong here? I am able to figure out nothing here but it is coming up in different queries that used to work just fine. I have checked and temp directory has the required space and my nodes are healthy too. In stderr, I get: INFO : Hadoop job information for Stage-11: number of mappers: 1; number of reducers: 1 INFO : 2017-07-21 15:52:16,549 Stage-11 map = 0%, reduce = 0% INFO : 2017-07-21 15:52:23,783 Stage-11 map = 100%, reduce = 0%, Cumulative CPU 4.23 sec INFO : 2017-07-21 15:52:33,181 Stage-11 map = 100%, reduce = 100%, Cumulative CPU 6.89 sec INFO : MapReduce Total cumulative CPU time: 6 seconds 890 msec INFO : Ended Job = <a href="IP:8888/jobbrowser/jobs/job_1499692338187_45811">job_1499692338187_45811</a> INFO : Starting task [Stage-20:MAPREDLOCAL] in serial mode ERROR : Execution failed with exit status: 1 ERROR : Obtaining error information ERROR : Task failed! Task ID: Stage-20 Logs: ERROR : <a href="http://ec2-35-154-150-43.ap-south-1.compute.amazonaws.com:8888/filebrowser/view=/var/log/hive/hadoop-cmf-CD-HIVE-XCVXskZf-HIVESERVER2-ip-172-31-4-192.ap-south-1.compute.internal.log.out">/var/log/hive/hadoop-cmf-CD-HIVE-XCVXskZf-HIVESERVER2-ip-172-31-4-192.ap-south-1.compute.internal.log.out</a> ERROR : FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.mr.MapredLocalTask INFO : MapReduce Jobs Launched: INFO : Stage-Stage-1: Map: 1 Reduce: 1 Cumulative CPU: 5.59 sec HDFS Read: 3487128 HDFS Write: 192 SUCCESS INFO : Stage-Stage-7: Map: 1 Reduce: 1 Cumulative CPU: 7.18 sec HDFS Read: 3484698 HDFS Write: 1572 SUCCESS INFO : Stage-Stage-11: Map: 1 Reduce: 1 Cumulative CPU: 6.89 sec HDFS Read: 3484445 HDFS Write: 1568 SUCCESS INFO : Total MapReduce CPU Time Spent: 19 seconds 660 msec INFO : Completed executing command(queryId=hive_20170721155151_da599ee2-d378-46ac-a2b3-a9dfd9824850); Time taken: 70.153 seconds Error: Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.mr.MapredLocalTask (state=08S01,code=1) Closing: 0: jdbc:hive2://ip-172-31-4-192.ap-south-1.compute.internal:10000/default Intercepting System.exit(2) Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.Hive2Main], exit code [2] ... View more