Member since
11-23-2016
25
Posts
6
Kudos Received
0
Solutions
02-08-2017
01:49 PM
whoaaa.. yes.. it works.. good to know the order matters.. thank you!
... View more
02-08-2017
12:25 PM
3 Kudos
I have a table dept_tbl in HBase with 1 Column Family and 3 columns in it cf1:dept_city, cf1:dept_name, cf1:dept_no ------- I want to filter a column say dept_no and get the corresponding dept_name for it Like: if dept_no=10, return dept_name=ACCOUNTING ------- I applied filter as below: scan 'dept_tbl',{FILTER
=> "MultipleColumnPrefixFilter('dept_name','dept_no') AND
SingleColumnValueFilter('cf1','dept_no',=, 'binary:10')"} ------- This returns me 2 columns: 'dept_name' and 'dept_no' I need only 1 column 'dept_name' to be returned ------- If I use MultipleColumnPrefixFilter('dept_name').. it gives me all rows as if it didnt check for filter of dept_no=10 I tried many combinations, I couldnt get it to return single column single row. ------- Script to create the table: create 'dept_tbl','cf1'
put 'dept_tbl','R1','cf1:dept_no','10'
put 'dept_tbl','R1','cf1:dept_name','ACCOUNTING'
put 'dept_tbl','R1','cf1:dept_city','NEW YORK'
put 'dept_tbl','R2','cf1:dept_no','20'
put 'dept_tbl','R2','cf1:dept_name','RESEARCH'
put 'dept_tbl','R2','cf1:dept_city','DALLAS'
put 'dept_tbl','R3','cf1:dept_no','30'
put 'dept_tbl','R3','cf1:dept_name','SALES'
put 'dept_tbl','R3','cf1:dept_city','CHICAGO'
put 'dept_tbl','R4','cf1:dept_no','40'
put 'dept_tbl','R4','cf1:dept_name','OPERATIONS'
put 'dept_tbl','R4','cf1:dept_city','BOSTON'
... View more
Labels:
- Labels:
-
Apache HBase
-
Apache Hive
01-19-2017
11:15 AM
1 Kudo
you can use Input port and Output port for this purpose.. Data flow 1 will send data to PG.. Data flow 2 will also send data to the same PG.. this can be done using the Input Port within the PG and if there is any Output from the PG, add Output port as well within the PG.. The number of data flows connecting to this PG = the number of Input ports this PG has..
... View more
01-19-2017
08:18 AM
there is no fixed mapping.. might go with Custom Processor to do all the tasks
... View more
01-19-2017
08:16 AM
yes, you are right.. even if the attributes get created.. I have no way to further reference them.. I was looking to create statements in PutSQL but yes I wont be able to do it..
... View more
01-18-2017
01:28 PM
UpdateAttribute will change the value of the JSON tag.. but it wont change the name of the Tag.. I am looking to change the name of the tag dynamically.. Like suppose in my JSON, i have a tag named CREDIT_FLAG with value 'C'.. I want the name of the tag to change from CREDIT_FLAG to say CR_FL.. assuming the data "CR_FL" is also present in our flow.. ----- and if the above cannot be done, can we create new FlowFile Attributes dynamically? or any other way ----- Summary: Change tag name "CREDIT_FLAG" to "CR_FL" in any possible way using NiFi built in processors ----- Let me know if more clarification is required..
... View more
01-18-2017
11:34 AM
Is it possible to use Expression language in UpdateAttribute processor? Not for the Property Value but for the Property Name? My mission is to get Dynamic Tag names..
If my JSON has 2 tags.. say Tag_1 and Tag_2.. I want to change them (tag_name not tag_value) to some other name, can that be done ? OR if existing tag name cannot be renamed, can I add a new tag? but again, the name of the Tag cannot be hardcoded in NiFi..
... View more
Labels:
- Labels:
-
Apache NiFi
01-16-2017
09:14 AM
One question.. Does the ID of a Processor or ProcessFlow change if NiFi is rebooted?
... View more
12-22-2016
01:36 PM
thank you so so much.. i can enjoy holidays now knowing this has been taken care of.. Happy Holidays to you 🙂 will surely research on Dev Tools
... View more
12-21-2016
01:03 PM
where can I get this entire documentation? What if I want to run a Process-Group ?
... View more
12-21-2016
11:58 AM
Got it here: https://community.hortonworks.com/questions/64771/unable-to-updateexecute-processor-though-nifi-rest.html
... View more
12-21-2016
11:57 AM
this should help : https://community.hortonworks.com/questions/64771/unable-to-updateexecute-processor-though-nifi-rest.html
... View more
12-21-2016
11:56 AM
thank you so much.. i had issues with this curl dude.. had been searching for the correct command for over 3 days.. its working now.. 😄
... View more
12-21-2016
09:52 AM
Hi Matt, I am working on this "curl" stuff but getting an error. I am using NiFi 1.0 Can you please see the below statements and let me know what I am missing? This works fine: curl -i -X GET http://localhost:8080/nifi-api/processors/1b943f28-3803-15dd-aec4-d362e560fbaf/state It gives a json as expected. ............................ This does not work: curl -i -X PUT -H 'Content-Type: application/json' -d '{"version":27,"clientId":"ddf4a732-0158-1000-419b-512493387a32"},"processors":{"id":"1b943f28-3803-15dd-aec4-362e560fbaf","state":"RUNNING"}' http://localhost:8080/nifi-api/processors/1b943f28-3803-15dd-aec4-d362e560fbaf/ This gives: HTTP/1.1 400 Bad Request
Date: Wed, 21 Dec 2016 05:50:43 GMT
Content-Type: text/plain
Transfer-Encoding: chunked
Server: Jetty(9.3.9.v20160517)
Message body is malformed. Unable to map into expected format.
... View more
12-16-2016
10:41 AM
with your script, i wont even need to use Put and Fetch processors.. Just call ExecuteScript and let it add / update / delete from the CacheServer.. Thank you very much for your quick reply 😄
... View more
12-15-2016
12:48 PM
1 Kudo
I am using the PUT and FETCH processors to work with Cache in NiFi.. Things are working fine for Inserts and Updates to data. However, if a data row is deleted at the source.. How do i make NiFi Cache understand that this row no longer exists in the source and should be deleted from the Cache. I see a function "remove" in DistributedMapCacheClient.java .. How do i use the remove functionality? Anyone having an idea please let me know.
... View more
Labels:
- Labels:
-
Apache NiFi
12-05-2016
09:56 AM
1 Kudo
any thoughts on how to clear this DMC cache.. Suppose I have 4 entries in DEPT_LKP table.. DEPT_NO 10, 20, 30, 40 get loaded to DMC.. in Future if i delete DEPT_NO 20 entry from source table.. DMC wont delete it from the cache.. worse part is.. it will use the cached value of DEPT_NO 20..
... View more
12-05-2016
09:44 AM
I tried one more time and it worked for me.. thanks!
... View more
12-02-2016
12:06 PM
yeah thanks.. append works.. \\n (double backslash) doesnt.. I was doing this while writing count to file.. it now works.. The count is: ${executesql.row.count:append('\n')}
... View more
12-02-2016
09:40 AM
Hi Timothy, I am trying to Lookup with Cache method. Load the lookup values into the DistributedMapCache and use them for replacements
PutDistributedMapCache FetchDistributedMapCache ----------- It doesnt seem to be working for me. When i try to compare values between 2 flows.. it doesnt compare them. I have a RouteOnAttribute which uses an Expression like this: ${DEPT_NO:equals(${LKP_DEPT_NO})} It doesnt send out anything. I checked the UpStream queues. They have correct values. Can you please suggest how to compare the incoming attributes from 2 flows?
... View more
11-23-2016
09:35 AM
did you find anything on this?
... View more
11-23-2016
08:19 AM
Hi, So what is the workaround if I dont want to update my NiFi version. Can we use any other processor for this rule/condition stuff?
... View more