About anubhav_r_raika

anubhav_r_raika · ‎02-08-2017

whoaaa.. yes.. it works.. good to know the order matters.. thank you!

anubhav_r_raika · ‎02-08-2017

I have a table dept_tbl in HBase with 1 Column Family and 3 columns in it cf1:dept_city, cf1:dept_name, cf1:dept_no ------- I want to filter a column say dept_no and get the corresponding dept_name for it Like: if dept_no=10, return dept_name=ACCOUNTING ------- I applied filter as below: scan 'dept_tbl',{FILTER => "MultipleColumnPrefixFilter('dept_name','dept_no') AND SingleColumnValueFilter('cf1','dept_no',=, 'binary:10')"} ------- This returns me 2 columns: 'dept_name' and 'dept_no' I need only 1 column 'dept_name' to be returned ------- If I use MultipleColumnPrefixFilter('dept_name').. it gives me all rows as if it didnt check for filter of dept_no=10 I tried many combinations, I couldnt get it to return single column single row. ------- Script to create the table: create 'dept_tbl','cf1' put 'dept_tbl','R1','cf1:dept_no','10' put 'dept_tbl','R1','cf1:dept_name','ACCOUNTING' put 'dept_tbl','R1','cf1:dept_city','NEW YORK' put 'dept_tbl','R2','cf1:dept_no','20' put 'dept_tbl','R2','cf1:dept_name','RESEARCH' put 'dept_tbl','R2','cf1:dept_city','DALLAS' put 'dept_tbl','R3','cf1:dept_no','30' put 'dept_tbl','R3','cf1:dept_name','SALES' put 'dept_tbl','R3','cf1:dept_city','CHICAGO' put 'dept_tbl','R4','cf1:dept_no','40' put 'dept_tbl','R4','cf1:dept_name','OPERATIONS' put 'dept_tbl','R4','cf1:dept_city','BOSTON'

anubhav_r_raika · ‎01-19-2017

you can use Input port and Output port for this purpose.. Data flow 1 will send data to PG.. Data flow 2 will also send data to the same PG.. this can be done using the Input Port within the PG and if there is any Output from the PG, add Output port as well within the PG.. The number of data flows connecting to this PG = the number of Input ports this PG has..

anubhav_r_raika · ‎01-19-2017

there is no fixed mapping.. might go with Custom Processor to do all the tasks

anubhav_r_raika · ‎01-19-2017

yes, you are right.. even if the attributes get created.. I have no way to further reference them.. I was looking to create statements in PutSQL but yes I wont be able to do it..

anubhav_r_raika · ‎01-18-2017

UpdateAttribute will change the value of the JSON tag.. but it wont change the name of the Tag.. I am looking to change the name of the tag dynamically.. Like suppose in my JSON, i have a tag named CREDIT_FLAG with value 'C'.. I want the name of the tag to change from CREDIT_FLAG to say CR_FL.. assuming the data "CR_FL" is also present in our flow.. ----- and if the above cannot be done, can we create new FlowFile Attributes dynamically? or any other way ----- Summary: Change tag name "CREDIT_FLAG" to "CR_FL" in any possible way using NiFi built in processors ----- Let me know if more clarification is required..

anubhav_r_raika · ‎01-18-2017

Is it possible to use Expression language in UpdateAttribute processor? Not for the Property Value but for the Property Name? My mission is to get Dynamic Tag names.. If my JSON has 2 tags.. say Tag_1 and Tag_2.. I want to change them (tag_name not tag_value) to some other name, can that be done ? OR if existing tag name cannot be renamed, can I add a new tag? but again, the name of the Tag cannot be hardcoded in NiFi..

anubhav_r_raika · ‎01-16-2017

One question.. Does the ID of a Processor or ProcessFlow change if NiFi is rebooted?

anubhav_r_raika · ‎12-22-2016

thank you so so much.. i can enjoy holidays now knowing this has been taken care of.. Happy Holidays to you 🙂 will surely research on Dev Tools

anubhav_r_raika · ‎12-21-2016

where can I get this entire documentation? What if I want to run a Process-Group ?

anubhav_r_raika · ‎12-21-2016

Got it here: https://community.hortonworks.com/questions/64771/unable-to-updateexecute-processor-though-nifi-rest.html

anubhav_r_raika · ‎12-21-2016

this should help : https://community.hortonworks.com/questions/64771/unable-to-updateexecute-processor-though-nifi-rest.html

anubhav_r_raika · ‎12-21-2016

thank you so much.. i had issues with this curl dude.. had been searching for the correct command for over 3 days.. its working now.. 😄

anubhav_r_raika · ‎12-21-2016

Hi Matt, I am working on this "curl" stuff but getting an error. I am using NiFi 1.0 Can you please see the below statements and let me know what I am missing? This works fine: curl -i -X GET http://localhost:8080/nifi-api/processors/1b943f28-3803-15dd-aec4-d362e560fbaf/state It gives a json as expected. ............................ This does not work: curl -i -X PUT -H 'Content-Type: application/json' -d '{"version":27,"clientId":"ddf4a732-0158-1000-419b-512493387a32"},"processors":{"id":"1b943f28-3803-15dd-aec4-362e560fbaf","state":"RUNNING"}' http://localhost:8080/nifi-api/processors/1b943f28-3803-15dd-aec4-d362e560fbaf/ This gives: HTTP/1.1 400 Bad Request Date: Wed, 21 Dec 2016 05:50:43 GMT Content-Type: text/plain Transfer-Encoding: chunked Server: Jetty(9.3.9.v20160517) Message body is malformed. Unable to map into expected format.

anubhav_r_raika · ‎12-16-2016

with your script, i wont even need to use Put and Fetch processors.. Just call ExecuteScript and let it add / update / delete from the CacheServer.. Thank you very much for your quick reply 😄

anubhav_r_raika · ‎12-15-2016

I am using the PUT and FETCH processors to work with Cache in NiFi.. Things are working fine for Inserts and Updates to data. However, if a data row is deleted at the source.. How do i make NiFi Cache understand that this row no longer exists in the source and should be deleted from the Cache. I see a function "remove" in DistributedMapCacheClient.java .. How do i use the remove functionality? Anyone having an idea please let me know.

anubhav_r_raika · ‎12-05-2016

any thoughts on how to clear this DMC cache.. Suppose I have 4 entries in DEPT_LKP table.. DEPT_NO 10, 20, 30, 40 get loaded to DMC.. in Future if i delete DEPT_NO 20 entry from source table.. DMC wont delete it from the cache.. worse part is.. it will use the cached value of DEPT_NO 20..

anubhav_r_raika · ‎12-05-2016

I tried one more time and it worked for me.. thanks!

anubhav_r_raika · ‎12-02-2016

yeah thanks.. append works.. \\n (double backslash) doesnt.. I was doing this while writing count to file.. it now works.. The count is: ${executesql.row.count:append('\n')}

anubhav_r_raika · ‎12-02-2016

Hi Timothy, I am trying to Lookup with Cache method. Load the lookup values into the DistributedMapCache and use them for replacements PutDistributedMapCache FetchDistributedMapCache ----------- It doesnt seem to be working for me. When i try to compare values between 2 flows.. it doesnt compare them. I have a RouteOnAttribute which uses an Expression like this: ${DEPT_NO:equals(${LKP_DEPT_NO})} It doesnt send out anything. I checked the UpStream queues. They have correct values. Can you please suggest how to compare the incoming attributes from 2 flows?

anubhav_r_raika · ‎11-23-2016

did you find anything on this?

anubhav_r_raika · ‎11-23-2016

Hi, So what is the workaround if I dont want to update my NiFi version. Can we use any other processor for this rule/condition stuff?

Online	Offline
Last Visited	‎02-08-2017 01:47 PM

Date Registered	‎11-23-2016 08:17 AM
Last Visited	‎02-08-2017 01:47 PM
Total Messages Posted	25
Total Kudos Received	6

Re: How to fetch single column from HBASE table

How to fetch single column from HBASE table

Re: Referencing and reusing a single instance of a...

Re: How to Add Dynamic Tags in NiFi

Re: How to Add Dynamic Tags in NiFi

Re: How to Add Dynamic Tags in NiFi

How to Add Dynamic Tags in NiFi

Re: Update NiFi Flow On-the-Fly via API

Re: Unable to update/execute processor though NIF...

Re: Unable to update/execute processor though NIF...

Re: How can we schedule nifi data flow ?

Re: Using the NIFI REST API to execute a data flow...

Re: Unable to update/execute processor though NIF...

Re: How can we schedule nifi data flow ?

Re: How to delete from NiFi DistributedMapCache

How to delete from NiFi DistributedMapCache

Re: DistributedMapCacheClientService (NiFi Wecrawl...

Re: ETL lookup transformation equivalent in Nifi

Re: Apache Nifi - Adding attributes as newlines Fl...

Re: ETL lookup transformation equivalent in Nifi

Re: ETL lookup transformation equivalent in Nifi

Re: Unable to save when using Advance setting in N...