About chortels

akhilsnaik · ‎07-19-2019

Hi @CarlosHS, inorder to perform CURL/REST APi with Nifi, you might need a access token , as per blog : following command will get you the access token curl 'https://nifi-host:port/nifi-api/access/token' -H 'Content-Type: application/x-www-form-urlencoded; charset=UTF-8' --data 'username=ldap-username&password=ldap-password' --compressed —insecure Later this token need to be reused for all operations like : curl -k ’https://nifi-host:port/nifi-api/flow/process-groups/root/status' -H “Authorization: Bearer $token” hope this helps

Wynner · ‎06-27-2019

@CarlosHS Here is a command I used to get a token: curl 'https://nifi-hostname:nifi-port/nifi-api/access/token' -H 'Content-Type: application/x-www-form-urlencoded; charset=UTF-8' --data 'username=username&password=password' --compressed --insecure

Shu_ashu · ‎05-13-2019

@CarlosHS You can use PutCassandraQL processor and extract all content of flowfile using ExtractText processor. Then prepare your insert statement and insert data into cassandra. Refer to this link for more details. (or) If you are having CSV data then You can configure CSV reader(in PutCassandraRecord) value separator which is not separator in data like ~ (or) some other characters not presented in the data. So that processor reads entire data as one value and writes to cassandra table.

chortels · ‎04-29-2019

Hi, I'm writing a Groovy script in which I would like to execute a query to a PostgreSQL database. To do so, I've configured a Controller Service following the instructions here indicated: http://funnifi.blogspot.com/2016/04/sql-in-nifi-with-executescript.html, and here you can see my own configuration: Later, I've followed the instructions to reference this controller from the groovy script. Specifically, this are the lines that I have added to my script: def lookup = context.controllerServiceLookup def dbServiceName = databaseConnectionPoolName.value def dbcpServiceId = lookup.getControllerServiceIdentifiers(ControllerService).find { cs -> lookup.getControllerServiceName(cs) == dbServiceName } def conn = lookup.getControllerService(dbcpServiceId).getConnection() Anyway, I'm receiving a "Cannot invoke method getConnection() on null object". Trying to debug to get to the problem, I've substituted dbcpServiceId in line def conn = lookup.getControllerService(dbcpServiceId).getConnection() with its literal value, so my line turns this way: def conn = lookup.getControllerService('6966346c-016a-1000-51f5-283beccda10c').getConnection(). Unfortunately, the result is the same. How can a controller service be null, and which could be the solution? Thanks for your help.

ask_bill_brooks · ‎04-28-2019

You initially posted this in an inappropriate Track. The

chortels · ‎04-24-2019

Hi @Matt Burgess, I have deleted the "AttributeToJSON" processor I indicated you and now PutCassandraRecord processor doesn't return any error, so this problem has disappeared. Without it, anyway, and setting only this structure: In AttributesToJson I take the field register_date (which is null until that date), because this is the only field I want to put in the database. Then, with UpdateAttribute, I configure register_date as ${now():toNumber()} . At last, I use PutCassandraRecord. I'm obtaining in my database the following record: -294294420. What does this number mean? What if I want to obtain the date in a format of "yyyy-MM-dd", which is the format I was expecting to see? However, I do not understand very well the solution you are proposing (English is not my first language so it will possibly has something to do with that). Which is the structure you are proposing me, and how could I configure the UpdateRecord Processor, to achieve the objective that I have proposed in the previous paragraph? Many thanks for your help.

mburgess · ‎03-25-2019

You can remove fields with any record-based processor, in this case probably ConvertRecord is the most straightforward. You'd use a JsonTreeReader with your incoming schema, and a JsonRecordSetWriter with a schema with the unwanted fields removed. Fields that don't exist in the outgoing schema are not written to the flow file.

chortels · ‎12-30-2018

Hi, Is it possible, with a CASE or IF statement, changing the value of one field depending on the value of another one? I'm doing an exercise in which the next condition is required: If country_code='NULL', the field 'country' must be 'Other' Thank you for your help. Regards.

Shu_ashu · ‎12-26-2018

@CarlosHS Even when we replace columns in hive text table the data will not be changed i.e wikipedia_link data will be still presented in HDFS file. So when we try to access the table hive reads the data with "," delimited and gives wikipedia_link data in place of keywords column. - Steps to drop wikipedia_link column with data: hive> set hive.support.quoted.identifiers=none; hive> create table countries_temp row format delimited fields terminated by ',' stored as textfile as select `(wikipedia_link)?+.+` from countries; //create temp table with out wikipedia_link columnhive> drop table countries; //drop countries table hive> alter table countries_temp rename to countries; //rename temp table to countries. (or) Another way would be creating a view without wikipedia_link column. hive> create view vw_countries as select id,code,name,continent,keywords from countries; then accessing data from view instead of countries table.

Online	Offline
Last Visited	‎07-18-2019 10:01 PM

Date Registered	‎12-25-2018 10:07 PM
Last Visited	‎07-18-2019 10:01 PM
Total Messages Posted	13

Re: How can I get the token to use the REST API in...

Re: Get NiFi authentication token in a secured ins...

Re: How can I load an entire flowfile (JSON) in a ...

Why is my NiFi controllerService null?

Re: Error trying to load flow file in Cassandra fr...

Re: How can I insert a date in Cassandra from NiFi...

Re: Getting one json file and transform it with Ni...

How to change the value of one field depending on ...

Re: Problem removing column from Hive table