About stevenmatison

stevenmatison · ‎01-20-2020

@VijaySankar In a recent Use Case, I had to connect invokeHttp to an API (https) to get an S3 bucket URL and then to Amazon S3 (https) to download the file. Each InvokeHTTP required its own SSL Context Service and for each I complete the following: Obtain the public SSL certificate from the end point. I use curl, or standard browser to download the cert. Use the cert to make a truststore (JKS) file. Put this truststore on all my NiFi nodes, owned nifi:nifi Put the trustore path, type, and password in the SSL Context Service. Enable Context Service, and test InvokeHTTP Hope this helps get you going...

stevenmatison · ‎01-15-2020

I am going to test it here myself shortly. I have a use case where we are inserting ISO-8601 into Elastic where data ultimately also goes to exernal csv table (wi thout the timestamp). I should be able to quickly validate what is required for a working example. I suspect you are having issues with the after ss parts matching the serde syntax.

stevenmatison · ‎01-15-2020

According to this previous accepted solution: ALTER TABLE table SET SERDEPROPERTIES ("timestamp.formats"="yyyy-MM-dd'T'HH:mm:ss"); Works only in case of Textformat,CSV format tables. If you are having other format table like orc..etc then set serde properties are not got to be working.

stevenmatison · ‎01-13-2020

I believe the best thing to do is jump right in. Start working with Cloudera Products. Complete some demos, join in online training, study documentation, and start creating experience. As an example here are a few things that Solution Architects work on at Cloudera: Install CDH or previous products: CDM, HDP, & HDF. Hadoop Yarn & Map Reduce Spark Kafka Hive & Hive LLAP NiFi, NiFi Registry, & Schema Registry Security (SSL, Encryption, etc) Active Directory, LDAP, and Ranger Other Components: Hbase, Solar, Impala, Zeppelin Cloudera Course List: https://ondemand.cloudera.com/courses Free CDP Essentials: https://www.cloudera.com/about/training/courses/cloudera-essentials-for-cdp.html (free)

stevenmatison · ‎01-12-2020

@Chada Can you share more details regarding any specific errors? This post may have the solution you are looking for: https://community.cloudera.com/t5/Support-Questions/Getting-Unable-to-obtain-listing-of-buckets-org-apache-nifi/td-p/227855

stevenmatison · ‎01-12-2020

@ashishtiw26 Can you show us the configuration of the CSVReader Controller Service, the PutDatabaseRecord Processor, and sample of the contents of a FlowFile before PutDatabaseRecord. Contributors need to see as much information as possible in order to trouble shoot specific error messages.

stevenmatison · ‎01-12-2020

@murali2425 You could build a nifi flow that could “copy” files to guthub. This would need to be done by creating a custom processor or maybe even just ExecuteScript to run a custom python script. Either route you take you would need to make sure that all nifi nodes are setup with permissions to write to the github repo. Then inside of your custom processor or script you would execute the required git commands to commit (“copy”) the file(s).

stevenmatison · ‎01-10-2020

@VijaySankar can you accept my answer (remove localhost) as the solution?

stevenmatison · ‎01-10-2020

Ahh I did not pay attention to that in the original screen shot, just tried to offer the syntax for the json parsing. Glad you got it to work! Isn't learning NiFi fun? I love it.

stevenmatison · ‎01-09-2020

In the routeonattribute proc you use just the ${attribute:equals(‘value’)} that you parsed from evaluatejson proc. Evaluatejson: attribute = $.HR.finance.name RouteOnAttribute ${attribute:equals(‘Murali’)}

Online	Offline
Last Visited	‎06-01-2022 03:47 PM

Name	Steven Matison
Location	Florida
Member Since	‎07-19-2018 04:45 PM
Last Visited	‎06-01-2022 03:47 PM
Posts	613
Kudos received	101

Cloudera Community

Re: Apache nifi - how to convert a file .txt into ...

Re: Apache Nifi - Using PutParquet, the HDFS file ...

Re: How to extract csv column record and used it f...

Re: Could not connect to Distributed Map Cache ser...

Re: NiFi InvokeHTTP POST JSON

Re: Nifi - How to enable mutual certificate authen...

Re: Storing ISO-8601 timestamp in hive

Re: Storing ISO-8601 timestamp in hive

Re: Cloudera Solution Architecture

Re: Nifi not able to load available buckets in nif...

Re: NIFI || Putdatabaserecord processor error ||In...

Re: is it possible to integrate Apache NiFi with G...

Re: Nifi - HandleHttpRequest processor throwing "...

Re: Facing problem while extracting the data from ...

Re: Facing problem while extracting the data from ...