Cloudera Community
cotopaul
user rank
Guru

Re: How to load data from Azure CosmosDB using Apa...

by Guru in Support Questions
‎07-27-2023 03:02 AM
‎07-27-2023 03:02 AM
@Sivaluxanif I am not mistaken, you need to download the JDBC of the database you are using in azure cosmos db. I am no expert in Azure, but as far as I know you have NoSQL, MongoDb, Cassandra, Gremlin and PostgreSQL. You first need to identify the DB you are connecting to, download the JDBC to that specific database and proceed next from there. ... View more

Re: How to load data from Google Big query table u...

by Guru in Support Questions
‎07-12-2023 03:46 AM
‎07-12-2023 03:46 AM
the question is how? 😀 I just tested again and I was able to extract data from (and into) BigQuery without any errors. It seems that something you have defined is not 100% correct. Circling back to my initial post, you would need those defined as: Database Connection URL: jdbc:bigquery://https://www.googleapis.com/bigquery/v2:443;ProjectId=your-project-if-here;OAuthType=0;OAuthServiceAcctEmail=your-email-for-service-account-here;OAuthPvtKeyPath=path_on_nifi_server_where_the_service_account_json_is_located;   Database Driver Class Name: com.simba.googlebigquery.jdbc.Driver Database Driver Location: full_path_to_jars_location/ Where the Database driver location has to be the full path to the folder where you have extracted the JDBC (not ODBC) ZIP File... and you only have to point to the folder, not to a specific JAR file. In addition, pay attention to how the connection URL is configured and make sure that you follow the same structure. Plus, make sure that your SA has all the necessary rights for your actions. ... View more

Re: PutBigQuery inserts null, whereas PutBigQueryB...

by Guru in Support Questions
‎07-10-2023 08:44 AM
‎07-10-2023 08:44 AM
@steven-matisonthanks for you answer:) You can download a template here: download Instead of GenerateFlowFile, I have another processing section, but nevertheless, the relevant part starts with AttributesToJson going up until the PutBigQuery Processors 🙂 ... View more

Re: Stuck loading after login

by Frequent Visitor in Support Questions
‎07-05-2023 03:18 PM
‎07-05-2023 03:18 PM
Oh god. One of my chrome extensions was causing this issue. Dark Reader. Issue solved.  ... View more

Re: Why is there an error on the colon in ${attrib...

by Explorer in Support Questions
‎06-26-2023 03:37 AM
‎06-26-2023 03:37 AM
The issue ended up being that ip is a reserved word (a default function) so changing the name of the attribute from ip to extractedIp solved it. ... View more

Re: Is it possible to reference parameters within ...

by Guru in Support Questions
‎06-26-2023 12:02 AM
‎06-26-2023 12:02 AM
@Carson, Like @joseomjr wrote (but did not gave the entire link by mistake), you should take a look at the following Article as it describes exactly what you need -->  https://community.cloudera.com/t5/Community-Articles/ExecuteScript-Cookbook-part-3/ta-p/249148   Basically, you add the property in your NiFi Processor and reference it to your parameter value and afterwards you call it in your script: myValue1 = myProperty1.getValue()   ... View more

Re: NiFi Optimization Record Oriented Processors

by Guru in Support Questions
‎06-21-2023 07:46 AM
‎06-21-2023 07:46 AM
@drewski7, in this case, have a look at @steven-matison 's answer because that is your solution to your problem. ... View more

Re: Nifi Integration with Microsoft Teams Channel

by Guru in Support Questions
‎06-19-2023 11:44 PM
‎06-19-2023 11:44 PM
@eykf, I never tried to send messages from NiFi to MS Teams but upon reading the documentation, I am not quite sure you need a Webhook URL at all.   MS Teams provides the Graph API to be able to integrate MS Teams into external application: https://learn.microsoft.com/en-us/graph/api/resources/teams-api-overview?view=graph-rest-1.0 Now, assuming that you have the channel and the users already created, my first guess is that you would need only to send the message so basically all you have to do is create the API POST as described in the following link: https://learn.microsoft.com/en-us/graph/api/chatmessage-post?view=graph-rest-1.0&tabs=http   And here are the parameters in case you need a more complex message, than the one described in the above link: https://learn.microsoft.com/en-us/graph/api/resources/chatmessage?view=graph-rest-1.0   ... View more

Re: Embedded zookeeper failing while setting up a ...

by Guru in Support Questions
‎06-19-2023 11:35 PM
‎06-19-2023 11:35 PM
@Fanxxx, First of all, make sure that nothing is running on the port 2182, as this is the port used by the embedded Zookeeper by default. It could be that you changed it, but my initial feeling is that you left it as it is. Secondly, make sure that you wrote the correct zookeeper connection string within state-management.xml and within each nifi.properties. ... View more

Re: [APACHE NIFI] How to extract only the last rec...

by Expert Contributor in Support Questions
‎06-16-2023 07:23 AM
‎06-16-2023 07:23 AM
@bhadraka    What version of NiFi are you using? In NiFi 1.20.0, you can use ReplaceText Processor after reading in the file.    Using the line-by-line evaluation mode, there is a drop down "Except-Last-Line". You could then configure it to just replace all previous lines with empty strings. Here's a screenshot of my ReplaceText processor properties.   ... View more
Contact Me
Online
Offline
Last Visited
‎03-14-2024 06:37 AM
Community Statistics
Member Since ‎01-27-2023 08:25 AM
Last Visited ‎03-14-2024 06:37 AM
Posts 229
Kudos received 74