Member since
02-01-2022
255
Posts
84
Kudos Received
56
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
689 | 12-07-2023 04:50 AM | |
387 | 12-05-2023 06:22 AM | |
711 | 11-28-2023 10:54 AM | |
513 | 11-28-2023 06:01 AM | |
1263 | 11-28-2023 05:55 AM |
03-27-2023
06:24 AM
@bennour This error is an issue with your database endpoint ssl. My first suggestion is to use the following arugment in your sqoop command: useSSL=false then if this doesn't work, focus on getting a proper ssl certificate for the host.
... View more
03-21-2023
06:10 AM
The file you need to send or upload to the api, should be the content of your flowfile that routes into InvokeHttp. So some upstream process should read the file, and send the content through success relationship to InvokeHttp. For example if this file is json, I use GenerateFlowFile processor, put the json contents in there, then send to InvokeHttp.
... View more
03-21-2023
05:46 AM
@Techie123 to add headers in invokeHttp just click the + sign to add a new dynamic property, and set key to "Content-Type" and value to "multipart/form-data". You will also need to make sure the rest of your invokeHttp is confirmed correctly. Depending on your version, you can also create and send an attribute called "Content-Type" of the same value. Newest versions of NiFi will see a default property "Request Content-Type" which can also be set to attribute $mime-type which you can also define to suit your API. One other suggestion, make sure you are testing remote API Calls with something like postman to confirm all the required values. Then, work with NiFi after you have a known operational understanding for the api.
... View more
03-20-2023
05:48 AM
@Fahmihamzah84 This appears to be an issue with your schema. The BigQuery error is suggesting an issue trying to cast a string into a collection (array/list/ect). It's hard to tell which array may be causing the issue as there are many. My suggestion is to set the processor to log level DEBUG and see if you can get more verbose error. This will help you figure out which field or fields is the culprit. Keep in mind it could be one of the empty arrays too. I do not suggest the following as a solution just as path to figuring out where the problem is. Sometimes when i have issues with type casting, i make everything a string temporarily and for development. If you do this carefully one at a time, when the error goes away, you can determine which field it is. This also helps you identify a working state for your flow and allow you to work from that operational base to find solution for the end schema being the format you need.
... View more
03-17-2023
06:08 AM
1 Kudo
@anton123 Please check these references, there is important information here that everyone needs to master in order to work with ExecuteScript: https://community.hortonworks.com/articles/75032/executescript-cookbook-part-1.html https://community.hortonworks.com/articles/75545/executescript-cookbook-part-2.html https://community.hortonworks.com/articles/77739/executescript-cookbook-part-3.html Some suggestions: Make sure you have all the imports you need Make sure you are using the correct variable names for "filter". You have this defined but its not used.
... View more
03-16-2023
08:16 AM
1 Kudo
Awesome news, +2 solutions here.
... View more
03-16-2023
05:29 AM
1 Kudo
@Sivagopal Check out this post for a similar scenario. It includes a solution: https://community.cloudera.com/t5/Support-Questions/Nifi-1-16-fails-to-start-with-Decryption-exception/m-p/358190
... View more
03-13-2023
07:30 AM
@Meeran Going out on a limb, but i think the conflict is related to "LogicalType" of uuid not preparing the downstream value to what casssandra expects. The error seems to think the logicalType of the string is the wrong format. I think the error on the cassandra driver level, not with the schema or nifi itself. One suggestion i have is that you could just make that a string (without the type) and see if the driver accepts. If it does, then you know the issue is just related to the LogicalType logic. As long as your uuid is not manipulated you do not need to re-confirm its actually a uuid in the nifi data flow.
... View more
03-13-2023
07:18 AM
@larsfrancke Unfortunately I do not have the exact solution or information you need. However, I do have multiple customers whom have gotten their CDP on Isilon kerberized and in production. There were some tickets on our support side leading through the kerberos setup, but the specific technical solution came from Dell's side since this is supported solution for Isilon. My recommendation is to work with Cloudera Support to see if they have suggestions, and then work with Dell Support coming out of that. Your Cloudera account team and Dell Partner should have access to deeper resources if both support's cannot resolve.
... View more
03-02-2023
06:44 AM
1 Kudo
@fahed What you see with the CDP Public Cloud Data Hubs using GCS (or object store) is a modernization of the platform around object storage. This removes differences across aws, azure, and on-prem (when Ozone is used). It is a change by customer demand so that workloads are able to be built and deployed with minimal changes from on prem to cloud or cloud to cloud. Unfortunately that creates a difference you describe above, but those are risks we are willing to take ourselves in favor of modern data architecture. If you are looking for performance, you should take a look at some of the newer options for databases: impala and kudu (this one uses local disk). Also we have Iceberg coming into this space too.
... View more