Member since
02-01-2022
281
Posts
103
Kudos Received
60
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 1120 | 05-15-2025 05:45 AM | |
| 4950 | 06-12-2024 06:43 AM | |
| 7922 | 04-12-2024 06:05 AM | |
| 5833 | 12-07-2023 04:50 AM | |
| 3204 | 12-05-2023 06:22 AM |
01-23-2023
06:52 AM
@phaelax ExecuteScript ExecuteProcess ExecuteStreamCommand etc are some of the hardest configs in nifi. It is very hard to give guidance without exact templates, configs, scripts, etc. That said, i would recommend ExecuteScript and python over bash. If that is interesting to. you, you should spend some time consuming the 3 part series on ExecuteScript by @MattWho . I believe the first part explains how to get flowfile attributes (filename) or flowfile content from previous processor flowfile (getFile) into the script. https://community.hortonworks.com/articles/75032/executescript-cookbook-part-1.html https://community.hortonworks.com/articles/75545/executescript-cookbook-part-2.html https://community.hortonworks.com/articles/77739/executescript-cookbook-part-3.html
... View more
01-23-2023
06:22 AM
Very good article, this will definitely help me in the future!
... View more
12-21-2022
05:55 AM
@zIfo based on what i see, you need to completely fill out the keystore and truststore using cacerts. Make sure nifi user has permissions to read file. If your https end point is not a public cert it will not work with cacerts, you will need to make your own keystore and truststore which contains your specific certs. Here is a post with more details: https://community.cloudera.com/t5/Support-Questions/Configure-StandardSSLContextService-for-Elasticsearch/td-p/302719 And another one that goes into much greater detail: https://community.cloudera.com/t5/Support-Questions/RESOLVED-NIFI-LISTENHTTP-SSL/td-p/146985
... View more
12-16-2022
05:19 AM
The hive libraries are quite large and are not included in the base binary distribution. You can add them manually, or use github to clone and build the full project. Reference: https://github.com/apache/nifi/blob/rel/nifi-1.19.0/nifi-assembly/pom.xml#L1054
... View more
12-16-2022
04:43 AM
Ahh my confusion, it is hard to assume without a lot more detail. Reference: https://nifi.apache.org/docs/nifi-docs/html/expression-language-guide.html#gt ${fileSize:gt( 1024 )} You need to use the expression "gt( some value )" against a parameter or variable. In the case above, "file size greater than 1024".
... View more
12-15-2022
06:31 AM
@wallacei There are roles attached to the main control plane and roles attached to specific environment. Work with you environmentAdmin to make sure you have all the correct roles at the control plane level and then deeper at the environment level if necessary. Below is the EnvironmentAdmin [
{
"crn": "crn:altus:iam:us-west-1:altus:policy:EnvironmentAdminPolicy",
"policyStatements": [
{
"rights": [
"environments/getFreeipaOperationStatus",
"environments/repairFreeIPA",
"environments/upgradeFreeIPA",
"environments/createDatahub",
"datahub/read",
"datahub/write",
"datalake/read",
"datalake/write",
"environments/read",
"environments/write"
],
"resources": [
"*"
]
}
]
}
] You may need more specific roles to access additional services around the environment.
... View more
12-15-2022
06:12 AM
@Jaimin7 assuming "gt" is your parameter, that would be referenced as #{gt} and i think would be: {"updatedAt" : {#{gt} : 2022-12-10}} If "gt" is your variable, that would be represented as ${gt} and that would then be: {"updatedAt" : {${gt} : 2022-12-10}} Preference going forward is to use Paramaters as Variables will be going away soon.
... View more
12-12-2022
05:42 AM
1 Kudo
@hegdemahendra Awesome to see you making custom processors. A few things that might help: Make sure this controller service exists in your nifi, some nifi builds do not include all nars Make sure this controller service exists in your project dependencies That said, you may find more advanced nifi help engaging with the nifi developer community on slack or the mailing list. You can find the slack invite link at the bottom of that page.
... View more
12-09-2022
05:54 AM
@quangbilly79 The top screen shot is for CDP Public Cloud and the bottom screen shot is for CDP Private Cloud Base. As such, the CDE (Cloudera Data Engineering) "Schedule Job" is not available in the Cloudera Manager UI. You could use something like Oozie: https://docs.cloudera.com/cdp-private-cloud-base/7.1.6/configuring-oozie/topics/oozie-introduction.html
... View more
12-09-2022
05:39 AM
@abdebja Have you completed HUE configuration for SSL of each services host(s)? The docs are as follows: https://docs.cloudera.com/cdp-private-cloud-base/7.1.6/securing-hue/topics/hue-configuring-tls-ssl.html
... View more