Member since
02-01-2022
269
Posts
95
Kudos Received
59
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1909 | 06-12-2024 06:43 AM | |
2666 | 04-12-2024 06:05 AM | |
1977 | 12-07-2023 04:50 AM | |
1177 | 12-05-2023 06:22 AM | |
2077 | 11-28-2023 10:54 AM |
08-15-2023
05:13 AM
1 Kudo
@learner-loading The Cloudera options here are: CDP Public Cloud (NiFI on Flow Management Data Hub - VMs) - (docs) CDP Public Cloud DataFlow (NiFi on kubernetes) - (docs) CDP Private Cloud Base There are cost calculators in each product but these are dependent on sizing and usage so its not a simple answer. You can open a sales request or reach out to me directly if you need more details. There is a great deal of value add in our offerings in the NiFi space. Including but not limited to: enterprise support and security, cloudera only processors, deploy on-prem, on azure, aws, or gcp. Although these are not SAAS offerings, the Dataflow service should be investigated. The capabilities within this are above and beyond what is found in nifi. Those include, cloud flow catalog, flow designer ui, ready flows, data flow functions (AWS Lamba, Google Cloud Functions, Azure Functions), and more. I am happy to demo and discuss these things as well. Official Sales Requests can be submitted here: https://www.cloudera.com/contact-sales.html
... View more
08-15-2023
04:54 AM
A quick dig shows this port 7191 is for parcel distribution and internal only Peer-to-peer parcel distribution 7190, 7191 Hosts > All Hosts > Configuration > P2P Parcel Distribution Port Used to distribute parcels to cluster hosts during installation and upgrade operations. Reference https://docs.cloudera.com/cdp-private-cloud-base/7.1.6/installation/topics/cdpdc-ports-used-by-cm.html
... View more
08-14-2023
05:54 AM
@Kiranq No, you do not have to use the USE statement. Some things to consider: Make sure each DBCP is configured correctly with the right schema or namespace if possible in the confIguration or connection string. You can also make sure the schema or namespace above your table is included in the processor configuration. For example in PutDatabaseRecord you will find Schema Name in the properties. It could also be done in the sql statement without a specific use statement like select * from default.tablename; assuming your user has access to this default namespace with the tablname.
... View more
08-14-2023
05:43 AM
@StatistiX If you pay attention to the past two CDP Releases (7.1.7 august 2021, 7.1.8 august 2022) you can get an idea of timing for 7.1.9. That said 7.1.9 is expected very soon and also expected include support for redhat 8.8. Due to not knowing what if anything is impacted in 7.1.7 or 7.1.8, i would recommend waiting for official release of 7.1.9 for rhel 8.8 upgrade. If you need official response on using redhat 8.8 with current versions, please open an Upgrade Planning Request ticket with Cloudera. This process will include evaluation of current environment and allow you to have that conversation within your support rep.
... View more
08-08-2023
09:27 AM
@kuhbrille When i execute this in my ranger and check the call, the date is URL parsed: 08%2F08%2F2023 https://host.host.a465-9q4k.cloudera.site/se-aw-mdl/cdp-proxy/ranger/service/assets/accessAudit?page=0&pageSize=25&total_pages=57997&totalCount=1449906&startIndex=0&excludeServiceUser=false&startDate=08%2F08%2F2023&accessResult=0&_=1691511837287 Does that help get your call to take it the date?
... View more
08-08-2023
08:58 AM
1 Kudo
@JohnSilver Open the queue list between list/fetch and look at the content of flowfile (0.00 size). Take the (i) or the (👁) in the list to go deeper. Also inspect the attributes tab attached to the flowfile. Looking for file names, path, etc... those bits need to be parsed to fetchSMB as attributes, and then the right file will be fetched for putHDFS.
... View more
08-08-2023
05:04 AM
@kwanchai The error seems to indicate that postgres is not running. If you can make sure that the postgres installed with the CDP is restarted and running then try again. It is possible after reboot that is stuck in undesired state you see (shutting down). Alternatively, redo the install and complete a shutdown of CDP completely before doing reboot and snapshot steps.
... View more
08-08-2023
04:56 AM
1 Kudo
@JohnSilver A few advices: In the future post screen shot of flow, and important processor configuration screen shots. You can also share a flow definition file on github, and sample data so we can help see what you see. Without those some advice is below. It sounds like ListSMB is returning a list of all results( files and or paths). Can you share that output? (Run ListSMB once, inspect flowfile, share here in a code block). Without seeing that I think another processor should iterate through that list flowfile contents, and fetch each file/path independently.
... View more
08-07-2023
07:09 AM
@ibrooks Excellent article here. I will definitely be using this in my CML Demos going foward. I just sent a PR w/ some flow improvements you may like to use as well.
... View more
08-07-2023
06:51 AM
2 Kudos
@sam_s0ni I took up this conversation internally and exposed another related JIRA 11763. This behavior was removed in 1.19 and will not be coming back due to nature of parameter evaluation against references of those parameters when they are changed. You can view the conversation for NIFI-11763 here: https://issues.apache.org/jira/browse/NIFI-11763
... View more