Member since
02-07-2019
2750
Posts
241
Kudos Received
31
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 2788 | 08-21-2025 10:43 PM | |
| 3027 | 04-15-2025 10:34 PM | |
| 7999 | 10-28-2024 12:37 AM | |
| 2681 | 09-04-2024 07:38 AM | |
| 4746 | 06-10-2024 10:24 PM |
05-19-2023
04:05 AM
@soc88 Some suggestions so community can better help you: Show screen shots of processor's configuration tab. We need to see the properties and how you have setup the processor. For processors with errors (red boxes), you can click the box to see full error. We need to see the errors to suggest solutions. Look in nifi-app.log for these errors if you need more verbose errors than shown in the UI. You can also set the processor log level to see more in the UI. For example, set it to DEBUG and test again. I would suspect your error could be the configuration of the processor, but would more suspect opensearch permissions on receiving end and less about the version of NIFI.
... View more
05-17-2023
10:41 PM
Hello @Rekha35 Thanks for using Cloudera Community. First, I shall answer the Q from Cloudera's perspective. Cloudera Data Engineering offering (CDE) offers Airflow built-in without any manual intervention. CDE is available on Cloudera Public Cloud & Private Cloud offering. The integration with other Platform Services is Seamless & offers an immersive experience to End-Users looking to explore Airflow. Note that your Team can integrate with an External Airflow [2] as well. Considering your ask was with checking out Airflow, You may try out [3], wherein the "Astronomer Apache Airflow Fundamentals Certification" offers the best starting point (Including Installing Locally). The Course is led by the foremost Airflow Instructor Marc Lamberti & helps anyone delve into Airflow seamlessly. Additionally, You asked about checking Airflow on Cloud owing to having issues with deploying the same locally. Each Cloud Provider (AWS, Azure, GCP) offers a Managed Service for Airflow. Hope your Q has been addressed by us. Feel free to share any further ask. Regards, Smarak [1] https://docs.cloudera.com/data-engineering/cloud/orchestrate-workflows/topics/cde-airflow-dag-pipeline.html [2] https://docs.cloudera.com/data-engineering/cloud/orchestrate-workflows/topics/cde-airflow-provider.html? [3] https://www.astronomer.io/certification/
... View more
05-17-2023
02:33 AM
Hi @Tonystark , The ERROR message doesn't reveal much info as to why the RM is failing to start. I would suggest looking into the RM logs to find the Root cause. https://issues.apache.org/jira/browse/HADOOP-16305
... View more
05-09-2023
06:50 PM
steps to reproduce this issue: 1.ranger usersync service syncs users 2.change some user's group with API : /service/xusers/secure/users/%s 3.restart usersync service 4.when usersync service finished, the user's group is gone @vamsi_redd
... View more
05-03-2023
02:17 AM
Hi @sukui Can you add following --llvm_cpu_attr_whitelist to Impala Daemon Command Line Argument Advanced Configuration Snippet (Safety Valve). --llvm_cpu_attr_whitelist=adx,aes,avx,avx2,bmi,bmi2,cmov,cx16,f16c,fma,fsgsbase,hle,invpcid,lzcnt,mmx,movbe,pclmul,popcnt,prfchw,rdrnd,rdseed,rtm,smap,sse,sse2,sse3,sse4.1,ssse3,xsave,xsaveopt Restart impala and see if it helps. Regards, Chethan YM
... View more
04-27-2023
11:12 PM
Raised HDFS thread for the above issue https://community.cloudera.com/t5/Support-Questions/second-replica-is-not-found-while-writing-a-simple-file-to/td-p/369684
... View more
04-27-2023
07:51 AM
Hello @MattWho @SAMSAL @steven-matison @DigitalPlumber @cotopaul , after confirming the access I'm able to verified I can access the bucket from aws cli on the same system Nifi is running on and download files. The problem I'm having now is that the ListS3 pickup the list of the files from the bucket but the FetchS3 doesn't do anything. When I enabled debugging on the FetchS3 I receiving the following error message. FetchS3 Error message FetchS3 Configuration ListS3 Configuration Any suggestion to what is causing the issue?
... View more
04-25-2023
07:25 AM
@rohit2811 When you have to figure out your own problem, like I did here, it could be painful. Fortunately, I received an email notification for the post that I totally forgot. What I did was using PutFile to write the CSV flowfiles to the local system, then call PutSQL to execute your Load Data command to load the local csv files to your target DB. I think there should be a processor to load data from flowfiles to the DB directly, but I failed to do so, not sure if NiFi has such as functionality. If anyone figures out how, please let me know.
... View more
04-24-2023
06:05 AM
Hello @AndreyKravtsov Please refer to the article below to Integrating Apache NiFi and Apache Kafka [1] [1] https://community.cloudera.com/t5/Community-Articles/Integrating-Apache-NiFi-and-Apache-Kafka/ta-p/247433 This example is with the PLAINTEXT Kafka protocol. It looks like you are using SSL/TLLS for kafka. You should check whether you are using SSL or SASL_SSL protocol for kafka from CM >> Kafka conf and created a StandardSSLContextService controller setting and update with Kafka Keystore and Truststore details. You can refer the below article for details [2]: [2] https://community.cloudera.com/t5/Support-Questions/Need-help-with-SSL-config-in-Nifi-ConsumeKafka/td-p/320594 Additionally, refer the following articles for more details: [1] - https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.17.0/org.apache.nifi.processors.standard.InvokeHTTP/index.html [2] - https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-ssl-context-service-nar/1.20.0/org.apache.nifi.ssl.StandardSSLContextService/index.html If this information helped you, then it will be appreciated if you will take a moment to click on KUDOS 🙂
... View more
04-24-2023
01:22 AM
I believe that issue you are facing here is due to column type Geometry When data is present in HDFS , thought is mapped to a Hive Table, particular column must be in STRING which is incompatible with Geometry type column in destination postgres, Only option we have is to alter the column type to VARCHAR at postgres
... View more