About zzeng

zzeng · ‎04-10-2022

The latest document about Airflow in Data Engineering Experience (CDE) within Public Cloud and CDP Private Cloud Data Service is here: CDP Public Cloud https://docs.cloudera.com/data-engineering/cloud/orchestrate-workflows/topics/cde-airflow-dag-pipeline.html CDP Private Cloud Data Service https://docs.cloudera.com/data-engineering/1.3.3/orchestrate-workflows/topics/cde-airflow-dag-pipeline.html

zzeng · ‎07-20-2021

Sorry for my late reply. > what AMI are you using and were there any pre-requisites for OS ? I used the CentOS 7.8, like the matrix showed. https://supportmatrix.cloudera.com/#Cloudera To download the CDP, if you are not paying for CDP, you can try it from here. https://docs.cloudera.com/cdp-private-cloud/latest/release-guide/topics/cdpdc-trial-download-information.html The trial version has the same functions with normal CDP but can only use 60 days. Please have a try and let me know if it works.

zzeng · ‎07-09-2021

Hi Sam, I am also use CDP on AWS for learning. If you don't have enough AWS credit budget, you can use 3 nodes in this way, Use these 3 nodes as both Master and worker nodes. Means put NameNode and DataNode in these nodes. Put DataNode in all the 3 nodes.

zzeng · ‎07-08-2021

I met similar errors, but with different reasons. My reason was, I created a leaf queue behind default queue. Then after Hive restart, it will submit a query to check the health status, however as default queue is not a leaf queue any more, then it went error. My solution was , I removed the child queue behind default queue, then the error resolved.

zzeng · ‎04-20-2021

Here is a URL, written by David W. Streever https://www.streever.com/post/2019/filter-hive-compactions/ It's not official steps. All the ‘extras’ you create against the metastore DB can/may break with the next release. This isn’t a supported method of accessing metadata.

zzeng · ‎01-26-2021

https://nifi.apache.org/docs/nifi-docs/components/nifi-docs/components/org.apache.nifi/nifi-gcp-nar/1.9.0/org.apache.nifi.processors.gcp.bigquery.PutBigQueryBatch/index.html With this processor, you can do Batch loads flow files content to a Google BigQuery table.

zzeng · ‎04-07-2020

1) Demarcator, use ${literal('
'):unescapeXml()} 2) Delimiter Strategy = Text

zzeng · ‎11-28-2019

If you meet this problem in new installing CM+CDP/CDH it can be resolve in this way: in CM, open Solr page, do the 2 actions: Initialize Solr / Create HDFS Home Dir

zzeng · ‎07-27-2019

It worked. Thanks!

zzeng · ‎07-16-2019

Your answer is just for httpd, not for Ambari

Online	Offline
Last Visited	‎05-30-2024 07:56 AM

Member Since	‎01-15-2019 07:24 PM
Last Visited	‎05-30-2024 07:56 AM
Posts	51
Kudos received	35

Cloudera Community

Re: Setup a 3-5 node CDP cluster in AWS

Re: Failed to configure urlScheme property for Sol...

Re: Is cloudera supports apache airflow?

Re: Setup a 3-5 node CDP cluster in AWS

Re: Setup a 3-5 node CDP cluster in AWS

Re: hive server restarted failed with error stoppi...

Re: How do I filter the compactions results provid...

Re: How to execute google big query from NiFi.?

Re: Adding newline when using mergecontent process...

Re: Failed to configure urlScheme property for Sol...

Re: NiFi 1.4 ConsumeMQTT Processor throws an error...

Re: Change Ambari server from TCP6 to TCP