Member since
08-16-2015
97
Posts
16
Kudos Received
12
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
893 | 07-11-2021 08:05 PM | |
1678 | 07-11-2021 06:37 PM | |
39647 | 06-04-2021 12:01 AM | |
1059 | 06-03-2021 11:43 PM | |
3477 | 04-26-2021 06:58 PM |
04-18-2021
08:25 PM
1 Kudo
Hello A lot details are provided here to your questions https://docs.cloudera.com/cdp-private-cloud-base/7.1.6/concepts/topics/cm-sdx-vpc.html Just to highlight a few points 1. not all components are available for VPC, limited to the following (no Flink) Only the following services can be installed on Compute clusters: Hive Execution Service (This service supplies the HiveServer2 role only.) Hue Kafka Spark 2 Oozie (only when Hue is available, and is a requirement for Hue) YARN HDFS (required) 2. data will be transferred to VPC during runtime, so check the network, performance requirements etc 3. only certain versions of the platform supports VPC, limited to the following: CDH 5.15 CDH 5.16 CDH 6.0 CDH 6.1 CDH 6.2 CDH 6.3 Cloudera Runtime 7.0.3 Cloudera Runtime 7.1.1 and higher 4. it is good you need to add temp compute resources to your cluster for some ad-hoc workloads, but it has the trade-off of the performance (refer to point 2) 5. VPC can be fully managed using Cloudera Manager, so it is a fairly easy process to implement
... View more
04-18-2021
08:09 PM
Hello You may refer to this thread for the monitoring options for NiFi https://community.cloudera.com/t5/Support-Questions/NIFI-Monitoring-processor-and-nifi-Service/td-p/128485
... View more
04-18-2021
07:39 PM
Hello Looks like a permission issue, try below sudo service nifi start
... View more
04-18-2021
04:52 PM
Dear Daming, Thanks for your appreciated support, Both database and default_site_encoding are UTF8 but still have Arabic doesn't appear.
... View more
04-15-2021
06:13 PM
1 Kudo
Hello Your question maybe related to this one: https://community.cloudera.com/t5/Support-Questions/Issue-of-copying-data-from-kudu-to-hdfs-using-spark-sql/td-p/282814
... View more
04-15-2021
01:11 AM
A colleague has just suggested the same thing. A shame there is no way to use the file directly, but I very much appreciate your answer. Many thanks
... View more
04-14-2021
06:39 PM
Use have to use --py-file via CDE CLI to submit your py files. This way you can submit your custom python scripts/packages as .py/.zip/.egg file(s). Similarly via API, use "pyFiles": [ "string" ] configuration to submit your files.
... View more
04-14-2021
05:36 PM
Hello Make sure you still access to the package in the Cloudera's public repo After Jan 2021, all binaries are behind paywall https://www.cloudera.com/downloads/paywall-expansion.html
... View more
04-13-2021
06:39 PM
1 Kudo
Hello You have the following commands from hive show databases show tables show partitions <dbName>.<tableName>; You can write your script to count, one example, count number of tables hive -e "show databases" >db3.out;cat db3.out | while read line; do hive -e "use $line;show tables" >> tables3.out;done; cat tables3.out | wc -l PS: there maybe some unwanted characters, you may want to do some cleaning up before final count
... View more