Member since
08-16-2015
96
Posts
16
Kudos Received
12
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
336 | 07-11-2021 08:05 PM | |
557 | 07-11-2021 06:37 PM | |
19058 | 06-04-2021 12:01 AM | |
505 | 06-03-2021 11:43 PM | |
1442 | 04-26-2021 06:58 PM |
02-09-2022
04:01 PM
Hello If you check PI System documentation, they have a few options to extract data, like PI JDBC, Web Services etc The performance is usually limited by the PI system side, i.e. how fast can it provides the data export
... View more
02-08-2022
06:26 PM
Hello Have you tried to export the metadata first? Once you export the existing metadata, you can have a working copy of the template for your version of Atlas, you can fit your bulk metadata into that and import back to Atlas
... View more
02-08-2022
06:16 PM
Hello Firstly, identify the issues with the node, replace any faulty hardware if necessary You can follow the below post for the procedure https://community.cloudera.com/t5/Community-Articles/Adding-nodes-to-an-HDP-cluster/ta-p/245386
... View more
07-30-2021
12:38 AM
Hello Perform the following in CM "Load Balancer Advanced Configuration Snippet (Safety Valve) for httpd.conf" Add following into above text box: ProxyTimeout 3600
... View more
07-29-2021
11:53 PM
Hello This is not a NiFi problem, you may try to use some online tool to help https://jolt-demo.appspot.com/#inception
... View more
07-29-2021
11:48 PM
Hello This may be related to the way you use Hue For example, if you uploading a large file using Import to table option, you may hit the proxy timeout issue, (by default, the timeout is 600 seconds), you can try to increase the proxy timeout option to a larger value, or you can optimise how you get large data files into the cluster by using other tools like NiFi etc
... View more
07-29-2021
11:36 PM
Hello You can refer here: https://stackoverflow.com/questions/55070778/extract-only-the-columns-header-from-the-csv-file-using-nifi
... View more
07-11-2021
08:05 PM
Hello You are welcomed to trial Cloudera CDP platform, you can find more details here: https://docs.cloudera.com/cdp-private-cloud/latest/release-guide/topics/cdpdc-trial-download-information.html
... View more
06-04-2021
12:01 AM
1 Kudo
Hello The table column type must match the columnar file format of the Parquet file, else you will result in the error you got One way if you prefer to use string instead of double for that data attribute, you can recreate the parquet file with the column type of string
... View more
06-03-2021
11:54 PM
Hello You can take a look of the Cloudera Manager Agent logs, and get the details about the issue Reference: https://docs.cloudera.com/cdp-private-cloud-base/7.1.6/managing-clusters/topics/cm-manage-agent-logs.html
... View more
06-03-2021
11:43 PM
Hello It is common for customer to run preferred 3rd party component along side with the CDP cluster, and for your case, you can deploy Flume on the edge nodes of the cluster
... View more
05-16-2021
07:27 PM
1 Kudo
Hello Since it is related to Load Balancer, you can take a look of your configurations # cluster load balancing properties # nifi.cluster.load.balance.host=192.170.108.140 nifi.cluster.load.balance.port=6342 nifi.cluster.load.balance.connections.per.node=50 nifi.cluster.load.balance.max.thread.count=600 nifi.cluster.load.balance.comms.timeout=45 sec For example nifi.cluster.load.balance.connections.per.node=50 The maximum number of connections to create between this node and each other node in the cluster. For example, if there are 5 nodes in the cluster and this value is set to 4, there will be up to 20 socket connections established for load-balancing purposes (5 x 4 = 20). The default value is 4 . Now you set it to 50, not sure how many nodes you got, you can do the math The rest of the configuration details you can refer here: https://docs.cloudera.com/HDPDocuments/HDF3/HDF-3.5.1/nifi-system-properties/content/cluster_node_properties.html
... View more
05-13-2021
07:42 PM
Hello Can you review this post and check the whether Hive namespace is created in ZK? https://community.cloudera.com/t5/Support-Questions/How-to-resolve-Unable-to-read-HiveServer2-configs-from/td-p/233701
... View more
05-13-2021
07:28 PM
Hello Please check the below instructions (HDP platform) and make sure you are following the right steps https://docs.cloudera.com/HDPDocuments/HDP3/HDP-3.1.4/fault-tolerance/content/update_the_hive_metastore.html If you are using pure open source, you can seek helps from Hive community forum
... View more
05-13-2021
07:24 PM
Hello Kafka is "pub and sub" If you plan you to use Spark, you can use Spark to subscribe to the topics and get the message Here is one example using Spark Streaming https://docs.cloudera.com/runtime/7.2.8/developing-spark-applications/topics/spark-streaming-example.html
... View more
05-02-2021
11:49 PM
Hello It is self-explained in the documentation https://docs.cloudera.com/cdp-private-cloud-base/7.1.6/security-ranger-authorization/topics/security-ranger-resource-policies-importing-exporting.html
... View more
05-02-2021
11:46 PM
Hello Extracted from your log " Incompatible sink and channel settings defined. sink's batch size is greater than the channels transaction capacity."
... View more
05-02-2021
09:56 PM
1 Kudo
Hello if the cluster is critical to your business, you should consider to get the subscription from Cloudera, and for your facing issues, Cloudera can create a patch by backporting the fix to an earlier CM version
... View more
05-02-2021
07:00 PM
Hello Once example is to use Kafka Streams https://blog.cloudera.com/building-secure-and-governed-microservices-with-kafka-streams/
... View more
05-02-2021
06:54 PM
Hello Make sure you configure in Windows hosts file for " sandbox-hdp.hortonworks.com" with a proper IP address
... View more
05-02-2021
06:50 PM
Hello Please look out for Cloudera Manager 7.4.1 update, which comes with the fix to the issue you are facing The issue is because producer client ids that are not configured correctly and are generating huge metrics from anonymous producers The solution proposed in CM 7.4.1 is to make the Kafka producer metric whitelist configurable in the CM UI
... View more
05-02-2021
06:39 PM
Hello As CCP is based on Metron, since Metron is retired, CCP will be retired too.
... View more
04-28-2021
11:26 PM
Hello You need to have an active subscription with Cloudera, your username/password will be provided upon activation of your license subscription
... View more
04-26-2021
07:28 PM
Hello This post may give you some ideas https://community.cloudera.com/t5/Support-Questions/How-to-hide-INFO-WARN-while-hive-execution/td-p/230775
... View more
04-26-2021
06:58 PM
Hello Depends on the cluster size and monitored entities, certain resources are recommended Please refer to the below link and check whether your resource allocation is in-line with the recommendations https://docs.cloudera.com/cdp-private-cloud/latest/release-guide/topics/cdpdc-service-monitor-requirements.html
... View more
04-21-2021
06:43 PM
Hello An example: https://stackoverflow.com/questions/38086684/hadoop-fs-du-h-sorting-by-size-for-m-g-t-p-e-z-y
... View more
04-21-2021
05:44 PM
Hello Check your client library files are in the CLASSPATH Caused by: java.lang.NoClassDefFoundError: Could not initialize class org.janusgraph.diskstorage.es.rest.RestElasticSearchClient
... View more
04-21-2021
05:38 PM
Hello I am not sure the data in your Hive table got duplicates? Maybe try SELECT DISTINCT?
... View more
04-21-2021
05:35 PM
Hello What's your CM version
... View more