Hello   If you check PI System documentation, they have a few options to extract data, like PI JDBC, Web Services etc   The performance is usually limited by the PI system side, i.e. how fast can it provides the data export ... View more

Hello   Have you tried to export the metadata first? Once you export the existing metadata, you can have a working copy of the template for your version of Atlas, you can fit your bulk metadata into that and import back to Atlas ... View more

Hello   Firstly, identify the issues with the node, replace any faulty hardware if necessary You can follow the below post for the procedure  https://community.cloudera.com/t5/Community-Articles/Adding-nodes-to-an-HDP-cluster/ta-p/245386 ... View more

Hello   Perform the following in CM   "Load Balancer Advanced Configuration Snippet (Safety Valve) for httpd.conf" Add following into above text box: ProxyTimeout 3600   ... View more

Hello   This is not a NiFi problem, you may try to use some online tool to help   https://jolt-demo.appspot.com/#inception ... View more

Hello   This may be related to the way you use Hue   For example, if you uploading a large file using Import to table option, you may hit the proxy timeout issue, (by default, the timeout is 600 seconds), you can try to increase the proxy timeout option to a larger value, or you can optimise how you get large data files into the cluster by using other tools like NiFi etc ... View more

Hello   You can refer here: https://stackoverflow.com/questions/55070778/extract-only-the-columns-header-from-the-csv-file-using-nifi ... View more

Hello   You can take a look of the Cloudera Manager Agent logs, and get the details about the issue   Reference: https://docs.cloudera.com/cdp-private-cloud-base/7.1.6/managing-clusters/topics/cm-manage-agent-logs.html ... View more

Hello   Since it is related to Load Balancer, you can take a look of your configurations   # cluster load balancing properties # nifi.cluster.load.balance.host=192.170.108.140 nifi.cluster.load.balance.port=6342 nifi.cluster.load.balance.connections.per.node=50 nifi.cluster.load.balance.max.thread.count=600 nifi.cluster.load.balance.comms.timeout=45 sec   For example nifi.cluster.load.balance.connections.per.node=50   The maximum number of connections to create between this node and each other node in the cluster. For example, if there are 5 nodes in the cluster and this value is set to 4, there will be up to 20 socket connections established for load-balancing purposes (5 x 4 = 20). The default value is  4 .   Now you set it to 50, not sure how many nodes you got, you can do the math   The rest of the configuration details you can refer here:  https://docs.cloudera.com/HDPDocuments/HDF3/HDF-3.5.1/nifi-system-properties/content/cluster_node_properties.html ... View more

Hello   Can you review this post and check the whether Hive namespace is created in ZK?   https://community.cloudera.com/t5/Support-Questions/How-to-resolve-Unable-to-read-HiveServer2-configs-from/td-p/233701 ... View more

Hello   Please check the below instructions (HDP platform) and make sure you are following the right steps   https://docs.cloudera.com/HDPDocuments/HDP3/HDP-3.1.4/fault-tolerance/content/update_the_hive_metastore.html   If you are using pure open source, you can seek helps from Hive community forum  ... View more

Hello    Kafka is "pub and sub" If you plan you to use Spark, you can use Spark to subscribe to the topics and get the message   Here is one example using Spark Streaming https://docs.cloudera.com/runtime/7.2.8/developing-spark-applications/topics/spark-streaming-example.html  ... View more

Hello   It is self-explained in the documentation https://docs.cloudera.com/cdp-private-cloud-base/7.1.6/security-ranger-authorization/topics/security-ranger-resource-policies-importing-exporting.html ... View more

Hello   Extracted from your log   " Incompatible sink and channel settings defined. sink's batch size is greater than the channels transaction capacity." ... View more

Hello   if the cluster is critical to your business, you should consider to get the subscription from Cloudera, and for your facing issues, Cloudera can create a patch by backporting the fix to an earlier CM version  ... View more

Hello   Once example is to use Kafka Streams https://blog.cloudera.com/building-secure-and-governed-microservices-with-kafka-streams/ ... View more

Hello   Make sure you configure in Windows hosts file for " sandbox-hdp.hortonworks.com" with a proper IP address ... View more

Hello   Please look out for Cloudera Manager 7.4.1 update, which comes with the fix to the issue you are facing   The issue is because producer client ids that are not configured correctly and are generating huge metrics from anonymous producers   The solution proposed in CM 7.4.1 is to make the Kafka producer metric whitelist configurable in the CM UI ... View more

Hello    As CCP is based on Metron, since Metron is retired, CCP will be retired too. ... View more

Hello   You need to have an active subscription with Cloudera, your username/password will be provided upon activation of your license subscription ... View more

Hello   This post may give you some ideas https://community.cloudera.com/t5/Support-Questions/How-to-hide-INFO-WARN-while-hive-execution/td-p/230775 ... View more

Hello   An example: https://stackoverflow.com/questions/38086684/hadoop-fs-du-h-sorting-by-size-for-m-g-t-p-e-z-y ... View more

Hello   Check your client library files are in the CLASSPATH   Caused by: java.lang.NoClassDefFoundError: Could not initialize class org.janusgraph.diskstorage.es.rest.RestElasticSearchClient ... View more

Hello   I am not sure the data in your Hive table got duplicates? Maybe try SELECT DISTINCT? ... View more

Hello   What's your CM version ... View more