About paras

paras · ‎07-23-2020

@fransyk Yes, you can have datanode and namenode role together on a host as long as the hardware requirements are met for the service to avoid any out of memory issues. Please refer https://docs.cloudera.com/documentation/enterprise/6/release-notes/topics/rg_hardware_requirements.html#concept_fzz_dq4_gbb Hope this helps, Paras Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.

paras · ‎07-22-2020

@pdev Yes, BDR is supported between different CDH versions. Refer below links for more details https://docs.cloudera.com/documentation/enterprise/5-14-x/topics/cm_bdr_replication_intro.html#concept_rt2_1wt_bx https://docs.cloudera.com/documentation/enterprise/6/release-notes/topics/rg_pcm_bdr.html#bdr Hope this helps, Paras Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.

paras · ‎07-22-2020

@pdev Please refer document [1] for details on how to enable replication between cluster with kerberos configuration. To configure encryption of data transmission between source and destination clusters: Enable TLS/SSL for HDFS clients on both the source and the destination clusters. You may also need to configure trust between the SSL certificates on the source and destination. The certificates of the source cluster should be trusted by your destination cluster. Enable TLS/SSL for the two peer Cloudera Manager Servers. Refer link [2] for more details. [1] https://docs.cloudera.com/documentation/enterprise/5-14-x/topics/cm_bdr_replication_and_kerberos.html#xd_583c10bfdbd326ba-5676e95c-13ed333c3d9--7ff3 [2] https://docs.cloudera.com/documentation/enterprise/5-14-x/topics/cm_bdr_replication_and_encryption.html#concept_lrr_rcf_4r Hope this helps, Paras Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.

paras · ‎07-22-2020

@Prav You can leverage CM API to track parcel distribution status: /api/v19/clusters/{clusterName}/parcels - This can be used to note the parcel name and version the cluster has access to /api/v19/clusters/{clusterName}/parcels/products/{product}/versions/{version} - This can be used to track the parcel distribution status Refer below link for more details http://cloudera.github.io/cm_api/apidocs/v19/path__clusters_-clusterName-_parcels_products_-product-_versions_-version-.html Hope this helps, Paras Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.

paras · ‎07-22-2020

@rok You can use the Cloudera Manager REST API to export and import all of its configuration data. The API exports a JSON document that contains configuration data for the Cloudera Manager instance. You can use this JSON document to back up and restore a Cloudera Manager deployment. Refer below document for the steps: https://docs.cloudera.com/documentation/enterprise/6/6.3/topics/cm_intro_api.html#concept_dnn_cr5_mr Hope this helps, Paras Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.

paras · ‎07-09-2020

@sarm Minimum heap size should be set to : 4 GB Increase the memory for higher replica counts or a higher number of blocks per DataNode. When increasing the memory, Cloudera recommends an additional 1 GB of memory for every 1 million replicas above 4 million on the DataNodes. For example, 5 million replicas require 5 GB of memory. Set this value using the Java Heap Size of DataNode in Bytes HDFS configuration property. Reference: https://docs.cloudera.com/documentation/enterprise/6/release-notes/topics/rg_hardware_requirements.html#concept_fzz_dq4_gbb Hope this helps, Paras Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.

paras · ‎07-09-2020

@tanishq1197 When you see this log entry, the Cloudera Manager Admin Console is ready: INFO WebServerImpl:com.cloudera.server.cmf.WebServerImpl: Started Jetty server Try to access the CM API instead, you should use the login credentials curl -u <username>:password http://<cm_host>:<port>/api/v19/clusters Are you able to reach out to the CM server from your desktop? #ping cmserverhost #telnet cmserverhost port

paras · ‎07-08-2020

@SeanU This level of detailed log scanning and alert functionality is not available. The existing service role logs for which rules can be set will not contain each application exceptions logged since detailed information is present in the application logs. You can check the available job history server logs and resource manager logs available to check if the logged in information during application run time helps serve your purpose.

paras · ‎06-30-2020

@Mondi What are these properties set to in your yarn configurations? 'yarn.app.mapreduce.am.staging-dir' 'yarn.app.mapreduce.am.staging-dir' Also, can you try running below query before your hive query and share results > set hive.exec.scratchdir=/tmp/mydir; Regards, Paras

paras · ‎06-30-2020

@AnjaliRocks Can you please share your workflow.xml to understand exactly how you are trying to execute the operations? What is the behaviour you observe when you run insert overwrite query from beeline? You can use the below query to set the hive scratch directories to set the temporary output path. set hive.exec.scratchdir=/tmp/mydir; Let me know if this helps.

Member Since	‎01-15-2019 11:41 PM
Last Visited
Posts	274
Kudos received	20

Cloudera Community

Re: Deny admin user/group from dropping hive table...

Re: Cloudera CDP 7.1.7 SP1 on Centos Stream 8

Re: cloudera embedded postgres db taking more memo...

Re: smpt configration changes have been done for C...

Re: Error when distributing Parcel file

Re: Install DataNode Role on NameNode/SNN machine

Re: How to implement BDR with kerberos and tls en...

Re: How to implement BDR with kerberos and tls en...

Re: Poll parcel distribution status

Re: Configuration file for Cloudera Management Ser...

Re: Datanode Heap Size computation

Re: Not able to access Cloudera Manager Web UI

Re: Monitoring Yarn application logs

Re: how to change the query logs on the /tmp/user/...

Re: .Trash space issue during insert overwrite in ...