About LeetKrew93

LeetKrew93 · ‎06-25-2021

Mcafee also lists launch_container.sh under vulnerability which can be ignored as launching containers is part of a yarn architecture. Please be kind to go through the below point to understand more about yarn: 1. Client/user submits a job request. 2. Resource manager will check the input splits and will throw an error if it cannot be computed. 3. On successful computation, the resource manager will call the job to submit the procedure. 4. It will then find a node manager where it can launch app master 5. App master process will check the input splits and will make mapper and reducer tasks(Task IDs are given at this point) 6. App master will do the computation and based on that it will request resources in form of a container that will contain memory and CPU as requested by the App master. 7. On receiving the request, the node manager will use "launch_container.sh" as well as a few other job-related inputs to successfully launch a container to be used for task execution. This is the expected behavior and should be considered a false vulnerability.

LeetKrew93 · ‎06-03-2021

@venkatadach , Please share below details : 1. Screenshots of the issue 2. Are you able to get any results while running the query 3. Zeppelin logs and livy interpreter logs Regards, Aditya

LeetKrew93 · ‎06-03-2021

@fj5000 , Please provide below details for us to proceed : 1. CM/CDH version 2. Document you are following to implement KDC freeipa setup 3. Refer https://www.freeipa.org/page/Troubleshooting/Kerberos and see if you can follow the suggestions coined in the doc Regards, Aditya

LeetKrew93 · ‎06-03-2021

@swathi_k , As the error suggests, it is unable to download the parcel files. Do you have valid credentials as the parcels are under paywall now . Also, please upload CM logs, CM agent log from CM server node as well as the operational logs for further troubleshooting. Regards, Aditya

LeetKrew93 · ‎05-28-2021

@ryu , could you please upload HS2 and HMS logs at the time you are hitting below exception while trying to make a connection to hive using Squirrel : ++++++ Error: org.apache.thrift.transport.TTransportException: java.net.SocketTimeoutException: Read timed out SQLState: 08S01 ErrorCode: 0 ++++++ Did you find anything suspicious from the Squirrel's log end ? Also, let us know if it is intermittent or not ? Regards, Aditya

LeetKrew93 · ‎05-28-2021

@ryu , as a general rule of thumb Cloudera recommends that you determine the total number of HS2 servers on a cluster by dividing the expected maximum number of concurrent users on a cluster by 40. For example, if 400 concurrent users are expected, 10 HS2 instances should be available to support them. Also, here are some HS2 tuning best practices that you can visit => https://docs.cloudera.com/documentation/enterprise/6/6.3/topics/admin_hive_tuning.html#hs2_perf_best_practices Regards, Aditya

LeetKrew93 · ‎05-28-2021

@sweeny_here , Could you please provide below details : 1. Complete cloudera-scm-server logs 2. Steps/documentation followed to enable DB SSL 3. After enabling SSL on DB, did you import the DB SSL certificate to the CM truststore ? Regards, Aditya

LeetKrew93 · ‎05-28-2021

@kkhambadkone1 , You are unable to find it under add service because Kafka Connect is included in CDH 6.3.x, but is not supported. Flume and Sqoop are proven solutions for batch and real time data loading that complement Kafka's message broker capability. In order to use SMM, you need to download parcels from the official cloudera download portal but in order to do that you must be a CSM customer to access these downloads. Having said that, please find the steps below : #Assumption : You already have CDH 6.x and Kerberos enabled 1. Install a database In this case, we are using MySQL: https://docs.cloudera.com/csp/2.0.1/deployment/topics/csp-installing_mysql.html 2. Configure the database for schema registry and SMM https://docs.cloudera.com/csp/2.0.1/deployment/topics/csp-configuring-schema-registry-metadata-store... 3. Download Schema Registry and SMM parcels SMM https://www.cloudera.com/downloads/cdf/csm.html CSR https://www.cloudera.com/downloads/cdf/csp.html 4. Install the Parcels Install the services in this order: 1. Schema Registry 2. SRM (if no SRM installation, avoid this step) 3. SMM https://docs.cloudera.com/csp/2.0.1/deployment/topics/csp-get-parcel-csd.html 5. Distribute and activate the parcels. In Schema registry point “Schema Registry storage connector url” to the mysql hostname. Check “Enable Kerberos Authentication”. Use the database registry password for “Schema Registry storage connector password” 5.1 For SMM use cm.metrics.host = cloudera manager host cm.metrics.password = cloudera manager UI password cm.metrics.service.name = kafka (default) Streams Messaging Manager storage connector url = jdbc:mysql://FQDN_MYHSQL:3306/streamsmsgmgr Streams Messaging Manager storage connector password = user database password specified Check “Enable Kerberos Authentication” 6. Add Kafka service Check "Enable Kerberos Authentication" 7. Configure and access the SMM UI Property "cm.metrics.service.name" must match with the Kafka service name, by default is "kafka" Create streamsmsgmgr principal in the KDC, example when using MIT KDC kadmin.local add_principal streammsmmgr Finally copy the /etc/krb5.conf to your local machine and get a valid kerberos ticket for streammsmmgr user by using "kinit streammsmmgr" and use the same password chosen for the user creation time. Please hit "accept as solution" if your queries have been answered Regards, Aditya

LeetKrew93 · ‎05-28-2021

@VBo , Could you please let us know if you were able to start the Atlas Metadata server ? . If not, please provide us application.log, operation logs to check further. Regards, Aditya

LeetKrew93 · ‎05-28-2021

@z_j22 , Could you please reproduce the issue and provide us the NN logs covering the timeline ? Regards, Aditya

Online	Offline
Last Visited	‎08-02-2021 06:40 AM

Member Since	‎07-14-2020 01:44 AM
Last Visited	‎08-02-2021 06:40 AM
Posts	22

Cloudera Community

Cloudera Community

Re: Kafka Connect service for CDH 6.3

Re: Excluding HDP components from Antivirus scans

Re: Zeppelin paragraph delete

Re: Import KDC Account Manager Credentials

Re: Failed to download package. Status code: 401 w...

Re: hiveserver2 error

Re: hiveserver2 error

Re: Cloudera 6.3 Enabling MySql 5.7 SSL

Re: Kafka Connect service for CDH 6.3

Re: Unable to start atlas metadata server

Re: hdfs PUT false