About EricL

EricL · ‎03-04-2020

Great catch @bgooley!!

EricL · ‎02-28-2020

Hi @HadoopBD, The log you provided is RM log, not application log that Ben asked earlier. Please run below command: yarn logs -applicationId application_1582677468069_0009 > application_1582677468069_0009.log And then find the snippet that has the error, as the log will likely to be very big. I also noticed that the log you provided earlier contained your domain name, if you have concerns, we can redact them for you. Please advise. Thanks Eric

EricL · ‎02-27-2020

@HadoopBD , If possible, if you can attach log as a file to this thread, it would be better, as the log messages make the page lengthy and hard to navigate around. Cheers

EricL · ‎02-27-2020

@wert_1311, Venkat's first link seems to be broken, I will share again here: https://blog.cloudera.com/how-does-cloudera-manager-work/ And official doc is here: https://docs.cloudera.com/documentation/enterprise/6/6.3/topics/cloudera_manager.html I also wrote one basic blog on Cloudera Management services, not sure if it can help: https://www.ericlin.me/2019/11/introduction-to-cloudera-management-services-part-1/ Cheers Eric

EricL · ‎02-18-2020

Is table-b's value fixed? You mentioned 1 or 2. Are they pre-defined? If you know the values up-front, then you don't need to do cross join, just add conditions based on the fixed number of values, like below: SELECT * FROM table-a WHERE TABLE-a.date_col <= from_unixtime(unix_timestamp()-(1*24*60*60))) OR TABLE-a.date_col <= from_unixtime(unix_timestamp()-(2*24*60*60))) OR TABLE-a.date_col <= from_unixtime(unix_timestamp()-(3*24*60*60))) ... Not sure if it still meet your requirement. Cheers

EricL · ‎02-13-2020

@Ellyly , Please also share the exact version of either HDP or CDH in use, this can help to determine the code that we need to check and see why we hit NPE. Cheers Eric

EricL · ‎02-13-2020

Does it have to be Cross JOIN? You are generating tens or hundreds of million rows, it is very intensive. Is it true that for every row in table-b, you have to join across in table-a? Cheers Eric

EricL · ‎02-05-2020

Glad it works now, thanks for sharing. Cheers

EricL · ‎02-04-2020

@dewi If HS2 was unable to connect to HMS, then you should check HMS log as well. What error is reported over there? Cheers Eric

EricL · ‎01-23-2020

@snm1523, CM's full API documentation can be found here: https://archive.cloudera.com/cm7/7.0.3/generic/jar/cm_api/apidocs/index.html The API url starts with /api/v{number}, for example: http://{CM_URL}:7180/api/v32/clusters I have never personally used API ${SCM_URL}/cmf/exportCLI, I googled and found those articles seemed very old (more than 8-9 years old). I do not think it is applicable anymore. Current CM provides a URL for you to export all cluster configurations in one call via ${SCM_URL}/api/v32/cm/deployment. v32 is the highest version number that is available in CM6.2, the version that I am using, so depending on your version of CM, the version of API might be different. Use ${SCM_URL}/api/version to check. Cheers Eric

Online	Offline
Last Visited	‎08-12-2020 03:17 AM

Member Since	‎03-23-2015 01:24 PM
Last Visited	‎08-12-2020 03:17 AM
Posts	1,288
Kudos received	113

Cloudera Community

Re: max() function generating an error in sqoop

Re: Add a dynamic variable to a Hive view

Re: Hive Server 2 failing to start CDP ,Cloudera M...

Re: Sqoop export from hive to teradata - > issue ...

Re: Cloudera Hadoop internal workings

Re: ALL hadoop-mapreduce-examples.jar fail cdh6

Re: ALL hadoop-mapreduce-examples.jar fail cdh6

Re: ALL hadoop-mapreduce-examples.jar fail cdh6

Re: Cloudera Hadoop internal workings

Re: Hive- Cross join-Optimization

Re: Is it possible to create materialized view fro...

Re: Hive- Cross join-Optimization

Re: Hiveserver2 not starting

Re: Hiveserver2 not starting

Re: Cloudera Manager APIs