About EricL

EricL · ‎09-10-2019

@ChineduLB , Thanks for the update. /user/history and /user/history/done need to be owned by mapred:hadoop, see below: drwxrwxrwx - mapred hadoop 0 2017-12-11 06:23 /user/history drwxrwx--- - mapred hadoop 0 2019-01-15 04:31 /user/history/done drwxrwx--- - mapred hadoop 0 2018-12-03 11:30 /user/history/done/2018 drwxrwx--- - mapred hadoop 0 2019-09-10 05:46 /user/history/done/2019 Please update accordingly and test again. Cheers

EricL · ‎09-10-2019

@DataMike, I am afraid that there is no such option that I am aware of, you would have to stop and start one by one manually. Cheers Eric

EricL · ‎09-10-2019

@wert_1311 ， When you say "there is no change", did you mean that after you add a new file/directory, it is not reflected in the UI? This might be indexing issue, have you checked the Reports Manager service log to see if there is any errors? Cheers Eric

EricL · ‎09-08-2019

@ilia987, The message "Driver grid-05.test.com:36315 disassociated! Shutting down" sounds like AM had trouble getting back to Driver, can you share below info: - did you run spark in cluster or client mode? - what is the full command? - what's the error from client side where you ran spark-submit? - what's the error in yarn side? As suggested by @AKR to share the entire application logs Cheers Eric

EricL · ‎09-08-2019

@ChineduLB, You have showed the permission and ownership of sub-directories for /user/history/done: drwxrwxrwx - cloudera-scm hdfs 0 2017-12-01 09:29 /user/history/done/2017 drwxrwxrwx - cloudera-scm hdfs 0 2018-11-01 07:20 /user/history/done/2018 What about the ownership of /user/history/done itself? Can you run below command share the output: hdfs dfs -ls -d /user/history hdfs dfs -ls -d /user/history/done Cheers Eric

EricL · ‎09-08-2019

Hi Aaron, Are you able to share the exact error you get in the ODBC trace log that you mentioned? Is your server using self-signed or CA signed certificates? If Self-Signed, you might need to add AllowSelfSignedServerCert=1 in your ODBC driver config file. Since you are using ODBC driver, the JDBC connection string you mentioned does not apply here: jdbc:hive2://{host}:{port}/;ssl=true;sslTrustStore={certs.jks};trustStorePassword=changeit Where is the certificate file cert.pem? Cheers Eric

EricL · ‎09-06-2019

@yukti, Are you able to share full spark log so that we can see a bit more context? Hitting SBNN is common, but it should be back to Active NN after that, and it should not be causing failure. I suspect there is something else, so full log might help to understand a bit more. Cheers Eric

EricL · ‎09-06-2019

@Mack, I don't fully understand your question, can you please clarify? The data for Hive/Impala tables are stored in HDFS, and the format of the data basically depends on the format you specify for the table. If you create a table as parquet format ,then data will be written as parquet and you can download them directly from HDFS. What do you mean by "Hue only allows CSV and Excel table format."? Cheers Eric

EricL · ‎09-04-2019

@ Vinit_Kratin, If low response time is a must, then Hive is not an option, Impala should be faster. HBase designed tables require a row key, which means, all data you want to retrieve will need this key to be queried against HBase. So for your event based data, if you need to use an event id to store and retrieve data, then hbase might be suitable. I still suggest you to go through details of differences between HBase and Hive and Impala to get a better understanding. Google is your friend. Cheers Eric

EricL · ‎09-03-2019

The folder should be /user/tom, without REALM part, and the permission is the same, should be just tom:tom, without REALM.

Online	Offline
Last Visited	‎08-12-2020 03:17 AM

Member Since	‎03-23-2015 01:24 PM
Last Visited	‎08-12-2020 03:17 AM
Posts	1,288
Kudos received	113

Cloudera Community

Re: max() function generating an error in sqoop

Re: Add a dynamic variable to a Hive view

Re: Hive Server 2 failing to start CDP ,Cloudera M...

Re: Sqoop export from hive to teradata - > issue ...

Re: Cloudera Hadoop internal workings

Re: YARN(MR2 Included) JobHistory Server failing...

Re: Exclude Kafka Service from Cluster Start/Stop?

Re: HDFS File Browser not working

Re: Spark submit fails, logs attached, ERROR Coars...

Re: YARN(MR2 Included) JobHistory Server failing...

Re: Informatica ODBC Setup with SSL

Re: SparkContext giving error in initialization : ...

Re: Export Hue query results as parquet?

Re: Which is better for performance? hive 3 or hba...

Re: DEBUG security.UserGroupInformation: Privilege...