Member since
05-16-2016
785
Posts
114
Kudos Received
39
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1811 | 06-12-2019 09:27 AM | |
3006 | 05-27-2019 08:29 AM | |
5027 | 05-27-2018 08:49 AM | |
4406 | 05-05-2018 10:47 PM | |
2747 | 05-05-2018 07:32 AM |
05-29-2017
04:25 AM
While you create external table - mention the LOCATION ' ' ( i,e The default location of Hive table is overwritten by using LOCATION ) Then load data from HDFS using ' inpath ' - if you drop the table it will only remove the pointer from the hdfs and will not delete the data in the hdfs. CREATE EXTERNAL TABLE text1 ( wban INT, date STRING)
ROW FORMAT DELIMITED
FIELDS TERMINATED BY ‘,’
LOCATION ‘ /hive/data/text1’; LOAD DATA INPATH ‘hdfs:/data/2000.txt’ INTO TABLE TABLE_NAME ;
... View more
05-11-2017
06:24 PM
Sounds good .
... View more
05-10-2017
04:08 AM
"I am still exploring how to get external DB done on hive, oozie and those monitoring DB " Can you please elborate more sorry , I can certainly give you more information.
... View more
05-06-2017
05:38 AM
My understanding is that the Quickstart VM will not change the icon and it will remain with the new wording. The only changes will be to the download page and other documentation that reference launching Cloudera Manager in the VM. You only need to use those icons if you wish to use Cloudera Manager otherwise you simply use CDH manually. Here is a page explaining the differences between Cloudera Express and Cloudera Enterprise. Keep in mind that the Cloudera Enterprise icon only e nables the additional features for a trial period. If you only need to use Cloudera Manager the Cloudera Express route is your most likely route. Also keep in mind that when using Cloudera Manager there is a greater need for resources to be allocated to the VM to handle it. You can read about it in the How to setup a Cloudera Quickstart Virtual Machine article.
... View more
05-05-2017
05:42 AM
Got it fixed! Directory '/dfs/nn' has been removed before, but 'dfs/dn' is still there! After I removed all these directories, it works!
... View more
04-18-2017
10:31 AM
Thanks for the update @Romainr. I will surely check with the MapR team. I just wanted to understand if log redaction could help us as the password is spitted out in the runcpserver.log.
... View more
03-21-2017
07:14 AM
I am able to connect finally. I had to authenticate using kerberos so initially I was authenticating like this : Sample () { Configuration conf = new Configuration(); conf.set("hadoop.security.authentication", "Kerberos"); UserGroupInformation.setConfiguration(conf); UserGroupInformation.loginUserFromKeytab(user, keytabPath); ugi = UserGroupInformation.getLoginUser(); } after this URL of this type : jdbc:impala://myhost.example.com:21050/;principal=impala/myhost.example.com@H2.EXAMPLE.COM;SSL=1;sslTrustStore=trustStorePath;trsutStorePassword=xyz; Creating datasource and get connection. This did not work and was giving above mentioned exception. Later Modification : Using AuthMech = 1 in URL and setting KrbHostFQDN, KrbServiceName, KrbAuthType in URL. Not executing Sample() after this and just setting these properties : java.security.krb5.conf = Your krb5.conf path java.security.auth.login.config = login.ini where login.ini is like this Client { com.sun.security.auth.module.Krb5LoginModule required useKeyTab=true keyTab="PathToTheKeyTab" principal="cloudera@CLOUDERA" doNotPrompt=true; }; Hopefully this may help to debug other guys struggling like me 🙂
... View more
03-21-2017
01:17 AM
If you are using Hive 1.3 you can use quarter() built in function. Since you are using String data type for date looks like you can use em . Reference - https://cwiki.apache.org/confluence/display/Hive/LanguageManual+UDF int quarter(date/timestamp/string) Returns the quarter of the year for a date, timestamp, or string in the range 1 to 4 (as of Hive 1.3.0) Example: quarter('2015-04-08') = 2.
... View more