Member since
04-11-2016
535
Posts
148
Kudos Received
77
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
9104 | 09-17-2018 06:33 AM | |
2377 | 08-29-2018 07:48 AM | |
3376 | 08-28-2018 12:38 PM | |
2866 | 08-03-2018 05:42 AM | |
2584 | 07-27-2018 04:00 PM |
07-07-2017
05:44 AM
1 Kudo
@swagat challagondla Have you added custom jar for class "'com.ibm.spss.hive.serde2.xml.XmlInputFormat" before creating the table?
... View more
07-06-2017
06:44 PM
@rama Try launching Hive cli as 'hive --hiveconf hive.execution.engine=mr".
... View more
07-06-2017
06:10 PM
@Akhil Reddy There is no syntax issue with query, could you please share the issue you are facing?
... View more
07-06-2017
05:39 PM
@Arnault Droz If the mysqldump is for different version other than Hive 2.1.1000 in HDP 2.6. Then do the following: 1. Stop Hive services from Ambari. 2. Create new database under MySQL as say hive2: mysql> create database hive2;
Query OK, 1 row affected (0.00 sec)
mysql> grant all privileges on hive2.* to 'hive'@'%' identified by 'hive';
Query OK, 0 rows affected (0.00 sec) 3. Restore database as: mysql -u hive -phive hive2 < dumpfilename.sql 4. Update database connection string for mysql under Ambari -> Hive configs. 5. Save configurations and try restarting. Since there is different in VERSION, this would fail. 6. Run Hive metatool command to upgrade the schema as below: hive@ssnode260 bin]$ /usr/hdp/2.6.0.3-8/hive2/bin/schematool -upgradeSchema -dbType mysql 7. Restart Hive services from Ambari. If the Hive metadata version is same as Hive 2.1.1000 in HDP 2.6, then follow steps 1 through 5. Hope this helps.!!
... View more
07-06-2017
05:22 PM
1 Kudo
@Akhil Reddy For tez, you need to use below parameter to set min and max splits of data:
set tez.grouping.min-size=16777216;--16 MB min split set tez.grouping.max-size=64000000;--64 GB max split Increase min and max split size to reduce the number of mappers.
... View more
07-05-2017
08:33 AM
@Anurag Mishra The fsimage would be under <namenode_dir>/current.
... View more
06-14-2017
06:13 AM
@Stinger You need to collect the statistics for the table using query 'analyze table', then use describe formatted and describe extended to see the information related to data and number of files.
... View more
06-12-2017
07:07 AM
@Gopalakrishnan Veeran Check the application log for the query run and also, Resource Manager entries for that application. The issue could be more than the 'Broken pipe'.
... View more
06-03-2017
03:17 AM
@Manikandan Jeyabal Glad to hear it worked with --password-file, you could also try updating the password in sqoop-site.xml under 'sqoop.metastore.client.autoconnect.password' and try.
... View more
05-31-2017
07:42 AM
@mÁRIO Rodrigues
This seems to be known issue and Jira DRILL-5214 has been raised for the same. You could remove "L3.L_SUPPKEY <> L1.L_SUPPKEY" and "L2.L_SUPPKEY <> L1.L_SUPPKEY", and try using "NOT IN" with sub-query.
... View more