Member since
08-23-2016
62
Posts
44
Kudos Received
8
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
20763 | 11-13-2016 06:24 PM | |
897 | 11-13-2016 04:21 PM | |
1682 | 11-13-2016 03:58 PM | |
8968 | 10-05-2016 04:45 AM | |
1906 | 09-29-2016 06:42 AM |
03-02-2017
03:05 PM
Hi Jose, From error log message I found that it's because of checksum mismatch. Please refer below links. Hope it will work. 1. http://stackoverflow.com/questions/15434709/checksum-exception-when-reading-from-or-copying-to-hdfs-in-apache-hadoop 2. https://issues.apache.org/jira/browse/HDFS-6804 Thanks, Mahesh
... View more
11-25-2016
07:58 AM
1 Kudo
Hi Varma, Please go through below links. Hope it will be useful. http://stackoverflow.com/questions/28119423/standard-practices-for-logging-in-mapreduce-jobs http://grepalex.com/2012/11/12/hadoop-logging/ Thanks, Mahesh
... View more
11-23-2016
09:55 AM
Hi Yogesh, Please refer below links. It will be useful for you. http://stackoverflow.com/questions/25257102/how-to-store-binary-data-in-hive https://community.hortonworks.com/questions/10764/effective-way-to-store-image-files-pdf-files-in-hd.html https://community.hortonworks.com/questions/4024/how-many-files-is-too-many-on-a-modern-hdp-cluster.html
... View more
11-17-2016
01:11 PM
Hi Aparna, Please go through this URL hope it will help you. http://stackoverflow.com/questions/25242287/filenotfoundexception-file-too-large
... View more
11-14-2016
03:53 PM
Hi Amith, Please refer this video he has explained very well MapReduce flow chart. Hope this will be useful. https://www.youtube.com/watch?v=6OemZEJdMp8 Thanks, Mahesh
... View more
11-13-2016
06:24 PM
Hi Kumar, Please check this https://issues.apache.org/jira/browse/HIVE-10294
... View more
11-13-2016
04:21 PM
1 Kudo
Hi Roger, Please refer this URL they have discussed same thing in this...it will be useful for you http://tecadmin.net/set-up-hadoop-multi-node-cluster-on-centos-redhat/#
... View more
11-13-2016
03:58 PM
1 Kudo
Hi, Please refer this link. Hope it will be useful. http://stackoverflow.com/questions/38402140/how-to-import-data-from-mysql-into-hive-using-apache-nifi
... View more
11-09-2016
01:26 PM
1 Kudo
Hi Vamsi, I have found some simple articles on this topic please go through following links. Hope it will be useful for you. http://www.ericlin.me/how-to-use-hive-lateral-view-in-your-query http://stackoverflow.com/questions/20667473/hive-explode-lateral-view-multiple-arrays http://stackoverflow.com/questions/33993123/hive-lateral-view-with-sample-example-with-hive-table-having-1-column-as-array Thanks, Mahesh
... View more
10-21-2016
06:16 AM
4 Kudos
HI, Please refer below example. With a little bash we can loop through all our tables, appending the results to a file:
#get a list of the files hive -e "show tables;" > hivetables.txt Now — cool stuff: for line in $(cat hivetables.txt) ;
do
results=$(hive -hiveconf tablename=$line -f test.hql)
echo $results >> tablecounts.txt done Hope this will be helpful. Thanks, Mahesh
... View more