Member since
08-23-2016
62
Posts
44
Kudos Received
8
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1831 | 11-13-2016 06:24 PM | |
34 | 11-13-2016 04:21 PM | |
174 | 11-13-2016 03:58 PM | |
831 | 10-05-2016 04:45 AM | |
129 | 09-29-2016 06:42 AM |
03-13-2017
01:03 PM
Hi Joe, Please refer following useful links for answer. What's the advantage of HDF Kerberisation ? http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.0/bk_security/content/ch_hdp-security-guide-overview.html is it only for Kafka and Storm ? https://hortonworks.com/blog/enabling-kerberos-hdp-active-directory-integration/ https://hortonworks.com/blog/office-hours-qa-on-yarn-in-hadoop-2/ Hope this will be useful.
... View more
03-02-2017
03:05 PM
Hi Jose, From error log message I found that it's because of checksum mismatch. Please refer below links. Hope it will work. 1. http://stackoverflow.com/questions/15434709/checksum-exception-when-reading-from-or-copying-to-hdfs-in-apache-hadoop 2. https://issues.apache.org/jira/browse/HDFS-6804 Thanks, Mahesh
... View more
12-27-2016
01:32 PM
1 Kudo
Hi community, can anyone help me to know about leader node selection in zookeeper clearly?
... View more
- Tags:
- Hadoop Core
- Zookeeper
12-17-2016
09:39 AM
Hi Manoj, Please refer below link hope it will be useful. http://stackoverflow.com/questions/18061332/storm-topology-configuration
... View more
11-25-2016
12:50 PM
can you please try the solutions mentioned in following link. Hope will work this time. https://community.cloudera.com/t5/Storage-Random-Access-HDFS/HBase-Master-Failed-to-become-active-master/td-p/27186
... View more
11-25-2016
07:58 AM
1 Kudo
Hi Varma, Please go through below links. Hope it will be useful. http://stackoverflow.com/questions/28119423/standard-practices-for-logging-in-mapreduce-jobs http://grepalex.com/2012/11/12/hadoop-logging/ Thanks, Mahesh
... View more
11-25-2016
07:43 AM
1 Kudo
Hi Harish, Before start working on HBase you can check the status of both Hbase Master and regionserver by using following commands. sudo service hbase-master status sudo service regionserver status If both are not working then start these service first and start working sudo service hbase-master start sudo service regionserver start Hope it will work. Thanks, Mahesh
... View more
11-24-2016
09:26 AM
Hi Vamsi, Please refer bleow links. http://stackoverflow.com/questions/18544602/how-to-flatten-a-group-into-a-single-tuple-in-pig https://pig.apache.org/docs/r0.7.0/piglatin_ref2.html Thanks, Mahesh
... View more
11-23-2016
09:55 AM
Hi Yogesh, Please refer below links. It will be useful for you. http://stackoverflow.com/questions/25257102/how-to-store-binary-data-in-hive https://community.hortonworks.com/questions/10764/effective-way-to-store-image-files-pdf-files-in-hd.html https://community.hortonworks.com/questions/4024/how-many-files-is-too-many-on-a-modern-hdp-cluster.html
... View more
11-22-2016
01:00 PM
Hi Magesh, By default Flume doesn't overwrite data existed in HDFS directory. You can find the updated data with timestamp.
... View more
11-17-2016
01:11 PM
Hi Aparna, Please go through this URL hope it will help you. http://stackoverflow.com/questions/25242287/filenotfoundexception-file-too-large
... View more
11-17-2016
12:28 PM
Hi, Can you please increase the following attribute values. agent.sinks.sink1.hdfs.rollCount = 100 (Number of events) please increase it to 1000. agent.sinks.sink1.hdfs.rollSize = 0 (Should be byte) make it to 5000. agent.sinks.sink1.rollInterval = 0 (Should be 500 seconds) Please try by using above values hope it will work. Thanks, Mahesh
... View more
11-17-2016
12:16 PM
Hi Lalith, I guess you didn't specified "-useHCatalot" in your script. Option "-useHCatalog" is not specified when starting pig. Please refer this link for more info. http://www.openkb.info/2014/11/failed-to-load-hive-table-in-pig-using_27.html
... View more
11-14-2016
03:53 PM
Hi Amith, Please refer this video he has explained very well MapReduce flow chart. Hope this will be useful. https://www.youtube.com/watch?v=6OemZEJdMp8 Thanks, Mahesh
... View more
11-14-2016
03:49 PM
Hi, I have same issue faces when I'm using clouera quick start. I did this to resolve it's very simple just go to that .CSV file location go to file properties copy the file location and give that same path in LOAD '/tmp/drivers.csv' and check.
... View more
11-13-2016
06:24 PM
Hi Kumar, Please check this https://issues.apache.org/jira/browse/HIVE-10294
... View more
11-13-2016
04:21 PM
1 Kudo
Hi Roger, Please refer this URL they have discussed same thing in this...it will be useful for you http://tecadmin.net/set-up-hadoop-multi-node-cluster-on-centos-redhat/#
... View more
11-13-2016
03:58 PM
1 Kudo
Hi, Please refer this link. Hope it will be useful. http://stackoverflow.com/questions/38402140/how-to-import-data-from-mysql-into-hive-using-apache-nifi
... View more
11-10-2016
08:16 AM
2 Kudos
Hi Suresh, Please refer this link. Hope this will be helpful for you. http://xingwu.me/2014/10/04/Implement-a-Flume-Deserializer-Plugin-to-Import-XML-Files/
... View more
11-09-2016
02:13 PM
1 Kudo
Hi Vamsi, In this case you have to check following things. 1. First check the column names are matching between Hive table columns and base "hbase.columns.mapping"=":key,cf1:name,cf1:role". 2. If column names are matching exactly but still facing issue means just once create table inside one database and try. I think it will work. Thanks!
... View more
11-09-2016
02:00 PM
1 Kudo
Hi Ajay, There are few known issues please refer this link https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.0/bk_HDP_RelNotes/content/known-issues-230.html
... View more
11-09-2016
01:26 PM
1 Kudo
Hi Vamsi, I have found some simple articles on this topic please go through following links. Hope it will be useful for you. http://www.ericlin.me/how-to-use-hive-lateral-view-in-your-query http://stackoverflow.com/questions/20667473/hive-explode-lateral-view-multiple-arrays http://stackoverflow.com/questions/33993123/hive-lateral-view-with-sample-example-with-hive-table-having-1-column-as-array Thanks, Mahesh
... View more
10-23-2016
12:55 PM
Hi, Apache Flume is used to collect, aggregate and move data into centralized data store. Please refer the following links for more and detailed information. Apache Kafka is a fast, scalable, durable, and fault-tolerant publish-subscribe messaging system http://flume.apache.org/FlumeUserGuide.html#exec-source http://hortonworks.com/apache/kafka/ Thanks, Mahesh
... View more
10-23-2016
12:50 PM
Hi, How to load .xml file into HDFS? just I wanted to know particular configurations to load XML file.
... View more
- Tags:
- flume-1.6
- Hadoop Core
Labels:
10-21-2016
06:37 AM
1 Kudo
HI Preethi, please check below link. http://stackoverflow.com/questions/24056863/oozie-sqoop-action-fails-to-import-data-to-hive Thanks, Mahesh
... View more
10-21-2016
06:21 AM
1 Kudo
Hi Rahul, You can add session timeout in your hbase-site.xml like this <property>
<name>zookeeper.session.timeout</name>
<value>60000</value>
</property>
Hopping this help Thanks, Mahesh
... View more
10-21-2016
06:16 AM
4 Kudos
HI, Please refer below example. With a little bash we can loop through all our tables, appending the results to a file:
#get a list of the files hive -e "show tables;" > hivetables.txt Now — cool stuff: for line in $(cat hivetables.txt) ;
do
results=$(hive -hiveconf tablename=$line -f test.hql)
echo $results >> tablecounts.txt done Hope this will be helpful. Thanks, Mahesh
... View more
10-21-2016
06:01 AM
Hi, Please go through once below example. Hope it will be useful. cat >mapfile 1,abc,40000,a$b$c,pf#500$epf#200,hyd$ap$500001 2,def,3000,d$f,pf#500,bang$kar$600038 hive> create table tab11(id int,name string,sal bigint,sub array<string>,dud map<string,int>,addr struct<city:string,state:string,pin:bigint>) > row format delimited
> fields terminated by ',' > collection items terminated by '$' > map keys terminated by '#'; hive> load data local inpath '/home/training/structfile' into table tab11;
... View more