Member since
09-18-2015
3274
Posts
1159
Kudos Received
426
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 2578 | 11-01-2016 05:43 PM | |
| 8558 | 11-01-2016 05:36 PM | |
| 4881 | 07-01-2016 03:20 PM | |
| 8213 | 05-25-2016 11:36 AM | |
| 4354 | 05-24-2016 05:27 PM |
12-04-2015
01:03 AM
2 Kudos
@Vedant Jain sqoop uses 4 mappers by default. Try running with option -m 1 or any other number to see if it makes the difference. Copying following line from this as it does make sense. Using the "top x" or "limit x" clauses do not make much sense with Sqoop as it can return different values on each query execution (there is no "order by"). Also in addition the clause will very likely confuse split generation, ending with not that easily deterministic outputs. Having said that I would recommend you to use only 1 mapper (-m 1 or --num-mappers 1) in case that you need to import predefined number of rows
... View more
12-04-2015
12:53 AM
1 Kudo
@Shane Kumpf @Wes Floyd That's good to know https://access.redhat.com/documentation/en-US/Red_Hat_Enterprise_Linux/7/html/Migration_Planning_Guide/sect-Red_Hat_Enterprise_Linux-Migration_Planning_Guide-File_System_Formats.html XFS is a very high performance, scalable file system and is routinely deployed in the most demanding applications. In Red Hat Enterprise Linux 7, XFS is the default file system and is supported on all architectures.
Ext4, which does not scale to the same size as XFS, is fully supported on all architectures and will continue to see active development and support.
... View more
12-03-2015
10:52 PM
@Jonas Straub @Guilherme Braccialli Never know ..all related to each other 🙂
... View more
12-03-2015
09:55 PM
@Guilherme Braccialli Please see this https://issues.apache.org/jira/browse/HADOOP-11461
... View more
12-03-2015
02:26 PM
1 Kudo
Google storage and Hive works fine as per this setup https://community.hortonworks.com/questions/553/hive-and-google-cloud-storage.html Is it possible to change hive.metastore.warehouse.dir to google bucket?
... View more
Labels:
- Labels:
-
Apache Hive
12-02-2015
09:16 PM
1 Kudo
@Wes Floyd All ext4 ...None XFS
... View more
12-02-2015
04:21 PM
@Piotr Pruski Try this http://hortonworks.com/blog/easy-steps-to-create-hadoop-cluster-on-microsoft-azure/
... View more
12-02-2015
03:30 PM
@Jeremy Dyer This is good read and may help to decide the serving layer. If you are storing data and index on HDFS then I will go with 1. https://community.hortonworks.com/questions/4858/solrcloud-performance-hdfs-indexdata.html#answer-4843
... View more
12-02-2015
02:35 PM
Thanks @peeyush
... View more