Member since
10-01-2015
3933
Posts
1150
Kudos Received
374
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
3384 | 05-03-2017 05:13 PM | |
2802 | 05-02-2017 08:38 AM | |
3085 | 05-02-2017 08:13 AM | |
3014 | 04-10-2017 10:51 PM | |
1528 | 03-28-2017 02:27 AM |
10-01-2016
10:04 PM
Apache Nifi is more feature-rich, battle tested and servers many purposes. Simply, it has bidirectional flow whereas Flume only moves data to HDFS. There's also visual UI for real time command and control as opposed to Flume with only configuration property files to deal with. If you are in the beginning stages, do yourself a favor and go with Nifi.
... View more
10-01-2016
02:58 PM
1 Kudo
@Marc Schriever according to release notes for HDP 2.5 Sandbox, nfs is up automatically http://hortonworks.com/hadoop-tutorial/hortonworks-sandbox-guide/#section_1 HDFS
Portmap – org.apache.hadoop.portmap.Portmap
NameNode – org.apache.hadoop.hdfs.server.namenode.NameNode
DataNode – org.apache.hadoop.hdfs.server.datanode.DataNode
Nfs Portmap – Unlike the other processes that are launched by hdfs user, these are run as root user.
The nfs process doesn’t show up as a name for jps output
... View more
09-29-2016
04:41 PM
@Amit Dass please review the latest documentation for all available arguments with export https://sqoop.apache.org/docs/1.4.6/SqoopUserGuide.html#_literal_sqoop_export_literal
... View more
09-29-2016
04:36 PM
@X Long please accept the answer if it solved your problem. Thank you
... View more
09-29-2016
01:51 PM
@Amit Dass yes it is possible, please see my tutorial https://community.hortonworks.com/content/kbentry/14802/sqoop-importexport-tutorial.html
... View more
09-27-2016
05:45 PM
@Randy Gelhausen confirmed with @Devaraj Das snapshot captures all info including version information for completeness, here's an example http://stackoverflow.com/questions/28334940/how-to-get-all-versions-of-an-hbase-cell-in-a-spark-newapihadooprdd just need to apply to snapshot rather than table
... View more
09-27-2016
05:24 PM
I'll give it a whirl and let you know, until then you get +1
... View more
09-27-2016
05:19 PM
@Randy Gelhausen I don't see any reference to HBase cell versions here
... View more
09-27-2016
05:05 PM
1 Kudo
I don't see the levels of detail in hbase reference guide whether cell version can be accessed via hbase snapshot. Use case is I'd like to access an older version of cell via hive over hbase snapshot or via spark, is that information retained in snapshot and do I need HBase to access it or this info is retained in hfile and I can access it with anything other than hbase?
... View more
Labels:
- Labels:
-
Apache HBase
09-27-2016
01:57 AM
@Andrew Blum I think the answer is no, here's discussion if you're referring to the same exam question https://community.hortonworks.com/questions/20487/store-output-file-as-3-files-using-pig.html
... View more