Member since
10-01-2015
3933
Posts
1150
Kudos Received
374
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 3644 | 05-03-2017 05:13 PM | |
| 2998 | 05-02-2017 08:38 AM | |
| 3253 | 05-02-2017 08:13 AM | |
| 3209 | 04-10-2017 10:51 PM | |
| 1676 | 03-28-2017 02:27 AM |
05-06-2016
06:06 PM
1 Kudo
here's an example of CSVExcelStorage https://community.hortonworks.com/questions/5775/best-practice-for-extractoutput-data-generated-by.html and then you can execute sql commands in pig using https://cwiki.apache.org/confluence/display/Hive/HCatalog+LoadStore
... View more
05-06-2016
05:10 PM
right now there are no concrete release dates, I would wait until Hadoop Summit San Jose for any announcements.
... View more
05-06-2016
03:56 PM
I'll try this out and let you guys know. Thanks!
... View more
05-06-2016
03:00 PM
@simran kaur check virtualbox networking configuration, you may need to port forward Mysql port in Virtualbox network settings.
... View more
05-05-2016
08:35 AM
@Pradeep kumar with RS you do need to decomission it first. You can't just remove RS from a node and Ambari stops you from doing that, at leasts in UI, I would assume the same in API. Now a question, why would you accept an answer if you still have doubts? I recommend you test this in a dev environment.
... View more
05-05-2016
07:50 AM
Oozie Spark action is coming in HDP 2.4.2, it is not supported in versions of HDP below that.
... View more
05-05-2016
07:41 AM
1 Kudo
consider removing references to Spark in your yarn-site.xml, in Ambari you'd go to configs section and use filter for spark option.
... View more
05-05-2016
07:35 AM
1 Kudo
please review Spark User Guide for the specific class you're missing http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.4.0/bk_spark-guide/content/config-dra-manual.html
... View more
05-05-2016
07:31 AM
2 Kudos
I would also use NiFi's TailFile processor and PutKafka to achieve what you're doing.
... View more
05-05-2016
07:26 AM
1 Kudo
you can just use distcp https://community.hortonworks.com/questions/7165/how-to-copy-hdfs-file-to-aws-s3-bucket-hadoop-dist.html
... View more