Member since
06-24-2016
8
Posts
1
Kudos Received
0
Solutions
09-20-2016
08:17 PM
Thanks @R c - this is perfect. My only issue is on the Hortonworks Sandbox on Azure- there doesn't seem to be a /user/hdp/current/flume-server/conf directory. Is this an error or an accidental deletion possible?
... View more
09-16-2016
11:04 PM
I am preparing the Hortonworks Certification Exam and need assistance configuring Flume on the hortonworks sandbox. Essentially all I want to do is practice/complete the following tasks from the exam objectives: Given a Flume configuration file, start a Flume agent Given a configured sink and source, configure a Flume memory channel with a specified capacity
I see how to start a Flume agent and configure a memory channel etc from the user guide, but you cannot do either of those without providing a configuration file. Unfortunately, I cannot find documentation/tutorials/assistance anywhere on how to set up the configuration file on the Sandbox. I know what needs to go in the configuration file from the user guide, but I can't seem to access the Flume root folder from the system shell so that I can edit the configuration file - thus making it impossible to accomplish the above task. Does anyone know how this can be done - or, if I am missing something obvious? Or - if anyone knows any good walk through that don't assume prior knowledge of Flume - that would be wonderful.
... View more
Labels:
- Labels:
-
Apache Flume
08-30-2016
11:32 PM
1 Kudo
I am trying to upload data from my local machine to HDFS on Azure using the command line. This is a simple task when using the Ambari GUI - you simply hit browse and then select the file you want: However, this is not so simple a task in the command shell it seems. I've tried various methods and the only information I can find online are solutions involving Azure's HDInsight.
For clarity: Goal - upload a csv file from my local machine to HDFS on azure using the command line (Hortonworks Sandbox). The basic hdfs dfs -put command does not work as it can't find the file. The reason I'd like to do this on the command line is because the Hortonworks cert exam is entirely in the shell - so I'd like to understand the solution. Any assistance would be wonderful!
... View more
Labels:
- Labels:
-
Apache Hadoop
06-24-2016
10:50 PM
That worked - but now I get error scp: /cwarren Permission denied
... View more
06-24-2016
10:35 PM
Let me clarify - I have deployed the Sandbox on azure - not using a local VM.
... View more
06-24-2016
10:27 PM
I am a sandbox user. The port doesn't seem to be working however.
... View more
06-24-2016
10:21 PM
Using gitbash on windows, I'm attempting to transfer a file from my local downloads folder into azure following the instructions here: http://hortonworks.com/hadoop-tutorial/learning-the-ropes-of-the-hortonworks-sandbox/ Command: <code>scp -P 2222~/Downloads/Restaurants.csv cwarren@168.62.237.240:/cwarren I have verified that the host is correct. Error: ssh connect to host 168.62.237.240 port 2222: Connection timed out lost connection
... View more
Labels:
- Labels:
-
Apache Hadoop