Member since
01-05-2018
24
Posts
0
Kudos Received
0
Solutions
01-07-2018
12:43 AM
@ Jay Kumar SenSharma thank you. Two questions: 1. Is there a way to merge the files directly from HDFS, or do you need to merge them to local file system and then back to HDFS? 2. I was following your instructions, but on point 4 with getmerge, I used this: hdfs dfs -getmerge /user/maria_dev/Folder1/* /maria_dev/Folder1/output.csv I have a folder called Folder1 (it is also on local file system under maria_dev folder as Folder1 but get the same error: getmerge: Mkdirs failed to create file:/maria_dev/Folder1 (exists=false, cwd=file:/home/maria_dev) Have I missed a step or written this incorrectly? Thanks
... View more
01-07-2018
12:04 AM
How can I now join all the files in one folder to one single csv file? I have a folder called Folder1 and I want to combine them all to a file called "output.csv". I tried:
hadoop fs -getmerge Folder1 /user/maria_dev/output.csv But I get the error:
getmerge: Mkdirs failed to create file:/user/maria_dev (exists=false, cwd=file:/home/maria_dev) I also tried: hadoop fs -cat Folder1 /output.csv But receive error: No such file or directory. Thanks
... View more
Labels:
- Labels:
-
Apache Hadoop
01-07-2018
12:01 AM
@ Jay Kumar SenSharma thank you for letting me know, as I am new to the community. I will mark this as answered and open another question.
... View more
01-06-2018
11:27 PM
@ Jay Kumar SenSharma many thanks. I have successfully moved a file (and now subsequently a folder which was my initial aim) to the maria_dev folder. How can I now join all the files in the folder to one single csv file? I tried: hadoop fs -getmerge Folder1 /user/maria_dev/output.csv But I get the error: getmerge: Mkdirs failed to create file:/user/maria_dev (exists=false, cwd=file:/home/maria_dev) I am trying to join all the files in Folder1 folder to a file called "output.csv" in the same folder. Thanks
... View more
01-06-2018
10:11 PM
@ Harald Berghoff thank you for your reply. I have installed WinSCP and I can see 2 drop down folders: 1. / <root> 2. root Which one is the correct directory? I have moved one file over as an example (called sample.txt) from my PC to the root folder as shown in the attached screen shot. How can I now move this file over to HDFS (or Sandbox?) using command line with Putty. I am logged into Putty as shown in the attached screen shot. pic1.jpgpic2.jpg
... View more
01-06-2018
06:10 AM
Hi I am completely new to Sandbox and I am struggling with connection to my local windows PC. All I have done is the following: 1. Downloaded and installed Oracle VirtualBox Manager. 2. Imported applicance - Hortonworks Sandbox. 3. Started my VM and logged into Ambari via my browser with maria_dev. Here is where I have a problem. How can I get the VM or Hortonworks to talk to my windows PC so that I can transfer files via command line? I know that I can use the upload via Ambari but I wish to transfer multiple files at once. What other steps are required? Do I need to set up another user in sandbox? Any help or advice for a newbie would be greatly appreciated. Thanks.
... View more
Labels:
- Labels:
-
Apache Ambari
-
HDFS
01-05-2018
09:48 AM
@ Jay Kiumar SenSharma ok thank you for your help anyway. I appreciate you replying to me even though I have had no success with it.
... View more
01-05-2018
09:27 AM
@ Jay Kumar SenSharma thank you for your reply. From Putty I used your command above: ssh root@127.0.0.1 -p 2222 And received the following error: ssh: connect to host 127.0.0.1 port 2222: Connection refused Can you also please explain what you mean by "you will need to SCP your files to Sandbox and then from Sandbox you can put them to HDFS"?
... View more
01-05-2018
09:13 AM
@ Jay Kumar SenSharma thank you, however I wish to upload multiple files at once from a directory. In Ambari File View, I can only upload a single file if I understand correctly.
... View more
01-05-2018
09:10 AM
@ Jay Kumar SenSharma Could you please explain how the user who is running hadoop command can belong to "hadoop" group?
... View more
- « Previous
-
- 1
- 2
- Next »