question how to import data in Support Questions

how to import data

hugo1 — Sun, 18 Aug 2019 10:02:38 GMT

Hi Guys, how are you? Hope so. I have a question, see if you can help me. Everything I create through the web interface only appears in the web interface, if I create a folder in / tmp for example, via terminal, it is not available in the Ambari interface and vice-versa. Even setting groups and permissions ... I'm using IBM's Hadoop service.

Re: how to import data

sandyy006 — Mon, 02 Jul 2018 21:29:18 GMT

@Hugo Cosme

Not sure how you are doing the "ls" in terminal. Ambari interface list and the list from "hdfs dfs -ls /tmp/" command terminal should match.

Re: how to import data

hugo1 — Mon, 02 Jul 2018 21:47:25 GMT

Hey, it worked out right .. thanks for the tip! Now another point, how do I access this directory? I tried the "hdfs dfs -cd / tmp /" command, but it did not work! I wanted to get into that directory and copy the data there with "wget" and then unzip them with a "tar -xzvf"

Re: how to import data

sandyy006 — Mon, 02 Jul 2018 23:07:15 GMT

This is not how HDFS works 🙂 you will have to configure NFS to be able to cd and other stuff (https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.4/bk_hdfs-nfs-gateway-user-guide/content/hdfs-nfs-gateway-user-guide.html)

Alternatively you can "wget" the files to hdfs client machine and then copy the files to hdfs using "hdfs dfs -put <local-source> <hdfs destination>"

Re: how to import data

hugo1 — Tue, 03 Jul 2018 02:20:48 GMT

Hi, how are you?
I even noticed that things do not work out like I imagined, lol! I found the documentation after your first tip, thanks for this.
My problem now, is to map my IBM CloudStorage to my Hadoop, this is making me confused, but I'm evolving!