Member since
12-18-2015
7
Posts
1
Kudos Received
0
Solutions
01-22-2016
03:45 PM
thanks Neeraj. Do you have any ideas why the gedit won't run? And is there no other already-installed simple non-vi editor in the sandbox?
... View more
01-22-2016
01:58 PM
'gedit' does not seem to be available on the sandbox, so I installed it using 'yum install gedit'. But then when I run gedit it says "Gtk-WARNING **: cannot open display". I am using the webclient SSH shell on 127.0.0.1:4200 Any suggestions on how to resolve this? And/or is there another easy-to-use editor already installed (other than vi)? thanks!
... View more
01-15-2016
04:24 PM
Thanks Ancil, that works, although I actually did it slightly differently based on another post, using '..-R root:root..' rather than ..-R root:hdfs..'. I guess that means I've changed the group to 'root' when I could've left it as 'hdfs'. Didn't seem to matter, so far.
... View more
01-15-2016
11:06 AM
Thanks Neeraj, But it seems there is no 'root' directory under '/user' in my HDFS anyway. So running the 'chown' command you gave above it says "No such file or directory". When I try it on just the '/user' directory (ie. .. -chown .. /user) it says "Permission denied: user=root is not the owner of inode=user So I tried changing the sqoop target-dir to a folder under /tmp, but it still complains about denied access to '/user/root'. ?? I guess I'm not understanding how the hadoop hdfs folders, owners, permissions etc fit together, and cannot find a clear summary of it anywhere.
... View more
01-14-2016
08:59 PM
I am using Hortonworks Sandbox (a clean setup), and created a simple table in mysql which I want to sqoop into hdfs. I'm used the MySql that was already installed on the sandbox, by running 'mysql' in the shell. My first attempt at sqoop was: sqoop import --connect jdbc:mysql://localhost/test --table mytable This gave "..access denied to localhost.." error, so based on an answer another post, and finding the MySQL port using "show variables like 'port'" within MySQL, I then tried: sqoop import --connect jdbc:mysql://sandbox.hortonworks.com:3306/test --username root --table mytable This gave errors about ".. streaming result sets are open...", which was solved by another post by adding the 'driver' argument as follows: sqoop import --connect jdbc:mysql://sandbox.hortonworks.com:3306/test --username root --table mytable --driver com.mysql.jdbc.Driver It now gets a bit further, but now fails with a RemoteException: ...Permission denied: user=root, access=WRITE, inode="user/root/.staging":hdfs:hdfs:drwxr-xr-x That's as far as I've got. Am I doing something wrong, or do I need to set up some access permissions somewhere? I would've expected that many people have been sqooping from MySql without having to change the set up, so is my sqoop command incorrect?
... View more
Labels:
- Labels:
-
Apache Sqoop
-
HDFS
12-18-2015
10:21 PM
1 Kudo
in the sandbox tutorial Lab-4 on Spark, when running this statement: risk_factor_spark.saveAsOrcFile("risk_factor_spark") it gives me the following error: error: value saveAsOrcFile is not a
member of org.apache.spark.sql.DataFrame I
have done the 'import org.apache.spark.sql.hive.orc._' earlier in the lab. Also tried capital '..ORC..'. And I am using the built-in web client for the SSH client. Any
suggestions?
... View more
Labels:
- Labels:
-
Apache Spark