Member since
12-25-2015
11
Posts
1
Kudos Received
0
Solutions
09-01-2016
11:38 AM
please check the permission of python installation directories and see your current user is having correct permission or not. Also try to simulate scenarios using root user. I hope using root user it should work.
... View more
01-18-2016
06:44 PM
1 Kudo
I am getting below error while executing Simple mapreduce programme using eclipse 'mars'
Hadoop 2.6
ubuntu: 15.05 (hacked it and made it 14.04 to avaoid any compatibility issues with hadoop)
using hadoopeclipse pluggin 2.6
Note that i am able to connect to HDFS via eclipse plugging since in the DFS location on right hand side i can
see the directory structure of HDFS.
Please find below the settings in eclipse and help to overcome the error while executing Mapreduce programme.
(Please note that if i make a jar out of the project via eclipse and run it in traditional command prompt way, i am
getting no issues(as the output and results are clearly visible in DFS location in eclipse, but i want to run it wia
eclipse as a whole))
Error while exeuting the programme :
Picked up JAVA_TOOL_OPTIONS: javaagent:/usr/share/java/jayatanaag.jar
20160108 07:32:46,255 INFO [main] datanode.DataNode
(StringUtils.java:startupShutdownMessage(633)) STARTUP_MSG:
/************************************************************
.....
...
..
STARTUP_MSG: build = https://gitwipus.apache.org/repos/asf/hadoop.git r
e3496499ecb8d220fba99dc5ed4c99c8f9e33bb1; compiled by 'jenkins' on 20141113T21:10Z
STARTUP_MSG: java = 1.8.0_66
************************************************************/
20160108 07:32:46,271 INFO [main] datanode.DataNode (SignalLogger.java:register(91))
registered UNIX signal handlers for [TERM, HUP, INT]
Usage: java DataNode [regular | rollback]
regular : Normal DataNode startup (default).
rollback : Rollback a standard or rolling upgrade.
Refer to HDFS documentation for the difference between standard
and rolling upgrades.
20160108 07:32:46,770 WARN [main] datanode.DataNode (DataNode.java:secureMain(2392))
Exiting Datanode
20160108 07:32:46,773 INFO [main] util.ExitUtil (ExitUtil.java:terminate(124)) Exiting
with status 1
20160108 07:32:46,778 INFO [Thread1] datanode.DataNode (StringUtils.java:run(659))
SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down DataNode at prince/127.0.1.1
************************************************************/
... View more
Labels:
- Labels:
-
Apache Hadoop
12-21-2015
06:53 PM
I want to proceed with distributed cluster. not standalone or sandbox Full flashed Production grade server
... View more
12-21-2015
05:30 PM
Labels:
- Labels:
-
Apache Spark
12-10-2015
05:29 AM
execution following eval function getting error sqoop eval --connect jdbc:mysql://localhost.localdomain/sqoop_test --table emp --username root --query "SELECT * FROM emp" Warning: /usr/lib/sqoop/../accumulo does not exist! Accumulo imports will fail.
Please set $ACCUMULO_HOME to the root of your Accumulo installation.
15/12/09 21:21:39 INFO sqoop.Sqoop: Running Sqoop version: 1.4.3-cdh4.7.0
15/12/09 21:21:39 ERROR tool.BaseSqoopTool: Error parsing arguments for eval:
15/12/09 21:21:39 ERROR tool.BaseSqoopTool: Unrecognized argument: --table
15/12/09 21:21:39 ERROR tool.BaseSqoopTool: Unrecognized argument: emp
15/12/09 21:21:39 ERROR tool.BaseSqoopTool: Unrecognized argument: --username
15/12/09 21:21:39 ERROR tool.BaseSqoopTool: Unrecognized argument: root
15/12/09 21:21:39 ERROR tool.BaseSqoopTool: Unrecognized argument: --query
15/12/09 21:21:39 ERROR tool.BaseSqoopTool: Unrecognized argument: SELECT * FROM emp
Try --help for usage instructions.
usage: sqoop eval [GENERIC-ARGS] [TOOL-ARGS]
... View more
Labels:
- Labels:
-
Apache Sqoop