sample-complex.txtHi All, I am running PIG query as mentioned below grunt> a = LOAD '/user/maria_dev/Sample_Complex.txt' USING JsonLoader ('recipe:chararray,ingredients:{(name:chararray)},inventor:(name:chararray,age:int)'); grunt> b = FOREACH a GENERATE recipe; grunt> DUMP b; Output is (Tacos) (TomatoSoup) But I want to get the output as Recipe (Tacos) (TomatoSoup) Please Suggest Samle dataset is also attached ... View more

Hi , I am unable to upload json file in HDFS using Ambari ( File View ). Getting error as Attached Sample file is also attached for your reference. ... View more

Hi All, I want to download live tweets from twitter.com into hdfs. i have followed all the steps mentioned in the link https://www.eduonix.com/blog/bigdata-and-hadoop/flume-installation-and-streaming-twitter-data-using-flume/ In flume.conf i need few clarification like as mentioned in flume.conf file TwitterAgent.sources.Twitter.type = com.cloudera.flume.source.TwitterSource TwitterAgent.sinks.HDFS.hdfs.path=hdfs://localhost:9000/user/flume/tweets I am using hdp 2.4 sandbox . So what will be values for TwitterAgent.sources.Twitter.type = TwitterAgent.sinks.HDFS.hdfs.path= Please help me on this. Regards Abhishek ... View more

Hi , I am doing sqoop import from oracle using below command sqoop import --connect jdbc:oracle:thin:@192.168.146.1:1521/orcl \ --username scott --password orcl --table emp --target-dir /tmp/test/ --m 1 But getting below error like Please set $ACCUMULO_HOME to the root of your Accumulo installation. 16/06/14 17:41:29 INFO sqoop.Sqoop: Running Sqoop version: 1.4.5.2.2.0.0-2041 16/06/14 17:41:29 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead. 16/06/14 17:41:30 INFO oracle.OraOopManagerFactory: Data Connector for Oracle and Hadoop is disabled. 16/06/14 17:41:30 INFO manager.SqlManager: Using default fetchSize of 1000 16/06/14 17:41:30 INFO tool.CodeGenTool: Beginning code generation 16/06/14 17:42:31 ERROR manager.SqlManager: Error executing statement: java.sql.SQLRecoverableException: IO Error: The Network Adapter could not establish the connection java.sql.SQLRecoverableException: IO Error: The Network Adapter could not establish the connection at oracle.jdbc.driver.T4CConnection.logon(T4CConnection.java:548) at oracle.jdbc.driver.PhysicalConnection.<init>(PhysicalConnection.java:564) at oracle.jdbc.driver.T4CConnection.<init>(T4CConnection.java:251) at oracle.jdbc.driver.T4CDriverExtension.getConnection(T4CDriverExtension.java:29) at oracle.jdbc.driver.OracleDriver.connect(OracleDriver.java:563) at java.sql.DriverManager.getConnection(DriverManager.java:571) at java.sql.DriverManager.getConnection(DriverManager.java:215) at org.apache.sqoop.manager.OracleManager.makeConnection(OracleManager.java:327) at org.apache.sqoop.manager.GenericJdbcManager.getConnection(GenericJdbcManager.java:52) at org.apache.sqoop.manager.SqlManager.execute(SqlManager.java:736) at org.apache.sqoop.manager.SqlManager.execute(SqlManager.java:759) at org.apache.sqoop.manager.SqlManager.getColumnInfoForRawQuery(SqlManager.java:269) at org.apache.sqoop.manager.SqlManager.getColumnTypesForRawQuery(SqlManager.java:240) at org.apache.sqoop.manager.SqlManager.getColumnTypes(SqlManager.java:226) at org.apache.sqoop.manager.ConnManager.getColumnTypes(ConnManager.java:295) at org.apache.sqoop.orm.ClassWriter.getColumnTypes(ClassWriter.java:1773) at org.apache.sqoop.orm.ClassWriter.generate(ClassWriter.java:1578) at org.apache.sqoop.tool.CodeGenTool.generateORM(CodeGenTool.java:96) at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:478) at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:601) at org.apache.sqoop.Sqoop.run(Sqoop.java:143) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:179) at org.apache.sqoop.Sqoop.runTool(Sqoop.java:218) at org.apache.sqoop.Sqoop.runTool(Sqoop.java:227) at org.apache.sqoop.Sqoop.main(Sqoop.java:236) Caused by: oracle.net.ns.NetException: The Network Adapter could not establish the connection at oracle.net.nt.ConnStrategy.execute(ConnStrategy.java:436) at oracle.net.resolver.AddrResolution.resolveAndExecute(AddrResolution.java:451) at oracle.net.ns.NSProtocol.establishConnection(NSProtocol.java:897) at oracle.net.ns.NSProtocol.connect(NSProtocol.java:271) at oracle.jdbc.driver.T4CConnection.connect(T4CConnection.java:1663) at oracle.jdbc.driver.T4CConnection.logon(T4CConnection.java:385) ... 25 more Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:579) at oracle.net.nt.TcpNTAdapter.connect(TcpNTAdapter.java:146) at oracle.net.nt.ConnOption.connect(ConnOption.java:130) at oracle.net.nt.ConnStrategy.execute(ConnStrategy.java:402) ... 30 more 16/06/14 17:42:31 ERROR tool.ImportTool: Encountered IOException running import job: java.io.IOException: No columns to generate for ClassWriter at org.apache.sqoop.orm.ClassWriter.generate(ClassWriter.java:1584) at org.apache.sqoop.tool.CodeGenTool.generateORM(CodeGenTool.java:96) at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:478) at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:601) at org.apache.sqoop.Sqoop.run(Sqoop.java:143) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:179) at org.apache.sqoop.Sqoop.runTool(Sqoop.java:218) at org.apache.sqoop.Sqoop.runTool(Sqoop.java:227) at org.apache.sqoop.Sqoop.main(Sqoop.java:236) Please help me on this. Regards Abhishek ... View more

Hi , I am doing sqoop import from Teradata to HDFS in hortonworks 2.2 using below command . Below settings have been done Placed below the jar files @ /usr/hdp/2.2.0.0-2041/sqoop/lib 1.teradata-connector-1.3.4-hdp2.2.noarch.rpm 2.terajdbc4.jar 3.tdgssconfig.jar 4.hdp-connector-for-teradata-1.4.1.2.3.2.0-2950-distro.tar Run the below command from /usr/hdp/current/sqoop-client/bin sqoop import --connection-manager org.apache.sqoop.teradata.TeradataConnManager \ --connect jdbc:teradata://192.168.146.130/Database=retail \ --connection-manager org.apache.sqoop.teradata.TeradataConnManager \ --table client --username dbc --password dbc \ --target-dir /usr/hue/Abhishek Getting below error Warning: /usr/hdp/2.2.0.0-2041/accumulo does not exist! Accumulo imports will fail. Please set $ACCUMULO_HOME to the root of your Accumulo installation. 16/06/11 13:28:04 INFO sqoop.Sqoop: Running Sqoop version: 1.4.5.2.2.0.0-2041 16/06/11 13:28:04 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead. 16/06/11 13:28:04 ERROR sqoop.ConnFactory: Sqoop could not found specified connection manager class org.apache.sqoop.teradata.TeradataConnManager. Please check that you've specified the class correctly. 16/06/11 13:28:04 ERROR tool.BaseSqoopTool: Got error creating database manager: java.io.IOException: java.lang.ClassNotFoundException: org.apache.sqoop.teradata.TeradataConnManager at org.apache.sqoop.ConnFactory.getManager(ConnFactory.java:166) at org.apache.sqoop.tool.BaseSqoopTool.init(BaseSqoopTool.java:249) at org.apache.sqoop.tool.ImportTool.init(ImportTool.java:89) at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:589) at org.apache.sqoop.Sqoop.run(Sqoop.java:143) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:179) at org.apache.sqoop.Sqoop.runTool(Sqoop.java:218) at org.apache.sqoop.Sqoop.runTool(Sqoop.java:227) at org.apache.sqoop.Sqoop.main(Sqoop.java:236) Caused by: java.lang.ClassNotFoundException: org.apache.sqoop.teradata.TeradataConnManager at java.net.URLClassLoader$1.run(URLClassLoader.java:366) at java.net.URLClassLoader$1.run(URLClassLoader.java:355) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:354) at java.lang.ClassLoader.loadClass(ClassLoader.java:425) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) at java.lang.ClassLoader.loadClass(ClassLoader.java:358) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:191) at org.apache.sqoop.ConnFactory.getManager(ConnFactory.java:146) ... 9 more ------------------------ Please help me on this and let me know the solution. Regards Abhishek ... View more