About joshua_persinge

joshua_persinge · ‎03-27-2017

When i run this i get: oozie admin -oozie http://host:11000/oozie -shareliblist [Available ShareLib] hive distcp mapreduce-streaming spark oozie hcatalog hive2 sqoop pig spark_orig

joshua_persinge · ‎03-27-2017

@tli 2017-03-27 12:28:39,482 WARN HiveActionExecutor:523 - SERVER[] USER[hdfs] GROUP[-] TOKEN[] APP[test_workflow] JOB[0000049-170319180732598-oozie-oozi-W] ACTION[0000049-170319180732598-oozie-oozi-W@test_query] Launcher ERROR, reason: Main class [org.apache.oozie.action.hadoop.HiveMain], exception invoking main(), java.lang.ClassNotFoundException: Class org.apache.oozie.action.hadoop.HiveMain not found 2017-03-27 12:28:39,483 WARN HiveActionExecutor:523 - SERVER[] USER[hdfs] GROUP[-] TOKEN[] APP[test_workflow] JOB[0000049-170319180732598-oozie-oozi-W] ACTION[0000049-170319180732598-oozie-oozi-W@test_query] Launcher exception: java.lang.ClassNotFoundException: Class org.apache.oozie.action.hadoop.HiveMain not found java.lang.RuntimeException: java.lang.ClassNotFoundException: Class org.apache.oozie.action.hadoop.HiveMain not found at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2214) at org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:240) at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54) at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1724) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162) Caused by: java.lang.ClassNotFoundException: Class org.apache.oozie.action.hadoop.HiveMain not found at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2120) at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2212) ... 9 more

joshua_persinge · ‎03-27-2017

Trying to run a basic oozie workflow that completes a hive action and i keep getting this error: java.lang.ClassNotFoundException: Class org.apache.oozie.action.hadoop.HiveMain not found Here is the XML workflow: <workflow-app xmlns = "uri:oozie:workflow:0.5" name = "test_workflow"> <start to = "test_query" />  <action name = "test_query"> <hive xmlns = "uri:oozie:hive-action:0.5"> <job-tracker>jobtracker</job-tracker> <name-node>nameNode</name-node> <configuration> <property> <name>oozie.use.system.libpath</name> <value>true</value> </property> <property> <name>oozie.libpath</name> <value>nameNode/user/oozie/share/lib/lib_20161215134654</value> </property> </configuration> <script>hdfspath/hive.hql</script> </hive> <ok to = "end" /> <error to = "kill_job" /> </action> <kill name = "kill_job"> <message>Job Failed</message> </kill> <end name = "end" /> </workflow-app>

joshua_persinge · ‎09-14-2016

Found the culprit, it's the CSVSerde, it casts all fields as strings.

joshua_persinge · ‎09-14-2016

I just tried following the method shown here: https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.0/bk_dataintegration/content/moving_data_from_hdfs_to_hive_external_table_method.html I created the ORC table and it still stores everything as a string

joshua_persinge · ‎09-14-2016

I am creating an external table with some fields that are numeric decimals. I have tried declaring them as floats, doubles, and decimal formats, but hive is casting them as strings regardless. Here is a sample of the query: create external table sapbw.copa_ods(currency_type string, cost_for_fi decimal, gross_margin_fi decimal, sales_for_fi decimal) ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.OpenCSVSerde' stored as textfile location '/data_LZ/BW/COPA_ODS'; Why is this happening?

joshua_persinge · ‎06-16-2016

So I found that if i force a query using --query it will work, but if I let sqoop generate the query it does not. Example --query "select * from \"BI0/TCUSTOMER\"" will work, but referring to the table in the same way by using the --table \"BI0/TCUSTOMER\" argument does not work. So the problem must be when sqoop generates the SQL query on its own, it is not syntactically correct. If there was a way to see the query it was generating that would be very helpful to troubleshoot it, but as far as I know there is not.

joshua_persinge · ‎06-13-2016

Any updates on this?

joshua_persinge · ‎06-09-2016

I tried that and got this error: ERROR manager.SqlManager: Error executing statement: com.sap.db.jdbc.exceptions.JDBCDriverException: SAP DBTech JDBC: [257]: sql syntax error: incorrect syntax near "AS": line 1 col 19 (at pos 19) com.sap.db.jdbc.exceptions.JDBCDriverException: SAP DBTech JDBC: [257]: sql syntax error: incorrect syntax near "AS": line 1 col 19 (at pos 19)

joshua_persinge · ‎06-08-2016

Got the same error: 16/06/08 16:20:49 ERROR tool.ImportTool: Encountered IOException running import job: java.io.FileNotFoundException: /tmp/sqoop-hdfs/compile/2fb644a9751cabd5c187540154e2e696/SAPR3."/BI0/TCUSTOMER".jar (No such file or directory)

Online	Offline
Last Visited	‎12-21-2017 06:29 PM

Member Since	‎04-20-2016 09:19 PM
Last Visited	‎12-21-2017 06:29 PM
Posts	35
Kudos received	6

Cloudera Community

Cloudera Community

Re: Hive ignoring data type declarations in create...

Re: Oozie Hive Action Class Not Found Exception

Re: Oozie Hive Action Class Not Found Exception

Oozie Hive Action Class Not Found Exception

Re: Hive ignoring data type declarations in create...

Re: Hive ignoring data type declarations in create...

Hive ignoring data type declarations in create tab...

Re: Problems importing tables from SAP that have /...

Re: Problems importing tables from SAP that have /...

Re: Problems importing tables from SAP that have /...

Re: Problems importing tables from SAP that have /...