Member since
04-20-2016
35
Posts
6
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2711 | 09-14-2016 08:05 PM |
03-27-2017
07:12 PM
When i run this i get: oozie admin -oozie http://host:11000/oozie -shareliblist [Available ShareLib] hive distcp mapreduce-streaming spark oozie hcatalog hive2 sqoop pig spark_orig
... View more
03-27-2017
06:23 PM
@tli 2017-03-27 12:28:39,482 WARN HiveActionExecutor:523 - SERVER[] USER[hdfs] GROUP[-] TOKEN[] APP[test_workflow] JOB[0000049-170319180732598-oozie-oozi-W] ACTION[0000049-170319180732598-oozie-oozi-W@test_query] Launcher ERROR, reason: Main class [org.apache.oozie.action.hadoop.HiveMain], exception invoking main(), java.lang.ClassNotFoundException: Class org.apache.oozie.action.hadoop.HiveMain not found
2017-03-27 12:28:39,483 WARN HiveActionExecutor:523 - SERVER[] USER[hdfs] GROUP[-] TOKEN[] APP[test_workflow] JOB[0000049-170319180732598-oozie-oozi-W] ACTION[0000049-170319180732598-oozie-oozi-W@test_query] Launcher exception: java.lang.ClassNotFoundException: Class org.apache.oozie.action.hadoop.HiveMain not found
java.lang.RuntimeException: java.lang.ClassNotFoundException: Class org.apache.oozie.action.hadoop.HiveMain not found
at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2214)
at org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:240)
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1724)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162)
Caused by: java.lang.ClassNotFoundException: Class org.apache.oozie.action.hadoop.HiveMain not found
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2120)
at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2212)
... 9 more
... View more
03-27-2017
05:50 PM
Trying to run a basic oozie workflow that completes a hive action and i keep getting this error: java.lang.ClassNotFoundException: Class org.apache.oozie.action.hadoop.HiveMain not found Here is the XML workflow: <workflow-app xmlns = "uri:oozie:workflow:0.5" name = "test_workflow"> <start to = "test_query" />
<!--Step 1 -->
<action name = "test_query"> <hive xmlns = "uri:oozie:hive-action:0.5"> <job-tracker>jobtracker</job-tracker> <name-node>nameNode</name-node> <configuration>
<property> <name>oozie.use.system.libpath</name>
<value>true</value>
</property> <property>
<name>oozie.libpath</name>
<value>nameNode/user/oozie/share/lib/lib_20161215134654</value>
</property>
</configuration> <script>hdfspath/hive.hql</script> </hive>
<ok to = "end" /> <error to = "kill_job" />
</action>
<kill name = "kill_job">
<message>Job Failed</message>
</kill>
<end name = "end" /> </workflow-app>
... View more
Labels:
- Labels:
-
Apache Oozie
09-14-2016
08:05 PM
2 Kudos
Found the culprit, it's the CSVSerde, it casts all fields as strings.
... View more
09-14-2016
07:50 PM
I just tried following the method shown here: https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.0/bk_dataintegration/content/moving_data_from_hdfs_to_hive_external_table_method.html I created the ORC table and it still stores everything as a string
... View more
09-14-2016
07:16 PM
1 Kudo
I am creating an external table with some fields that are numeric decimals. I have tried declaring them as floats, doubles, and decimal formats, but hive is casting them as strings regardless. Here is a sample of the query: create external table sapbw.copa_ods(currency_type string, cost_for_fi decimal,
gross_margin_fi decimal, sales_for_fi decimal)
ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.OpenCSVSerde'
stored as textfile
location '/data_LZ/BW/COPA_ODS'; Why is this happening?
... View more
Labels:
- Labels:
-
Apache Hive
06-16-2016
07:22 PM
1 Kudo
So I found that if i force a query using --query it will work, but if I let sqoop generate the query it does not. Example --query "select * from \"BI0/TCUSTOMER\"" will work, but referring to the table in the same way by using the --table \"BI0/TCUSTOMER\" argument does not work. So the problem must be when sqoop generates the SQL query on its own, it is not syntactically correct. If there was a way to see the query it was generating that would be very helpful to troubleshoot it, but as far as I know there is not.
... View more
06-13-2016
06:21 PM
Any updates on this?
... View more
06-09-2016
01:18 PM
I tried that and got this error: ERROR manager.SqlManager: Error executing statement: com.sap.db.jdbc.exceptions.JDBCDriverException: SAP DBTech JDBC: [257]: sql syntax error: incorrect syntax near "AS": line 1 col 19 (at pos 19)
com.sap.db.jdbc.exceptions.JDBCDriverException: SAP DBTech JDBC: [257]: sql syntax error: incorrect syntax near "AS": line 1 col 19 (at pos 19)
... View more
06-08-2016
09:22 PM
Got the same error: 16/06/08 16:20:49 ERROR tool.ImportTool: Encountered IOException running import job: java.io.FileNotFoundException: /tmp/sqoop-hdfs/compile/2fb644a9751cabd5c187540154e2e696/SAPR3."/BI0/TCUSTOMER".jar (No such file or directory)
... View more