Member since
12-21-2015
27
Posts
4
Kudos Received
0
Solutions
01-25-2016
03:16 PM
@Neeraj Sabharwal and this is mine, I'll check yours. Thanks. http://hortonworks.com/hadoop-tutorial/hello-world-an-introduction-to-hadoop-hcatalog-hive-and-pig/#section_5
... View more
01-25-2016
03:03 PM
The last row gives the error, If it's commented out, no error. It must be about hive configuration. I'm using mysql jdbc jars. I'll check for it... a = LOAD 'geolocation' using org.apache.hive.hcatalog.pig.HCatLoader(); b = filter a by event != 'normal'; c = foreach b generate driverid, event, (int) '1' as occurance; d = group c by driverid; e = foreach d generate group as driverid, SUM(c.occurance) as t_occ; g = LOAD 'drivermileage' using org.apache.hive.hcatalog.pig.HCatLoader(); h = join e by driverid, g by driverid;
final_data = foreach h generate $0 as driverid, $1 as events, $3 as totmiles, (float) $3/$1 as riskfactor; /*store final_data into 'riskfactor' using org.apache.hive.hcatalog.pig.HCatStorer();*/
... View more
01-25-2016
12:35 PM
That's ok, but I've sent images, as you can see there files exist. Thanks anyway...
... View more
01-25-2016
12:22 PM
@Neeraj SabharwalI've checked, but I didnot understand ;), It's a successful job log for your cluster I think...
... View more
01-25-2016
11:52 AM
Thanks @Benjamin Leonhardi ssh-tez.png I get the tar, and untar it without an error. Thanks @Neeraj Sabharwal I have that setting. tez-ok.png
... View more
01-25-2016
11:27 AM
Thanks @Benjamin Leonhardi 🙂 No not sandbox, I have 6 node vm cluster, 3 data, 2 master and 1 ambari server. 2.3.4 is HDP version, 2.2 is Ambari version. I have no error on Ambari, I have a TEZ 0.7.0.2.3.4.0-1310 instance. I'll use hadoof fs -ls when checking right? if you can give a hint, it'll be great... I'll check the link you sent. Appreciate your help. Regards.
... View more
01-25-2016
10:03 AM
1 Kudo
Hi folks, I'm following HDP Hello World tutorial. In Lab 3 when I execute the PIG script by checking "Execute on Tez" checkbox I got the following error. I think I have a configuration issue. Have an idea? I've attached the log file. Thanks Özgür [PigTezLauncher-0] ERROR org.apache.pig.backend.hadoop.executionengine.tez.TezSessionManager - Exception while waiting for Tez client to be ready
org.apache.tez.dag.api.TezUncheckedException: Invalid configuration of tez jars, tez.lib.uris is not defined in the configuration
at org.apache.tez.client.TezClientUtils.setupTezJarsLocalResources(TezClientUtils.java:168)
at org.apache.tez.client.TezClient.getTezJarResources(TezClient.java:841)
at org.apache.tez.client.TezClient.start(TezClient.java:380)
at org.apache.pig.backend.hadoop.executionengine.tez.TezSessionManager.createSession(TezSessionManager.java:96)
at org.apache.pig.backend.hadoop.executionengine.tez.TezSessionManager.getClient(TezSessionManager.java:211)
at org.apache.pig.backend.hadoop.executionengine.tez.TezJob.run(TezJob.java:158)
at org.apache.pig.backend.hadoop.executionengine.tez.TezLauncher$1.run(TezLauncher.java:195)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2016-01-25 11:06:57,500 [PigTezLauncher-0] ERROR org.apache.pig.backend.hadoop.executionengine.tez.TezJob - Cannot submit DAG tezerror.txt
... View more
Labels:
- Labels:
-
Apache Pig
-
Apache Tez
01-22-2016
11:43 AM
What I meant is the table I created is not shown under default database, refresh also not works.
... View more
01-22-2016
10:04 AM
@Neeraj Sabharwal really appreciate for your useful directions, I gave up windows and installed I have a 6 virtual node centos 7 cluster (on windows virtualbox). The cluster has the following nodes. 1 edge,
1 namenode,
1 secondary namenode,
3 datanodes, and it's working now ;), I can use ambari without any red errors. I began hello world tutorial, In hive section of the tutorial, I created geolocation_stage table with a CREATE statement, the statement is executing without an error. But I could not see my staging table under default database, An interesting point is, if I use search database textbox, I can show the staging table. I verified the table with an sql statement to mysql hive database, "select * from TBLS;" Am I on the right way ? 😄 Thanks Regards Özgür
... View more
01-17-2016
02:12 PM
1 Kudo
I found the 2.3.4 installation link in documentation. Thanks 😉 is it my mistake or does the main page need an update ? 😄 Really thanks for the help. Regards
... View more
- « Previous
-
- 1
- 2
- Next »