Member since
01-01-2016
54
Posts
26
Kudos Received
0
Solutions
01-06-2016
03:32 AM
1 Kudo
I am working on HDPCD practice test instance. Can anybody let me know - a) Is there anything I should do before issue sqoop command on AWS practice instance. b) what is the parameter I should use for --connect jdbc:?????
... View more
Labels:
- Labels:
-
Apache Sqoop
01-04-2016
08:48 PM
@rich Thanks Rich. That is very useful info. I can execute from Grunt shell. As Ambari provides good interface which helps in syntax for script writing, if you can provide any help on running from Ambari would be great.
... View more
01-04-2016
08:37 PM
1 Kudo
@rich It is working from the Grunt Shell without REGISTER, if I do: $pig -useHCatalog -f myscript.pig Thanks. But I am not able to execute the same script from Ambari. Do I have to REGISTER the jars, if I have to execute from Ambari? In certification, do I have to execute the pig script from Grunt shell or from ambari?
... View more
01-03-2016
03:55 AM
1 Kudo
I ran the following script and get the following error: A = LOAD 'batting' USING org.apache.hive.hcatalog.pig.HCatLoader(); dump A; 2016-01-0303:52:33,153[main] ERROR org.apache.pig.PigServer- exception during parsing:Error during parsing.Couldnot resolve org.apache.hive.hcatalog.pig.HCatLoaderusing imports:[, java.lang., org.apache.pig.builtin., org.apache.pig.impl.builtin.] Failed to parse:Pig script failed to parse: <file script.pig, line 11, column 25> pig script failed to validate: org.apache.pig.backend.executionengine.ExecException: ERROR 1070:Couldnot resolve org.apache.hive.hcatalog.pig.HCatLoaderusing imports:[, java.lang., org.apache.pig.builtin., org.apache.pig.impl.builtin.]
... View more
01-03-2016
03:54 AM
1 Kudo
@rich I ran the following script and get the following error: A = LOAD 'batting' USING org.apache.hive.hcatalog.pig.HCatLoader();
dump A; 2016-01-03 03:52:33,153 [main] ERROR org.apache.pig.PigServer - exception during parsing: Error during parsing. Could not resolve org.apache.hive.hcatalog.pig.HCatLoader using imports: [, java.lang., org.apache.pig.builtin., org.apache.pig.impl.builtin.]
Failed to parse: Pig script failed to parse:
<file script.pig, line 11, column 25> pig script failed to validate: org.apache.pig.backend.executionengine.ExecException: ERROR 1070: Could not resolve org.apache.hive.hcatalog.pig.HCatLoader using imports: [, java.lang., org.apache.pig.builtin., org.apache.pig.impl.builtin.]
... View more
01-03-2016
03:17 AM
1 Kudo
@rich Rich, you mentioned that we DO NOT need to REGISTER any libraries for HCatLoader. Then why I am getting the error I mentioned in the first post?
... View more
01-02-2016
10:48 PM
1 Kudo
@rich Hi Rich, please let me know the standard libs we use (RETISTER) in pig scripts on hortonworks sandbox (downloaded from hortonworks site for learning purpose) and also sandbox used for certification.
... View more
01-02-2016
04:19 AM
I have included the following REGISTER statement. Still I get the above error. register '/usr/hdp/current/pig-client/lib/piggybank.jar';
... View more
01-02-2016
04:14 AM
1 Kudo
Gangadhar Thanks for the response. I installed Hartonworks sandbox to learn. what is the default path for Hartonworks sandbox?
... View more
01-02-2016
04:07 AM
I am trying to execute the following Pig Script. DISTINCT is not working. Am I missing anything. Please help. A = LOAD '/tmp/admin/data/gpa.txt' using PigStorage(',') AS (name, age, gpa);
B = group A by age;
C = foreach B generate ABS(SUM(A.gpa)), DISTINCT(A.name), MIN(A.gpa)+MAX(A.gpa)/2, group;
dump C; 2016-01-02 04:03:21,049 [main] ERROR org.apache.pig.PigServer - exception during parsing: Error during parsing. Could not resolve DISTINCT using imports: [, java.lang., org.apache.pig.builtin., org.apache.pig.impl.builtin.]
Failed to parse: Pig script failed to parse:
<file script.pig, line 6, column 40> Failed to generate logical plan. Nested exception: org.apache.pig.backend.executionengine.ExecException: ERROR 1070: Could not resolve DISTINCT using imports: [, java.lang., org.apache.pig.builtin., org.apache.pig.impl.builtin.]
... View more
Labels:
- Labels:
-
Apache Hive
-
Apache Pig
- « Previous
- Next »