Dear Experts,   We have written a PIG Java UDF which fetches a record one at a time from hbase:               Configuration config = HBaseConfiguration.create();             // This instantiates an HTable object that connects you to             HTable table = new HTable(config, hbaseTable);             // Get the Hbase row for the corresponding rowkey             Get hbaseRow = new Get(Bytes.toBytes(rowkey));             Result resultRow = table.get(hbaseRow);   However when running and using our UDF in Pig, it cannot find the hbase-site.xml and searches for our zookeeperQuorum on localhost instead of what is specified in the Config file.   However when we use the PiggyBank HbaseStorage, we don't have any problems. I have tried setting PIG_CLASSPATH, PIG_OPTS, etc. However it doesn't work.   I would appreciate your help!   Greetings, Mark ... View more

Is it possible to write the a UDF that works as following?   B= load ... A = PigUDF(B)   I keep getting the following error "Cannot expand macro 'PigUDF'. Reason: Macro must be defined before expansion." .   Thank you ... View more

Dear Experts,   I have read that external jars or libraries used in Java Pig UDFs can be registered the following way: * REGISTER ../path/library.jar * pig -Dpig.additional.jars=/local/path/to/your.jar   However I was writing a my SHA1 UDF based on Apache Commons Codec and wasn't succesful in registering this. I had the error that the method sha1hex could not be found. I had the following maven dependencies:   <dependency>             <groupId>org.apache.hadoop</groupId>             <artifactId>hadoop-core</artifactId>             <version>0.20.2</version>         </dependency>         <dependency>             <groupId>org.apache.pig</groupId>             <artifactId>piggybank</artifactId>             <version>0.12.1</version>         </dependency> <dependency>     <groupId>commons-codec</groupId>     <artifactId>commons-codec</artifactId>     <version>1.9</version> </dependency> <dependency>     <groupId>org.apache.commons</groupId>     <artifactId>commons-lang3</artifactId>     <version>3.3.2</version> </dependency>   Maybe the issue lies in dependency conflicts, both Apache commons-lang3 and commons-codec are also contained in the piggybank dependency; but these are pretty old. Eventually I ended up deleting the two apache dependencies and use the libs/jars already contained in Piggybank.   Why wasn't I able to REGISTER my external jars? How can I register them succesfully?   thanks for your help!   Greetings, Mark ... View more

Dear Experts,   Would you happen to have succesful caes where you override Hbase Timestamps with your own timestamps? Throughout the documentation this is not advised, however we are importing historical data into Hbase.   I would be grateful if you have a step by step guide or could help us determine the consequences? Does a hbase scan using a timerange query perform a full table scan?   Thank you.   Mark ... View more