Member since
09-29-2015
19
Posts
3
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1670 | 04-27-2016 08:59 PM |
07-16-2016
12:34 AM
Here's another possibility, from the HDP 2.4.2 Release Notes: Configuring Pig Scripts to Use HCatalog in Oozie Workflows To access HCatalog with a Pig action in an Oozie workflow, you
need to modify configuration information to point to the Hive metastore URIs. There are two methods for providing this configuration
information. Which method you use depends upon how often your Pig scripts
access the HCatalog. Configuring
Individual Pig Actions to Access HCatalog If only a few individual Pig actions access HCatalog, do the
following:
Identify
the URI (host and port) for the Thrift metastore server. a. In Ambari, click Hive
> Configs > Advanced. b. Make note of the URI in the hive.metastore.uris field in the General section. This information is also
stored in the hive.default.xml file. 2. Add
the following two properties to the <configuration> elements
in each Pig action. Note: Replace [host:port(default:9083)] in
the example below with the host and port for the Thrift metastore server. <configuration>
<property>
<name>hive.metastore.uris</name>
<value>thrift://[host:port(default:9083)]</value>
<description>A comma separated list of metastore uris the client can use to contact the metastore server.</description>
</property>
<property>
<name>oozie.action.sharelib.for.pig</name>
<value>pig,hive,hcatalog</value>
<description>A comma separated list of libraries to be used by the Pig action.</description>
</property>
</configuration>
Configuring
All Pig Actions to Access HCatalog If all of your Pig actions access HCatalog, do the following:
Add
the following line to the job.properties files,
located in your working directory: oozie.action.sharelib.for.pig=pig,hive,hcatalog <!-- A comma separated list of libraries to be used by the
Pig action.--> 2. Identify
the URI (host and port) for the Thrift metastore server. a. In Ambari, click Hive
> Configs > Advanced. b. Make note of the URI in the hive.metastore.uris field in the General section. This information is also
stored in the hive.default.xml file. 3. Add
the following property to the <configuration> elements in
each Pig action. Note: Replace [host:port(default:9083)] in
the example below with the host and port for the Thrift metastore server. <configuration>
<property>
<name>hive.metastore.uris</name>
<value>thrift://[host:port(default:9083)]</value>
<description>A comma separated list of metastore uris the client can use to contact the
metastore server.</description>
</property>
</configuration>
... View more
07-15-2016
08:28 PM
The above answer gives a lot of good detail, but for what you're trying to do, the WARN messages are actually okay. Though, I'll be happy when they're gone. If you run /usr/metron/0.2.0BETA/bin/zk_load_configs.sh -i /usr/metron/0.2.0BETA/config/zookeeper -m DUMP -z hostname:2181 you should see the changes you PUSHed.
... View more
06-03-2016
08:03 PM
That certainly works. It has the same effect as adding an available port to Storm so that the new topology can be run. Not sure which is cleaner -- have a user kill another topology before deploying the squid one, update the canned storm config to have a port available, or have a user update the config and restart Storm and related services.
... View more
04-27-2016
08:59 PM
1 Kudo
Performed installation on desktop rather than on VM and installation succeeded.
... View more
04-15-2016
04:34 AM
it is Okay. I already fixed it successfully. My question is closed. Thanks.
... View more