About kkane

kkane · ‎12-04-2015

Is there a way to prevent default Tez containers when using the Hive CLI and the Hive version is >= .14? I would like Tez to be the default engine but not spin up any containers when launching the Hive CLI.

kkane · ‎12-02-2015

kkane · ‎12-01-2015

Can I use Ambari 2.1.2 (API or other) to manage principals and keytab deployments for non-ambari controlled services?

kkane · ‎11-24-2015

Thanks Paul. These are read out of the /etc/ambari-server/conf/ambari.properties? If so, I'll have to rearrange my Chef recipe.

kkane · ‎11-24-2015

This is a result, not the reason why. The question is: What is setup using to determine this.

kkane · ‎11-24-2015

kkane · ‎11-23-2015

This is the Oozie shell vice Sqoop action but I took that and attempted anyway not thinking that Oozie configuration would not have effect on Sqoop running in the shell that calls its own Hive setup but it did. So, I used the dist cache <files></files> like you did in the Sqoop action and it worked. Thanks.

kkane · ‎11-23-2015

Yes, I think that preventing the Tez container would fix the problems which are: Set the queue name and use delegation tokens for Sqoop when running in an Oozie shell. The cluster default Hive execution engine is Tez.

kkane · ‎11-23-2015

Is there a way to pass Hive configuration to Sqoop that would be evaluated in the same fashion as '--hiveconf' when the actual Hive job is run to conduct the move task of data from landing to Hive table? '-D' has no effect. This is particularly needed when Hive on Tez is the default engine and Hive starts up a Tez container no matter what other configuration has been provided.

kkane · ‎11-06-2015

Pulled this from an Oozie patch: ... String delegationToken = getFilePathFromEnv("HADOOP_TOKEN_FILE_LOCATION"); if (delegationToken != null) { hiveConf.set("mapreduce.job.credentials.binary", delegationToken); + hiveConf.set("tez.credentials.path", delegationToken); ...

Online	Offline
Last Visited	‎07-01-2016 12:57 AM

Member Since	‎09-26-2015 12:45 AM
Last Visited	‎07-01-2016 12:57 AM
Posts	30
Kudos received	10

Cloudera Community

Re: Is there a way to prevent the start of the Tez...

Re: Can I use the token files present in Oozie to ...

How to prevent default Tez containers.

What are the blueprint properties for specifying t...

MIT principal and keytab management via Amabari 2....

Re: What does 'ambari-server setup -s' use to dete...

Re: What does 'ambari-server setup -s' use to dete...

What does 'ambari-server setup -s' use to determin...

Re: Can Hive configuration be passed to Sqoop?

Re: Can Hive configuration be passed to Sqoop?

Can Hive configuration be passed to Sqoop?

Re: Can I use the token files present in Oozie to ...