About alarsen

alarsen · ‎11-17-2017

for me /usr/hdf/current/nifi/lib did not work. HDF Version 2.1.1 Apache NiFi - Version 1.1.0.2.1.2.0-10

alarsen · ‎10-23-2017

Thx for answer. We are using a older version today. As showed only some of the fields is supported for Expression Language. HDF Version 2.1.1 - Powered by Apache NiFi - Version 1.1.0.2.1.2.0-10

alarsen · ‎10-23-2017

We are trying making our processor using custom properties for environment independent. In this case we are using a SelectHiveQL processor which is working if the Database Connection URL is hardcode. If the Database Connection URL is a reference as done with Kerberos Principal and Kerberos Keytab it return a error, when running SelectHiveQL. The pictures show the two scenarios. Our hive url is as follow: jdbc:hive2://HOST:10000/default;principal=hive/_HOST@HOST.com I have tried added the propery How is it possible to do a custom property reference in Database Connection URL?

alarsen · ‎10-17-2017

HI @Rishi The interpreter settings is as followed: livy.spark.driver.cores = 1 livy.spark.driver.memory = 12G livy.spark.dynamicAllocation.cachedExecutorIdleTimeout livy.spark.dynamicAllocation.enabled livy.spark.dynamicAllocation.initialExecutors livy.spark.dynamicAllocation.maxExecutors livy.spark.dynamicAllocation.minExecutors livy.spark.executor.cores = 4 livy.spark.executor.instances = 11 livy.spark.executor.memory = 12G livy.spark.master = yarn-cluster spark.driver.maxResultSize = 120G zeppelin.interpreter.localRepo = (HIDDEN) zeppelin.livy.concurrentSQL = false zeppelin.livy.create.session.retries = 240 zeppelin.livy.keytab = (HIDDEN) zeppelin.livy.principal = (HIDDEN) zeppelin.livy.spark.sql.maxResult = 100000 zeppelin.livy.url = http://HOST:8998 It is very clear that, the Y job says PENDING and when X is finish Y starts.

alarsen · ‎10-16-2017

Scenario: User X run a %livy.pyspark job in notebook AnalysisX 5 seconds after user Y run a %livy.pyspark job in notebook AnalysisY Y have to wait for X's spark job to finish, which is not effective. How is it possible in HDP2.5 through Livy impersonated, to run multiple spark jobs from Zeppeline at the same time?

alarsen · ‎04-12-2017

@Rafael Coss and @Saumitra Buragohain Are there any news about the sandbox version of HDP 2.6

alarsen · ‎03-28-2017

There is problem with both XSLT schema. Below example is not converted correct. <?xml version="1.0" encoding="UTF-8"?> <note> <country> <city>Stockholm</city> </country> <country> <code>FR</code> <city>Paris</city> <streets> <road>Paris</road> </streets> </country> <country> <code>DK</code> <city>Copenhagen</city> <streets> <road>Paris</road> <no>1</no> </streets> </country> </note>

alarsen · ‎03-06-2017

Problem solve by using Hive2

alarsen · ‎03-06-2017

Thx for your reply. I solve the problem by converting the Oozie script to run Hive2.

alarsen · ‎03-01-2017

Thx for the replies. The problem is solve by using Hive2 (Beeline) instead of Hive1.

Online	Offline
Last Visited	‎10-22-2018 04:31 PM

Member Since	‎09-06-2016 06:57 AM
Last Visited	‎10-22-2018 04:31 PM
Posts	35
Kudos received	2

Cloudera Community

Cloudera Community

Re: Avoid Oozie running Hive action with user cred...

Re: Hive JDBC connection from Windows PC to Linux ...

Re: Standard way of giving Hadoop Configuration Re...

Re: Nifi custom property for SelectHiveQL Database...

Nifi custom property for SelectHiveQL Database Con...

Re: How multiple users run spark concurrently?

How multiple users run spark concurrently?

Re: Any plan to release HDP 2.6 Sandbox?

Re: NiFi - Converting XML to JSON

Re: Avoid Oozie running Hive action with user cred...

Re: Avoid Oozie running Hive action with user cred...

Re: Hive JDBC connection from Windows PC to Linux ...