Member since
09-06-2016
35
Posts
2
Kudos Received
2
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2699 | 03-06-2017 12:52 PM | |
2675 | 03-01-2017 09:46 PM |
11-17-2017
02:11 PM
for me /usr/hdf/current/nifi/lib did not work. HDF Version 2.1.1 Apache NiFi - Version 1.1.0.2.1.2.0-10
... View more
10-23-2017
05:07 PM
Thx for answer. We are using a older version today. As showed only some of the fields is supported for Expression Language. HDF Version 2.1.1 - Powered by Apache NiFi - Version 1.1.0.2.1.2.0-10
... View more
10-23-2017
03:37 PM
We are trying making our processor using custom properties for environment independent. In this case we are using a SelectHiveQL processor which is working if the Database Connection URL is hardcode. If the Database Connection URL is a reference as done with Kerberos Principal and Kerberos Keytab it return a error, when running SelectHiveQL. The pictures show the two scenarios. Our hive url is as follow: jdbc:hive2://HOST:10000/default;principal=hive/_HOST@HOST.com I have tried added the propery How is it possible to do a custom property reference in Database Connection URL?
... View more
Labels:
- Labels:
-
Apache NiFi
10-17-2017
07:14 AM
HI @Rishi The interpreter settings is as followed: livy.spark.driver.cores = 1 livy.spark.driver.memory = 12G livy.spark.dynamicAllocation.cachedExecutorIdleTimeout livy.spark.dynamicAllocation.enabled livy.spark.dynamicAllocation.initialExecutors livy.spark.dynamicAllocation.maxExecutors livy.spark.dynamicAllocation.minExecutors livy.spark.executor.cores = 4 livy.spark.executor.instances = 11 livy.spark.executor.memory = 12G livy.spark.master = yarn-cluster spark.driver.maxResultSize = 120G zeppelin.interpreter.localRepo = (HIDDEN) zeppelin.livy.concurrentSQL = false zeppelin.livy.create.session.retries = 240 zeppelin.livy.keytab = (HIDDEN) zeppelin.livy.principal = (HIDDEN) zeppelin.livy.spark.sql.maxResult = 100000 zeppelin.livy.url = http://HOST:8998 It is very clear that, the Y job says PENDING and when X is finish Y starts.
... View more
10-16-2017
09:45 AM
Scenario: User X run a %livy.pyspark job in notebook AnalysisX 5 seconds after user Y run a %livy.pyspark job in notebook AnalysisY Y have to wait for X's spark job to finish, which is not effective. How is it possible in HDP2.5 through Livy impersonated, to run multiple spark jobs from Zeppeline at the same time?
... View more
Labels:
- Labels:
-
Apache Zeppelin
04-12-2017
10:40 AM
@Rafael Coss and @Saumitra Buragohain Are there any news about the sandbox version of HDP 2.6
... View more
03-28-2017
11:10 AM
There is problem with both XSLT schema. Below example is not converted correct. <?xml version="1.0" encoding="UTF-8"?>
<note>
<country>
<city>Stockholm</city>
</country>
<country>
<code>FR</code>
<city>Paris</city>
<streets>
<road>Paris</road>
</streets>
</country>
<country>
<code>DK</code>
<city>Copenhagen</city>
<streets>
<road>Paris</road>
<no>1</no>
</streets>
</country>
</note>
... View more
03-06-2017
12:52 PM
Problem solve by using Hive2
... View more
03-06-2017
12:52 PM
Thx for your reply. I solve the problem by converting the Oozie script to run Hive2.
... View more
03-01-2017
09:46 PM
Thx for the replies. The problem is solve by using Hive2 (Beeline) instead of Hive1.
... View more