Member since
01-02-2017
18
Posts
3
Kudos Received
0
Solutions
03-24-2018
08:56 PM
Hello, I thought that NiFi 1.5 can report lineage to Atlas but I couldn't find how to it. I've checked the reporting tasks but couldn't find Atlas reporting task. Does anyone succeeded in using this new feature? Thanks Joe
... View more
Labels:
- Labels:
-
Apache Atlas
-
Apache NiFi
10-01-2017
03:47 PM
Hello, There are several tools in HDP that doesn't use Yarn (Storm, HBase, etc). If I have OS, HBase, Storm and other tools taking resources on my cluster, how does Yarn know how much resources he owns for its application? What are the best practices for multi-tenancy and isolation in this case? How can I isolate IO with Yarn? is this something coming in future versions? Thanks
... View more
Labels:
- Labels:
-
Apache YARN
06-13-2017
06:39 AM
Hi @rkovacs Thank you for your reply. I understand that I can not upgrade a Cloudbreak cluster since Ambari upgrade is not supported. What do you mean by HDP upgrade is supported? Thanks for the clarification
... View more
06-12-2017
05:12 PM
Hi, How can I upgrade a cluster deployed by Cloudbreak? If I upgrade through Ambari, what's the impact on Cloudbreak relation? (API, version, Autoscaling, etc) Thanks
... View more
Labels:
- Labels:
-
Apache Ambari
-
Hortonworks Cloudbreak
03-12-2017
04:21 PM
Hi I have two HDF cluster, one secured (with SSL enabled) and the other without security. Can I have the cluster 2 (unsecure) send data to cluster 1 (secured) with S2S ? if yes, what's the required configuration? Thanks
... View more
Labels:
- Labels:
-
Apache NiFi
-
Cloudera DataFlow (CDF)
01-29-2017
11:03 AM
Hi @Matt Burgess Thanks for your detailed answer. Your first suggestion looks interesting. I'll give it a try. I still have a question on ConvertJsonToSQL if you can help https://community.hortonworks.com/questions/80362/jdbc-connection-pool-for-convertjsontosql.html
... View more
01-27-2017
07:24 PM
@Binu Mathew
Thanks for your reply. No I don't need data in JSON, I just need to ingest directly into Hive. How do you ingest data in Hive in your suggestion ? PutHiveQL waits for an SQL statement
... View more
01-27-2017
06:52 PM
Hi @mqureshi
I don't agree with your statement. If it's the case, why there's processors like getFile, getHDFS, QueyTable etc ?
... View more
01-27-2017
06:23 PM
I want to use NiFi to ingest CSV file (getFile) to Hive (PutHiveQL). Since HiveQL need the SQL statement, how can I generate it ? A solution would be getFile -> InferAvroSchema -> ConvertCSVToAvro -> ConvertAvroToJSon -> ConvertJSONtoSQL -> PutHiveQL. This looks so complex and resource consuming. Any suggestions ?
... View more
Labels:
- Labels:
-
Apache Hive
-
Apache NiFi
01-27-2017
05:45 PM
Thanks @Eugene Koifman
Can you point to an updated complete and updated documentation/book on Hive features ? (ACID, LLAP, etc)
... View more