Member since
12-14-2015
70
Posts
94
Kudos Received
16
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
6122 | 03-14-2017 03:56 PM | |
1345 | 03-07-2017 07:20 PM | |
4316 | 01-23-2017 05:57 AM | |
5623 | 01-23-2017 05:40 AM | |
1712 | 10-18-2016 03:36 PM |
04-17-2017
12:24 AM
Thank you!
... View more
03-28-2017
02:27 AM
1 Kudo
Answer here https://community.hortonworks.com/questions/66805/issue-when-deploying-a-new-parser-topology-in-stor.html#answer-66998
... View more
03-07-2017
07:20 PM
4 Kudos
Working further with our support team and customer, it was determined that this issue was coming mostly from Postgres side. The reason being the ticket caching was not enabled for the PG side, and the customer is currently working on enabling the same. This document link should talk about enabling caching from Postgres - http://jpmens.net/2012/06/23/postgresql-and-kerberos/ As far as the above question on multiple requests on the same session goes - Yes, Hive metastore does caching my default, and the multiple commands executed within the same HS2 session is translated to a single auth request due to caching at the HMS level
... View more
10-18-2016
03:52 PM
2 Kudos
No, the temp swapspace is not encrypted. So we do have the vulnerability with intermediate shuffles. However, this is temporary short lived data and may not pose a major issue depending on the customer/usecase. If this is still a concern, then put the temp swap space to a separate disk and encrypt the disk at OS Level
... View more
10-18-2016
04:01 PM
Thanks my friend!
... View more
10-09-2016
10:16 PM
1 Kudo
You are welcome. Glad it worked.
... View more
09-26-2016
05:52 PM
4 Kudos
@Bala Vignesh N V If your table is an actual Hive table (not an external table) and it is ACID-enabled (require ORC file format) and Hive/Tez is enabled globally for parallelism and you write those SQL statements as separate jobs, then YES. The assumption is that you run one of the versions of Hive capable of ACID which most likely you do if you use anything released in the last 1.5-2 years.
... View more
09-21-2016
01:51 PM
Java Library + Spark => Magic https://github.com/gmallard/packed-decimal You could also have that in a dataflow in NiFi 1. get the file via NiFi GetFile 2. ExecuteStreamCommand packed-decimal Java class 2b. or call via Kafka/JMS to Java or Spark program 3. Insert or save as ORC 4. Create a hive table on top
... View more
09-01-2016
02:00 AM
1 Kudo
Just an update - the 'SelectHiveQL' has been added as part of Nifi 0.7
... View more
09-26-2016
09:02 AM
what happens if after continuous worker failuers ultimately all tasks are rescheduled to start on one worker ?
... View more