About rahulsmtauti

rahulsmtauti · ‎05-08-2018

@Felix Albani, Yeah for first time it's fine can you please try to run the same command again? My Spark version is 2.3.0 from my local windows machine.

rahulsmtauti · ‎05-08-2018

I am doing spark with hive. My requirement is to create hive database if not exists and doing the same in code, however spark application is throwing an ERROR RetryingHMSHandler:159 - AlreadyExistsException(message:Database abc already exists). which is quite awkward. Hive should not throw AlreadyExistsException in case of IF NOT EXISTS . My Create database statement. CREATE DATABASE IF NOT EXISTS abc

rahulsmtauti · ‎04-20-2018

@Matt Clarke, Really appreciate your detailed answers as always.

rahulsmtauti · ‎04-18-2018

@Matt Clarke, can you please post me the changes which i need to do in logback.xml in order to delete logs which are older than 10 days?

rahulsmtauti · ‎04-18-2018

Hi, My NiFi is hosted on 3 node clustered mode, NiFi is maintaining logs and might be the chances of disk overflow. I wanted to cleanup NiFi logs which are older than some day. What is the best approach to do this? Thanks,

rahulsmtauti · ‎04-17-2018

@Matt Clarke, seems quite refined approach. happy to see your response.

rahulsmtauti · ‎04-17-2018

@Shu, Thanks for your answer, We are currently doing the same thing we save setup time driven flags to make sure only one node can write the data to HDFS. I was expecting something else apart from workaround as there will be performance complications. If there is any recommended way of doing this please let me know.

rahulsmtauti · ‎04-17-2018

Hi, My NiFi is hosted on 3 node cluster, my requirement is to append data at the end of the file, since my NiFi is working on clustered mode how we should make sure that only one node should write data to the file? There should not be any conflict in write operation. Thanks,

rahulsmtauti · ‎04-11-2018

@Matt Clarke, Thanks for logging this as defect to the NiFi. I've changed my answer to the comment.

rahulsmtauti · ‎04-11-2018

@Matt Clarke Thanks for your response. I am using NiFi 1.4 since there is an option to specify variables using UI. I mean https://community.hortonworks.com/articles/154951/introduce-a-ui-driven-variable-registry-starting-f.html

Online	Offline
Last Visited	‎10-09-2018 11:47 AM

Member Since	‎04-11-2018 09:15 AM
Last Visited	‎10-09-2018 11:47 AM
Posts	47

Cloudera Community

Re: Write dataframe into parquet hive table ended ...

Re: Why create databases if not exists is throwing...

Why create databases if not exists is throwing exc...

Re: Cleanup NiFi logs which are older than x days?

Re: Cleanup NiFi logs which are older than x days?

Cleanup NiFi logs which are older than x days?

Re: How to append HDFS file using putHDFS where Ni...

Re: How to append HDFS file using putHDFS where Ni...

How to append HDFS file using putHDFS where NiFi i...

Re: The value of NiFi variables is not getting pop...

Re: The value of NiFi variables is not getting pop...