About rohit_ravishank

rohit_ravishank · ‎09-28-2017

Hi Team, I am trying to create a database in Hive using spark sql in spark 2.0 version & encounter the below permission issue, command - spark.sql("create database test") ************************************************************************************************************************ Caused by: org.apache.hadoop.hive.metastore.api.MetaException: java.security.AccessControlException: Permission denied: ************************************************************************************************************************ However when I try to do the same in Spark 1.6 version, I am able to do it without any issues. command - sqlContext.sql("create database test") Do I need to set some configuration to execute from Spark 2.0? Thanks in Advance!

rohit_ravishank · ‎09-16-2017

@Yash Thanks!

rohit_ravishank · ‎09-16-2017

Hi, I am trying to upload my template created in NiFi version 1.1(HDF 2.0) to NiFi version 1.2(HDF 3.0). However I am facing some versioning error/conflicts. Could you please help me overcome this issue? Thanks, R.Rohit

rohit_ravishank · ‎09-16-2017

Hi, We are currently running NiFi as a single instance & we are planning to move to a clustered setup(3 node cluster). Please consider the below sample flow, ListFile -> updateAtrribute -> routeOnAttribute -> ExecuteStreamCommand(Executes a shell script) -> fetchFile -> updateAtrribute -> fetchFile -> putFile Since we are going to run in cluster setup, we need to use Remote Processor groups to balance the load. We going to place the RPG after ListFile processor, ListFile(on Primary Node) -> RPG Input port -> updateAtrribute -> routeOnAttribute -> ExecuteStreamCommand(Executes a shell script) -> fetchFile -> updateAtrribute -> fetchFile -> putFile My question is, if I want my ExecuteStreamCommand(which triggers a shell script) to execute only on the primary node & rest of the processors in all the nodes, can I go ahead and change the settings of processor to run 'On Primary Node'? Will it have any impact on the flow? Thanks, R.Rohit

rohit_ravishank · ‎08-29-2017

@Wynner Is there a way to overcome it? Any alternate way to parameterize?

rohit_ravishank · ‎08-28-2017

@Wynner Attached the sample data. The total length of the record is 40. We are trying to convert the fixed width data to delimited data using regex. sample-data.txt Thanks!

rohit_ravishank · ‎08-28-2017

@Wynner ReplaceText Configuration - where search_pattern - ^(.{1})(.{2})(.{18})(.{19}) & replace_pattern - $1|$2|$3|$4 Thanks!

rohit_ravishank · ‎08-28-2017

@Wynner I am passing them as flow file attributes only. But still I am not able to parse it properly. Could you please check and help me out? Thanks in Advance!

rohit_ravishank · ‎08-28-2017

Hi Team, I am trying to parameterize 'Search Value' & 'Replacement Value' properties in ReplaceText processor. However, I am not getting the desired result. search_pattern - ^(.{1})(.{2})(.{18})(.{19}) replace_pattern - $1|$2|$3|$4 If I use the parameters 'search_pattern' & 'replace_pattern'(${search_pattern} & ${replace_pattern}), replace is not happening. However, if I hardcode the patterns, the search & replace is happening as expected. Could you please help me out? Thanks!

rohit_ravishank · ‎08-07-2017

Thanks @Hellmar Becker

Online	Offline
Last Visited	‎09-28-2017 12:18 PM

Date Registered	‎12-23-2016 04:22 AM
Last Visited	‎09-28-2017 12:18 PM
Total Messages Posted	38
Total Kudos Received	2

Trouble creating databases in Hive using Spark 2.0

Re: Query on executing NiFi in a clustered setup w...

NiFi template upload migration from 1.1 to 1.2 ver...

Query on executing NiFi in a clustered setup with ...

Re: Parameterizing ReplaceText Processor

Re: Parameterizing ReplaceText Processor

Re: Parameterizing ReplaceText Processor

Re: Parameterizing ReplaceText Processor

Parameterizing ReplaceText Processor

Re: Need for Controller Services in Apache Nifi