Member since
12-23-2016
38
Posts
2
Kudos Received
0
Solutions
09-28-2017
12:18 PM
Hi Team, I am trying to create a database in Hive using spark sql in spark 2.0 version & encounter the below permission issue, command - spark.sql("create database test")
************************************************************************************************************************
Caused by: org.apache.hadoop.hive.metastore.api.MetaException: java.security.AccessControlException: Permission denied:
************************************************************************************************************************ However when I try to do the same in Spark 1.6 version, I am able to do it without any issues.
command - sqlContext.sql("create database test") Do I need to set some configuration to execute from Spark 2.0? Thanks in Advance!
... View more
Labels:
- Labels:
-
Apache Spark
09-16-2017
04:46 PM
@Yash Thanks!
... View more
09-16-2017
01:06 PM
Hi, I am trying to upload my template created in NiFi version 1.1(HDF 2.0) to NiFi version 1.2(HDF 3.0). However I am facing some versioning error/conflicts. Could you please help me overcome this issue? Thanks, R.Rohit
... View more
Labels:
- Labels:
-
Apache NiFi
09-16-2017
07:08 AM
Hi, We are currently running NiFi as a single instance & we are planning to move to a clustered setup(3 node cluster).
Please consider the below sample flow,
ListFile -> updateAtrribute -> routeOnAttribute -> ExecuteStreamCommand(Executes a shell script) -> fetchFile -> updateAtrribute -> fetchFile -> putFile Since we are going to run in cluster setup, we need to use Remote Processor groups to balance the load. We going to place the RPG after ListFile processor,
ListFile(on Primary Node) -> RPG
Input port -> updateAtrribute -> routeOnAttribute -> ExecuteStreamCommand(Executes a shell script) -> fetchFile -> updateAtrribute -> fetchFile -> putFile My question is, if I want my ExecuteStreamCommand(which triggers a shell script) to execute only on the primary node & rest of the processors in all the nodes, can I go ahead and change the settings of processor to run 'On Primary Node'? Will it have any impact on the flow? Thanks,
R.Rohit
... View more
Labels:
- Labels:
-
Apache NiFi
08-29-2017
01:14 AM
@Wynner Is there a way to overcome it? Any alternate way to parameterize?
... View more
08-28-2017
05:44 PM
@Wynner Attached the sample data. The total length of the record is 40. We are trying to convert the fixed width data to delimited data using regex. sample-data.txt Thanks!
... View more
08-28-2017
05:15 PM
@Wynner ReplaceText Configuration - where search_pattern - ^(.{1})(.{2})(.{18})(.{19}) & replace_pattern - $1|$2|$3|$4 Thanks!
... View more
08-28-2017
04:44 PM
@Wynner I am passing them as flow file attributes only. But still I am not able to parse it properly. Could you please check and help me out? Thanks in Advance!
... View more
08-28-2017
02:20 PM
Hi Team, I am trying to parameterize 'Search Value' & 'Replacement Value' properties in ReplaceText processor. However, I am not getting the desired result. search_pattern - ^(.{1})(.{2})(.{18})(.{19}) replace_pattern - $1|$2|$3|$4 If I use the parameters 'search_pattern' & 'replace_pattern'(${search_pattern} & ${replace_pattern}), replace is not happening. However, if I hardcode the patterns, the search & replace is happening as expected. Could you please help me out? Thanks!
... View more
Labels:
- Labels:
-
Apache NiFi
08-07-2017
01:30 AM
Thanks @Hellmar Becker
... View more