You can build the custom processor on top of the nifi 1.2 version only and keep the nar file with the same name. It would work the same way. I have done it in my code. ... View more

Adding few more details to the query as in the current scenario , the data is encrypted using AWS KMS-Managed Keys (SSE-KMS) only using client side encryption. The client (Nifi) need to download the encrypted object from Amazon S3 along with the cipher blob version of the data encryption key stored as object metadata. The client then sends the cipher blob to AWS KMS to get the plain-text version of the key so that it can decrypt the object data. Please have a look to the option 1 of the below link: https://docs.aws.amazon.com/AmazonS3/latest/dev/UsingClientSideEncryption.html Not sure if we can do this with the existing Nifi processor with some customization OR we need to create a new processor altogether. Please suggest. ... View more

Current Nifi flow in which the above mentioned error is thrown in the GetSQS processor. Thanks, Bandhu Gupta ... View more

I am facing connectivity issue from Apache Nifi to Amazon SQS & S3: I have given the details in the below link: https://community.hortonworks.com/questions/214811/connection-issue-in-integrating-apache-nifi-with-a.html Thanks in Advance. Please suggest. ... View more

Is there a way to add gear configuration button on the ambari 2.2.2.0 as well ... View more

Any Responses ? ... View more

We are facing the above error while we were using the below query sqoop import --connect jdbc:oracle:thin:@XX:1521/DATABASENAME --username USER --password PWD --table SCHEMANAME.TABLENAME --hive-import --hive-table TABLENAME --hive-overwrite --num-mappers 1 --as-parquetfile It's an issue when we are using Parquet and trying to ingest data in hive only because if we do the ingestion in hdfs with parquet , it gets completed. ... View more

We are only getting the above error if we are using parquet otherwise my table get pulled in hive easily .Please keep in mind that we have installed the HDP without internet so it's highly possible that we missed some thing. ... View more

sqoop import --connect jdbc:oracle:thin:@XXX:XXXX/YYYY --username YYYYY --password YYYYY --table A.BBBB --hive-import --hive-database default --hive-table test15 --as-parquetfile -m 1 Job job_1465371735536_0055 failed with state FAILED due to: Job commit failed: java.lang.IllegalArgumentException: Wrong FS: ____file:/tmp/default/.temp/job_1465371735536_0055/mr/job_1465371735536_0055/b402d4ba-1a16-46bc-92c6-91fe141070d2.parquet, expected: hdfs://lxapp5524.dc.corp.telstra.com:8020 at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:646) ... View more

This is our machine for POC and creating a single node cluster so we installed Ambari and when we are adding our machine as a host , it gets added with the above warnings. Please suggest. ... View more