Hi All, We have a three node Nifi Cluster which is in backend and haproxy (LB) in frontend with a defined port for client to send request to the LB which will hit Nifi cluster in backend in round robin method. We have a built a pipeline which has "HandleHTTPRequest" --> intermediate processing using multiple processors | "HandleHTTPResponse". Client application may send multi part payload with different file extension and within the pipeline we parse and process according to business logic and move it to Network/Central Drive. When client application submits parallel payloads, we are being hit by below error on "HandleHTTPRequest" processor. I have tried to increase concurrent tasks for "HandleHTTPRequest" from "1 to 10" and all nodes on our cluster can handle the increase in tasks as we have enough CPU. Also we have increased the container queue size from "50 to 80" Failed to receive content from HTTP Request from <host> due to org.eclipse.jetty.io.EofException: Early EOF: org.eclipse.jetty.io.EofException: Early EOF org.eclipse.jetty.io.EofException: Early EOF         at org.eclipse.jetty.server.HttpInput$3.getError(HttpInput.java:1138)         at org.eclipse.jetty.server.HttpInput$3.noContent(HttpInput.java:1126)         at org.eclipse.jetty.server.HttpInput.read(HttpInput.java:313)         at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)         at java.io.BufferedInputStream.read(BufferedInputStream.java:265)         at org.eclipse.jetty.util.ReadLineInputStream.read(ReadLineInputStream.java:131)         at org.eclipse.jetty.util.MultiPartInputStreamParser.parse(MultiPartInputStreamParser.java:769)         at org.eclipse.jetty.util.MultiPartInputStreamParser.getParts(MultiPartInputStreamParser.java:493)         at org.eclipse.jetty.server.MultiParts$MultiPartsUtilParser.<init>(MultiParts.java:121)         at org.eclipse.jetty.server.Request.newMultiParts(Request.java:2410)         at org.eclipse.jetty.server.Request.getParts(Request.java:2333)         at org.eclipse.jetty.server.Request.getParts(Request.java:2319)         at org.apache.nifi.processors.standard.HandleHttpRequest.onTrigger(HandleHttpRequest.java:575)         at org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27)         at org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1165)         at org.apache.nifi.controller.tasks.ConnectableTask.invoke(ConnectableTask.java:203)         at org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:117)         at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)         at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)         at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)         at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748) Thanks in Advance, Ram ... View more

Hi All, My cluster is on HDP 2.5.3 and we have multiple jobs running every 2-5 minutes frequency. So there will be 8-10 K job id's generated in a day with job history. Actually I wanted a log of job which was 3 days older & I was not able to find since MapReduce JHS was storing 20,000 Job ID's, how do I increase this to maximum number? ... View more

Hi All, Is there a way to use RHEL 7 custom AMI on AWS with Cloudbreak as I can currently see only Amazon Linux is being supported? Is there any way that I can use RHEL7/Centos7 on AWS using Cloudbreak? Thanks in advance. ... View more

We are trying to setup the Kerberos on our Dev environment using Exising AD and we will also need to do similarly in Production cluster later. What are the challenges that we might face after having necessary prerequisites in handy also? Note: We do not have Hortonworks Support, what are issues that might occur if we do it on our Production cluster without enterprise support? ... View more

Hi All, Hortonworks ODBC tools works for most of the 3rd party tools but it does not work for JMP (SAS) tool, do we have any other alternative? I wanted to use Zookeeper Quorum url for HiveServer2 HA connectivity in JMP tool. Thanks in advance. ... View more

Hi All, Earlier we were not able to install HDF on top of HDP, as per latest document (https[:]//docs.hortonworks[.]com/HDPDocuments/HDF3/HDF-3.0.2/bk_release-notes) we can install HDF on top of existing HDP cluster. My HDP version: 2.6.4.0, Ambari 2.6.1.3 I need to install NiFi on my cluster through HDF, but the document refers to install the databases on MySQL 5.5.x or PostgreSQL 9.5 later versions on Ambari Server node but I have MySQL (5.1.73) and PostgreSQL(8.4.20) on the same Server which supports my current HDP environment. Now how can I proceed further to install? Can someone please brief the steps here to proceed further? Do we really require installing these DB servers or databases to install NiFi from HDF? Thanks in Advance. ... View more

Hi, We are currently on HDP 2.5.3 running on AWS EC2 instance type m4.4xlarge with 16 CPUs and 64 GB memory. We need to change the Instance type from m4.4xlarge to m4.10xlarge (40 CPUs and 160 GB memory). Changing the Instance types does not harm any EBS volumes or data that is residing but are there any other issues post changing the instance type? If yes, what kind of issues we might face? If anyone has already succeeded, please brief me the steps prior to changing the instance type. Appreciate for response. Thank you. ... View more

All, I have set up PAM authentication and successfully authenticated with Linux users but I see this error in hiveserver2.log, can someone help with this error. 2017-07-24 03:55:46,111 ERROR [HiveServer2-Handler-Pool: Thread-5643]: transport.TSaslTransport (TSaslTransport.java:open(315)) - SASL negotiation failure javax.security.sasl.SaslException: Error validating the login [Caused by javax.security.sasl.AuthenticationException: Error authenticating with the PAM service: sshd] at org.apache.hive.service.auth.PlainSaslServer.evaluateResponse(PlainSaslServer.java:109) at org.apache.thrift.transport.TSaslTransport$SaslParticipant.evaluateChallengeOrResponse(TSaslTransport.java:539) at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:283) at org.apache.thrift.transport.TSaslServerTransport.open(TSaslServerTransport.java:41) at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:216) at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:268) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: javax.security.sasl.AuthenticationException: Error authenticating with the PAM service: sshd at org.apache.hive.service.auth.PamAuthenticationProviderImpl.Authenticate(PamAuthenticationProviderImpl.java:46) at org.apache.hive.service.auth.PlainSaslHelper$PlainServerCallbackHandler.handle(PlainSaslHelper.java:106) at org.apache.hive.service.auth.PlainSaslServer.evaluateResponse(PlainSaslServer.java:102) ... 8 more 2017-07-24 03:55:46,112 ERROR [HiveServer2-Handler-Pool: Thread-5643]: server.TThreadPoolServer (TThreadPoolServer.java:run(296)) - Error occurred during proces sing of message. java.lang.RuntimeException: org.apache.thrift.transport.TTransportException: Error validating the login at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:219) at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:268) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.thrift.transport.TTransportException: Error validating the login at org.apache.thrift.transport.TSaslTransport.sendAndThrowMessage(TSaslTransport.java:232) at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:316) at org.apache.thrift.transport.TSaslServerTransport.open(TSaslServerTransport.java:41) at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:216) ... 4 more Though there are no issues with Hive authentication but why I'm getting these errors? ... View more

Hi All, I'm on HDP 2.3.6 with Spark 1.5.2. Since R does not support sparklyr for Spark 1.5.2. So I downloaded 2.0.1 Spark and i'm running it as Standalone to test it out before distributing it other nodes. So I have connected to Hive Metastore, where Managed tables are accessible through this Spark perfectly, but I'm unable to do simple select for S3 tables. I'm using this config in Spark-Shell and same way for Spark-Sql using spark.properties. Spark Thrift server was started from /sbin/. Also hadoop-aws and aws-sdk jars are in place. val hc = sc.hadoopConfiguration hc.set("fs.s3a.impl", "org.apache.hadoop.fs.s3a.S3AFileSystem") hc.setInt("fs.s3a.connection.maximum", 100) hc.set("fs.s3a.awsAccessKeyId", "OUR ACCESS KEY") hc.set("fs.s3a.awsSecretAccessKey", "OUR SECRET KEY") Spark.Properties for Spark Sql spark.hadoop.fs.s3a.impl org.apache.hadoop.fs.s3a.S3AFileSystem spark.driver.extraClassPath /home/ram/spark-2.0.1/jars/hadoop-aws-2.7.1.2.3.6.0-3796.jar:/home/ram/spark-2.0.1/jars/aws-java-sdk-1.11.164.jar spark.hadoop.fs.s3a.access.key OUR ACCESS KEY spark.hadoop.fs.s3a.secret.key OUR SECRET KEY So here's the error, scala> import org.apache.spark.sql.SQLContext scala> val sqlContext = new org.apache.spark.sql.hive.HiveContext(sc); scala> val df_1=sqlContext.sql("select * from win.win_vi1_data") scala> df_1.show() java.lang.NoSuchMethodError: org.apache.hadoop.security.ProviderUtils.excludeIncompatibleCredentialProviders(Lorg/apache/hadoop/conf/Configuration;Ljava/lang/Class;)Lorg/apache/hadoop/conf/Configuration; at org.apache.hadoop.fs.s3a.S3AFileSystem.getAWSAccessKeys(S3AFileSystem.java:352) at org.apache.hadoop.fs.s3a.S3AFileSystem.initialize(S3AFileSystem.java:160) at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2669) at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:94) at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2703) at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2685) at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:373) at org.apache.hadoop.fs.Path.getFileSystem(Path.java:295) at org.apache.hadoop.mapred.FileInputFormat.singleThreadedListStatus(FileInputFormat.java:258) at org.apache.hadoop.mapred.FileInputFormat.listStatus(FileInputFormat.java:229) at org.apache.hadoop.mapred.FileInputFormat.getSplits(FileInputFormat.java:315) at org.apache.spark.rdd.HadoopRDD.getPartitions(HadoopRDD.scala:199) at org.apache.spark.rdd.RDD$$anonfun$partitions$2.apply(RDD.scala:248) at org.apache.spark.rdd.RDD$$anonfun$partitions$2.apply(RDD.scala:246) at scala.Option.getOrElse(Option.scala:121) at org.apache.spark.rdd.RDD.partitions(RDD.scala:246) at org.apache.spark.rdd.MapPartitionsRDD.getPartitions(MapPartitionsRDD.scala:35) at org.apache.spark.rdd.RDD$$anonfun$partitions$2.apply(RDD.scala:248) at org.apache.spark.rdd.RDD$$anonfun$partitions$2.apply(RDD.scala:246) at scala.Option.getOrElse(Option.scala:121) at org.apache.spark.rdd.RDD.partitions(RDD.scala:246) at org.apache.spark.rdd.MapPartitionsRDD.getPartitions(MapPartitionsRDD.scala:35) at org.apache.spark.rdd.RDD$$anonfun$partitions$2.apply(RDD.scala:248) at org.apache.spark.rdd.RDD$$anonfun$partitions$2.apply(RDD.scala:246) at scala.Option.getOrElse(Option.scala:121) at org.apache.spark.rdd.RDD.partitions(RDD.scala:246) at org.apache.spark.rdd.UnionRDD$$anonfun$1.apply(UnionRDD.scala:84) at org.apache.spark.rdd.UnionRDD$$anonfun$1.apply(UnionRDD.scala:84) at scala.collection.parallel.AugmentedIterableIterator$class.map2combiner(RemainsIterator.scala:115) at scala.collection.parallel.immutable.ParVector$ParVectorIterator.map2combiner(ParVector.scala:62) at scala.collection.parallel.ParIterableLike$Map.leaf(ParIterableLike.scala:1054) at scala.collection.parallel.Task$$anonfun$tryLeaf$1.apply$mcV$sp(Tasks.scala:49) at scala.collection.parallel.Task$$anonfun$tryLeaf$1.apply(Tasks.scala:48) at scala.collection.parallel.Task$$anonfun$tryLeaf$1.apply(Tasks.scala:48) at scala.collection.parallel.Task$class.tryLeaf(Tasks.scala:51) at scala.collection.parallel.ParIterableLike$Map.tryLeaf(ParIterableLike.scala:1051) at scala.collection.parallel.AdaptiveWorkStealingTasks$WrappedTask$class.internal(Tasks.scala:159) at scala.collection.parallel.AdaptiveWorkStealingForkJoinTasks$WrappedTask.internal(Tasks.scala:443) at scala.collection.parallel.AdaptiveWorkStealingTasks$WrappedTask$class.compute(Tasks.scala:149) at scala.collection.parallel.AdaptiveWorkStealingForkJoinTasks$WrappedTask.compute(Tasks.scala:443) at scala.concurrent.forkjoin.RecursiveAction.exec(RecursiveAction.java:160) at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) at scala.concurrent.forkjoin.ForkJoinTask.doJoin(ForkJoinTask.java:341) at scala.concurrent.forkjoin.ForkJoinTask.join(ForkJoinTask.java:673) at scala.collection.parallel.ForkJoinTasks$WrappedTask$class.sync(Tasks.scala:378) at scala.collection.parallel.AdaptiveWorkStealingForkJoinTasks$WrappedTask.sync(Tasks.scala:443) at scala.collection.parallel.ForkJoinTasks$class.executeAndWaitResult(Tasks.scala:426) at scala.collection.parallel.ForkJoinTaskSupport.executeAndWaitResult(TaskSupport.scala:56) at scala.collection.parallel.ParIterableLike$ResultMapping.leaf(ParIterableLike.scala:958) at scala.collection.parallel.Task$$anonfun$tryLeaf$1.apply$mcV$sp(Tasks.scala:49) at scala.collection.parallel.Task$$anonfun$tryLeaf$1.apply(Tasks.scala:48) at scala.collection.parallel.Task$$anonfun$tryLeaf$1.apply(Tasks.scala:48) at scala.collection.parallel.Task$class.tryLeaf(Tasks.scala:51) at scala.collection.parallel.ParIterableLike$ResultMapping.tryLeaf(ParIterableLike.scala:953) at scala.collection.parallel.AdaptiveWorkStealingTasks$WrappedTask$class.compute(Tasks.scala:152) at scala.collection.parallel.AdaptiveWorkStealingForkJoinTasks$WrappedTask.compute(Tasks.scala:443) at scala.concurrent.forkjoin.RecursiveAction.exec(RecursiveAction.java:160) at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) scala> :quit How do I get rid of this error, I have tried all the way but no luck. Any help, Appreciated!! ... View more