I'm trying to use NiFi to replace a basic flume agent that uses Spooling Directory Source and send content to Kafka. http://flume.apache.org/FlumeUserGuide.html#spooling-directory-source The functionality of Flume Spooling Directory source is describe in flume documentation as: "This source lets you ingest data by placing files to be ingested into a “spooling” directory on disk. This source will watch the specified directory for new files, and will parse events out of new files as they appear. The event parsing logic is pluggable. After a given file has been fully read into the channel, it is renamed to indicate completion (or optionally deleted)." Looking for hints on how to do it with NiFi. ... View more

version: Ambari 1.7.0 Have anyone seen error below when trying to deploy a new cluster using ambari api. 30 Nov 2015 17:24:06,826 WARN [ambari-action-scheduler] ActionScheduler:200 - Exception received java.lang.RuntimeException: org.apache.ambari.server.ClusterNotFoundException: Cluster not found, clusterName=clusterID=6 at org.apache.ambari.server.actionmanager.ExecutionCommandWrapper.getExecutionCommand(ExecutionCommandWrapper.java:116) at org.apache.ambari.server.actionmanager.ActionScheduler.isStageHasBackgroundCommandsOnly(ActionScheduler.java:428) at org.apache.ambari.server.actionmanager.ActionScheduler.filterParallelPerHostStages(ActionScheduler.java:416) at org.apache.ambari.server.actionmanager.ActionScheduler.doWork(ActionScheduler.java:246) at org.apache.ambari.server.actionmanager.ActionScheduler.run(ActionScheduler.java:195) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.ambari.server.ClusterNotFoundException: Cluster not found, clusterName=clusterID=6 at org.apache.ambari.server.state.cluster.ClustersImpl.getClusterById(ClustersImpl.java:250) at org.apache.ambari.server.actionmanager.ExecutionCommandWrapper.getExecutionCommand(ExecutionCommandWrapper.java:74) ... 5 more 30 Nov 2015 17:24:09,931 WARN [ambari-hearbeat-monitor] HeartbeatMonitor:146 - Heartbeat lost from host brtlvlts0233pl.redecorp.br 30 Nov 2015 17:24:09,931 WARN [ambari-hearbeat-monitor] HeartbeatMonitor:146 - Heartbeat lost from host brtlvlts0234pl.redecorp.br 30 Nov 2015 17:24:09,932 WARN [ambari-hearbeat-monitor] HeartbeatMonitor:146 - Heartbeat lost from host brtlvlts0232pl.redecorp.br 30 Nov 2015 17:24:09,932 WARN [ambari-hearbeat-monitor] HeartbeatMonitor:146 - Heartbeat lost from host brtlvlts0237pl.redecorp.br 30 Nov 2015 17:24:09,932 WARN [ambari-hearbeat-monitor] HeartbeatMonitor:146 - Heartbeat lost from host brtlvlts0235pl.redecorp.br 30 Nov 2015 17:24:09,932 WARN [ambari-hearbeat-monitor] HeartbeatMonitor:146 - Heartbeat lost from host brtlvlts0236pl.redecorp.br 30 Nov 2015 17:24:13,274 ERROR [alert-event-bus-1] AmbariJpaLocalTxnInterceptor:114 - [DETAILED ERROR] Rollback reason: If we log in ambari webui, cluster stuck with install pending: ... View more