Thank You. You pointed me in right direction. ... View more

@Saikrishna Tarapareddy @Sushanth Sowmyan One way to handle this is to use another JSONSerde that has support for skipping malformed records. I had exactly similar situation and worked around it by using org.openx.data.jsonserde.JsonSerDe. This SerDe has support for handling malformed JSON. You need to create table with following TBLPROPERTIES. 'ignore.malformed.json'='true' and ensure this Serde is available to Hive by using ADD JAR command before using this Serde or modifying your Hive JAR path. ... View more

@Randy Gelhausen Under conf there is a templates directory where all the templates are located. ... View more

@spdvnz @Andrew Grande By input/output being in root Top level processing group what Andrew means is that it shouldn't be part of a process group. If you look at bottom left hand corner, your input port should be under NiFi Flow, not under a process group. Also, site to site property in B should have nifi.remote.input.host=FQDN of B. instance A of NiFi will initially talk to instance B of Nifi on public port ( how you access instance B UI ). Then instance B will reply with information available in nifi.remote.* properties. instance A, will then communicate with instance B on host and port specified in remote properties. Can you please post a screenshot of your setup? ... View more

Thanks Matt for your help. I finally resolved this issue by referring to internal ip of hosts. ... View more

Thanks Matt. Source Nifi instance is not able to talk to target cluster because it it trying to access public ip that it can't access. I guess it is more of EC2 question, how can I get my node to communicate using public ip. Only one of the node is public facing. Other node is not public facing and doesn't have a public facing FQDN. ... View more

HDF 2.0. Source nifi is also running on same instance. Looking at logs, it looks like nifi is trying to communicate on public ip address, but it can't communicate. How do I specify private ip for communication. ... View more