@Saikrishna Tarapareddy @Sushanth Sowmyan One way to handle this is to use another JSONSerde that has support for skipping malformed records. I had exactly similar situation and worked around it by using org.openx.data.jsonserde.JsonSerDe. This SerDe has support for handling malformed JSON. You need to create table with following TBLPROPERTIES. 'ignore.malformed.json'='true' and ensure this Serde is available to Hive by using ADD JAR command before using this Serde or modifying your Hive JAR path. ... View more

This is a longer regex, assumed the log_entry meets 2 ip address displayed. ... View more

Looks like only the Name nodes are opened for connectivity to\from HDF server , the data nodes are not . We are trying to fix and will test after that. ... View more

Hi @Matt Burgess i know nifi uses port 8080..i was wondering if Jetty it self runs on a different port. thank you. ... View more

@Saikrishna Tarapareddy In addition to the answer submitted by @Matt Clarke, ExecuteProcess and ExecuteStreamCommand should work as well. However, you'll want to move the arguments you're passing to kinit to the "Command Arguments" properties in the respective processors. The "Command" property should be set to "kinit" (or "/usr/bin/kinit", the full path to the executable can be provided). The "Command Arguments" property should be set to -k -t /etc/security/keytabs/nifi.keytab nifi/server@domain.COM The "Argument Delimiter" should be set to the space character, since you do not have any embedded spaces in the arguments you're using, or you can use the ";" character, for instance. In that case, "Command Arguments" should be set to -k;-t;/etc/security/keytabs/nifi.keytab;nifi/server@domain.COM ... View more

Correct, SelectHiveQL is for statements that return ResultSets (like SELECT *), those results are converted to Avro records. PutHiveQL is for executing statements (except callable statements like stored procedures) that do not return results, such as your ALTER TABLE example. ... View more

Hi @Saikrishna Tarapareddy Can you provide output of below? 1. create table def hive> Show create table test_display 2. Files in the hdfs location hadoop fs -ls <table_display table hdfs location> ... View more