@bvishal, as this is an older post, you would have a better chance of receiving a resolution by starting a new thread. This will also be an opportunity to provide details specific to your environment that could aid others in assisting you with a more accurate answer to your question. You can link this thread as a reference in your new post. ... View more

@simran_k   format your namenode by using below command:   $ bin/hdfs namenode -format ... View more

export HADOOP_CLIENT_OPTS="-Xmx3072m $HADOOP_CLIENT_OPTS" Adjust memory using the above setting and launch your hadoop distcp job . It should go through ... View more

If you don't care about Avro format and want to go directly to JSON you can use the ExecuteSQLRecord processor where you can specify the output format.  ... View more

Hi,  I faced the same issue and I used the below query. The solution is the bold parts of the query ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.OpenCSVSerde' WITH SERDEPROPERTIES ('separatorChar' = ",",'quoteChar'= "\"", 'escapeChar' = "\\") STORED AS INPUTFORMAT 'org.apache.hadoop.mapred.TextInputFormat' OUTPUTFORMAT 'org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat' thanks ... View more

Hi, the link seems broken. Can you share with us the working one? Thanks. ... View more

I don't understand why NN and SNN is advisable on different nodes. Because SNN read log from NN and process them into fsimage and so on. If SNN is in different node, that will cost network transferring. Not make sense. ... View more

Anyone here to help out with the issue? ... View more

I needed to whitelist port 8020 and 50071 on Hadoop cluster instance. Worked 🙂 Thank you! ... View more

@Bryan Bende : I have a workflow like HandleHttpRequest -> InvokeHttp -> Custom Processor -> HandleHttpResponse. My requirement is that I want to support multiple templated jsons and URL sent to HandleHttpRequest will have query params who values should replace some values in the templated jsons based on the template I need. These templated jsons are nested and complex in structure. Pleaseee suggest how to do this. Different posts mention about diff processors like EvaluateJsonPath, ReplaceText, UpdateAttribute and so on but which processor should I use to store my templated json and how can I do the values replacement. I am new to NiFi and request your help on this and I am basically from Java background. ... View more