@Gophalr This document may be helpful but I am not 100% sure.  There are several settings required for basic http authentication including some for headers:   https://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/HttpAuthentication.html     If this answer resolves your issue or allows you to move forward, please choose to ACCEPT this solution and close this topic. If you have further dialogue on this topic please comment here or feel free to private message me. If you have new questions related to your Use Case please create separate topic and feel free to tag me in your post.     Thanks, Steven @ DFHZ ... View more

I ve tried both of them. But it did not work. You can see that container is running.    ... View more

updateAttribute Attributetojson invoke http   ... View more

@Gubbi Simplest method would be to create a separate ListFile-->FetchFile-->PutS3 flow .   However you should be able to grab everything with the same ListFile processor.  For a single flow you would add updateAttribute to set path you want to use in PutS3.  For example if you see "demo" in the source of the original file, set path to append "demo\".  If not, leave it as " \aws\data\".     You could also use a RouteOnAttribute to send each data type to different PutS3.   If I was doing this myself I might start initially with separate flows which I clearly know are operating as expected.    Then I would start on a third dynamic single flow that achieves the results of both.      ... View more

Hi @palaaniappan , According to your screenshot I suspect there are invisible characters (new-line, tab, space, etc.) present in the name of your folder - see how there is a new line present after your IoT folders, but no new-lines for other folders. Please check your NiFi processors and make sure the file paths for creating the folders are correct. Sometimes when copy-pasting between different windows you might inadvertently paste some invisible characters as well. Kind regards, Julius ... View more

https://issues.apache.org/jira/browse/HIVE-13037     Perhaps this may make you see some insights   ... View more

I could not succeed in multipart upload with InvokeHTTP processor. So I used a simple java code to upload file using 'multipart/form-data'. Invoked java code from nifi SprintContextProcessor. As my file was large, I wrote the file content to disc before invoking 'SprintContextProcessor' and using java code read the file content and uploaded to the target. You can transfer flow file content directly to the java code (SpringContext processor).   Thanks Mahendra ... View more

@renuu   RouteOnAttribute is the method to do this.  You will need to use EvaluateJsonPath to get the attributes you want to route on. For Example: checkResource =  $.alarms.resource   Then code off that attribute in RouteOnAttribute: ${checkResource:equals('abc')}  Also be sure to use valid json.  In your post above,  the snippet is incorrect format with spelling errors.  See my other reply for more info on JSON Validation as well as input on EvaluateJSON.     If this answer resolves your issue or allows you to move forward, please choose to ACCEPT this solution and close this topic. If you have further dialogue on this topic please comment here or feel free to private message me. If you have new questions related to your Use Case please create separate topic and feel free to tag me in your post.     Thanks, Steven @ DFHZ ... View more

@renuu   One of the first issues I came across with your json are some errors from the attributes and related key value pairs being empty:     "attributes": { " ": " ", " ": " " }, "related": [ " ", " ", ], There are also missing } and ], an extra "href" and missing " on value for href.  These JSON inconsistencies make it impossible to parse json without fixing them.  In my template the json I used is updated, validated within GenerateFlowFIle.  I recommend to use a JSON Validator like:      https://jsonlint.com   Next, in order to get ID from each of the alarm's object results you need a Json Reader or another split.... evaluateJson will not match multiple IDs.   It looks like you have the split above.  To get ID after the split use :   $.history[0].id   in EvaluateJsonPath since the id is found within the history array.   You can find my template here ("NiFI EvaluateJsonPath Demo 2):   https://github.com/steven-dfheinz/NiFi-Templates   If this answer resolves your issue or allows you to move forward, please choose to ACCEPT this solution and close this topic. If you have further dialogue on this topic please comment here or feel free to private message me. If you have new questions related to your Use Case please create separate topic and feel free to tag me in your post.     Thanks, Steven @ DFHZ ... View more

@u9008015  It is not possible in a single command.  Using Ambari or the API you will need to stop hst_agent on all hosts, and the hst_sever on the main server, only then you can delete the SmartSense from Ambari.    If you use the API, you will need to get a list of hosts for agent, the correct host for server, then execute each stop call programatically.  Last but not last execute the delete against the main component.     If this answer resolves your issue or allows you to move forward, please choose to ACCEPT this solution and close this topic. If you have further dialogue on this topic please comment here or feel free to private message me. If you have new questions related to your Use Case please create separate topic and feel free to tag me in your post.     Thanks, Steven @ DFHZ ... View more

@arunnalpet You should be able to just add the $. If it doesn't work, maybe have to escape it:  \$ ... View more

@ozaki You should take a look at the hive metastore configuration in Hue.  It sounds like you have Hue access through hive, but you do not have access to the hive metastore.  The hive metastore stores the information about which hive schemas/databases exist, and which tables are found within each.   I would comment more about specific configuration, but I am not sure what platform you are using, or versions.  To troubleshoot further, while using HUE UI, monitor the hue logs, and hive logs for more specific information as the Hue UI shows limited error details.     If this answer resolves your issue or allows you to move forward, please choose to ACCEPT this solution and close this topic. If you have further dialogue on this topic please comment here or feel free to private message me. If you have new questions related to your Use Case please create separate topic and feel free to tag me in your post.     Thanks, Steven @ DFHZ ... View more