Hi Simon,   I am facing the same issue but my case might be different. Are you using temporary credentials? i.e. assuming role. If so, you can't provide aws_session_token property in nifi unfortunately and this will throw the error you are facing. There is an open issue here https://issues.apache.org/jira/browse/NIFI-7900    /Mahmoud ... View more

Do you have this flow available for download? Would be an excellent template ... View more

Only a partial answer but in general I do not think REGEX_REPLACE cuts large strings. It will be hard to figure this out in more detail unless you can share a reproducible example.   Here is what i tested just now: 1. Create a table that contains a string of 60000+ characters (lorem ipsum) 2. Create a new table by selecting the regex replace of that string (i replaced every a with b) 3. Counting the length of the field in the new table   ---   As said, it may well be that you are using a very specific string or regex that together create this problem, it would be interesting to see if this could be reduced to a minimal example. -- Also keep in mind that though they are very similar, there are many ways a regex itself can be parsed, perhaps the test you did is simply slightly different than the implementation in Hive. ... View more

Thats great news thank you Dan. ... View more

If you have to convert simple XML files then this approach works well. However, if you have a very large volume of XML files that are based on an industry data standard such as FpML, HL7 etc. then this manual approach becomes very time-consuming. I am also facing in custom nursing essay very must so what I did, I Use 3rd party tools that automate the whole XML conversion process on various big data frameworks such as Hive, Impala, Spark etc. ... View more

@Simon Jespersen It states that "myuser" is not authorized to access this resource. Would need to look at your authorizer now to determine why. Assuming you are using NiFi's built-in file based authorizer, you would need to check teh users.xml and authorizations.xml files or carefullly inspect what permissions have been created for "myuser" within teh NiFi UI. ... View more

The process group name can actually be found with the attached groovy code: def flowFile = session.get() if(!flowFile) return processGroupName = context.procNode?.getProcessGroup().getName() flowFile = session.putAttribute(flowFile, 'processGroupName', processGroupName) session.transfer(flowFile, REL_SUCCESS) ... View more

Thank you this worked for me ... View more