Hi @stevenmatison , We are having three nodes nifi cluster, Now we need external storage solutions for these nodes, the nifi nodes are hosted in azure vm with ubuntu, Can you provide us any supporting articles which explain the process of configuration or can you guide us the required steps here.   Flow file, content repository, provence repository would be required 2tb of data every month. We are planning to go with azure SSD with shared disks, can you explain the limitations on these as well..?? ... View more

You can view the packaged version of Parquet in this pom.  ./nifi-nar-bundles/nifi-parquet-bundle/nifi-parquet-processors/pom.xml ... View more

@Bern  I suggest starting a new community question with the full error stack trace you are seeing.  Your exception seems different then the one discussed in this community question:   Failure is due to java.lang.IllegalArgumentException: A HostProvider may not be empty!: java.lang.IllegalArgumentException: A HostProvider may not be empty!   You exception is:   Failure is due to org.apache.nifi.processor.exception.TerminatedTaskException:   A few observations and things you may want to provide details around in your new community post: 1. The version of Apache NiFi you are using was released ~6 years ago.  You should really consider upgrading to take advantage of lost of bug fixes, performance improvements, new features, and security CVEs addressed.  The latest release in the 1.x branch is 1.28 (which is final release of 1.x branch). 2. Your screenshot shows over 250,000 queued FlowFiles (25.75 GB) and 1.373 running processors components. What do you have set as your Max Rimer Driven Tread count? 3. Any other WARN or ERROR messages in your NiFi logs?  Any Out of Memory (OOM) reported? 4. It does not make sense why you are load-balancing in so many connections? Thank you, Matt ... View more

@lv_antel Welcome to the Cloudera Community! As this is an older post, you would have a better chance of receiving a resolution by starting a new thread. This will also be an opportunity to provide details specific to your environment that could aid others in assisting you with a more accurate answer to your question. You can link this thread as a reference in your new post. Thanks. ... View more

Can you help me with a similar issue? My code: import json import collections import java.io import ast   from org.apache.commons.io import IOUtils from java.nio.charset import StandardCharsets from org.apache.nifi.processor.io import StreamCallback class ModJSON(StreamCallback) :   def __init__(self):          pass   def process(self, inputStream, outputStream):     text = IOUtils.toString(inputStream, StandardCharsets.UTF_8)     obj = ast.literal_eval(text)     mail = obj['mail']     outputStream.write(bytearray(json.dumps(obj['mail'], indent=4).encode('utf-8')))     outputStream.write(bytearray(json.dumps(obj['id'], indent=4).encode('utf-8')))       flowFile = session.get() if (flowFile != None):   flowFile = session.write(flowFile, ModJSON())   flowFile = session.putAttribute(flowFile, "filename", flowFile.getAttribute('filename').split('.')[0]+'_translated.json')   flowFile = session.putAttribute(flowFile, "mail", mail) session.transfer(flowFile, REL_SUCCESS) session.commit()     I want to get "mail" value and create a new attribute for it. However, mail variable is not accessible when I insert it into the putattribute command. Any feedback? ... View more

Hey @bjornmy I am looking to resolve the same kind of issue do you have the groovy-script to share?   Thanks, Vasu ... View more

Hi,   I am trying to implemented this blog and so far have successfully completed till version controlling. However, I get an error when I am trying to import the flow in the PG. The prompted error says that FlowID does not exists in Bucket ID whereas I can see that the specific flow is present in the nifi registry in the UI. Can anyone help explain why this is happening?   Additional info: Nifi version: 1.20.0 Nifi registry: 1.22.0 (securely connected to Nifi and buckets are given access to the CNs) Log: Error retrieving flow snapshot: An unexpected error has occurred. Please check the logs for additional details. at org.apache.nifi.registry.client.impl.AbstractJerseyClient.executeAction(AbstractJerseyClient.java:117) Caused by: javax.ws.rs.InternalServerErrorException: HTTP 500 Internal Server Error o.a.n.r.web.mapper.ThrowableMapper An unexpected error has occurred: java.lang.NullPointerException. Returning Internal Server Error response. ... View more

This worked. Thanks. ... View more

It's alright, thank you for replying.  Do you remember if the changes were in nifi config file or nifi-registry config file ?   ... View more

I have a similar issue. I wonder if you have found an answer already. Was that community helpful? ... View more