Hey @Raj B, I am stuck on the same error. Did you find a solution to this? Kindly share any insights. ... View more

Hey @Jean Rossier, I am stuck on the same issue. Can you please share what you changed in the config to get it up and running? Thanks. ... View more

@Sneha Vadhi , can you please share your configuration for the connection between ReplaceText and ExecuteSQL ? Maybe a little tweak with the Back Pressure and Size Threshold might help you slow down the average load on NiFi. If you know the average size of each flowfile, you can decrease the threshold or backpressure threshold, so that the queue holds less number of flowfiles and after those files are processed, new files are queued. There is a Wait Processor for NiFi, but according to the documentation here, you'll have to setup a cache service on Couchbase or Redis. ... View more

I fiddled with the XML and I found that the issue is having data in form of XML attributes. For example if the longitude and latitude data is in this format, you get the desired output. Seems like there is some issue in the XMLReader. I upvoted your JIRA issue. Lets wait and see. Thanks for your response. ... View more

@David Sargrad , Would you mind sharing the source of your XML? I want to see if I missed something. Also, I could not find a way to have a look at the schema. Write Schema to attribute is disabled on inferSchema. Even InferavroSchema processor supports CSV and JSON only at the moment. Please share if you find a way to look at the inferred schema in future. If it is a bug, lets hope it gets fixed soon. ... View more

@David Sargrad , I faced the same issue and I believe that the nested structure of your XML is causing inferredSchema to fill null in those attributes. I came across this post, it suggested using a XSLT file to transform the XML directly to JSON. The inferred Schema works great for flat XML files. You might want to give it a try or you can manually define a schema for the file you want to convert. Here is how you can use the XSLT to transform the XML. Configuration of TransformXML processor Save the XSLT file and add the path to the file at XSLT file name ... View more

Hi @Sneha Vadhi , May I ask you what are values of Concurrent Tasks and Run Schedule for both ExecuteSQL and ReplaceText processors? Also, you have mentioned that ExecuteSQL generates a million records, did you try increasing the heap size of JVM in bootstrap.conf? ... View more

Even if its possible, doesn't makes sense to make an external table, transactional. External Table reads data from HDFS and making it transactional would mean the file in the HDFS will be written again and again which violates the Hadoop "write once and read many times" paradigm and also increases the write-head time on the cluster. That is why HIVE explicitly warns about this and doesn't allow you to do this. ... View more