@joshtheflame  I just wanted to provide a bit more context. The partial page shot you've included above appears to show Cloudera Manager running against a CDH 6.1.0 cluster. CDH 6.1.0 was released in December of 2018. As you no doubt are aware, that was quite a while ago, especially in terms of "internet time". Hopefully you are aware that CDH 6.1.x has reached its End of Support (EoS). You can find the most recent official reminder of the previous announcement that Cloudera Enterprise 6.x reached End of Support (EoS) in 2021 here: March 2021 Customer Advisory - 2: End of Support for Cloudera Products (CDH/CM 6.x & HDP 3.x). Cloudera's lifecycle support policies are documented here: https://www.cloudera.com/legal/policies/support-lifecycle-policy.html My understanding is that organizations with a valid Cloudera subscription for legacy products such as CDH would have been sent this announcement directly.   If that screenshot represents what your bank is running in production, I would recommend that you reach out to your Cloudera Account team and discuss your upgrade options as soon as possible. You are going to have to upgrade in order to take advantage of any of the offerings mentioned in @steven-matison 's reply earlier.     ... View more

Nice one sir!   ... View more

@Ghilani  While I agree that using record based processors so you can work with single FlowFiles with multiple records in them to make more efficient dataflows, what you are doing here should be possible with a ReplaceText processor in the interim using "Literal Replace":   Here we are searching for the pattern _" and replacing it with just ". If you found this response assisted with your query, please take a moment to login and click on "Accept as Solution" below this post. Thank you, Matt ... View more

@Rohan44 maybe you have a typo above, but try:   SELECT COUNT(*) FROM FLOWFILE ... View more

@BlueShangai First, HDP is very out dated, i recommend alternative and newer toolsets.  That said,  in my previous experience with this sandbox, even a 16gb machine struggles to deploy the entire cluster.  If it does, there will be stability issues with 1 or more components.  When i used a 32gb machine, the stack come sup and is much better stable sandbox.  However, this HDP Sandbox is a gaint stack of services that is designed for many machines, so use something like this with caution. ... View more

@Tokolosk I would recommend that you provide java's cacerts as the keystore/truststore with the default password (changeit).  This will work for most public certs.    If you have a custom cert at the SFTP end you will need to import that cert and create your own keystore/truststore.  I always try cacerts first. ... View more

@Tra The recommend path forward here is to use a JSON Record Reader and JSON Record Writer with schema matching your source (reader) and downstream needs.  You want to avoid splitjson and regex matching flow file contents.   ... View more

Hi All,   I was able to get my script tested on my 10 nodes DEV cluster. Below are the results:   1. All HDP core services started / stopped okay 2. None of Hive Service Interactive service started and hence, Hive service was not marked as STARTED though HMS and HS2 were started okay 3. None of the Spark2_THRIFTSERVER was started   Any one can share some thoughts on points 2 and 3? Thanks snm1523 ... View more

@mala_etl Well I cant do all of them,  that would be to your values, not mine, but to achieve the move,  you need to set: Completion Strategy: Move File Move Destination Directory:  The directory to move file to Create Directory:  enable true/ disable false   Be sure to check the ? for each property, it will explain everything. ... View more