@Genentech I am not sure if this is the answer you are looking for, but my recommendation is to leave your original table as is and select results from that into the parquet table.  I am a firm believe of using backup copies, staging, copies or temporary copies of original data sources on the path through translation to final source.   Make a new empty table with the parquet format you want.   The format must match.   Next execute:   INSERT INTO final_table SELECT * from source_table;   If you need to retain the same original table name, you can alter or drop the original table, and execute a rename statement on the final_table above.   If this answer resolves your issue or allows you to move forward, please choose to ACCEPT this solution and close this topic. If you have further dialogue on this topic please comment here or feel free to private message me. If you have new questions related to your Use Case please create separate topic and feel free to tag me in your post.     Thanks, Steven @ DFHZ ... View more

@satishjan1 the command to set the hostname is:   hostnamectl set-hostname host.name.com Depending on your OS config, you may also need to update items that may manage that hostname and the host files.  You can confirm by doing above, and then reboot.   The hostname should persist after reboot.     If this answer resolves your issue or allows you to move forward, please choose to ACCEPT this solution and close this topic. If you have further dialogue on this topic please comment here or feel free to private message me. If you have new questions related to your Use Case please create separate topic and feel free to tag me in your post.     Thanks,   ... View more

@johndcal   I am excited that you are learning NiFi.  It is my favorite tool to solve any Use Case I have.      Problem 1:   Your extractText logic is matching all values, not one, and is put them into attributes as an array (0,1,2,3,4,etc).   It's okay to use this in this manner, just use the values you need an ignore the rest. There are things you can do to single out each value better but I would recommend that you use a CSVRecordReader Controller Service to parse the CSV.      This allows much more control over the values as well as the schema.   Problem 2:  Can you send your flow screenshot?  You said it doesn't stop inserting the FlowFiles... is the first processor in your flow always on?  What I mean by this, if that first processsor's run schedule is 0 sec, it will always run, and continuously generate FlowFiles.     When I am creating a flow for first time, I set the first proc to some controllable run schedule.  For example 30 seconds.   I push play, then immediately stop it, then step the Flow Files through each downstream Processor, one at a time, testing at each queue that the FlowFiles attributes are as expected.   Once I know I have a full operating flow, then I address how to trigger the flow to start, or the appropriate timing to always run.       If this answer resolves your issue or allows you to move forward, please choose to ACCEPT this solution and close this topic. If you have further dialogue on this topic please comment here or feel free to private message me. If you have new questions related to your Use Case please create separate topic and feel free to tag me in your post.     Thanks, ... View more

@michaelli Not from the UI.  You will need to go back to the actual metastore server and see the command(s) to create the hive user. If it’s a MySQL metastore it’s easy to go to MySQL prompt and arrow up to see previously executed commands with the hive user and password.   ... View more

@arunnalpet   yes that is correct.  I wanted to avoid $set in basic testing and also advocating for valid code practice to avoid issues further with the data source.         If the answer above resolves your issue or allows you to move forward, please choose to ACCEPT this solution and close this topic. If you have further dialogue on this topic please comment here or feel free to private message me. If you have new questions related to your Use Case please create separate topic and feel free to tag me in your post.     Thanks, Steven @ DFHZ ... View more