I have a folder in S3 bucket let us say Test/ Now the Test folder has multiple sub folders and each of these subfolders have multiple files. Now I want to list only the sub folder names within the Test folder and I don't want the names of contents within these sub folders. I configured the processor like this:  prefix: Test/ With this configuration, I get all the subfolders along with their contents. When I give the delimiter as /, then I don't get any result. ... View more

I am currently migrating data from MSSQL to PostgreSQL. While fetching the data from MSSQL, I use the following query to ensure the time is in UTC:   SELECT "time column" AT TIME ZONE 'UTC' AS "time column"    This gives me the correct result in UTC. However, when I ingest the data into PostgreSQL using NiFi's PutDatabaseprocessor, I notice that the time is being increased by 5 hours. The destination column in PostgreSQL is of type timestamp with time zone. when I manually run an INSERT command in PostgreSQL with the same time value, the time remains unchanged. The time shift only occurs during the NiFi ingestion process. Any ideas on what could be causing this discrepancy? ... View more

Can someone tell me how to use GETSFTP processor? For the hostname should we provide value like sftp://host or host I am not able to fetch the files from SFTP. I have provided hostname, Port, Username, Password, Remote path. For remote path, I am following this pattern : /folder/subfolder/ ... View more

How can I establish connection with MSSQL using DBCPconnectionpool if I have windows authentication. I tried adding integratedSecurity = true in the connection URL but it didn't work.  ... View more

I am using executesqlrecord processor to run select sql queries. I use the CSVRecordsetwriter to write the results. In the CSVRecordsetwriter properties, I have mentioned the date format as MM/dd/.yyyy but still the CSVrecordsetwriter is converting the date into epoch timestamps. How do i resolve this issue? This is a screenshot of my csvrecordsetwriter settings.   ... View more

I am trying to use putdatabaserecord record processor to migrate data from a csv without header row or the column names into the database using putdatabaserecord processor.   I get this error: none of the columns in csv are mapped to the table columns ... View more