I have a dataframe with an id field and a path, looks like this: I need to read the files (csv) and match them with the id. I expect it should work out:   while I can't even figure out how to read files from the path specified in the dataframe, all my knowledge leads to getting a list of paths from the dataframe and reading each one ... View more

I'm just starting to learn NiFi. I need to read parquet data from s3 bucket, I don’t understand how to set up lists3 and fetchs3object processors for reading data. full path looks like this: s3://inbox/prod/export/date=2022-01-07/user=100/cro.parquet I'll write data to sql database - I don't have problems with it, but not sure)) I tried to configure the lists3 processor myself and I think is not very good bucket inbox aws_access_key_id aws_secret_access_key region US EAST endpoint override URL http://s3.wi-fi.ru:8080 ... View more

Hi! I'm trying to set up a data transfer with Ni-Fi. I need to transfer data from postgresql to Clickhouse. I'm asking for help in configuring processors. There is also a problem with connecting Nifi to Clickhouse. ... View more