Hello @Jack_sparrow,  Glad to see you on the Community.  As far as I know, df.write is not possible to be used on an rdd.foreach or rdd.foreachpartition.  The reason is because df.write is a driver-side action, it triggers a Spark job. rdd.foreach or rdd.foreachpartition are executors, and executors cannot trigger jobs. Check these references:  https://stackoverflow.com/questions/46964250/nullpointerexception-creating-dataset-dataframe-inside-foreachpartition-foreach https://stackoverflow.com/questions/46964250/nullpointerexception-creating-dataset-dataframe-inside-foreachpartition-foreach https://sparkbyexamples.com/spark/spark-foreachpartition-vs-foreach-explained The option that looks like it works for you is this:  df.write.partitionBy Something like this:  df.write.partitionBy("someColumn").parquet("/path/out")   ... View more

Hello @HoangNguyen,  If I do not understand wrong, what you want is not possible.  ListFile does not support incoming FlowFile as an source.  To do that, you will need to use variable registry.  Look here: Display Name: Input Directory API Name: Input Directory Description: The input directory from which files to pull files Supports Expression Language: true (will be evaluated using variable registry only) https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.9.2/org.apache.nifi.processors.standard.ListFile/index.html Looking on that, FetchFile will do what you need:  Display Name: File to Fetch API Name: File to Fetch Default Value: ${absolute.path}/${filename} Description: The fully-qualified filename of the file to fetch from the file system Supports Expression Language: true (will be evaluated using flow file attributes and variable registry) https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.9.2/org.apache.nifi.processors.standard.FetchFile/index.html ... View more