question Re: ListFTP not taking into account french special characters in filename [Nifi 1.21.0] in Support Questions

ListFTP not taking into account french special characters in filename [Nifi 1.21.0]

sinRudra — Wed, 16 Aug 2023 16:19:34 GMT

Hello,

I have upgraded nifi from 1.16.3 to 1.21.0

Now, the processors ListFTP, FetchFTP, PutFTP won't work with filenames that contains french accents like à é etc..

It worked like a charm on Nifi 1.16.3

Could you please help me on this topic ? I will happy to provide all the information that you need to debug the problem.

Thank you.

Re: ListFTP not taking into account french special characters in filename [Nifi 1.21.0]

DianaTorres — Wed, 16 Aug 2023 20:30:54 GMT

@sinRudra Welcome to the Cloudera Community!

To help you get the best possible solution, I have tagged our NiFi experts @steven-matison who may be able to assist you further.

Please keep us updated on your post, and we hope you find a satisfactory solution to your query.

Re: ListFTP not taking into account french special characters in filename [Nifi 1.21.0]

cotopaul — Thu, 17 Aug 2023 13:03:44 GMT

@sinRudra,

I do not think that your problem is related to the name itself and/or the characters. Your error messages states clearly that you do not have the required permissions to extract the file. If there would have been an issue with the name, you would have received an error message stating that the file cannot be found in that location. Make sure that you have all the configurations done properly to be able to access that ftp location.

Re: ListFTP not taking into account french special characters in filename [Nifi 1.21.0]

sinRudra — Thu, 17 Aug 2023 13:12:11 GMT

Hello @cotopaul

Thanks for taking time to look at the issue.

I have tested with same ftp account on the nifi version 1.16.3 and 1.21.0. It works perfectly fine on 1.16.3.

FetchFtp gives the permission error because filename fetched from listftp contains characters (black question marks)

I can assure that the there is no problem concerning the permissions. with the Nifi 1.21.0, i fetched the files without special characters in the filename.

Re: ListFTP not taking into account french special characters in filename [Nifi 1.21.0]

MattWho — Thu, 17 Aug 2023 17:14:24 GMT

@sinRudra

I recommend reading through the comments, suggestions, and troubleshooting done within the following Apache NiFi Jira to see if you are encountering similar observations.
https://issues.apache.org/jira/browse/NIFI-10143

If so, it may be best to create a new Apache JIra for your specific character set issues to see what the committer community can do for you.

If you found that the provided solution(s) assisted you with your query, please take a moment to login and click Accept as Solution below each response that helped.

Thank you,

Matt

Re: ListFTP not taking into account french special characters in filename [Nifi 1.21.0]

sinRudra — Fri, 18 Aug 2023 08:47:25 GMT

Hello @MattWho

Thanks for the jira link.

It seems that the following commit in the version nifi 1.17.0 have somehow broke the recognition of french characters :

to test it, i downloaded nifi 1.17.0 and ran the tests, got the following result

I will create a Apache Jira ticket.

In the interim, could you propose some alternative solutions? Perhaps a custom processor using the listftp code, but with modifications from version 1.17.0 removed? What are your thoughts?

Thank you for your help.

Re: ListFTP not taking into account french special characters in filename [Nifi 1.21.0]

MattWho — Fri, 18 Aug 2023 12:16:52 GMT

@sinRudra

As a workaround you could take the "nifi-standard-nar-1.16.3.nar" from the NiFi 1.16.3 distro and add it to your NiFi 1.21 install. This will give you access to both version of all the standard nar components. The nifi-standard-nar does however contain a lot of components besides just listFTP. You'll end up seeing two available versions of a lot of components with either 1.21.0 or 1.16.3 as the version when adding components to the canvas.

If you found that the provided solution(s) assisted you with your query, please take a moment to login and click Accept as Solution below each response that helped.

Thank you,

Matt

Re: ListFTP not taking into account french special characters in filename [Nifi 1.21.0]

sinRudra — Fri, 18 Aug 2023 12:27:13 GMT

Hello @MattWho

Thanks for the workaround. I tested and it worked.

Thank you very much.

Re: ListFTP not taking into account french special characters in filename [Nifi 1.21.0]

steven-matison — Fri, 18 Aug 2023 12:27:55 GMT

A solution and a jira, excellent work gents!

Re: ListFTP not taking into account french special characters in filename [Nifi 1.21.0]

sinRudra — Fri, 18 Aug 2023 15:23:42 GMT

For information, jira ticket created.

https://issues.apache.org/jira/browse/NIFI-11967