question Re: Need parsing and import data from ftp to sql database with nifi. in Support Questions

Need parsing and import data from ftp to sql database with nifi.

vscherbakov — Thu, 07 Jun 2018 16:55:18 GMT

Hi. It's my first days with nifi, so I need a lot of help!

Firstly, I've got ftp from which I need to get data. After it need to parsing and processing data. And download them on sql database.

P.S. As I understand, need to use ListFTP and FetchFTP to take data from ftp and transform them into FlowFile. But what after it? Which processors should I use?

P.S.S. Hope clearly explained.

Re: Need parsing and import data from ftp to sql database with nifi.

Shu_ashu — Thu, 07 Jun 2018 17:08:58 GMT

@Vladislav Shcherbakov

You need to use PutDataBaseRecord processor to push data to Sql database from NiFi.

Configure/enable Record Reader controller service(avro schema that matches incoming data) that can read the incoming data and and database connection then give all the details about your target table in sql server.

Refer to this link to get more details regarding configs/usage of PutDatabaseRecord processor and to this link how to Configure Record Reader controller service.

Re: Need parsing and import data from ftp to sql database with nifi.

vscherbakov — Thu, 07 Jun 2018 17:27:28 GMT

Thx a lot!
But I still got a few questions. If you can help - it will be perfect!
At the output FetchFTP, we get a file of the CSV format?

Re: Need parsing and import data from ftp to sql database with nifi.

Shu_ashu — Thu, 07 Jun 2018 17:46:29 GMT

@Vladislav Shcherbakov

It depends on how the file is been stored on FTP server side if the file is in CSV format then FetchFTP processor pulls the file in CSV format. Fetching of files won't change the format of the file in NiFi.

If the file is in CSV format on source server side then in PutDatabaseRecord processor you need to configure/enable CSV Reader processor so that processor reads the incoming data and executes sql statements based on the SqlType property value.

Re: Need parsing and import data from ftp to sql database with nifi.

vscherbakov — Thu, 07 Jun 2018 18:02:42 GMT

And thanks again!
I hope this will be enough for the first time.

question Re: ​Need parsing and import data from ftp to sql database with nifi. in Support Questions

​Need parsing and import data from ftp to sql database with nifi.

Re: ​Need parsing and import data from ftp to sql database with nifi.

Re: ​Need parsing and import data from ftp to sql database with nifi.

Re: ​Need parsing and import data from ftp to sql database with nifi.

Re: ​Need parsing and import data from ftp to sql database with nifi.

question Re: Need parsing and import data from ftp to sql database with nifi. in Support Questions

Need parsing and import data from ftp to sql database with nifi.

Re: Need parsing and import data from ftp to sql database with nifi.

Re: Need parsing and import data from ftp to sql database with nifi.

Re: Need parsing and import data from ftp to sql database with nifi.

Re: Need parsing and import data from ftp to sql database with nifi.