About vscherbakov

vscherbakov · ‎07-04-2018

Trying to insert data in postgresql database. In pgAdmin this statement is working. What's wrong?

vscherbakov · ‎07-03-2018

How can I parsing html file in nifi? I need remove the first two <table> and take data from every <th> in <tr>. Which processors I need to use and how? Example of a file structure on pic.

vscherbakov · ‎06-28-2018

Hello! I've got divided json file and need to put him whole (without crushing into parts) into postgresql database (in 'attributes' on pic, with jsonb format) How I can do it? What need to write in "SQL Statment"? Help, please!

vscherbakov · ‎06-27-2018

Perfect! Thanks! I'll try QueryDatabaseTable for it. It'll be better!

vscherbakov · ‎06-27-2018

Processor reads data from database an infinite number of times. How can I limit this so that he reads the data only once and does not repeat?

vscherbakov · ‎06-27-2018

Hello! Can't understand whats wrong... I've got processors group to take data from json to sql. When I try to "view as formatted" - I see this: Use SplitJson to split file after it use ReplaceText... and he doesn't work correctly. Unable to generate view of data: Unrecognized token 'INSERT': was expecting 'null', 'true', 'false' or NaN at [Source: (BufferedInputStream); line: 1, column: 8"

vscherbakov · ‎06-25-2018

May I insert json file into sql db? (like on picture) What I need to write in properties of PutSQL processor? I already got FlowFile with json data with help ExecuteSQL(to take data from another database), ConvertAvroToJSON, SplitJson and ReplaceText processors.

vscherbakov · ‎06-21-2018

Thanks a lot!

vscherbakov · ‎06-20-2018

Files on FTP server. I got them with ListFTP and FetchFTP. Then I use RouteText(I think) to filter them by name. And after it I need to parsing data with divide into parts(with SplitContent, I'll try). And unload data on sql server with PutDatabaseRecord.

vscherbakov · ‎06-20-2018

Thanks! I think this should solve my problem!

vscherbakov · ‎06-20-2018

If you could show me an example, it would be rly nice, 'cause I don't quite understand the principle of action... Thanks!

vscherbakov · ‎06-19-2018

I've got a data file that needs to be divided. Inside the text file, the sections are divided: # @ - the beginning of the section with data, # $ is the start of the data block, Next # means the end of the Section. How can I do it?

vscherbakov · ‎06-19-2018

I figured out how to add data from the server to the database *applause*. But the question arose: can I add an extra column with file name/id in the data that I load into the database to understand the data from which file I'm using. Mbe nifi got some processor toadd persistent data to each line before we take them into database?

vscherbakov · ‎06-19-2018

Yes, thanks!

vscherbakov · ‎06-19-2018

-- New day - new problem. I download the CSV file into the InferAvroScheme to determine the scheme of the avro file. After that file's sent to the ConvertCSVToAvro where it is converted. 1. InferAvroSchema incorrectly defines the scheme, outputting in a single cell all the values. 2. ConvertCSVToAvro "Cannot find schema", although I indicated ${inferred.avro.schema} in Record schema.

vscherbakov · ‎06-18-2018

String "${path}/${filename}" decided my problem.

vscherbakov · ‎06-18-2018

Thanks, but it's not really what I wanted to know... What I need to specify in the field "remote file"? *and I use ListFTP before FetchFTP

vscherbakov · ‎06-18-2018

I got a new problem... - can't understand what need to enter and in what format into "Remote File" in "FetchFTP" ...

vscherbakov · ‎06-18-2018

Thanks again!

vscherbakov · ‎06-18-2018

I'm using template from https://gist.github.com/ijokarumawak/b37db141b4d04c2da124c1a6d922f81f and see this error. Whats wrong?

vscherbakov · ‎06-07-2018

And thanks again! I hope this will be enough for the first time.

vscherbakov · ‎06-07-2018

Thx a lot! But I still got a few questions. If you can help - it will be perfect! At the output FetchFTP, we get a file of the CSV format?

vscherbakov · ‎06-07-2018

Hi. It's my first days with nifi, so I need a lot of help! Firstly, I've got ftp from which I need to get data. After it need to parsing and processing data. And download them on sql database. P.S. As I understand, need to use ListFTP and FetchFTP to take data from ftp and transform them into FlowFile. But what after it? Which processors should I use? P.S.S. Hope clearly explained.

Online	Offline
Last Visited	‎07-04-2018 02:16 PM

Date Registered	‎06-07-2018 08:23 AM
Last Visited	‎07-04-2018 02:16 PM
Total Messages Posted	23
Total Kudos Received	1

Why PutSQL not working?

Parsing html file in nifi

PutSQL processor with json

Re: ExecuteSQL reads data from database an infinit...

ExecuteSQL reads data from database an infinite nu...

ReplaceText Processor

JSON file into Sql database

Re: Adding columns to sql in nifi

Re: Divide file in nifi

Re: Adding columns to sql in nifi

Re: Divide file in nifi

Divide file in nifi

Adding columns to sql in nifi

Re: ConvertCSVToAvro with InferAvroScheme

ConvertCSVToAvro with InferAvroScheme

Re: "Remote File" in "FetchFTP"

Re: "Remote File" in "FetchFTP"

"Remote File" in "FetchFTP"

Re: Controller Service is disabled.

Controller Service is disabled.

Re: Need parsing and import data from ftp to sql ...

Re: Need parsing and import data from ftp to sql ...

Need parsing and import data from ftp to sql data...