Member since
09-25-2023
10
Posts
0
Kudos Received
0
Solutions
10-16-2023
06:31 AM
we have data in source and loading in staging .What are the processors and configuration need use for incremental loading using timestamp in NIFI?
... View more
Labels:
- Labels:
-
Apache NiFi
10-15-2023
03:52 AM
Hi i am wokring on it can you share me the flow file configuration and sp it will helpful to me
... View more
10-11-2023
06:44 AM
1 Kudo
Again, you answer is a little bit vague and it does not provide any information whatsoever, so therefor you answer will be quite generic. You can use any Processor you want to extract the data from your source database: GenerateTableFetch+ExecuteSQLRecord, ExecuteSQLRecord, ExecuteSQL, QueryDatabaseTable, QueryDatabaseTableRecord. In all of them you will have to define a DBCP Connection Service so that you can connect to your database. In the processors with Record, you can define the type of the output you will see (Avro, Parquet, JSON, etc) Afterwards, you do whatever processing you need and assuming that you will use an RestAPI, you can use the InvokeHTTP Processor to call that API Endpoint, with whatever parameters you require. Take note that if those parameters are inside the flowfile, you will need to extract them as attributes, meaning that you will have to add some extra processing.
... View more
09-28-2023
12:55 AM
Thank you so much SAMSAL it's working
... View more
09-25-2023
02:42 PM
@Abhiram-4455 As this is an older post, you would have a better chance of receiving a resolution by starting a new thread. This will also be an opportunity to provide details specific to your environment that could aid others in assisting you with a more accurate answer to your question. You can link this thread as a reference in your new post. Thanks.
... View more