Member since
06-17-2019
4
Posts
0
Kudos Received
0
Solutions
09-02-2019
03:43 AM
Hello.., i am trying to load data from multiple tables with partition from same database to another tables. for that, i am following following procedure: ListDatabaseTables --> RouteOnAttribute --> Replacetext --> ExecuteSQL --> PutHive3Streaming in the executeSQL processor, getting following exception: unable to execute SQL select query select * from test.department1 where dt='20190901' due to java.sql.SQLFeatureNotSuppoertedException:method not supported; routing to failure:org.apache.nifi.procssor.exception.processException:java.sql.SQLFeaturenotSupportedException: Method not Supported. in Replacetext processor, ,my query is like : select * from '{$ db.table.fullname} '
... View more
Labels:
08-15-2019
04:41 AM
Hello, i have a 2 node nifi cluster and i am trying to load data from local directory from one of the node(non-primary node) by using listfile processor and doing some transformation and trying to put transformed data into primary node only. here is my flow: ListFile(all nodes) --> FetchFile(all nodes) -->ReplaceText(all nodes) -->PutFile(primary node only) but PutFile is not working, data is hanging in the queue only. can anyone tell me the solution for this? @Shu @Matt Burgess @Timothy Spann
... View more
Labels:
08-13-2019
12:44 PM
Hello, i am trying to load data from multiple postgresql tables and load it into multiple hive tables. For that, i have followed procedure: 1. ListDatabaseTables here, i mentioned connection details and database name. 2. routeonAttribure here, i selected list of tables where i want to load from source into one variable called tables like, ${db.table.name:in("student","employee")} 3. Replace text here, i am replacing content with sql query like: SELECT * from ${db.table.fullname} 4.ExecuteSQL here, fetch source table data. 5. putHive3Streaming i am trying to load it into Hive like: database name: default table name : ${db.table.fullname} Here my problem is, database name is different from source to destination and is there any way to get only table name without database name? ${db.table.fullname} from this expression i want only table name. @Matt Burgess @Shu @Timothy Spann
... View more
Labels:
08-05-2019
02:17 PM
Hello, i have two node nifi cluster and i have a scenario that i need to run the bash script to connect to database. now file is available in one machine and when i run this it returns error like cannot run program./zz.sh (in directory /home/nifi/test/) no such file or directory. i created test directory in all two machines under /home/nifi and i have enough permissions. now i created zz.sh file in one of the nifi instance(non primary node) and gave 777 permission. my flow: generateflowfile(allnodes) --> executestreamcommand i tried like create zz.sh file only in primary node and set run on primary node only in generatedataflow it works fine. but i need to workout this as generateflowfile(allnodes). any help would be appreciated. @Shu @Matt Burgess @Timothy Spann
... View more
Labels: