Yes we managed to get this with work, however the solution did not use NiFi, we used an Oracle View with an INSTEAD of trigger. ... View more

Sorry I did not get this to work in xQuery. I ended up using XSLT to do the transformation. ... View more

So the PutDatabaseRecords looks very promising. I had to make some small changes to the input file. First I had to place a [ at the beginning of the file and a ] at the end of the file, then I replace the LR with a comma ',' . I used the command sed '$!s/$/,/' to make the changes. Is there a NiFi process to make this happen? So the file was {...} {...} {...} {...} New file is <code>[{...}, {...}, {...}, {...}] If I route this new file (JSON array) into both the JSONtoSQL/PUTSQL and PutDatabaseRecords. The JSONtoSQL outputs a new flowfile (much like the splitrecords) for each row and the PutDatabaseRecords ingests the file and is currently creating an empty record for each row, I haven't figured why that is yet ... View more

Hm, learning something new here, never used the ScriptedRecordSetWriter, need to read up on that. Below are some 3 sample records, there is a LF at the end of each record. Ideally the NetworkPolicy array goes into a single column asis. { "ServiceInstanceReferenceId": "9143992365913643215", "ServiceInstanceStatus": "active", "AccessNetworkTechnologyType": "vdsl2", "NetworkPolicy": [ "conn-conf-set:ttv|hsia", "dn-speed-kbps:150000", "up-speed-kbps:30000" ], "createTimeStamp": "2016-03-03 19:35:06-05", "modifiersName": "cn=directory manager", "modifyTimeStamp": "2016-05-13 06:10:45-04" } { "ServiceInstanceReferenceId": "9143992365913643271", "ServiceInstanceStatus": "active", "AccessNetworkTechnologyType": "vdsl2", "NetworkPolicy": [ "conn-conf-set:ttv|hsia", "dn-speed-kbps:150000", "up-speed-kbps:30000" ], "createTimeStamp": "2016-03-03 19:37:21-05", "modifiersName": "cn=directory manager", "modifyTimeStamp": "2016-05-13 06:10:45-04" } { "ServiceInstanceReferenceId": "7030000000000000001", "ServiceInstanceStatus": "active", "AccessNetworkTechnologyType": "gpon", "NetworkPolicy": [ "up-speed-kbps:50000", "dn-speed-kbps:50000", "redir-policy:ssp", "conn-conf-set:hsia" ], "createTimeStamp": "2015-12-04 16:20:16-05", "modifiersName": "cn=directory manager", "modifyTimeStamp": "2016-05-13 05:29:20-04" } ... View more

Sorry same error. ... View more

I did test out the connectivity and the Oracle port is working and the DB is up. However I was using a newest driver (ojdbc7.jar), I'm going to fall back to the previouns version whech was working on the other host. ... View more

Wow, didn't know the xQuery could do this. Based on quick research it appears that fn:tokenize might be just what I'm looking for. I'll have to play with this to see if I can this to work. ... View more

Ok, I learned something new there is a LogAttribute process, and this is what is in the logs now, problem is nothing is being inserted into the table now? Standard FlowFile Attributes Key: 'entryDate' Value: 'Thu Jul 21 13:40:06 MDT 2016' Key: 'lineageStartDate' Value: 'Thu Jul 21 13:40:05 MDT 2016' Key: 'fileSize' Value: '117' FlowFile Attribute Map Content Key: 'RouteOnAttribute.Route' Value: 'Filter_Attributes' Key: 'absolute.path' Value: 'C:\HDF-1.2.0.1-1\nifi\.\data-in/' Key: 'begin_time' Value: '2016-07-12T05:00:00-06:00' Key: 'file.creationTime' Value: '2016-07-21T13:40:05-0600' Key: 'file.lastAccessTime' Value: '2016-07-21T13:40:05-0600' Key: 'file.lastModifiedTime' Value: '2016-07-18T14:20:14-0600' Key: 'file.owner' Value: 'BUILTIN\Administrators' Key: 'filename' Value: 'A20160712.0500-0600-0530-0600_LTHAB0113422.xml' Key: 'fragment.count' Value: '1' Key: 'fragment.identifier' Value: '50540eda-0902-4b5a-bf7a-2b45d956fe3a' Key: 'fragment.index' Value: '0' Key: 'infoid' Value: '1526726706' Key: 'measResults' Value: '0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 NIL NIL NIL 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ' Key: 'measTypes' Value: '1526726986 1526726987 1526726988 1526726989 1526726990 1526726991 1526726992 1526726993 1526726994 1526727226 1526727227 1526727228 1526728306 1526728307 1526728308 1526728309 1526728310 1526728311 1526728312 1526728313 1526728314 1526728315 1526728316 1526728317 1526728318 1526728321 1526728322 1526728323 1526728324 1526728326 1526728327 1526728328 1526728329 1526728330 1526728331 1526728386 1526728387 1526728388 1526728400 1526728401 1526728402 1526728403 1526728404 1526728405 1526728406 1526728407 1526728408 1526728409 1526728410 1526728441 1526728442 1526728468 1526728469 1526728470 1526728471 1526728472 1526728497 1526728498 1526728499 1526728500 1526728501 1526728502 1526728503 1526728504 1526728505 1526728506 1526728507 1526728508 1526728509 1526728510 1526728511 1526728512 1526728513 1526728529 1526728530 1526728531 1526728532 1526728533 1526728534 1526728535 1526728536 1526728542 1526728543 1526728544 1526728560 1526728561 1526728705 1526728706 1526728707 1526728708 1526728709 1526728710 1526728746 1526728747 1526728748 1526728749 1526728750 1526728751 1526728752 1526728753 1526728754 1526728755 1526728756 1526728757 1526728758 1526728759 1526728760 1526728761 1526728889 1526728890 1526728891 1526728892 1526728893 1526728894 1526728895 1526728896 1526728897 1526728898 1526728899 1526728900 1526728901 1526729054 1526729055 1526729260 1526729422 1526729423 1526729424 1526729425 1526729426 1526729427 1526729428 1526729429 1526729432 1526729433 1526729434 1526729485 1526729486 1526729487 1526729488 1526729489 1526729490 1526729491 1526729492 1526729505 1526729506 1526729507 1526729508 1526729509 1526729510 1526729511 1526729512 1526729513 1526729514 1526729515 1526729516 1526729544 1526729573 1526730017 1526730018 1526730019 1526730020 1526730021 1526730022 1526730023 1526730024 1526730025 1526730026 1526730027 1526730028 1526730029 1526730030 1526730031 1526730032 1526730033 1526730034 1526730035 1526730036 1526730037 1526730038 1526730039 1526730040 1526730041 1526730076 1526730077 1526730078 1526730079 1526730080 1526730081 1526730082 1526730083 1526730084 1526730085 1526730086 1526730087 1526730088 1526730089 1526730090 1526730091 1526730092 1526730093 1526730094 1526730095 1526730096 1526730097 1526730098 1526730099 1526730146 1526730147 1526730148 1526730848 1526730849 1526733006 1526733007 1526733008 1526733009 1526733190 1526733191 1526733192 ' Key: 'measValue' Value: 'LTHAB0113422/Cell:eNodeB Function Name=LTHAB0113422, Local Cell ID=110, Cell Name=LTHAB0113422-110-2600-1-1, eNodeB ID=113422, Cell FDD TDD indication=CELL_FDD' Key: 'mime.type' Value: 'text/plain' Key: 'node_name' Value: 'LTHAB0113422' Key: 'path' Value: '/' Key: 'sql.args.1.type' Value: '12' Key: 'sql.args.1.value' Value: '1526726706' Key: 'sql.args.2.type' Value: '12' Key: 'sql.args.2.value' Value: '2016-07-12T05:00:00-06:00' Key: 'sql.args.3.type' Value: '12' Key: 'sql.args.3.value' Value: 'LTHAB0113422/Cell:eNodeB Function Name=LTHAB0113422, Local Cell ID=110, Cell Name=LTHAB0113422-110-2600-1-1, eNodeB ID=113422, Cell FDD TDD indication=CELL_FDD' Key: 'sql.args.4.type' Value: '12' Key: 'sql.args.4.value' Value: '0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 NIL NIL NIL 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ' Key: 'sql.args.5.type' Value: '12' Key: 'sql.args.5.value' Value: '1526726986 1526726987 1526726988 1526726989 1526726990 1526726991 1526726992 1526726993 1526726994 1526727226 1526727227 1526727228 1526728306 1526728307 1526728308 1526728309 1526728310 1526728311 1526728312 1526728313 1526728314 1526728315 1526728316 1526728317 1526728318 1526728321 1526728322 1526728323 1526728324 1526728326 1526728327 1526728328 1526728329 1526728330 1526728331 1526728386 1526728387 1526728388 1526728400 1526728401 1526728402 1526728403 1526728404 1526728405 1526728406 1526728407 1526728408 1526728409 1526728410 1526728441 1526728442 1526728468 1526728469 1526728470 1526728471 1526728472 1526728497 1526728498 1526728499 1526728500 1526728501 1526728502 1526728503 1526728504 1526728505 1526728506 1526728507 1526728508 1526728509 1526728510 1526728511 1526728512 1526728513 1526728529 1526728530 1526728531 1526728532 1526728533 1526728534 1526728535 1526728536 1526728542 1526728543 1526728544 1526728560 1526728561 1526728705 1526728706 1526728707 1526728708 1526728709 1526728710 1526728746 1526728747 1526728748 1526728749 1526728750 1526728751 1526728752 1526728753 1526728754 1526728755 1526728756 1526728757 1526728758 1526728759 1526728760 1526728761 1526728889 1526728890 1526728891 1526728892 1526728893 1526728894 1526728895 1526728896 1526728897 1526728898 1526728899 1526728900 1526728901 1526729054 1526729055 1526729260 1526729422 1526729423 1526729424 1526729425 1526729426 1526729427 1526729428 1526729429 1526729432 1526729433 1526729434 1526729485 1526729486 1526729487 1526729488 1526729489 1526729490 1526729491 1526729492 1526729505 1526729506 1526729507 1526729508 1526729509 1526729510 1526729511 1526729512 1526729513 1526729514 1526729515 1526729516 1526729544 1526729573 1526730017 1526730018 1526730019 1526730020 1526730021 1526730022 1526730023 1526730024 1526730025 1526730026 1526730027 1526730028 1526730029 1526730030 1526730031 1526730032 1526730033 1526730034 1526730035 1526730036 1526730037 1526730038 1526730039 1526730040 1526730041 1526730076 1526730077 1526730078 1526730079 1526730080 1526730081 1526730082 1526730083 1526730084 1526730085 1526730086 1526730087 1526730088 1526730089 1526730090 1526730091 1526730092 1526730093 1526730094 1526730095 1526730096 1526730097 1526730098 1526730099 1526730146 1526730147 1526730148 1526730848 1526730849 1526733006 1526733007 1526733008 1526733009 1526733190 1526733191 1526733192 ' Key: 'sql.args.6.type' Value: '12' Key: 'sql.args.6.value' Value: 'LTHAB0113422' Key: 'sql.table' Value: 'NIFI' Key: 'uuid' Value: 'bc5aa92e-de98-4516-b6a3-674f67e4787b' -------------------------------------------------- INSERT INTO RCS_STG.NIFI (INFOID, BEGIN_TIME, MEASVALUE, MEASRESULTS, MEASTYPES, NODE_NAME) VALUES (?, ?, ?, ?, ?, ?) ... View more

Where will I find the "sql.args.1.type" and "sql.args.1.value" information logged? ... View more

Perfect, works like a charm, Thank you ... View more

Here is my sample, if I remove the xmlns parts Xpath works just fine. <measCollecFile xmlns="http://latest/nmc-omc/cmNrm.doc#measCollec" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://latest/nmc-omc/cmNrm.doc#measCollec schema\pmResultSchedule.xsd"> ... View more