Options
- Subscribe to RSS Feed
- Mark as New
- Mark as Read
- Bookmark
- Subscribe
- Printer Friendly Page
- Report Inappropriate Content
Master Guru
Created on 05-21-2018 06:36 PM
DevOps Tips: Using the Apache NiFi Toolkit with Apache NiFI 1.6.0
Apache NiFi now has a cool command-line tool that can run interactive or one off.
You can see it here:
https://github.com/apache/nifi/tree/master/nifi-toolkit/nifi-toolkit-cli
You will need to fork and build the current version of Apache NiFi from github. If you have the Java JDK 8+ and Maven you are good to guy. It's pretty quick.
After you build, navigate to the nifi-toolkit target directory and you will have a zip to copy and unzip. You can then use this helpful tool.
This is a separate tool from https://github.com/Chaffelson/nipyapi. Both are awesome though.
I ran this on my local Mac.
nifi-toolkit-1.6.0
List Registry Buckets
./bin/cli.sh registry list-buckets -u http://localhost:18080
# Name Id Description - ------------------------ ------------------------------------ ----------- 1 Development dd323482-c62e-4b18-9f99-c782abd512b4 (empty) 2 Experimental 2f3d1e34-4e20-4d16-af5a-7be99af98869 (empty) 3 Integration e7410f97-1ec1-4b20-a87b-35944517ba4a (empty) 4 Production d3acee10-1bef-4fa8-a75c-0d0e37f7162e (empty) 5 Test 09774cd8-3d3c-4ac6-9921-e341b96b6e38 (empty) 6 nipyapi_console_bucket_0 e40b9d47-cf67-46cc-85d5-028195e6f38a (empty) 7 nipyapi_console_bucket_1 f4212398-af8f-45f3-8951-5ee71800bed8 (empty) 8 tim 7a547c9d-cba6-4445-be29-eb8e9f3892da (empty) ./bin/cli.sh session set nifi.props ../conf/nifi.properties ./bin/cli.sh session set nifi.reg.props /Volumes/seagate/apps/nifi-registry/nifi-registry-assembly/target/nifi-registry-0.1.1-SNAPSHOT-bin/nifi-registry-0.1.1-SNAPSHOT/conf/nifi-registry.properties ./bin/cli.sh registry list-flows -b dd323482-c62e-4b18-9f99-c782abd512b4 -u http://localhost:18080 -ot json [ { "identifier" : "391ead49-79e1-4537-b4c9-a794a129eefe", "name" : "aaa Demo", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1521840088894, "modifiedTimestamp" : 1521840088908, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 1, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/391ead49-79e1-4537-b4c9-a794a129eefe" } }, { "identifier" : "7b8711fb-0454-4302-a6a3-7c2383ed901a", "name" : "aaa ETL POC Kafka", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1521840078539, "modifiedTimestamp" : 1522362203607, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 2, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/7b8711fb-0454-4302-a6a3-7c2383ed901a" } }, { "identifier" : "418f0946-740a-439f-bfd5-f49d7f03f7b0", "name" : "aaa POC", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1521840096718, "modifiedTimestamp" : 1522249506270, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 2, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/418f0946-740a-439f-bfd5-f49d7f03f7b0" } }, { "identifier" : "6c87bba2-e44d-462b-8c42-e89bae35c896", "name" : "aaa Partition 1", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1521840000793, "modifiedTimestamp" : 1522252098304, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 2, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/6c87bba2-e44d-462b-8c42-e89bae35c896" } }, { "identifier" : "ce2fdaf9-bf81-43fa-846f-f38f6891be95", "name" : "water Twitter", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1521840058128, "modifiedTimestamp" : 1522252580364, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 3, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/ce2fdaf9-bf81-43fa-846f-f38f6891be95" } }, { "identifier" : "dd98dfa1-5d8a-4871-a145-2b2a99e9c1bd", "name" : "water", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1521840050742, "modifiedTimestamp" : 1522246164842, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 2, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/dd98dfa1-5d8a-4871-a145-2b2a99e9c1bd" } }, { "identifier" : "6225970e-c483-4041-bddc-9ffe906baaf5", "name" : "Backup", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1521840114610, "modifiedTimestamp" : 1521840114621, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 1, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/6225970e-c483-4041-bddc-9ffe906baaf5" } }, { "identifier" : "d9ddcea0-1f65-49ca-9c84-a98b5aea7c14", "name" : "Backup NiFi Registry", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1522497354889, "modifiedTimestamp" : 1523637422397, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 3, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/d9ddcea0-1f65-49ca-9c84-a98b5aea7c14" } }, { "identifier" : "1d429eac-b4e0-4adc-b1a0-a4872c27dfd6", "name" : "Backup Schemas", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1522076372861, "modifiedTimestamp" : 1522497180409, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 3, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/1d429eac-b4e0-4adc-b1a0-a4872c27dfd6" } }, { "identifier" : "da41aa10-cdcc-4b24-b4cd-6af8d2d51f0d", "name" : "DataWorksSummit2018", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1524079296861, "modifiedTimestamp" : 1524079297284, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 1, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/da41aa10-cdcc-4b24-b4cd-6af8d2d51f0d" } }, { "identifier" : "86fcb309-50dd-44d8-bcb9-df98dcad5147", "name" : "Deep Learning Local", "description" : "TensorFlow\nApache MXNet", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1521841611090, "modifiedTimestamp" : 1524111902612, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 13, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/86fcb309-50dd-44d8-bcb9-df98dcad5147" } }, { "identifier" : "ef5e318f-61ae-473f-afe8-b4d004b9401a", "name" : "DisplayImages", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1522698373151, "modifiedTimestamp" : 1522698373749, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 1, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/ef5e318f-61ae-473f-afe8-b4d004b9401a" } }, { "identifier" : "d67c248a-6dcf-4785-b6ba-8d62bd272048", "name" : "Drones", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1521840043046, "modifiedTimestamp" : 1521840043065, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 1, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/d67c248a-6dcf-4785-b6ba-8d62bd272048" } }, { "identifier" : "64a861d3-da76-40a7-8258-59bc84cb3920", "name" : "First Version", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1516754562969, "modifiedTimestamp" : 1523652572628, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 23, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/64a861d3-da76-40a7-8258-59bc84cb3920" } }, { "identifier" : "51cdc133-0f80-45c4-9f57-4db80e14b1ba", "name" : "Flat File Ingest", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1517515827689, "modifiedTimestamp" : 1517608811893, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 2, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/51cdc133-0f80-45c4-9f57-4db80e14b1ba" } }, { "identifier" : "edcce7af-f2cd-42bb-be13-56df04eac967", "name" : "Flights", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1521839911832, "modifiedTimestamp" : 1522252095529, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 2, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/edcce7af-f2cd-42bb-be13-56df04eac967" } }, { "identifier" : "4409863e-a055-4258-85fd-d38d97d844ff", "name" : "HL7", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1521840150843, "modifiedTimestamp" : 1522249094133, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 2, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/4409863e-a055-4258-85fd-d38d97d844ff" } }, { "identifier" : "2862f26c-1c9b-476b-8fcc-c9889853e83e", "name" : "place", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1521840013403, "modifiedTimestamp" : 1521840013414, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 1, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/2862f26c-1c9b-476b-8fcc-c9889853e83e" } }, { "identifier" : "e458f1eb-6991-4547-b108-2330d45a2f52", "name" : "IBM", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1521840107194, "modifiedTimestamp" : 1521840107201, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 1, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/e458f1eb-6991-4547-b108-2330d45a2f52" } }, { "identifier" : "f2cc6a69-e1d8-4d74-b310-c83d29feddcc", "name" : "Integrate Geo", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1521839902600, "modifiedTimestamp" : 1523644378024, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 3, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/f2cc6a69-e1d8-4d74-b310-c83d29feddcc" } }, { "identifier" : "8a39489a-3431-4ac7-a5fe-83f0ff3663b4", "name" : "Internet of Beer", "description" : "IoT + Deep Learning + Supervised Learning + phone gps ingest + Feed Ingest + Social Media + Picture ingest and analyze", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1523643141557, "modifiedTimestamp" : 1523643968208, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 2, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/8a39489a-3431-4ac7-a5fe-83f0ff3663b4" } }, { "identifier" : "d759b371-2c98-4dbe-b2f8-05657efcb828", "name" : "product place", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1521840023279, "modifiedTimestamp" : 1522252092880, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 3, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/d759b371-2c98-4dbe-b2f8-05657efcb828" } }, { "identifier" : "f0a45484-98e6-45fd-b815-c0b64bab2b6f", "name" : "Pharma MQTT", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1521840034235, "modifiedTimestamp" : 1521840034244, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 1, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/f0a45484-98e6-45fd-b815-c0b64bab2b6f" } }, { "identifier" : "d88ed1c8-3e0f-44d3-b67f-d6566db8a9b9", "name" : "MXNetServer", "description" : "mxnet server connection", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1518104624528, "modifiedTimestamp" : 1524111906112, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 13, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/d88ed1c8-3e0f-44d3-b67f-d6566db8a9b9" } }, { "identifier" : "178cfea3-8d54-44ff-b252-d3d100041a30", "name" : "MiniFi Creator", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1517005511676, "modifiedTimestamp" : 1517082021271, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 3, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/178cfea3-8d54-44ff-b252-d3d100041a30" } }, { "identifier" : "58c887f4-1cfb-4a7c-b732-4b31b260df7e", "name" : "MiniFi Jetson MQTT", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1522698439589, "modifiedTimestamp" : 1522771843123, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 3, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/58c887f4-1cfb-4a7c-b732-4b31b260df7e" } }, { "identifier" : "5fc0add8-4a95-4ed6-ba40-480a57299dc3", "name" : "Mobile Ingest", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1521839889009, "modifiedTimestamp" : 1522252234607, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 2, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/5fc0add8-4a95-4ed6-ba40-480a57299dc3" } }, { "identifier" : "b75ab78a-0e6a-48d8-9c79-9907fdd588aa", "name" : "Mobile Phone Ingest", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1523641063614, "modifiedTimestamp" : 1523641063709, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 1, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/b75ab78a-0e6a-48d8-9c79-9907fdd588aa" } }, { "identifier" : "4060bdd9-6683-4d08-9c89-b4287cf30a4d", "name" : "Monitor Power Local", "description" : "local", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1515791354068, "modifiedTimestamp" : 1523651603644, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 11, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/4060bdd9-6683-4d08-9c89-b4287cf30a4d" } }, { "identifier" : "37cc56a7-126f-48ff-9224-5cea80fc1f79", "name" : "Movidius Ingest", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1521839973960, "modifiedTimestamp" : 1523917401292, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 8, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/37cc56a7-126f-48ff-9224-5cea80fc1f79" } }, { "identifier" : "e1677c9b-f97b-4eea-a644-00c542d3d781", "name" : "NVidia Jetson TX1 Processing Local", "description" : "Local Jetson", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1516050390446, "modifiedTimestamp" : 1523033627484, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 18, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/e1677c9b-f97b-4eea-a644-00c542d3d781" } }, { "identifier" : "f5dda5ef-3660-4c22-9aa1-fb36c539f643", "name" : "NiFi16 Experiments", "description" : "NiFi16 Experiments", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1523637405975, "modifiedTimestamp" : 1523637406198, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 1, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/f5dda5ef-3660-4c22-9aa1-fb36c539f643" } }, { "identifier" : "c0cc71f2-68e1-4157-a80b-a6bfe4f098b1", "name" : "Person Blocker", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1523046406925, "modifiedTimestamp" : 1523048416942, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 2, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/c0cc71f2-68e1-4157-a80b-a6bfe4f098b1" } }, { "identifier" : "35cd923b-679e-497f-80ff-b9f0fa8a0f0e", "name" : "Process MiniFi Creator", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1517005566715, "modifiedTimestamp" : 1517102371332, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 2, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/35cd923b-679e-497f-80ff-b9f0fa8a0f0e" } }, { "identifier" : "d818840d-2657-49ea-95b4-b58e1c0fdbdf", "name" : "Spark Integration", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1517253928065, "modifiedTimestamp" : 1517345802681, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 2, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/d818840d-2657-49ea-95b4-b58e1c0fdbdf" } }, { "identifier" : "472eb39b-9ee5-485b-858c-bceb0bdaeb10", "name" : "Spring Boot 2 ", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1521839961984, "modifiedTimestamp" : 1522246310636, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 2, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/472eb39b-9ee5-485b-858c-bceb0bdaeb10" } }, { "identifier" : "f05b8f0c-bcdc-4798-9a46-dbe7ff0b6d28", "name" : "TensorFlowMXNetProcessing", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1522848101958, "modifiedTimestamp" : 1522848102166, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 1, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/f05b8f0c-bcdc-4798-9a46-dbe7ff0b6d28" } }, { "identifier" : "fd6851d3-18af-492c-b9bf-a038bac417a4", "name" : "Tika", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1516215208293, "modifiedTimestamp" : 1521839930665, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 5, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/fd6851d3-18af-492c-b9bf-a038bac417a4" } }, { "identifier" : "f76e0702-9630-4cb0-aef5-a248961b41fc", "name" : "Weather", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1521839924416, "modifiedTimestamp" : 1521839924428, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 1, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/f76e0702-9630-4cb0-aef5-a248961b41fc" } }, { "identifier" : "968b48f6-aaab-40a0-9074-01ad476b65d0", "name" : "Weather Local", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1522252104918, "modifiedTimestamp" : 1522252104958, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 1, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/968b48f6-aaab-40a0-9074-01ad476b65d0" } }, { "identifier" : "02daca4b-4c14-4616-8891-d04a2d45b338", "name" : "Weg Page Ingest", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1523641088195, "modifiedTimestamp" : 1523642783980, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 3, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/02daca4b-4c14-4616-8891-d04a2d45b338" } }, { "identifier" : "c45779b1-a9f1-4603-a721-b898018efa56", "name" : "c-cda ingest", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1521840158291, "modifiedTimestamp" : 1522252544710, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 2, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/c45779b1-a9f1-4603-a721-b898018efa56" } }, { "identifier" : "eb8a9f26-304d-4967-ad09-e880ead9e50c", "name" : "jetson ingest", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1515810733851, "modifiedTimestamp" : 1515810733869, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 1, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/eb8a9f26-304d-4967-ad09-e880ead9e50c" } }, { "identifier" : "f3893fd0-fbd1-43e5-a8a9-ef6f2a5f82d1", "name" : "jetson minifi", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1515810717305, "modifiedTimestamp" : 1522702554919, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 6, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/f3893fd0-fbd1-43e5-a8a9-ef6f2a5f82d1" } }, { "identifier" : "b4f8f776-1e6a-4b7c-be36-997678e12a31", "name" : "minifi", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1521840136409, "modifiedTimestamp" : 1522253724327, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 2, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/b4f8f776-1e6a-4b7c-be36-997678e12a31" } }, { "identifier" : "be3456e9-3410-4d02-ab9e-323680e7655b", "name" : "nifi registry reading", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1517430895411, "modifiedTimestamp" : 1522246519295, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 10, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/be3456e9-3410-4d02-ab9e-323680e7655b" } } ]% <br>
List Registry Buckets As JSON
./bin/cli.sh registry list-buckets -u http://localhost:18080 -ot json
[ {
"identifier" : "dd323482-c62e-4b18-9f99-c782abd512b4",
"name" : "Development",
"createdTimestamp" : 1515619429045,
"permissions" : {
"canRead" : true,
"canWrite" : true,
"canDelete" : true
},
"link" : {
"params" : {
"rel" : "self"
},
"href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4"
}
}, {
"identifier" : "2f3d1e34-4e20-4d16-af5a-7be99af98869",
"name" : "Experimental",
"createdTimestamp" : 1515619441720,
"permissions" : {
"canRead" : true,
"canWrite" : true,
"canDelete" : true
},
"link" : {
"params" : {
"rel" : "self"
},
"href" : "buckets/2f3d1e34-4e20-4d16-af5a-7be99af98869"
}
}, {
"identifier" : "e7410f97-1ec1-4b20-a87b-35944517ba4a",
"name" : "Integration",
"createdTimestamp" : 1515619435677,
"permissions" : {
"canRead" : true,
"canWrite" : true,
"canDelete" : true
},
"link" : {
"params" : {
"rel" : "self"
},
"href" : "buckets/e7410f97-1ec1-4b20-a87b-35944517ba4a"
}
}, {
"identifier" : "d3acee10-1bef-4fa8-a75c-0d0e37f7162e",
"name" : "Production",
"createdTimestamp" : 1515619404627,
"permissions" : {
"canRead" : true,
"canWrite" : true,
"canDelete" : true
},
"link" : {
"params" : {
"rel" : "self"
},
"href" : "buckets/d3acee10-1bef-4fa8-a75c-0d0e37f7162e"
}
}, {
"identifier" : "09774cd8-3d3c-4ac6-9921-e341b96b6e38",
"name" : "Test",
"createdTimestamp" : 1515619414172,
"permissions" : {
"canRead" : true,
"canWrite" : true,
"canDelete" : true
},
"link" : {
"params" : {
"rel" : "self"
},
"href" : "buckets/09774cd8-3d3c-4ac6-9921-e341b96b6e38"
}
}, {
"identifier" : "e40b9d47-cf67-46cc-85d5-028195e6f38a",
"name" : "nipyapi_console_bucket_0",
"createdTimestamp" : 1520608613095,
"permissions" : {
"canRead" : true,
"canWrite" : true,
"canDelete" : true
},
"link" : {
"params" : {
"rel" : "self"
},
"href" : "buckets/e40b9d47-cf67-46cc-85d5-028195e6f38a"
}
}, {
"identifier" : "f4212398-af8f-45f3-8951-5ee71800bed8",
"name" : "nipyapi_console_bucket_1",
"createdTimestamp" : 1520608613169,
"permissions" : {
"canRead" : true,
"canWrite" : true,
"canDelete" : true
},
"link" : {
"params" : {
"rel" : "self"
},
"href" : "buckets/f4212398-af8f-45f3-8951-5ee71800bed8"
}
}, {
"identifier" : "7a547c9d-cba6-4445-be29-eb8e9f3892da",
"name" : "tim",
"createdTimestamp" : 1515616281094,
"permissions" : {
"canRead" : true,
"canWrite" : true,
"canDelete" : true
},
"link" : {
"params" : {
"rel" : "self"
},
"href" : "buckets/7a547c9d-cba6-4445-be29-eb8e9f3892da"
}
} ]%
List All the Apache NiFi Flows for a Bucket
./bin/cli.sh registry list-flows -b dd323482-c62e-4b18-9f99-c782abd512b4 -u http://localhost:18080
# Name Id Description -- ---------------------------------- ------------------------------------ ---------------------------------------- 1 AAAA Demo 391ead49-79e1-4537-b4c9-a794a129eefe 2 AAAA ETL POC Kafka 7b8711fb-0454-4302-a6a3-7c2383ed901a 3 AAAA POC 418f0946-740a-439f-bfd5-f49d7f03f7b0 4 AAAA Partition 1 6c87bba2-e44d-462b-8c42-e89bae35c896 5 WATER Twitter ce2fdaf9-bf81-43fa-846f-f38f6891be95 6 Water dd98dfa1-5d8a-4871-a145-2b2a99e9c1bd 7 Backup 6225970e-c483-4041-bddc-9ffe906baaf5 8 Backup NiFi Registry d9ddcea0-1f65-49ca-9c84-a98b5aea7c14 9 Backup Schemas 1d429eac-b4e0-4adc-b1a0-a4872c27dfd6 10 DataWorksSummit2018 da41aa10-cdcc-4b24-b4cd-6af8d2d51f0d 11 Deep Learning Local 86fcb309-50dd-44d8-bcb9-df98dcad5147 TensorFlow Apache MXNet 12 DisplayImages ef5e318f-61ae-473f-afe8-b4d004b9401a 13 Drones d67c248a-6dcf-4785-b6ba-8d62bd272048 14 First Version 64a861d3-da76-40a7-8258-59bc84cb3920 15 Flat File Ingest 51cdc133-0f80-45c4-9f57-4db80e14b1ba 16 Flights edcce7af-f2cd-42bb-be13-56df04eac967 17 HL7 4409863e-a055-4258-85fd-d38d97d844ff 18 Somewell 2862f26c-1c9b-476b-8fcc-c9889853e83e 19 IBM e458f1eb-6991-4547-b108-2330d45a2f52 20 Integrate Geo f2cc6a69-e1d8-4d74-b310-c83d29feddcc 21 Internet of Beer 8a39489a-3431-4ac7-a5fe-83f0ff3663b4 IoT + Deep Learning + Supervised Lear... 22 Pharma d759b371-2c98-4dbe-b2f8-05657efcb828 23 Pharma MQTT f0a45484-98e6-45fd-b815-c0b64bab2b6f 24 MXNetServer d88ed1c8-3e0f-44d3-b67f-d6566db8a9b9 mxnet server connection 25 MiniFi Creator 178cfea3-8d54-44ff-b252-d3d100041a30 26 MiniFi Jetson MQTT 58c887f4-1cfb-4a7c-b732-4b31b260df7e 27 Mobile Ingest 5fc0add8-4a95-4ed6-ba40-480a57299dc3 28 Mobile Phone Ingest b75ab78a-0e6a-48d8-9c79-9907fdd588aa 29 Monitor Power Local 4060bdd9-6683-4d08-9c89-b4287cf30a4d local 30 Movidius Ingest 37cc56a7-126f-48ff-9224-5cea80fc1f79 31 NVidia Jetson TX1 Processing Local e1677c9b-f97b-4eea-a644-00c542d3d781 Local Jetson 32 NiFi16 Experiments f5dda5ef-3660-4c22-9aa1-fb36c539f643 NiFi16 Experiments 33 Person Blocker c0cc71f2-68e1-4157-a80b-a6bfe4f098b1 34 Process MiniFi Creator 35cd923b-679e-497f-80ff-b9f0fa8a0f0e 35 Spark Integration d818840d-2657-49ea-95b4-b58e1c0fdbdf 36 Spring Boot 2 472eb39b-9ee5-485b-858c-bceb0bdaeb10 37 TensorFlowMXNetProcessing f05b8f0c-bcdc-4798-9a46-dbe7ff0b6d28 38 Tika fd6851d3-18af-492c-b9bf-a038bac417a4 39 Weather f76e0702-9630-4cb0-aef5-a248961b41fc 40 Weather Local 968b48f6-aaab-40a0-9074-01ad476b65d0 41 Weg Page Ingest 02daca4b-4c14-4616-8891-d04a2d45b338 42 c-cda ingest c45779b1-a9f1-4603-a721-b898018efa56 43 jetson ingest eb8a9f26-304d-4967-ad09-e880ead9e50c 44 jetson minifi f3893fd0-fbd1-43e5-a8a9-ef6f2a5f82d1 45 minifi b4f8f776-1e6a-4b7c-be36-997678e12a31 46 nifi registry reading be3456e9-3410-4d02-ab9e-323680e7655b
A really useful one is:
./bin/cli.sh registry export-flow-version --flowIdentifier 47766463-6e74-470f-b2fb-1ae9453cf45c -u http://localhost:18080 -ot json
We can do things like:
- List All the Buckets in an Apache NiFi Registry
- List All the Flows
- You can output simple text or -ot json for JSON. You can use this to script things even more with your favorite devops tools.
Like everything Apache NiFi, it's awesomely configurable. So you can add your own command! Take a look.
4,194 Views
Comments
Master Guru
Created on 05-21-2018 08:13 PM
- Mark as Read
- Mark as New
- Bookmark
- Permalink
- Report Inappropriate Content
/nifi/nifi-toolkit/nifi-toolkit-assembly/target
copy this somewhere nifi-toolkit-1.7.0-SNAPSHOT-bin.zip and unzip to run
