Detecting Language with Apache NiFi This is a work-in-progress as I am still experimenting with some libraries and techniques to improve this. I originally looked at Apache OpenNLP, Apache Tika, optimaize, Deep Learning and some older libraries. It turns out that most of them are defunct or use optimaize. So I am using the Apache Tika wrapper of optimaize for this pass. I am testing with a few experts to see if we can parse the main languages we need. JUnit Test Add The Processor (First copy to LIB directory and restart the NiFi server) Do not run this in production. Download the NAR from the github. A Quick Flow It produces an attribute: langdetectTika So far I have tested with Spanish (es) and English (en). Source: https://github.com/optimaize/language-detector JUNit Results 18:30:37.386 [pool-1-thread-1] DEBUG com.optimaize.langdetect.LanguageDetectorImpl - ==> [DetectedLanguage[es:0.9999962696603875]] 18:30:37.389 [pool-1-thread-1] DEBUG com.optimaize.langdetect.LanguageDetectorImpl - ==> [DetectedLanguage[es:0.9999953090550733]] 18:30:37.389 [pool-1-thread-1] DEBUG com.optimaize.langdetect.LanguageDetectorImpl - ==> [DetectedLanguage[es:0.9999942717275939]] 18:30:37.389 [pool-1-thread-1] DEBUG com.optimaize.langdetect.LanguageDetectorImpl - ==> [DetectedLanguage[es:0.9999938953293799]] 18:30:37.390 [pool-1-thread-1] DEBUG com.optimaize.langdetect.LanguageDetectorImpl - ==> [DetectedLanguage[es:0.9999991278041699]] 18:30:37.390 [pool-1-thread-1] DEBUG com.optimaize.langdetect.LanguageDetectorImpl - ==> [DetectedLanguage[es:0.9999961087425597]] 18:30:37.390 [pool-1-thread-1] DEBUG com.optimaize.langdetect.LanguageDetectorImpl - ==> [DetectedLanguage[es:0.9999914584331221]] Confidence:HIGH Raw:0.99999523 Attribute:path = target Attribute:filename = 356189695474847.mockFlowFile Attribute:langdetectTika = es Attribute:uuid = 401ef360-53c9-431a-a04c-43b736e3dda1 18:30:37.907 [pool-2-thread-1] DEBUG com.optimaize.langdetect.LanguageDetectorImpl - ==> [DetectedLanguage[en:0.9999913063395092]] 18:30:37.907 [pool-2-thread-1] DEBUG com.optimaize.langdetect.LanguageDetectorImpl - ==> [DetectedLanguage[en:0.9999943343981726]] 18:30:37.907 [pool-2-thread-1] DEBUG com.optimaize.langdetect.LanguageDetectorImpl - ==> [DetectedLanguage[en:0.9999997921395858]] 18:30:37.908 [pool-2-thread-1] DEBUG com.optimaize.langdetect.LanguageDetectorImpl - ==> [DetectedLanguage[en:0.9999900938658981]] 18:30:37.908 [pool-2-thread-1] DEBUG com.optimaize.langdetect.LanguageDetectorImpl - ==> [DetectedLanguage[en:0.9999981049962143]] 18:30:37.908 [pool-2-thread-1] DEBUG com.optimaize.langdetect.LanguageDetectorImpl - ==> [DetectedLanguage[en:0.9999981885752027]] 18:30:37.908 [pool-2-thread-1] DEBUG com.optimaize.langdetect.LanguageDetectorImpl - ==> [DetectedLanguage[en:0.999994743498219]] Confidence:HIGH Raw:0.99999523 Attribute:path = target Attribute:filename = 356190481937339.mockFlowFile Attribute:langdetectTika = en Attribute:uuid = ce142262-c4b1-4f4c-8dd1-31afd90a0645 References: There are many SDKs that tap the REST APIs of Google and Microsoft for translation. https://cloud.google.com/translate/docs/ Optimaize Language Detector - supports 103 language options https://github.com/optimaize/language-detector/blob/master/README.md This other libraries hasn't been updated in 4 years and has no Maven repo, so it's on the back burner for now. https://github.com/shuyo/language-detection/blob/wiki/ProjectHome.md https://github.com/shuyo/language-detection/blob/wiki/Downloads.md https://github.com/shuyo/language-detection/blob/wiki/Tutorial.md Many of the other packages want you to train them on corpus of text for all the languages you are interested in. I downloaded the Apache OpenNLP 1.8.3 language model https://opennlp.apache.org/news/model-langdetect-183.html https://www.apache.org/dist/opennlp/models/langdetect/1.8.3/README.txt https://opennlp.apache.org/docs/1.8.4/manual/opennlp.html#tools.langdetect.classifying.cmdline https://www.apache.org/dyn/closer.cgi/opennlp/models/langdetect/1.8.3/langdetect-183.bin OpenNLP has it's own model, but it's not great for small text. These two have not been updated in nearly 8 years. https://mvnrepository.com/artifact/net.sourceforge.jchardet/jchardet/1.0 http://jchardet.sourceforge.net/ https://github.com/albfernandez/juniversalchardet Download the NAR https://github.com/tspannhw/nifi-langdetect-processor/releases/tag/1.6.0 Thanks for a commenter, we are going to investigate Facebooks Fast Text which has good results in some tests: https://github.com/facebookresearch/fastText/ Thanks Alex! ... View more

Parsing Web Pages for Images with Apache NiFi This could be used to build a web crawler that downloads images. I am downloading awesome images from Pixabay! URL: https://pixabay.com/en/photos/?image_type=&cat=&min_width=&min_height=&q=data+science&order=popular I wanted to be able to grab every image from a page, I have some web sites I want to backup my images from. So I added a processor that uses JSoup to do. Once you download the NAR from github and deploy to your /usr/hdf/current/nifi/lib directories and restart Apache NiFi you will have a new processor. It is ImageProcessor listed version 1.6.0. You can examine and test the Java source code if you wish. Here is an example flow of grabbing all the images from a pixabay URL then filtering out the empty images. Then we split into individual image URLs. We pull out that tag and then download those images. If they are not blank or small I route to TensorFlow to run some inception on it. I extract image meta data and then we send it to my production cluster for processing and storing of the image in an object store and the meta data to a Hive table. Our Routing To Filter Away Small and blank images Pretty basic flow to process. I use my custom Attribute Cleaner to clean up the names and make all the attribute names Apache Avro name compliant. Some of the useful metadata pulled from the image. See the Height and Width, very useful. High Level Processing Flow Example Data { "segmentoriginalfilename" : "331368950519412", "ExifSubIFDFocalLength" : "16.7 mm", "Server" : "nginx/1.13.5", "ContentType" : "application/json", "invokehttpstatuscode" : "200", "fragmentidentifier" : "a5e50c12-4c36-4a65-bc74-83209bae7a9c", "JPEGImageWidth" : "453 pixels", "FileTypeDetectedFileTypeName" : "JPEG", "ExifIFD0Model" : "V-LUX 1", "label4" : "paintbrush", "LastModified" : "Wed, 18 Apr 2018 13:04:35 GMT", "label5" : "binder", "ExifIFD0ExposureTime" : "1/30 sec", "MediaType" : "application/json", "JFIFYResolution" : "300 dots", "JPEGImageHeight" : "340 pixels", "ExifSubIFDFNumber" : "f/3.2", "JFIFThumbnailHeightPixels" : "0", "ExifSubIFDExposureTime" : "1/30 sec", "invokehttpstatusmessage" : "OK", "ETag" : "\"5ad74263-4dab\"", "JPEGNumberofComponents" : "3", "JFIFXResolution" : "300 dots", "fragmentcount" : "100", "CacheControl" : "no-cache, must-revalidate", "invokehttptxid" : "74ee166e-7897-40be-b508-b823bece6ce6", "FileTypeExpectedFileNameExtension" : "jpg", "mediatype" : "application/json", "JPEGDataPrecision" : "8 bits", "probability4" : "2.19%", "probability3" : "4.25%", "invokehttprequesturl" : "https://cdn.pixabay.com/photo/2018/04/18/15/04/literature-3330647__340.jpg", "probability2" : "4.44%", "probability1" : "42.69%", "link" : "https://cdn.pixabay.com/photo/2018/04/18/15/04/literature-3330647__340.jpg", "JFIFThumbnailWidthPixels" : "0", "JPEGCompressionType" : "Baseline", "sshost" : "10.42.80.116", "JFIFVersion" : "1.1", "MimeType" : "application/json", "FileTypeDetectedFileTypeLongName" : "Joint Photographic Experts Group", "invokehttpremotedn" : "CN=pixabay.com", "fragmentindex" : "15", "JPEGComponent3" : "Cr component: Quantization table 1, Sampling factors 1 horiz/1 vert", "RouteOnContentRoute" : "unmatched", "JPEGComponent2" : "Cb component: Quantization table 1, Sampling factors 1 horiz/1 vert", "AcceptRanges" : "bytes", "JPEGComponent1" : "Y component: Quantization table 0, Sampling factors 2 horiz/2 vert", "FileTypeDetectedMIMEType" : "image/jpeg", "HuffmanNumberofTables" : "4 Huffman tables", "ExifSubIFDDateTimeOriginal" : "2012:10:08 13:44:30", "ssaddress" : "10.42.80.116:50450", "Connection" : "keep-alive", "miimetype" : "application/json", "label1" : "quill", "label2" : "safety pin", "Date" : "Fri, 25 May 2018 15:46:15 GMT", "label3" : "umbrella", "contenttype" : "application/json", "ExifIFD0Make" : "LEICA", "mimetype" : "application/json", "ContentLength" : "19883", "JFIFResolutionUnits" : "inch", "probability5" : "1.82%" } Source Code: https://github.com/tspannhw/nifi-imageextractor-processor References: Parsing Any Document https://community.hortonworks.com/articles/163776/parsing-any-document-with-apache-nifi-15-with-apac.html A Simple Webcrawler (First Part) https://community.hortonworks.com/articles/65239/mp3-jukebox-with-nifi-1x.html Webcrawler Options https://github.com/USCDataScience/sparkler http://nutch.apache.org/ https://github.com/yasserg/crawler4j ... View more

Updating The Apache OpenNLP Community Apache NiFi Processor to Support Flow Files In this new release, we add the ability to read content from the FlowFile and analyze that for Locations, Dates, Organizations and Names. We are using the Apache OpenNLP 1.5 Models that are available for download. These do a decent job. You can build new models as needed. I also changed it to output one attribute per type with a String list of locations, organizations, dates and names. I put out a new release, built around Apache NiFi 1.6.0. Source and NAR Download https://github.com/tspannhw/nifi-nlp-processor/releases/tag/1.6 Download the Pre-trained Models for Your Language Here: http://opennlp.sourceforge.net/models-1.5/ I chose English (en). In a future release I made add Organization, Money, Time and Percentage to the lists we extract if there is interest. A Final JSON File Produced Example Output The Main Flow For Trying Out The NLP Processor Set Your Models New NLP Processor Documentation Here is the schema to use to process this data. Not nlp_names is a String of comma delimited values. You may want to parse this or do additional processing in these fields. High Level Flow Example NiFi Flow nlpupdates2018.xml References: https://community.hortonworks.com/articles/76240/using-opennlp-for-identifying-names-from-text.html https://community.hortonworks.com/articles/163776/parsing-any-document-with-apache-nifi-15-with-apac.html https://community.hortonworks.com/articles/178510/integration-apache-opennlp-184-into-apache-nifi-15.html https://community.hortonworks.com/articles/76924/data-processing-pipeline-parsing-pdfs-and-identify.html https://community.hortonworks.com/articles/80418/open-nlp-example-apache-nifi-processor.html https://community.hortonworks.com/articles/76935/using-sentiment-analysis-and-nlp-tools-with-hdp-25.html ... View more

DevOps Tips: Using the Apache NiFi Toolkit with Apache NiFI 1.6.0 Apache NiFi now has a cool command-line tool that can run interactive or one off. You can see it here: https://github.com/apache/nifi/tree/master/nifi-toolkit/nifi-toolkit-cli You will need to fork and build the current version of Apache NiFi from github. If you have the Java JDK 8+ and Maven you are good to guy. It's pretty quick. After you build, navigate to the nifi-toolkit target directory and you will have a zip to copy and unzip. You can then use this helpful tool. This is a separate tool from https://github.com/Chaffelson/nipyapi. Both are awesome though. I ran this on my local Mac. nifi-toolkit-1.6.0 List Registry Buckets ./bin/cli.sh registry list-buckets -u http://localhost:18080 # Name Id Description - ------------------------ ------------------------------------ ----------- 1 Development dd323482-c62e-4b18-9f99-c782abd512b4 (empty) 2 Experimental 2f3d1e34-4e20-4d16-af5a-7be99af98869 (empty) 3 Integration e7410f97-1ec1-4b20-a87b-35944517ba4a (empty) 4 Production d3acee10-1bef-4fa8-a75c-0d0e37f7162e (empty) 5 Test 09774cd8-3d3c-4ac6-9921-e341b96b6e38 (empty) 6 nipyapi_console_bucket_0 e40b9d47-cf67-46cc-85d5-028195e6f38a (empty) 7 nipyapi_console_bucket_1 f4212398-af8f-45f3-8951-5ee71800bed8 (empty) 8 tim 7a547c9d-cba6-4445-be29-eb8e9f3892da (empty) ./bin/cli.sh session set nifi.props ../conf/nifi.properties ./bin/cli.sh session set nifi.reg.props /Volumes/seagate/apps/nifi-registry/nifi-registry-assembly/target/nifi-registry-0.1.1-SNAPSHOT-bin/nifi-registry-0.1.1-SNAPSHOT/conf/nifi-registry.properties ./bin/cli.sh registry list-flows -b dd323482-c62e-4b18-9f99-c782abd512b4 -u http://localhost:18080 -ot json [ { "identifier" : "391ead49-79e1-4537-b4c9-a794a129eefe", "name" : "aaa Demo", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1521840088894, "modifiedTimestamp" : 1521840088908, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 1, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/391ead49-79e1-4537-b4c9-a794a129eefe" } }, { "identifier" : "7b8711fb-0454-4302-a6a3-7c2383ed901a", "name" : "aaa ETL POC Kafka", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1521840078539, "modifiedTimestamp" : 1522362203607, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 2, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/7b8711fb-0454-4302-a6a3-7c2383ed901a" } }, { "identifier" : "418f0946-740a-439f-bfd5-f49d7f03f7b0", "name" : "aaa POC", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1521840096718, "modifiedTimestamp" : 1522249506270, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 2, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/418f0946-740a-439f-bfd5-f49d7f03f7b0" } }, { "identifier" : "6c87bba2-e44d-462b-8c42-e89bae35c896", "name" : "aaa Partition 1", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1521840000793, "modifiedTimestamp" : 1522252098304, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 2, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/6c87bba2-e44d-462b-8c42-e89bae35c896" } }, { "identifier" : "ce2fdaf9-bf81-43fa-846f-f38f6891be95", "name" : "water Twitter", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1521840058128, "modifiedTimestamp" : 1522252580364, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 3, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/ce2fdaf9-bf81-43fa-846f-f38f6891be95" } }, { "identifier" : "dd98dfa1-5d8a-4871-a145-2b2a99e9c1bd", "name" : "water", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1521840050742, "modifiedTimestamp" : 1522246164842, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 2, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/dd98dfa1-5d8a-4871-a145-2b2a99e9c1bd" } }, { "identifier" : "6225970e-c483-4041-bddc-9ffe906baaf5", "name" : "Backup", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1521840114610, "modifiedTimestamp" : 1521840114621, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 1, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/6225970e-c483-4041-bddc-9ffe906baaf5" } }, { "identifier" : "d9ddcea0-1f65-49ca-9c84-a98b5aea7c14", "name" : "Backup NiFi Registry", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1522497354889, "modifiedTimestamp" : 1523637422397, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 3, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/d9ddcea0-1f65-49ca-9c84-a98b5aea7c14" } }, { "identifier" : "1d429eac-b4e0-4adc-b1a0-a4872c27dfd6", "name" : "Backup Schemas", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1522076372861, "modifiedTimestamp" : 1522497180409, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 3, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/1d429eac-b4e0-4adc-b1a0-a4872c27dfd6" } }, { "identifier" : "da41aa10-cdcc-4b24-b4cd-6af8d2d51f0d", "name" : "DataWorksSummit2018", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1524079296861, "modifiedTimestamp" : 1524079297284, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 1, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/da41aa10-cdcc-4b24-b4cd-6af8d2d51f0d" } }, { "identifier" : "86fcb309-50dd-44d8-bcb9-df98dcad5147", "name" : "Deep Learning Local", "description" : "TensorFlow\nApache MXNet", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1521841611090, "modifiedTimestamp" : 1524111902612, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 13, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/86fcb309-50dd-44d8-bcb9-df98dcad5147" } }, { "identifier" : "ef5e318f-61ae-473f-afe8-b4d004b9401a", "name" : "DisplayImages", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1522698373151, "modifiedTimestamp" : 1522698373749, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 1, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/ef5e318f-61ae-473f-afe8-b4d004b9401a" } }, { "identifier" : "d67c248a-6dcf-4785-b6ba-8d62bd272048", "name" : "Drones", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1521840043046, "modifiedTimestamp" : 1521840043065, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 1, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/d67c248a-6dcf-4785-b6ba-8d62bd272048" } }, { "identifier" : "64a861d3-da76-40a7-8258-59bc84cb3920", "name" : "First Version", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1516754562969, "modifiedTimestamp" : 1523652572628, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 23, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/64a861d3-da76-40a7-8258-59bc84cb3920" } }, { "identifier" : "51cdc133-0f80-45c4-9f57-4db80e14b1ba", "name" : "Flat File Ingest", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1517515827689, "modifiedTimestamp" : 1517608811893, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 2, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/51cdc133-0f80-45c4-9f57-4db80e14b1ba" } }, { "identifier" : "edcce7af-f2cd-42bb-be13-56df04eac967", "name" : "Flights", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1521839911832, "modifiedTimestamp" : 1522252095529, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 2, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/edcce7af-f2cd-42bb-be13-56df04eac967" } }, { "identifier" : "4409863e-a055-4258-85fd-d38d97d844ff", "name" : "HL7", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1521840150843, "modifiedTimestamp" : 1522249094133, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 2, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/4409863e-a055-4258-85fd-d38d97d844ff" } }, { "identifier" : "2862f26c-1c9b-476b-8fcc-c9889853e83e", "name" : "place", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1521840013403, "modifiedTimestamp" : 1521840013414, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 1, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/2862f26c-1c9b-476b-8fcc-c9889853e83e" } }, { "identifier" : "e458f1eb-6991-4547-b108-2330d45a2f52", "name" : "IBM", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1521840107194, "modifiedTimestamp" : 1521840107201, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 1, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/e458f1eb-6991-4547-b108-2330d45a2f52" } }, { "identifier" : "f2cc6a69-e1d8-4d74-b310-c83d29feddcc", "name" : "Integrate Geo", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1521839902600, "modifiedTimestamp" : 1523644378024, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 3, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/f2cc6a69-e1d8-4d74-b310-c83d29feddcc" } }, { "identifier" : "8a39489a-3431-4ac7-a5fe-83f0ff3663b4", "name" : "Internet of Beer", "description" : "IoT + Deep Learning + Supervised Learning + phone gps ingest + Feed Ingest + Social Media + Picture ingest and analyze", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1523643141557, "modifiedTimestamp" : 1523643968208, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 2, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/8a39489a-3431-4ac7-a5fe-83f0ff3663b4" } }, { "identifier" : "d759b371-2c98-4dbe-b2f8-05657efcb828", "name" : "product place", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1521840023279, "modifiedTimestamp" : 1522252092880, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 3, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/d759b371-2c98-4dbe-b2f8-05657efcb828" } }, { "identifier" : "f0a45484-98e6-45fd-b815-c0b64bab2b6f", "name" : "Pharma MQTT", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1521840034235, "modifiedTimestamp" : 1521840034244, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 1, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/f0a45484-98e6-45fd-b815-c0b64bab2b6f" } }, { "identifier" : "d88ed1c8-3e0f-44d3-b67f-d6566db8a9b9", "name" : "MXNetServer", "description" : "mxnet server connection", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1518104624528, "modifiedTimestamp" : 1524111906112, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 13, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/d88ed1c8-3e0f-44d3-b67f-d6566db8a9b9" } }, { "identifier" : "178cfea3-8d54-44ff-b252-d3d100041a30", "name" : "MiniFi Creator", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1517005511676, "modifiedTimestamp" : 1517082021271, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 3, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/178cfea3-8d54-44ff-b252-d3d100041a30" } }, { "identifier" : "58c887f4-1cfb-4a7c-b732-4b31b260df7e", "name" : "MiniFi Jetson MQTT", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1522698439589, "modifiedTimestamp" : 1522771843123, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 3, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/58c887f4-1cfb-4a7c-b732-4b31b260df7e" } }, { "identifier" : "5fc0add8-4a95-4ed6-ba40-480a57299dc3", "name" : "Mobile Ingest", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1521839889009, "modifiedTimestamp" : 1522252234607, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 2, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/5fc0add8-4a95-4ed6-ba40-480a57299dc3" } }, { "identifier" : "b75ab78a-0e6a-48d8-9c79-9907fdd588aa", "name" : "Mobile Phone Ingest", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1523641063614, "modifiedTimestamp" : 1523641063709, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 1, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/b75ab78a-0e6a-48d8-9c79-9907fdd588aa" } }, { "identifier" : "4060bdd9-6683-4d08-9c89-b4287cf30a4d", "name" : "Monitor Power Local", "description" : "local", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1515791354068, "modifiedTimestamp" : 1523651603644, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 11, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/4060bdd9-6683-4d08-9c89-b4287cf30a4d" } }, { "identifier" : "37cc56a7-126f-48ff-9224-5cea80fc1f79", "name" : "Movidius Ingest", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1521839973960, "modifiedTimestamp" : 1523917401292, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 8, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/37cc56a7-126f-48ff-9224-5cea80fc1f79" } }, { "identifier" : "e1677c9b-f97b-4eea-a644-00c542d3d781", "name" : "NVidia Jetson TX1 Processing Local", "description" : "Local Jetson", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1516050390446, "modifiedTimestamp" : 1523033627484, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 18, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/e1677c9b-f97b-4eea-a644-00c542d3d781" } }, { "identifier" : "f5dda5ef-3660-4c22-9aa1-fb36c539f643", "name" : "NiFi16 Experiments", "description" : "NiFi16 Experiments", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1523637405975, "modifiedTimestamp" : 1523637406198, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 1, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/f5dda5ef-3660-4c22-9aa1-fb36c539f643" } }, { "identifier" : "c0cc71f2-68e1-4157-a80b-a6bfe4f098b1", "name" : "Person Blocker", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1523046406925, "modifiedTimestamp" : 1523048416942, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 2, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/c0cc71f2-68e1-4157-a80b-a6bfe4f098b1" } }, { "identifier" : "35cd923b-679e-497f-80ff-b9f0fa8a0f0e", "name" : "Process MiniFi Creator", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1517005566715, "modifiedTimestamp" : 1517102371332, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 2, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/35cd923b-679e-497f-80ff-b9f0fa8a0f0e" } }, { "identifier" : "d818840d-2657-49ea-95b4-b58e1c0fdbdf", "name" : "Spark Integration", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1517253928065, "modifiedTimestamp" : 1517345802681, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 2, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/d818840d-2657-49ea-95b4-b58e1c0fdbdf" } }, { "identifier" : "472eb39b-9ee5-485b-858c-bceb0bdaeb10", "name" : "Spring Boot 2 ", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1521839961984, "modifiedTimestamp" : 1522246310636, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 2, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/472eb39b-9ee5-485b-858c-bceb0bdaeb10" } }, { "identifier" : "f05b8f0c-bcdc-4798-9a46-dbe7ff0b6d28", "name" : "TensorFlowMXNetProcessing", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1522848101958, "modifiedTimestamp" : 1522848102166, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 1, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/f05b8f0c-bcdc-4798-9a46-dbe7ff0b6d28" } }, { "identifier" : "fd6851d3-18af-492c-b9bf-a038bac417a4", "name" : "Tika", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1516215208293, "modifiedTimestamp" : 1521839930665, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 5, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/fd6851d3-18af-492c-b9bf-a038bac417a4" } }, { "identifier" : "f76e0702-9630-4cb0-aef5-a248961b41fc", "name" : "Weather", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1521839924416, "modifiedTimestamp" : 1521839924428, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 1, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/f76e0702-9630-4cb0-aef5-a248961b41fc" } }, { "identifier" : "968b48f6-aaab-40a0-9074-01ad476b65d0", "name" : "Weather Local", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1522252104918, "modifiedTimestamp" : 1522252104958, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 1, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/968b48f6-aaab-40a0-9074-01ad476b65d0" } }, { "identifier" : "02daca4b-4c14-4616-8891-d04a2d45b338", "name" : "Weg Page Ingest", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1523641088195, "modifiedTimestamp" : 1523642783980, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 3, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/02daca4b-4c14-4616-8891-d04a2d45b338" } }, { "identifier" : "c45779b1-a9f1-4603-a721-b898018efa56", "name" : "c-cda ingest", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1521840158291, "modifiedTimestamp" : 1522252544710, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 2, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/c45779b1-a9f1-4603-a721-b898018efa56" } }, { "identifier" : "eb8a9f26-304d-4967-ad09-e880ead9e50c", "name" : "jetson ingest", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1515810733851, "modifiedTimestamp" : 1515810733869, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 1, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/eb8a9f26-304d-4967-ad09-e880ead9e50c" } }, { "identifier" : "f3893fd0-fbd1-43e5-a8a9-ef6f2a5f82d1", "name" : "jetson minifi", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1515810717305, "modifiedTimestamp" : 1522702554919, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 6, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/f3893fd0-fbd1-43e5-a8a9-ef6f2a5f82d1" } }, { "identifier" : "b4f8f776-1e6a-4b7c-be36-997678e12a31", "name" : "minifi", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1521840136409, "modifiedTimestamp" : 1522253724327, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 2, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/b4f8f776-1e6a-4b7c-be36-997678e12a31" } }, { "identifier" : "be3456e9-3410-4d02-ab9e-323680e7655b", "name" : "nifi registry reading", "description" : "", "bucketIdentifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "bucketName" : "Development", "createdTimestamp" : 1517430895411, "modifiedTimestamp" : 1522246519295, "type" : "Flow", "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "versionCount" : 10, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4/flows/be3456e9-3410-4d02-ab9e-323680e7655b" } } ]% <br> List Registry Buckets As JSON ./bin/cli.sh registry list-buckets -u http://localhost:18080 -ot json [ { "identifier" : "dd323482-c62e-4b18-9f99-c782abd512b4", "name" : "Development", "createdTimestamp" : 1515619429045, "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/dd323482-c62e-4b18-9f99-c782abd512b4" } }, { "identifier" : "2f3d1e34-4e20-4d16-af5a-7be99af98869", "name" : "Experimental", "createdTimestamp" : 1515619441720, "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/2f3d1e34-4e20-4d16-af5a-7be99af98869" } }, { "identifier" : "e7410f97-1ec1-4b20-a87b-35944517ba4a", "name" : "Integration", "createdTimestamp" : 1515619435677, "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/e7410f97-1ec1-4b20-a87b-35944517ba4a" } }, { "identifier" : "d3acee10-1bef-4fa8-a75c-0d0e37f7162e", "name" : "Production", "createdTimestamp" : 1515619404627, "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/d3acee10-1bef-4fa8-a75c-0d0e37f7162e" } }, { "identifier" : "09774cd8-3d3c-4ac6-9921-e341b96b6e38", "name" : "Test", "createdTimestamp" : 1515619414172, "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/09774cd8-3d3c-4ac6-9921-e341b96b6e38" } }, { "identifier" : "e40b9d47-cf67-46cc-85d5-028195e6f38a", "name" : "nipyapi_console_bucket_0", "createdTimestamp" : 1520608613095, "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/e40b9d47-cf67-46cc-85d5-028195e6f38a" } }, { "identifier" : "f4212398-af8f-45f3-8951-5ee71800bed8", "name" : "nipyapi_console_bucket_1", "createdTimestamp" : 1520608613169, "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/f4212398-af8f-45f3-8951-5ee71800bed8" } }, { "identifier" : "7a547c9d-cba6-4445-be29-eb8e9f3892da", "name" : "tim", "createdTimestamp" : 1515616281094, "permissions" : { "canRead" : true, "canWrite" : true, "canDelete" : true }, "link" : { "params" : { "rel" : "self" }, "href" : "buckets/7a547c9d-cba6-4445-be29-eb8e9f3892da" } } ]% List All the Apache NiFi Flows for a Bucket ./bin/cli.sh registry list-flows -b dd323482-c62e-4b18-9f99-c782abd512b4 -u http://localhost:18080 # Name Id Description -- ---------------------------------- ------------------------------------ ---------------------------------------- 1 AAAA Demo 391ead49-79e1-4537-b4c9-a794a129eefe 2 AAAA ETL POC Kafka 7b8711fb-0454-4302-a6a3-7c2383ed901a 3 AAAA POC 418f0946-740a-439f-bfd5-f49d7f03f7b0 4 AAAA Partition 1 6c87bba2-e44d-462b-8c42-e89bae35c896 5 WATER Twitter ce2fdaf9-bf81-43fa-846f-f38f6891be95 6 Water dd98dfa1-5d8a-4871-a145-2b2a99e9c1bd 7 Backup 6225970e-c483-4041-bddc-9ffe906baaf5 8 Backup NiFi Registry d9ddcea0-1f65-49ca-9c84-a98b5aea7c14 9 Backup Schemas 1d429eac-b4e0-4adc-b1a0-a4872c27dfd6 10 DataWorksSummit2018 da41aa10-cdcc-4b24-b4cd-6af8d2d51f0d 11 Deep Learning Local 86fcb309-50dd-44d8-bcb9-df98dcad5147 TensorFlow Apache MXNet 12 DisplayImages ef5e318f-61ae-473f-afe8-b4d004b9401a 13 Drones d67c248a-6dcf-4785-b6ba-8d62bd272048 14 First Version 64a861d3-da76-40a7-8258-59bc84cb3920 15 Flat File Ingest 51cdc133-0f80-45c4-9f57-4db80e14b1ba 16 Flights edcce7af-f2cd-42bb-be13-56df04eac967 17 HL7 4409863e-a055-4258-85fd-d38d97d844ff 18 Somewell 2862f26c-1c9b-476b-8fcc-c9889853e83e 19 IBM e458f1eb-6991-4547-b108-2330d45a2f52 20 Integrate Geo f2cc6a69-e1d8-4d74-b310-c83d29feddcc 21 Internet of Beer 8a39489a-3431-4ac7-a5fe-83f0ff3663b4 IoT + Deep Learning + Supervised Lear... 22 Pharma d759b371-2c98-4dbe-b2f8-05657efcb828 23 Pharma MQTT f0a45484-98e6-45fd-b815-c0b64bab2b6f 24 MXNetServer d88ed1c8-3e0f-44d3-b67f-d6566db8a9b9 mxnet server connection 25 MiniFi Creator 178cfea3-8d54-44ff-b252-d3d100041a30 26 MiniFi Jetson MQTT 58c887f4-1cfb-4a7c-b732-4b31b260df7e 27 Mobile Ingest 5fc0add8-4a95-4ed6-ba40-480a57299dc3 28 Mobile Phone Ingest b75ab78a-0e6a-48d8-9c79-9907fdd588aa 29 Monitor Power Local 4060bdd9-6683-4d08-9c89-b4287cf30a4d local 30 Movidius Ingest 37cc56a7-126f-48ff-9224-5cea80fc1f79 31 NVidia Jetson TX1 Processing Local e1677c9b-f97b-4eea-a644-00c542d3d781 Local Jetson 32 NiFi16 Experiments f5dda5ef-3660-4c22-9aa1-fb36c539f643 NiFi16 Experiments 33 Person Blocker c0cc71f2-68e1-4157-a80b-a6bfe4f098b1 34 Process MiniFi Creator 35cd923b-679e-497f-80ff-b9f0fa8a0f0e 35 Spark Integration d818840d-2657-49ea-95b4-b58e1c0fdbdf 36 Spring Boot 2 472eb39b-9ee5-485b-858c-bceb0bdaeb10 37 TensorFlowMXNetProcessing f05b8f0c-bcdc-4798-9a46-dbe7ff0b6d28 38 Tika fd6851d3-18af-492c-b9bf-a038bac417a4 39 Weather f76e0702-9630-4cb0-aef5-a248961b41fc 40 Weather Local 968b48f6-aaab-40a0-9074-01ad476b65d0 41 Weg Page Ingest 02daca4b-4c14-4616-8891-d04a2d45b338 42 c-cda ingest c45779b1-a9f1-4603-a721-b898018efa56 43 jetson ingest eb8a9f26-304d-4967-ad09-e880ead9e50c 44 jetson minifi f3893fd0-fbd1-43e5-a8a9-ef6f2a5f82d1 45 minifi b4f8f776-1e6a-4b7c-be36-997678e12a31 46 nifi registry reading be3456e9-3410-4d02-ab9e-323680e7655b A really useful one is: ./bin/cli.sh registry export-flow-version --flowIdentifier 47766463-6e74-470f-b2fb-1ae9453cf45c -u http://localhost:18080 -ot json We can do things like: List All the Buckets in an Apache NiFi Registry List All the Flows You can output simple text or -ot json for JSON. You can use this to script things even more with your favorite devops tools. Like everything Apache NiFi, it's awesomely configurable. So you can add your own command! Take a look. ... View more