I've got a standalone HBase running on my local Windows 10 machine.  It starts up fine, I can connect to it with `hbase shell` and life is grand.   But connecting to it with Java has been a complete failure.  Here's my setup in brief: hbase-site.xml     <configuration> <property> <name>hbase.master.port</name> <value>16000</value> </property> <property> <name>hbase.master.info.bindAddress</name> <value>localhost</value> </property> <property> <name>hbase.cluster.distributed</name> <value>false</value> </property> </configuration>       Java code:     Configuration configuration = HBaseConfiguration.create(); configuration.addResource(new Path(hbaseSiteXMLPath)); UserGroupInformation.setConfiguration(configuration); Connection connection = ConnectionFactory.createConnection(configuration); Table table = connection.getTable(TableName.valueOf(myTableName)); Result result = table.get(get); table.close(); connection.close();       This seems like it should be straightforward, but hours later I'm still getting the same Exception as I have all day:     MasterNotRunningException: org.apache.hadoop.hbase.MasterNotRunningException: java.io.IOException: org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase-secure/master     I've changed `zookeeper.znode.parent` to `/hbase` but the Exception remains the same, except `/hbase-secure` changes to `/hbase`.  I've also added ` hbase.zookeeper.quorum` to `localhost` and ` hbase.zookeeper.property.clientPort` to 2181, but that seemed to look for an existing zookeeper connection and fail when it didn't exist rather than create a new one, so I took those out.   Any help appreciated, very frustrated. ... View more

This is something that should be pretty straightforward that isn't working for some reason. I'm trying to query a table and return rows that match 2 filters. I'm getting a single result that matches one of the filters and doesn't have the other column in it. I was expecting this code to return all rows where PersonAddressHash = ba3d1874fee1d9076bde083d819c6a2165ec5790 AND PdfHash = 5151c1394a08a61cbd4d821914bbdca5fa333975dd413685bd1f6b086f555f3e, but its only matching on the PdfHash: Scan scan = new Scan(); // Create filters and add them to scan object         SingleColumnValueFilter filter1 = new SingleColumnValueFilter(             Bytes.toBytes("data"),              Bytes.toBytes("PersonAddressHash"),              CompareOperator.EQUAL,              Bytes.toBytes("ba3d1874fee1d9076bde083d819c6a2165ec5790"));         SingleColumnValueFilter filter2 = new SingleColumnValueFilter(             Bytes.toBytes("data"),              Bytes.toBytes("PdfHash"),              CompareOperator.EQUAL,              Bytes.toBytes("5151c1394a08a61cbd4d821914bbdca5fa333975dd413685bd1f6b086f555f3e")         FilterList filters = new FilterList(FilterList.Operator.MUST_PASS_ALL);         filters.addFilter(filter1);         filters.addFilter(filter2);         scan.setFilter(filters); // Read the results into a JSON array, then print it to stdout         ResultScanner scanner = table.getScanner(scan);         JSONArray resultsJSON = new JSONArray();         for (Result result : scanner) {             JSONObject swap = new JSONObject();             for (Cell cell : result.listCells()) {                 String qualifier = Bytes.toString(CellUtil.cloneQualifier(cell));                 String value = Bytes.toString(CellUtil.cloneValue(cell));                 swap.put(qualifier, value);             }             resultsJSON.put(swap);         }         System.out.print(resultsJSON.toString(4));     } I'm specifying FilterList.Operator.MUST_PASS_ALL yet its only passing one of the filters. My only guess is about the missing column perhaps? Not sure why this isn't working, help appreciated. ... View more

I have this XML file: <request>     <requestType>BULKRETRIEVE</requestType>     <requestDomainType>ROI</requestDomainType>     <systemName>SYSTEMTEST</systemName>     <location>USA</location>         <userInformation>         <userId>1313</userId>         <firstName>Some</firstName> <!-- required -->         <lastName>Guy</lastName> <!-- required -->         <email>email@address.com</email> <!-- required if phone not included -->         <phone></phone> <!-- required if email not included -->     </userInformation>       <requestObject>         <startDate>2019-01-01T00:00:00.000-05:00</startDate>         <endDate>2019-01-31T00:00:00.000-05:00</endDate>         <type>ROI</type>     </requestObject> </request> Using this schema {     "namespace": "com.organization.somethingspecific",     "name": "request",     "type": "record",     "fields": [       {"name": "requestType", "type": ["string","null"], "default": null},       {"name": "requestDomainType", "type": ["string","null"], "default": null},       {"name": "systemName", "type": ["string","null"], "default": null},       {"name": "location", "type": ["string","null"], "default": null},       {"name": "userInformation", "type": ["null", {         "name": "userInformation", "type": "array", "items": {           "name": "userInformation", "type": "record", "fields": [             {"name": "userId", "type": ["string","null"], "default": null},             {"name": "firstName", "type": ["string","null"], "default": null},             {"name": "lastName", "type": ["string","null"], "default": null},             {"name": "email", "type": ["string","null"], "default": null},             {"name": "phone", "type": ["string","null"], "default": null}           ]         }       }], "default": null},       {"name": "requestObject", "type": ["null",{         "name": "requestObject", "type": "array", "items": {           "name": "requestObject", "type": "record", "fields": [             {"name": "startDate", "type": ["string","null"], "default": null},             {"name": "endDate", "type": ["string","null"], "default": null},             {"name": "type", "type": ["string","null"], "default": null}           ]         }       }], "default": null}     ] } I am confident that the schema is correct because I am able to convert from XML to JSON no problem. However UpdateRecord is not able to alter nested fields no matter how I reference them. I have the following UpdateRecord processor: At the very least I would expect //startDate to work since that is SUPPOSED to ignore hierarchy, but I can only update top level fields such as /requestType which is the only one that actually updates of the 4 in my configuration. I am following the documentation exactly, what else could be wrong? Any help appreciated. ... View more

I am using an ExecuteScript processor to read the keys and values of all the attributes from a 0 byte empty flowFile into a JSON string, write the JSON string to the contents of the flowFile and transfer to REL_SUCCESS. This is the script in the ExecuteScriptProcessor: from org.apache.commons.io import IOUtils from java.nio.charset import StandardCharsets from org.apache.nifi.processor.io import OutputStreamCallback # Define a subclass of OutputStreamCallback for use in session.write() class PyOutputStreamCallback(OutputStreamCallback): def __init__(self): pass def process(self, outputStream): atts = {} for key, value in flowFile.getAttributes().iteritems(): atts[key] = str(value).encode('utf-8') atts_string = str(atts) outputStream.write(bytearray(atts_string.encode('utf-8'))) # end class flowFile = session.get() if (flowFile != None): flowFile = session.write(flowFile, PyOutputStreamCallback()) session.transfer(flowFile, REL_SUCCESS) # implicit return at the end I have been using GenerateFlowFile and UpdateAttributes to generate a test flowFile, the info for which is the image attached to this post. When I try to run the pipeline, I get this output: SyntaxError: mismatched input '/' expecting EOF in <script> at line number 1 at column number 0 From what I've found on Google, this error typically means an indenting or formatting issue with Python, but I've made absolutely sure that is not the case by deleting and re-tabbing each line individually since its such a short script, but the error still persists. So it seems to be NiFi related but I have no idea what could be causing it, I can't find a '/' character anywhere in the sample flowFile attributes (the 'path' attribute had a '/' but I changed it to 'test' and the issue persisted) or my code. EDIT: I just realized there is an AttributesToJson processor that I can use to keep going, but I am still curious as to why my code above isn't working, I feel like this is a use case similar to things I will want to do in the future and it makes me nervous not understanding why this won't work. ... View more

I need to replace all of the contents of my flowfile with a file on the disk. Seems like FetchFile just adds the contents to the flowfile, is there a way to drop the contents of my flowfile first? ... View more

I'm getting the error "Cluster is still in the process of voting on the appropriate Data Flow." on the sandbox HDF docker image. Not really sure how to troubleshoot this, I'm not familiar with NiFi or HDF at all. Suggestions appreciated ... View more