About dave_sargrad

dave_sargrad · ‎06-03-2019

I've finally worked through this challenge. It was a bit of a struggle for me, since there is inadequate documentation on some of these lower-level developer details. However I did take the time to capture what I learned along the way. Currently I placed this learning here. If I capture more detail on this process, i will place it in the same NiFi issue.

dave_sargrad · ‎05-31-2019

Hi @Matt Burgess. I've been able to attach a debugger.. yet i cant seem to set breakpoints. I've attempted to set breakpoints in RunNIFI (in the nifi-bootstrap project). I've set breakpoints at the "status", and "stop" locations, and at many other locations. I've also tried to suspend start to allow for an attach. I've commented on this in detail under a NIFI issue I created, since I think it deserves better attention from the developers (documentation support for new developers). Anyways if you can give me some guidance relative to actually getting my first breakpoint placed in a location where I actually hit the breakpoint, I'd appreciate it.

dave_sargrad · ‎05-30-2019

@Matt Burgess I've got a couple of questions for you. What nifi maven project contains the core application that listens on port 8000? In other words, what component implements support for the "Enable Remote Debugging" property that you describe above? Do you have a preferred IDE for NIFI development? I'd think that the IDE with the best support for maven integration would be the one. Perhaps they are all comparable. I do have an option to use other than eclipse: eclipse (on centos 7) is what I'm trying for now.

dave_sargrad · ‎05-30-2019

Thank you @Matt Burgess. I'll try this today hopefully. We've built our first custom processor, and it seems like the best way to work with that is to run everything inside a single debug environment. Anyways, as usual, I appreciate your prompt and thorough response.

dave_sargrad · ‎05-29-2019

I've successfully cloned and built the NIFI system. It built cleanly. Though initially I experienced a few random unit test failures. That was solved (it was actually a network configuration issue on my end that caused this). The instructions I followed are here: https://nifi.apache.org/quickstart.html The built system is in nifi-assembly/target. I want to run the primary NIFI backend application in the debugger (not the web app, but rather the backend). I have the nifi set of maven projects loaded into eclipse. Can someone provide me information that would assist in getting the app up and running in the debugger? For example: What project contains the main entry point? Aside from running the main application, how do I launch the web app? I'm assuming it is launched separately from the main application.

dave_sargrad · ‎04-25-2019

Please see the template i added in my comment above.. it has the source generator that you need (Test_Convert_Record_2.xml)

dave_sargrad · ‎04-25-2019

Hi @Sumit Das Thanks for your response. I came to the same conclusion. I have indeed used XSLT before along with TransformXML. I was hoping that the new capability with XMLReader would give me an alternative option. Given the current state of the inference capability, I think that you are right. Thanks again for taking the time to respond. I did write an issue on the NIFI issue board: https://issues.apache.org/jira/browse/NIFI-6241. Hopefully this will get some attention.

dave_sargrad · ‎04-24-2019

I've added a simple template that someone can use to replicate this. Test_Convert_Record_2.xml

dave_sargrad · ‎04-24-2019

My simple flow: The input XML: The output JSON: ConvertRecord Configuration: XMLReader Configuration: Several questions arise: Why are position and ncsmTrackData null? Why are all the attributes on fltdMessage being ignored? How can I see the inferred schema? What is a proper schema to correctly transform those two null fields, (along with the rest of the transformation as it currently looks ok)?

dave_sargrad · ‎04-10-2019

I think this may be a bug in the NIFI JoltTransformRecord processor. What is the best way to register this bug?

Online	Offline
Last Visited	‎07-24-2019 07:29 PM

Member Since	‎09-18-2018 11:04 AM
Last Visited	‎07-24-2019 07:29 PM
Posts	92
Kudos received	5

Cloudera Community

Re: How does one run NIFI in the debugger?

Re: How does one run NIFI in the debugger?

Re: How does one run NIFI in the debugger?

Re: How does one run NIFI in the debugger?

How does one run NIFI in the debugger?

Re: Why is Convert Record leaving two fields null,...

Re: Why is Convert Record leaving two fields null,...

Re: Why is Convert Record leaving two fields null,...

Why is Convert Record leaving two fields null, and...

Re: Can someone please help me with the AVRO spec ...