Wow, that was fast, thank you very much @steven-matison! ... View more

Hi @gopinath and @abathla .  Let me know what you think. ... View more

@svenhans  I would recommend you file an Apache NiFi Jira ticket for your new component processor request. https://issues.apache.org/jira/projects/NIFI Let's say an AD/LDAP lookup processor was create. that means supplying the ldap search configuration properties along with manager DN and manager password in order to do the lookup.  To avoid exposing that to other users in NiFi, maybe creating an LDAPLookup Controller service would be better.  Then create a processor like getLDAPUser that gets configured to use that LDAPLookup CS along with a StandardSSL CS with user defined AD/LDAP attributes to return and require a user Identity property value.    Of course you run the risk of other who have access to your NiFi copying your processor and using it to fetch any details they want about your AD/LDAP users.   Matt ... View more

thanks for the information, we're running on yarn so I guess the steps mentioned in https://spark.apache.org/docs/3.0.0-preview2/running-on-yarn.html#configuring-the-external-shuffle-service must be executed to configure the external shuffle service on each worker node. Are there any plans to support any other external shuffle service like uber rss or apache uniffle in the future? ... View more

@NaBeeL_NaQeeBi Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future. Thanks. ... View more

@Trojan Welcome to the Cloudera Community! To help you get the best possible solution, I have tagged our Kafka experts @rki_ and @ChethanYM  who may be able to assist you further. Please keep us updated on your post, and we hope you find a satisfactory solution to your query. ... View more

@ajmariella Welcome to the Cloudera Community! To help you get the best possible solution, I have tagged our Hbase experts @smdas and @blizano  who may be able to assist you further. Please keep us updated on your post, and we hope you find a satisfactory solution to your query. ... View more

Congratulations on resolving the issue @cdsw_user_23432. Please use the "Accept as Solution" button to mark the reply that resolved the issue for you. It helps others in a similar situation find assistance in the future.  ... View more

Thank you for replying.  I have tried so many different ports and I am even trying external zookeeper.  None of my nifi's can connect to any port I provide them.  It's almost like something is wrong with the code.  I have installed ZK on one of my actual nifi servers and that starts up immediately on port 2181.  That's what is leading me to think it's something in the code.  The other odd thing I keep seeing is, apache.zookeeper.ClientCnxnSocketNetty future isn't success. ... View more

If a port conflict occurs; the most common method is to either vacate it or to configure the service installation to use another port instead.   Can you provide the documents being followed here? Did you consider making changes to docker-deploy-hdp30.sh? ... View more