About rlebretonnic

rlebretonnic · ‎02-18-2019

Hi, I share a feedback about HDP 2.6 with centos 7.6. We have a cluster based on HDP 2.6.4. We added news nodes that are now systematically installed under centos 7.6 version. In that configuration, ambari-agent can not connect to the server and raises the following error in ambari-agent.log: INFO 2019-02-15 14:25:45,083 NetUtil.py:70 - Connecting to https://xhdpbackgtw02u.hadoop:8440/ca ERROR 2019-02-15 14:25:45,085 NetUtil.py:96 - EOF occurred in violation of protocol (_ssl.c:618) ERROR 2019-02-15 14:25:45,085 NetUtil.py:97 - SSLError: Failed to connect. Please check openssl library versions. Refer to: https://bugzilla.redhat.com/show_bug.cgi?id=1022468 for more details. WARNING 2019-02-15 14:25:45,085 NetUtil.py:124 - Server at https://xhdpbackgtw02u.hadoop:8440 is not reachable, sleeping for 10 seconds... The root cause is NetUtil.py that fails for unkown reason. It seems to work if you download Python packages to centos 7.5 ones. We also tried to upgrade ambari-agent to 2.6.2.2 that is certified under centos 7.6 but with the same result. Definitively ambari-agent don't seem to work with Python 2.7.5-76. Good luck...

rlebretonnic · ‎09-14-2017

Hi tom I have the same issue... Did you finally achieve to make oozie works with spark2 ? Régis

rlebretonnic · ‎06-27-2017

Hi everybody By default most UI address (for hdfs datanode, yarn nodemanager, etc) are started on http://<hostname's fqdn>:port (50075, 8042, etc). I do not achieve to change the default server name... which is important to me for I'd like to expose these ports to an all users network and restrict internal communication to a dedicated one... I unsuccessully tried to change yarn.nodemanager.webapp.address to alter the hostname... I also tried to play with public_hostname.sh to define a public hostname but webservers don't seem to start on it? Did someone already achieve to do this ? Regards

rlebretonnic · ‎06-15-2016

Hum... It seems that I have to use the new publisher and consumer API, and not the old one. Now it works but I still have warnings in kafka.out... With 6 lines of warning every second, I will quickly have a problem.

rlebretonnic · ‎06-15-2016

Hi Neeraj I am trying to do exactly the same thing, ie using ranger with a non kerberized Kafka. Unfortunately I have following error : [root@mykafka kafka]# tail -f kafka.out [2016-06-15 15:45:34,002] WARN got exception trying to get groups for user ANONYMOUS: id: ANONYMOUS: no such user (org.apache.hadoop.security.ShellBasedUnixGroupsMapping) [2016-06-15 15:45:34,002] WARN No groups available for user ANONYMOUS (org.apache.hadoop.security.UserGroupInformation) The public group should be mapped to an ANONYMOUS user. https://cwiki.apache.org/confluence/display/RANGER/Kafka+Plugin#KafkaPlugin-WhydowehavetospecifypublicusergrouponallpoliciesitemscreatedforauthorizingKafkaaccessovernon-securechannel? Did you do something special to declare it manually within ranger ? Can you share the list of declared users within ranger ? Thx in advance. Regards

rlebretonnic · ‎06-08-2016

Of course you're right. I was thinking that this property was inherited from the server but it is a consumer feature. It worked as wished now... I still have an issue when I want to personalize the offset topic : [2016-06-08 05:20:02,664] WARN Property offset.storage.topic is not valid (kafka.utils.VerifiableProperties) I will investigate, but if I ignore this property and use the default topic __consumer_offsets it works fine. Thk a lot for your clarification.

rlebretonnic · ‎06-07-2016

Yes I set it to true. I made a mistake... It seems that it is offsets.storage (with S) and offset.storage.topic (w/o S)... See :http://kafka.apache.org/documentation.html But even after having fixed this, it doesn't work. Did you achieve to us offset management within kafka ? Regards

rlebretonnic · ‎06-07-2016

Hi Almost evrything is in the title.. I want to switch from an offsets management in ZK to an offsets management in kafka. How to do this in HDP 2.4 ? I tried to add offsets.storage and offsets.storage.topic in the "custom kafka broker" and parameters are well taken into account : [kafka@mykafka conf]$ grep offsets.storage * server.properties:offsets.storage=kafka server.properties:offsets.storage.topic=offset-topic But it doesn't work... and nothing is recorded in my offset topic. Thx in advance. Regards...

Online	Offline
Last Visited	‎05-06-2019 02:13 PM

Date Registered	‎06-03-2016 08:28 AM
Last Visited	‎05-06-2019 02:13 PM
Total Messages Posted	12
Total Kudos Received	1

HDP 2.6 with centos 7.6

Re: Oozie distributes application jar twice making...

How to customize webapp hostname for UI server ?

Re: Apache Ranger and Kafka - No kerberos

Re: Apache Ranger and Kafka - No kerberos

Re: how to set offset.storage to kafka in HDP 2.4 ...

Re: how to set offset.storage to kafka in HDP 2.4 ...

how to set offset.storage to kafka in HDP 2.4 ?