rlebretonnic
Explorer

HDP 2.6 with centos 7.6

by Explorer in Support Questions
‎02-18-2019 06:08 PM
‎02-18-2019 06:08 PM
Hi, I share a feedback about HDP 2.6 with centos 7.6. We have a cluster based on HDP 2.6.4. We added news nodes that are now systematically installed under centos 7.6 version. In that configuration, ambari-agent can not connect to the server and raises the following error in ambari-agent.log: INFO 2019-02-15 14:25:45,083 NetUtil.py:70 - Connecting to https://xhdpbackgtw02u.hadoop:8440/ca ERROR 2019-02-15 14:25:45,085 NetUtil.py:96 - EOF occurred in violation of protocol (_ssl.c:618) ERROR 2019-02-15 14:25:45,085 NetUtil.py:97 - SSLError: Failed to connect. Please check openssl library versions. Refer to: https://bugzilla.redhat.com/show_bug.cgi?id=1022468 for more details. WARNING 2019-02-15 14:25:45,085 NetUtil.py:124 - Server at https://xhdpbackgtw02u.hadoop:8440 is not reachable, sleeping for 10 seconds... The root cause is NetUtil.py that fails for unkown reason. It seems to work if you download Python packages to centos 7.5 ones. We also tried to upgrade ambari-agent to 2.6.2.2 that is certified under centos 7.6 but with the same result. Definitively ambari-agent don't seem to work with Python 2.7.5-76. Good luck... ... View more
Labels:

Re: Oozie distributes application jar twice making...

by Explorer in Support Questions
‎09-14-2017 07:21 PM
‎09-14-2017 07:21 PM
Hi tom I have the same issue... Did you finally achieve to make oozie works with spark2 ? Régis ... View more

How to customize webapp hostname for UI server ?

by Explorer in Support Questions
‎06-27-2017 02:55 PM
‎06-27-2017 02:55 PM
Hi everybody By default most UI address (for hdfs datanode, yarn nodemanager, etc) are started on http://<hostname's fqdn>:port (50075, 8042, etc). I do not achieve to change the default server name... which is important to me for I'd like to expose these ports to an all users network and restrict internal communication to a dedicated one... I unsuccessully tried to change yarn.nodemanager.webapp.address to alter the hostname... I also tried to play with public_hostname.sh to define a public hostname but webservers don't seem to start on it? Did someone already achieve to do this ? Regards ... View more
Labels:

Re: Apache Ranger and Kafka - No kerberos

by Explorer in Community Articles
‎06-15-2016 08:51 PM
‎06-15-2016 08:51 PM
Hum... It seems that I have to use the new publisher and consumer API, and not the old one. Now it works but I still have warnings in kafka.out... With 6 lines of warning every second, I will quickly have a problem. ... View more

Re: Apache Ranger and Kafka - No kerberos

by Explorer in Community Articles
‎06-15-2016 03:34 PM
‎06-15-2016 03:34 PM
Hi Neeraj I am trying to do exactly the same thing, ie using ranger with a non kerberized Kafka. Unfortunately I have following error : [root@mykafka kafka]# tail -f kafka.out [2016-06-15 15:45:34,002] WARN got exception trying to get groups for user ANONYMOUS: id: ANONYMOUS: no such user (org.apache.hadoop.security.ShellBasedUnixGroupsMapping) [2016-06-15 15:45:34,002] WARN No groups available for user ANONYMOUS (org.apache.hadoop.security.UserGroupInformation) The public group should be mapped to an ANONYMOUS user. https://cwiki.apache.org/confluence/display/RANGER/Kafka+Plugin#KafkaPlugin-WhydowehavetospecifypublicusergrouponallpoliciesitemscreatedforauthorizingKafkaaccessovernon-securechannel? Did you do something special to declare it manually within ranger ? Can you share the list of declared users within ranger ? Thx in advance. Regards ... View more

Re: how to set offset.storage to kafka in HDP 2.4 ...

by Explorer in Support Questions
‎06-08-2016 08:00 AM
‎06-08-2016 08:00 AM
Of course you're right. I was thinking that this property was inherited from the server but it is a consumer feature. It worked as wished now... I still have an issue when I want to personalize the offset topic : [2016-06-08 05:20:02,664] WARN Property offset.storage.topic is not valid (kafka.utils.VerifiableProperties) I will investigate, but if I ignore this property and use the default topic __consumer_offsets it works fine. Thk a lot for your clarification. ... View more

Re: how to set offset.storage to kafka in HDP 2.4 ...

by Explorer in Support Questions
‎06-07-2016 04:25 PM
‎06-07-2016 04:25 PM
Yes I set it to true. I made a mistake... It seems that it is offsets.storage (with S) and offset.storage.topic (w/o S)... See :http://kafka.apache.org/documentation.html But even after having fixed this, it doesn't work. Did you achieve to us offset management within kafka ? Regards ... View more

how to set offset.storage to kafka in HDP 2.4 ?

by Explorer in Support Questions
‎06-07-2016 03:43 PM
‎06-07-2016 03:43 PM
Hi Almost evrything is in the title.. I want to switch from an offsets management in ZK to an offsets management in kafka. How to do this in HDP 2.4 ? I tried to add offsets.storage and offsets.storage.topic in the "custom kafka broker" and parameters are well taken into account : [kafka@mykafka conf]$ grep offsets.storage * server.properties:offsets.storage=kafka server.properties:offsets.storage.topic=offset-topic But it doesn't work... and nothing is recorded in my offset topic. Thx in advance. Regards... ... View more
Labels:
Contact Me
Online
Offline
Last Visited
‎05-06-2019 02:13 PM
Public Statistics
Date Registered ‎06-03-2016 08:28 AM
Last Visited ‎05-06-2019 02:13 PM
Total Messages Posted 12
Total Kudos Received 1
; ;