Member since
07-11-2019
2
Posts
0
Kudos Received
0
Solutions
11-05-2020
09:37 AM
I am trying to upgrade our Airflow installation including Kerberos authentication from the localexecutor to the celeryexecutor. Currently, we run the airflow installation from only one server. The exact same sqoop job fails using the celeryexecutor due to an kerberos authentication error while the localexecutor is successful: Client cannot authenticate via:[TOKEN, KERBEROS]; Host Details : local host is: "lsrv****.linux.****/10.251.128.148"; destination host is: "lsrv***.linux.****":8020; , while invoking ClientNamenodeProtocolTranslatorPB.getFileInfo over lsrv****.linux.****/10.251.128.104:8020 after 1 failover attempts. Trying to failover after sleeping for 1377ms.' kerberos settings: [kerberos]
ccache = /tmp/krb5cc_32606
# gets augmented with fqdn
principal = airflow
reinit_frequency = 3600
kinit_path = kinit
keytab = /var/lib/airhome/.certs/airflow.keytab Is there anything that needs to change in the kerberos or celery setup to have kerberos work in combination with celery executor? Or does anything need to change in the Cloudera Hadoop settings? (e.g.: hadoop.security.token.service.use_ip?) Does it have to do something with the additional ip adress mentioned in the error message?
... View more
Labels:
12-05-2019
05:17 AM
Is there any Documentation how to implement the ArangoDB Spark connector? There is a short manual but it's not telling how to configure it in your environment. Or which config files you have to edit. https://www.arangodb.com/docs/3.4/drivers/spark-connector-getting-started.html
Or do I miss something??
... View more
- Tags:
- Spark
Labels: