Support Questions
Find answers, ask questions, and share your expertise

Install Airflow on CDH 6.2 (using parcels)

New Contributor

Hello friends.

 

I want to use Apache Airflow on CDH 6.2 cluster, I am following this tutorial 

 

https://freesoft.dev/program/69570654

https://blog.clairvoyantsoft.com/apache-airflow-csd-ac5b145d5e2d

 

I installed RabbitMQ as parcel (3.7.9-3.7.9-1.el7-21.3.8.14-1.el7) with this tutorial:

 

https://github.com/teamclairvoyant/rabbitmq-cloudera-parcel

 

But always I have this error:

 

   return f(*args, **kwargs)
  File "/opt/cloudera/parcels/AIRFLOW-1.10.3-python2.7.15_b2/lib/python2.7/site-packages/airflow/bin/cli.py", line 1090, in worker
    worker.run(**options)
  File "/opt/cloudera/parcels/AIRFLOW-1.10.3-python2.7.15_b2/lib/python2.7/site-packages/celery/bin/worker.py", line 257, in run
    **kwargs)
  File "/opt/cloudera/parcels/AIRFLOW-1.10.3-python2.7.15_b2/lib/python2.7/site-packages/celery/worker/worker.py", line 101, in __init__
    self.setup_instance(**self.prepare_args(**kwargs))
  File "/opt/cloudera/parcels/AIRFLOW-1.10.3-python2.7.15_b2/lib/python2.7/site-packages/celery/worker/worker.py", line 122, in setup_instance
    self._conninfo = self.app.connection_for_read()
  File "/opt/cloudera/parcels/AIRFLOW-1.10.3-python2.7.15_b2/lib/python2.7/site-packages/celery/app/base.py", line 743, in connection_for_read
    return self._connection(url or self.conf.broker_read_url, **kwargs)
  File "/opt/cloudera/parcels/AIRFLOW-1.10.3-python2.7.15_b2/lib/python2.7/site-packages/celery/app/base.py", line 819, in _connection
    'broker_connection_timeout', connect_timeout
  File "/opt/cloudera/parcels/AIRFLOW-1.10.3-python2.7.15_b2/lib/python2.7/site-packages/kombu/connection.py", line 189, in __init__
    url_params = parse_url(hostname)
  File "/opt/cloudera/parcels/AIRFLOW-1.10.3-python2.7.15_b2/lib/python2.7/site-packages/kombu/utils/url.py", line 47, in parse_url
    scheme, host, port, user, password, path, query = _parse_url(url)
  File "/opt/cloudera/parcels/AIRFLOW-1.10.3-python2.7.15_b2/lib/python2.7/site-packages/kombu/utils/url.py", line 81, in url_to_parts
    parts.port,
  File "/opt/cloudera/parcels/AIRFLOW-1.10.3-python2.7.15_b2/lib/python2.7/site-packages/future/backports/urllib/parse.py", line 162, in port
    port = int(port, 10)
  File "/opt/cloudera/parcels/AIRFLOW-1.10.3-python2.7.15_b2/lib/python2.7/site-packages/future/types/newint.py", line 76, in __new__
    return super(newint, cls).__new__(cls, val)
ValueError: invalid literal for long() with base 10: ''

 

Some person can help me?