Support Questions

Find answers, ask questions, and share your expertise
Announcements
Welcome to the upgraded Community! Read this blog to see What’s New!

Error when run PySpark job with Hue

avatar

Hi averyone,

 

I tried to run a PySpark job using Oozie by Hue but an error occured:

[22/Jul/2022 03:03:48 -0700] access       INFO     87.10.222.78 admin - "GET /500 HTTP/1.1" returned in 8ms 200 705
[22/Jul/2022 03:03:48 -0700] base         WARNING  Not Found: /jobbrowser/apps
[22/Jul/2022 03:03:48 -0700] decorators   INFO     args: (True,)
[22/Jul/2022 03:03:48 -0700] decorators   INFO     AXES: Calling decorated function: dt_login
[22/Jul/2022 03:03:48 -0700] views        WARNING  User admin is bypassing the load balancer
[22/Jul/2022 03:03:48 -0700] views        WARNING  User admin is using Hue 3 UI
[22/Jul/2022 03:03:48 -0700] access       WARNING  87.10.222.78 admin - "GET /jobbrowser/apps HTTP/1.1" --- 404 not found
[22/Jul/2022 03:03:48 -0700] access       INFO     87.10.222.78 admin - "POST /oozie/editor/workflow/submit/7 HTTP/1.1" returned in 1245ms 200 83
[22/Jul/2022 03:03:48 -0700] submission2  INFO     Started: Submission for job '0000000-220722115331462-oozie-oozi-W'. -- 0000000-220722115331462-oozie-oozi-W
[22/Jul/2022 03:03:48 -0700] resource     DEBUG    PUT None http://FQDN:11000/oozie/v1/job/0000000-220722115331462-oozie-oozi-W?action=start&timezone=America%2FLos_Angeles&user.name=hue&doAs=admin <?xml version="1.0" encoding="UTF-8"?>
<configuration>
<property>
  <name>user.name</name>
  <value><![CDATA[admin]]></value>
</property>

</configuration>
 returned in 370ms 200 0 
[22/Jul/2022 03:03:47 -0700] submission2  INFO     Submitted: Submission for job '0000000-220722115331462-oozie-oozi-W'. -- 0000000-220722115331462-oozie-oozi-W
[22/Jul/2022 03:03:47 -0700] resource     DEBUG    POST None http://FQDN:11000/oozie/v1/jobs?timezone=America%2FLos_Angeles&user.name=hue&doAs=admin <?xml version="1.0" encoding="UTF-8"?>
<configuration>
<property>
  <name>dryrun</name>
  <value><![CDATA[False]]></value>
</property>

<property>
  <name>hue-id-w</name>
  <value><![CDATA[7]]></value>
</property>

<property>
  <name>jobTracker</name>
  <value><![CDATA[FQDN:8032]]></value>
</property>

<property>
  <name>nameNode</name>
  <value><![CDATA[hdfs://FQDN:8020]]></value>
</property>

<property>
  <name>oozie.use.system.libpath</name>
  <value><![CDATA[True]]></value>
</property>

<property>
  <name>oozie.wf.application.path</name>
  <value><![CDATA[hdfs://FQDN:8020/user/hue/oozie/workspaces/hue-oozie-1658408731.88]]></value>
</property>

<property>
  <name>security_enabled</name>
  <value><![CDATA[False]]></value>
</property>

<property>
  <name>send_email</name>
  <value><![CDATA[False]]></value>
</property>

<property>
  <name>user.name</name>
  <value><![CDATA[admin]]></value>
</property>

</configuration>
 returned in 414ms 201 45 {"id":"0000000-220722115331462-oozie-oozi-W"}
[22/Jul/2022 03:03:47 -0700] submission2  INFO     Using FS <desktop.lib.fs.proxyfs.ProxyFS object at 0x7fe6fc322790> and JT None
[22/Jul/2022 03:03:47 -0700] submission2  DEBUG    Created/Updated /user/hue/oozie/workspaces/hue-oozie-1658408731.88/job.properties
[22/Jul/2022 03:03:47 -0700] resource     DEBUG    PUT None http://FQDN:9864/webhdfs/v1/user/hue/oozie/workspaces/hue-oozie-1658408731.88/job.properties?op=CREATE&doas=admin&user.name=hue&namenoderpcaddress=FQDN:8020&createflag=&createparent=true&overwrite=true&permission=644 oozie.use.system.libpath=True
send_email=False
dryrun=False
nameNode=hdfs://FQDN:8020
jobTracker=FQDN:8032
security_enabled=False returned in 25ms 201 0 
[22/Jul/2022 03:03:47 -0700] resource     DEBUG    PUT http://FQDN:9870/webhdfs/v1 returned in 0ms
[22/Jul/2022 03:03:47 -0700] resource     ERROR    Error logging return call PUT http://FQDN:9870/webhdfs/v1
Traceback (most recent call last):
  File "/opt/cloudera/parcels/CDH-7.1.7-1.cdh7.1.7.p1000.24102687/lib/hue/desktop/core/src/desktop/lib/rest/resource.py", line 122, in _invoke
    resp_content = smart_unicode(resp.content, errors='replace')
AttributeError: 'NoneType' object has no attribute 'content'
[22/Jul/2022 03:03:47 -0700] submission2  DEBUG    Created/Updated /user/hue/oozie/workspaces/hue-oozie-1658408731.88/workflow.xml
[22/Jul/2022 03:03:47 -0700] resource     DEBUG    PUT None http://FQDN:9864/webhdfs/v1/user/hue/oozie/workspaces/hue-oozie-1658408731.88/workflow.xml?op=CREATE&doas=admin&user.name=hue&namenoderpcaddress=FQDN:8020&createflag=&createparent=true&overwrite=true&permission=644 <workflow-app name="Oozie flow con PySpark" xmlns="uri:oozie:workflow:0.5">
    <start to="spark-27ea"/>
    <kill name="Kill">
        <message>Action failed, error message[${wf:errorMessage(wf:lastErrorNode())}]</message>
    </kill>
    <action name="spark-27ea">
        <spark xmlns="uri:oozie:spark-action:0.2">
            <job-tracker>${jobTracker}</job-tracker>
            <name-node>${nameNode}</name-node>
            <master>yarn</master>
            <mode>client</mode>
            <name></name>
            <jar>main_1.py</jar>
            <file>/user/admin/spark/main_1.py#main_1.py</file>
        </spark>
        <ok to="End"/>
        <error to="Kill"/>
    </action>
    <end name="End"/>
</workflow-app> returned in 287ms 201 0 
[22/Jul/2022 03:03:46 -0700] http_client  DEBUG    Setting session adapter for http://FQDN:9864
[22/Jul/2022 03:03:46 -0700] http_client  DEBUG    Setting request Session
[22/Jul/2022 03:03:46 -0700] resource     DEBUG    PUT http://FQDN:9870/webhdfs/v1 returned in 0ms
[22/Jul/2022 03:03:46 -0700] resource     ERROR    Error logging return call PUT http://FQDN:9870/webhdfs/v1
Traceback (most recent call last):
  File "/opt/cloudera/parcels/CDH-7.1.7-1.cdh7.1.7.p1000.24102687/lib/hue/desktop/core/src/desktop/lib/rest/resource.py", line 122, in _invoke
    resp_content = smart_unicode(resp.content, errors='replace')
AttributeError: 'NoneType' object has no attribute 'content'
[22/Jul/2022 03:03:46 -0700] resource     DEBUG    GET http://FQDN:9870/webhdfs/v1 returned in 0ms
[22/Jul/2022 03:03:46 -0700] resource     ERROR    Error logging return call GET http://FQDN:9870/webhdfs/v1
Traceback (most recent call last):
  File "/opt/cloudera/parcels/CDH-7.1.7-1.cdh7.1.7.p1000.24102687/lib/hue/desktop/core/src/desktop/lib/rest/resource.py", line 122, in _invoke
    resp_content = smart_unicode(resp.content, errors='replace')
AttributeError: 'NoneType' object has no attribute 'content'
[22/Jul/2022 03:03:46 -0700] resource     DEBUG    GET None http://FQDN:9870/webhdfs/v1//user/hue/oozie/workspaces/hue-oozie-1658408731.88?op=GETFILESTATUS&user.name=hue&doas=admin  returned in 3ms 200 238 {"FileStatus":{"accessTime":0,"blockSize":0,"childrenNum":3,"fileId":19823,"group":"hue","length":0,"modificationTime":1658415960391,"owner":"admin","pathSuffix":"","permission":"755","replication":0,"storagePolicy":0,"type":"DIRECTORY"}}
[22/Jul/2022 03:03:46 -0700] resource     DEBUG    GET None http://FQDN:9870/webhdfs/v1//user/hue/oozie/workspaces/hue-oozie-1658408731.88?op=GETFILESTATUS&user.name=hue&doas=admin  returned in 3ms 200 238 {"FileStatus":{"accessTime":0,"blockSize":0,"childrenNum":3,"fileId":19823,"group":"hue","length":0,"modificationTime":1658415960391,"owner":"admin","pathSuffix":"","permission":"755","replication":0,"storagePolicy":0,"type":"DIRECTORY"}}
[22/Jul/2022 03:03:46 -0700] resource     DEBUG    GET None http://FQDN:9870/webhdfs/v1//user/hue/oozie/workspaces/hue-oozie-1658408731.88?op=GETFILESTATUS&user.name=hue&doas=admin  returned in 3ms 200 238 {"FileStatus":{"accessTime":0,"blockSize":0,"childrenNum":3,"fileId":19823,"group":"hue","length":0,"modificationTime":1658415960391,"owner":"admin","pathSuffix":"","permission":"755","replication":0,"storagePolicy":0,"type":"DIRECTORY"}}
[22/Jul/2022 03:03:46 -0700] resource     DEBUG    GET None http://FQDN:9870/webhdfs/v1//user/hue/oozie/workspaces/hue-oozie-1658408731.88?op=GETFILESTATUS&user.name=hue&doas=admin  returned in 3ms 200 238 {"FileStatus":{"accessTime":0,"blockSize":0,"childrenNum":3,"fileId":19823,"group":"hue","length":0,"modificationTime":1658415960391,"owner":"admin","pathSuffix":"","permission":"755","replication":0,"storagePolicy":0,"type":"DIRECTORY"}}
[22/Jul/2022 03:03:46 -0700] resource     DEBUG    GET None http://FQDN:9870/webhdfs/v1//user/hue/oozie/deployments/_$USER_-oozie-$JOBID-$TIME?op=GETFILESTATUS&user.name=hue&doas=hue  returned in 10ms 200 237 {"FileStatus":{"accessTime":0,"blockSize":0,"childrenNum":0,"fileId":19754,"group":"hue","length":0,"modificationTime":1658408078822,"owner":"hue","pathSuffix":"","permission":"1777","replication":0,"storagePolicy":0,"type":"DIRECTORY"}}
[22/Jul/2022 03:03:46 -0700] submission2  INFO     Using FS <desktop.lib.fs.proxyfs.ProxyFS object at 0x7fe6fc322790> and JT None
[22/Jul/2022 03:03:46 -0700] http_client  DEBUG    Setting session adapter for http://FQDN:8088
[22/Jul/2022 03:03:46 -0700] http_client  DEBUG    Setting request Session
[22/Jul/2022 03:03:45 -0700] access       INFO     87.10.222.78 admin - "GET /oozie/editor/workflow/submit/7 HTTP/1.1" returned in 81ms 200 5411
[22/Jul/2022 03:03:45 -0700] resource     DEBUG    GET None http://FQDN:11000/oozie/v1/admin/configuration?timezone=America%2FLos_Angeles&user.name=hue&doAs=admin  returned in 7ms 200 48024 {"oozie.email.smtp.auth":"false","oozie.service.ELService.functions.coord-job-submit-data":"\n            coord:dataIn=org.apache.oozie.coord.CoordELFunctions#ph1_coord_dataIn_echo,\n            coord:dataOut=org.apache.oozie.coord.CoordELFunctions#ph1_coord_dataOut_echo,\n            coord:nominalTime=org.apache.oozie.coord.CoordELFunctions#ph1_coord_nominalTime_echo_wrap,\n            coord:actualTime=org.apache.oozie.coord.CoordELFunctions#ph1_coord_actualTime_echo_wrap,\n            coord:dateOffset=org.apache.oozie.coord.CoordELFunctions#ph1_coord_dateOffset_echo,\n            coord:dateTzOffset=org.apache.oozie.coord.CoordELFunctions#ph1_coord_dateTzOffset_echo,\n            coord:formatTime=org.apache.oozie.coord.CoordELFunctions#ph1_coord_formatTime_echo,\n            coord:epochTime=org.apache.oozie.coord.CoordELFunctions#ph1_coord_epochTime_echo,\n            coord:actionId=org.apache.oozie.coord.CoordELFunctions#ph1_coord_actionId_echo,\n            coord:name=org.apache.oozie.coord.CoordELFunctions#ph1_coord_name_echo,\n            coord:conf=org.apache.oozie.coord.CoordELFunctions#coord_conf,\n            coord:user=org.apache.oozie.coord.CoordELFunctions#coord_user,\n            coord:databaseIn=org.apache.oozie.coord.HCatELFunctions#ph1_coord_databaseIn_echo,\n            coord:databaseOut=org.apache.oozie.coord.HCatELFunctions#ph1_coord_databaseOut_echo,\n            coord:tableIn=org.apache.oozie.coord.HCatELFunctions#ph1_coord_tableIn_echo,\n            coord:tableOut=org.apache.oozie.coord.HCatELFunctions#ph1_coord_tableOut_echo,\n            coord:dataInPartitionFilter=org.apache.oozie.coord.HCatELFunctions#ph1_coord_dataInPartitionFilter_echo,\n            coord:dataInPartitionMin=org.apache.oozie.coord.HCatELFunctions#ph1_coord_dataInPartitionMin_echo,\n            coord:dataInPartitionMax=org.apache.oozie.coord.HCatELFunctions#ph1_coord_dataInPartitionMax_echo,\n            coord:dataInPartitions=org.apache.oozie.coord.HCatELFunctions#ph1_coor...
[22/Jul/2022 03:03:44 -0700] access       INFO     87.10.222.78 admin - "GET /desktop/api2/docs/ HTTP/1.1" returned in 22ms 200 681
[22/Jul/2022 03:03:43 -0700] access       INFO     87.10.222.78 admin - "GET /desktop/api2/doc/ HTTP/1.1" returned in 31ms 200 1253
[22/Jul/2022 03:03:43 -0700] access       INFO     87.10.222.78 admin - "GET /desktop/api2/user_preferences/default_app HTTP/1.1" returned in 3ms 200 27
[22/Jul/2022 03:03:43 -0700] access       INFO     87.10.222.78 admin - "GET /desktop/api2/context/computes/oozie HTTP/1.1" returned in 36ms 200 228
[22/Jul/2022 03:03:43 -0700] access       INFO     87.10.222.78 admin - "GET /desktop/api2/context/namespaces/oozie HTTP/1.1" returned in 0ms 200 288
[22/Jul/2022 03:03:43 -0700] access       INFO     87.10.222.78 admin - "GET /oozie/editor/workflow/edit HTTP/1.1" returned in 262ms 200 194745
[22/Jul/2022 03:03:43 -0700] resource     DEBUG    GET None http://FQDN:11000/oozie/v1/admin/configuration?timezone=America%2FLos_Angeles&user.name=hue&doAs=admin  returned in 15ms 200 48024 {"oozie.email.smtp.auth":"false","oozie.service.ELService.functions.coord-job-submit-data":"\n            coord:dataIn=org.apache.oozie.coord.CoordELFunctions#ph1_coord_dataIn_echo,\n            coord:dataOut=org.apache.oozie.coord.CoordELFunctions#ph1_coord_dataOut_echo,\n            coord:nominalTime=org.apache.oozie.coord.CoordELFunctions#ph1_coord_nominalTime_echo_wrap,\n            coord:actualTime=org.apache.oozie.coord.CoordELFunctions#ph1_coord_actualTime_echo_wrap,\n            coord:dateOffset=org.apache.oozie.coord.CoordELFunctions#ph1_coord_dateOffset_echo,\n            coord:dateTzOffset=org.apache.oozie.coord.CoordELFunctions#ph1_coord_dateTzOffset_echo,\n            coord:formatTime=org.apache.oozie.coord.CoordELFunctions#ph1_coord_formatTime_echo,\n            coord:epochTime=org.apache.oozie.coord.CoordELFunctions#ph1_coord_epochTime_echo,\n            coord:actionId=org.apache.oozie.coord.CoordELFunctions#ph1_coord_actionId_echo,\n            coord:name=org.apache.oozie.coord.CoordELFunctions#ph1_coord_name_echo,\n            coord:conf=org.apache.oozie.coord.CoordELFunctions#coord_conf,\n            coord:user=org.apache.oozie.coord.CoordELFunctions#coord_user,\n            coord:databaseIn=org.apache.oozie.coord.HCatELFunctions#ph1_coord_databaseIn_echo,\n            coord:databaseOut=org.apache.oozie.coord.HCatELFunctions#ph1_coord_databaseOut_echo,\n            coord:tableIn=org.apache.oozie.coord.HCatELFunctions#ph1_coord_tableIn_echo,\n            coord:tableOut=org.apache.oozie.coord.HCatELFunctions#ph1_coord_tableOut_echo,\n            coord:dataInPartitionFilter=org.apache.oozie.coord.HCatELFunctions#ph1_coord_dataInPartitionFilter_echo,\n            coord:dataInPartitionMin=org.apache.oozie.coord.HCatELFunctions#ph1_coord_dataInPartitionMin_echo,\n            coord:dataInPartitionMax=org.apache.oozie.coord.HCatELFunctions#ph1_coord_dataInPartitionMax_echo,\n            coord:dataInPartitions=org.apache.oozie.coord.HCatELFunctions#ph1_coor...
[22/Jul/2022 03:03:43 -0700] http_client  DEBUG    Setting session adapter for http://FQDN:11000
[22/Jul/2022 03:03:43 -0700] http_client  DEBUG    Setting request Session
[22/Jul/2022 03:03:39 -0700] access       INFO     87.10.222.78 admin - "GET /desktop/api2/docs/ HTTP/1.1" returned in 9ms 200 116
[22/Jul/2022 03:03:39 -0700] access       INFO     87.10.222.78 admin - "POST /notebook/api/create_session HTTP/1.1" returned in 180ms 200 72
[22/Jul/2022 03:03:39 -0700] base         DEBUG    Selected interpreter java interface=oozie compute=None
[22/Jul/2022 03:03:39 -0700] access       INFO     87.10.222.78 admin - "GET /desktop/workers/aceSqlSyntaxWorker.js HTTP/1.1" returned in 27ms 304 0
[22/Jul/2022 03:03:39 -0700] access       INFO     87.10.222.78 admin - "GET /desktop/workers/aceSqlLocationWorker.js HTTP/1.1" returned in 28ms 304 0
[22/Jul/2022 03:03:39 -0700] access       INFO     87.10.222.78 admin - "GET /notebook/api/get_history HTTP/1.1" returned in 7ms 200 70
[22/Jul/2022 03:03:39 -0700] access       INFO     87.10.222.78 admin - "GET /desktop/api2/user_preferences/default_app HTTP/1.1" returned in 3ms 200 27
[22/Jul/2022 03:03:39 -0700] access       INFO     87.10.222.78 admin - "POST /notebook/api/create_notebook HTTP/1.1" returned in 0ms 200 243
[22/Jul/2022 03:03:38 -0700] access       INFO     87.10.222.78 admin - "GET /editor HTTP/1.1" returned in 370ms 304 0
[22/Jul/2022 03:03:38 -0700] access       INFO     87.10.222.78 admin - "POST /metadata/api/catalog/list_tags HTTP/1.1" returned in 12ms 500 308
[22/Jul/2022 03:03:38 -0700] navigator_client ERROR    Failed to search for entities with search query: {"query": "((originalName:**^3)OR(originalDescription:**^1)OR(name:**^10)OR(description:**^3)OR(tags:**^5))AND((originalName:[* TO *])OR(originalDescription:[* TO *])OR(name:[* TO *])OR(description:[* TO *])OR(tags:[* TO *]))", "filterQueries": ["deleted:false"], "facetFields": ["tags"]}
[22/Jul/2022 03:03:38 -0700] resource     DEBUG    POST http://localhost:7187/api/v9 returned in 0ms
[22/Jul/2022 03:03:38 -0700] resource     ERROR    Error logging return call POST http://localhost:7187/api/v9
Traceback (most recent call last):
  File "/opt/cloudera/parcels/CDH-7.1.7-1.cdh7.1.7.p1000.24102687/lib/hue/desktop/core/src/desktop/lib/rest/resource.py", line 122, in _invoke
    resp_content = smart_unicode(resp.content, errors='replace')
AttributeError: 'NoneType' object has no attribute 'content'
[22/Jul/2022 03:03:38 -0700] navigator_client INFO     {"query": "((originalName:**^3)OR(originalDescription:**^1)OR(name:**^10)OR(description:**^3)OR(tags:**^5))AND((originalName:[* TO *])OR(originalDescription:[* TO *])OR(name:[* TO *])OR(description:[* TO *])OR(tags:[* TO *]))", "filterQueries": ["deleted:false"], "facetFields": ["tags"]}
[22/Jul/2022 03:03:38 -0700] access       INFO     87.10.222.78 admin - "GET /desktop/api2/doc/ HTTP/1.1" returned in 66ms 200 2463
[22/Jul/2022 03:03:38 -0700] access       INFO     87.10.222.78 admin - "GET /notebook/api/get_history HTTP/1.1" returned in 8ms 304 0
[22/Jul/2022 03:03:38 -0700] access       INFO     87.10.222.78 admin - "POST /notebook/api/create_notebook HTTP/1.1" returned in 0ms 200 252
[22/Jul/2022 03:03:38 -0700] access       INFO     87.10.222.78 admin - "POST /desktop/api2/get_config/ HTTP/1.1" returned in 36ms 200 6173
[22/Jul/2022 03:03:37 -0700] access       INFO     87.10.222.78 admin - "GET /desktop/globalJsConstants.js HTTP/1.1" returned in 48ms 304 0
[22/Jul/2022 03:03:37 -0700] resource     DEBUG    GET None http://FQDN:9870/webhdfs/v1//user/admin?op=GETFILESTATUS&user.name=hue&doas=admin  returned in 5ms 200 240 {"FileStatus":{"accessTime":0,"blockSize":0,"childrenNum":2,"fileId":16567,"group":"admin","length":0,"modificationTime":1658408896066,"owner":"admin","pathSuffix":"","permission":"755","replication":0,"storagePolicy":0,"type":"DIRECTORY"}}
[22/Jul/2022 03:03:37 -0700] access       INFO     87.10.222.78 admin - "GET /desktop/globalJsConstants.js HTTP/1.1" returned in 2737ms 304 0
[22/Jul/2022 03:03:37 -0700] resource     DEBUG    GET None http://FQDN:9870/webhdfs/v1//user/admin?op=GETFILESTATUS&user.name=hue&doas=admin  returned in 812ms 200 240 {"FileStatus":{"accessTime":0,"blockSize":0,"childrenNum":2,"fileId":16567,"group":"admin","length":0,"modificationTime":1658408896066,"owner":"admin","pathSuffix":"","permission":"755","replication":0,"storagePolicy":0,"type":"DIRECTORY"}}
[22/Jul/2022 03:03:34 -0700] access       INFO     87.10.222.78 admin - "GET /hue HTTP/1.1" returned in 551ms 200 234941
[22/Jul/2022 03:03:34 -0700] decorators   INFO     args: (True,)
[22/Jul/2022 03:03:34 -0700] decorators   INFO     AXES: Calling decorated function: dt_login
[22/Jul/2022 03:03:34 -0700] access       INFO     87.10.222.78 admin - "GET / HTTP/1.1" returned in 0ms 302 0
[22/Jul/2022 03:03:34 -0700] views        WARNING  User admin is bypassing the load balancer
[22/Jul/2022 03:03:34 -0700] access       INFO     87.10.222.78 admin - "GET / HTTP/1.1" returned in 33ms 302 0
[22/Jul/2022 03:03:34 -0700] webhdfs      DEBUG    Initializing Hadoop WebHdfs: http://FQDN:9870/webhdfs/v1 (security: False, superuser: None)
[22/Jul/2022 03:03:34 -0700] http_client  DEBUG    Setting session adapter for http://FQDN:9870
[22/Jul/2022 03:03:34 -0700] http_client  DEBUG    Setting request Session
[22/Jul/2022 03:03:34 -0700] backend      INFO     Augmenting users with class: <class 'desktop.auth.backend.DefaultUserAugmentor'>
[22/Jul/2022 03:03:20 -0700] access       INFO     10.0.2.28 -anon- - "HEAD /desktop/debug/is_alive HTTP/1.1" returned in 6ms 200 0
[22/Jul/2022 03:03:20 -0700] access       DEBUG    10.0.2.28 -anon- - "HEAD /desktop/debug/is_alive HTTP/1.1" -
[22/Jul/2022 03:02:20 -0700] access       INFO     10.0.2.28 -anon- - "HEAD /desktop/debug/is_alive HTTP/1.1" returned in 7ms 200 0
[22/Jul/2022 03:02:20 -0700] access       DEBUG    10.0.2.28 -anon- - "HEAD /desktop/debug/is_alive HTTP/1.1" -
[22/Jul/2022 03:01:20 -0700] access       INFO     10.0.2.28 -anon- - "HEAD /desktop/debug/is_alive HTTP/1.1" returned in 6ms 200 0
[22/Jul/2022 03:01:20 -0700] access       DEBUG    10.0.2.28 -anon- - "HEAD /desktop/debug/is_alive HTTP/1.1" -
[22/Jul/2022 03:00:20 -0700] access       INFO     10.0.2.28 -anon- - "HEAD /desktop/debug/is_alive HTTP/1.1" returned in 6ms 200 0
[22/Jul/2022 03:00:20 -0700] access       DEBUG    10.0.2.28 -anon- - "HEAD /desktop/debug/is_alive HTTP/1.1" -
[22/Jul/2022 02:59:20 -0700] access       INFO     10.0.2.28 -anon- - "HEAD /desktop/debug/is_alive HTTP/1.1" returned in 7ms 200 0
[22/Jul/2022 02:59:20 -0700] access       DEBUG    10.0.2.28 -anon- - "HEAD /desktop/debug/is_alive HTTP/1.1" -
[22/Jul/2022 02:58:20 -0700] access       INFO     10.0.2.28 -anon- - "HEAD /desktop/debug/is_alive HTTP/1.1" returned in 7ms 200 0
[22/Jul/2022 02:58:20 -0700] access       DEBUG    10.0.2.28 -anon- - "HEAD /desktop/debug/is_alive HTTP/1.1" -
[22/Jul/2022 02:57:20 -0700] access       INFO     10.0.2.28 -anon- - "HEAD /desktop/debug/is_alive HTTP/1.1" returned in 6ms 200 0
[22/Jul/2022 02:57:20 -0700] access       DEBUG    10.0.2.28 -anon- - "HEAD /desktop/debug/is_alive HTTP/1.1" -
[22/Jul/2022 02:56:20 -0700] access       INFO     10.0.2.28 -anon- - "HEAD /desktop/debug/is_alive HTTP/1.1" returned in 7ms 200 0
[22/Jul/2022 02:56:20 -0700] access       DEBUG    10.0.2.28 -anon- - "HEAD /desktop/debug/is_alive HTTP/1.1" -
[22/Jul/2022 02:55:20 -0700] access       INFO     10.0.2.28 -anon- - "HEAD /desktop/debug/is_alive HTTP/1.1" returned in 7ms 200 0
[22/Jul/2022 02:55:20 -0700] access       DEBUG    10.0.2.28 -anon- - "HEAD /desktop/debug/is_alive HTTP/1.1" -
[22/Jul/2022 02:54:20 -0700] access       INFO     10.0.2.28 -anon- - "HEAD /desktop/debug/is_alive HTTP/1.1" returned in 11ms 200 0
[22/Jul/2022 02:54:20 -0700] access       DEBUG    10.0.2.28 -anon- - "HEAD /desktop/debug/is_alive HTTP/1.1" -
[22/Jul/2022 02:53:48 -0700] middleware   INFO     Unloading MimeTypeJSFileFixStreamingMiddleware
[22/Jul/2022 02:53:48 -0700] middleware   INFO     Unloading HueRemoteUserMiddleware
[22/Jul/2022 02:53:48 -0700] middleware   INFO     Unloading SpnegoMiddleware
[22/Jul/2022 02:53:48 -0700] middleware   INFO     Unloading ProxyMiddleware
[22/Jul/2022 02:53:48 -0700] middleware   INFO     Unloading AuditLoggingMiddleware
[22/Jul/2022 02:53:48 -0700] runcherrypyserver INFO     Starting server with options:
{'daemonize': False,
 'host': 'FQDN',
 'pidfile': None,
 'port': 8888,
 'server_group': 'hue',
 'server_name': 'localhost',
 'server_user': 'hue',
 'ssl_certificate': None,
 'ssl_certificate_chain': None,
 'ssl_cipher_list': 'ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-AES256-GCM-SHA384:DHE-RSA-AES128-GCM-SHA256:DHE-DSS-AES128-GCM-SHA256:kEDH+AESGCM:ECDHE-RSA-AES128-SHA256:ECDHE-ECDSA-AES128-SHA256:ECDHE-RSA-AES128-SHA:ECDHE-ECDSA-AES128-SHA:ECDHE-RSA-AES256-SHA384:ECDHE-ECDSA-AES256-SHA384:ECDHE-RSA-AES256-SHA:ECDHE-ECDSA-AES256-SHA:DHE-RSA-AES128-SHA256:DHE-RSA-AES128-SHA:DHE-DSS-AES128-SHA256:DHE-RSA-AES256-SHA256:DHE-DSS-AES256-SHA:DHE-RSA-AES256-SHA:AES128-GCM-SHA256:AES256-GCM-SHA384:AES128-SHA256:AES256-SHA256:AES128-SHA:AES256-SHA:AES:CAMELLIA:DES-CBC3-SHA:!aNULL:!eNULL:!EXPORT:!DES:!RC4:!MD5:!PSK:!aECDH:!EDH-DSS-DES-CBC3-SHA:!EDH-RSA-DES-CBC3-SHA:!KRB5-DES-CBC3-SHA',
 'ssl_no_renegotiation': False,
 'ssl_private_key': None,
 'threads': 50,
 'workdir': None}
[22/Jul/2022 02:53:47 -0700] api          WARNING  Oozie is not enabled
[22/Jul/2022 02:53:47 -0700] __init__     INFO     Couldn't import snappy. Support for snappy compression disabled.
[22/Jul/2022 02:53:47 -0700] hiveserver2  WARNING  Job Browser app is not enabled
[22/Jul/2022 02:53:47 -0700] decorators   DEBUG    Looking for header value HTTP_X_FORWARDED_FOR
[22/Jul/2022 02:53:47 -0700] decorators   DEBUG    Axes is configured to be behind reverse proxy
[22/Jul/2022 02:53:47 -0700] decorators   INFO     Using django-axes 2.2.0
[22/Jul/2022 02:53:47 -0700] decorators   INFO     AXES: BEGIN LOG
[22/Jul/2022 02:53:46 -0700] sslcompat    DEBUG    backports.ssl_match_hostname module is available
[22/Jul/2022 02:53:46 -0700] sslcompat    DEBUG    ipaddress module is available
[22/Jul/2022 02:53:45 -0700] settings     DEBUG    DESKTOP_DB_TEST_USER SET: hue_test
[22/Jul/2022 02:53:45 -0700] settings     DEBUG    DESKTOP_DB_TEST_NAME SET: /opt/cloudera/parcels/CDH-7.1.7-1.cdh7.1.7.p1000.24102687/lib/hue/desktop/desktop-test.db
[22/Jul/2022 02:53:45 -0700] settings     DEBUG    Installed Django modules: DesktopModule(aws: aws),DesktopModule(azure: azure),DesktopModule(hadoop: hadoop),DesktopModule(libanalyze: libanalyze),DesktopModule(liboauth: liboauth),DesktopModule(liboozie: liboozie),DesktopModule(librdbms: librdbms),DesktopModule(libsaml: libsaml),DesktopModule(libsentry: libsentry),DesktopModule(libsolr: libsolr),DesktopModule(libzookeeper: libzookeeper),DesktopModule(Hue: desktop),DesktopModule(About: about),DesktopModule(Hive: beeswax),DesktopModule(File Browser: filebrowser),DesktopModule(Help: help),DesktopModule(Job Designer: jobsub),DesktopModule(Table Browser: metastore),DesktopModule(Oozie Editor/Dashboard: oozie),DesktopModule(Proxy: proxy),DesktopModule(RDBMS UI: rdbms),DesktopModule(User Admin: useradmin),DesktopModule(Data Importer: indexer),DesktopModule(Metadata: metadata),DesktopModule(Notebook: notebook),DesktopModule(Analytics Dashboards: dashboard),DesktopModule(Kafka: kafka)

 

My suspicion is that it fails to http PUT and GET on those URLs because the FQDNs resolve them to a private IP address non-public IP address.

 

What could be the problem?

1 REPLY 1

avatar
New Contributor

I am also trying to figure it out.

Labels