Cloudera Community

Support Questions

Find answers, ask questions, and share your expertise
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Show  only  | Search instead for 
Did you mean: 
Advanced Search
Announcements
Welcome to the upgraded Community! Read this blog to see What’s New!

Error when run PySpark job with Hue

avatar
author-rank federicoferruti
Explorer

Created ‎07-22-2022 05:37 AM

Hi averyone,

 

I tried to run a PySpark job using Oozie by Hue but an error occured:

[22/Jul/2022 03:03:48 -0700] access       INFO     87.10.222.78 admin - "GET /500 HTTP/1.1" returned in 8ms 200 705
[22/Jul/2022 03:03:48 -0700] base         WARNING  Not Found: /jobbrowser/apps
[22/Jul/2022 03:03:48 -0700] decorators   INFO     args: (True,)
[22/Jul/2022 03:03:48 -0700] decorators   INFO     AXES: Calling decorated function: dt_login
[22/Jul/2022 03:03:48 -0700] views        WARNING  User admin is bypassing the load balancer
[22/Jul/2022 03:03:48 -0700] views        WARNING  User admin is using Hue 3 UI
[22/Jul/2022 03:03:48 -0700] access       WARNING  87.10.222.78 admin - "GET /jobbrowser/apps HTTP/1.1" --- 404 not found
[22/Jul/2022 03:03:48 -0700] access       INFO     87.10.222.78 admin - "POST /oozie/editor/workflow/submit/7 HTTP/1.1" returned in 1245ms 200 83
[22/Jul/2022 03:03:48 -0700] submission2  INFO     Started: Submission for job '0000000-220722115331462-oozie-oozi-W'. -- 0000000-220722115331462-oozie-oozi-W
[22/Jul/2022 03:03:48 -0700] resource     DEBUG    PUT None http://FQDN:11000/oozie/v1/job/0000000-220722115331462-oozie-oozi-W?action=start&timezone=America%2FLos_Angeles&user.name=hue&doAs=admin <?xml version="1.0" encoding="UTF-8"?>
<configuration>
<property>
  <name>user.name</name>
  <value><![CDATA[admin]]></value>
</property>

</configuration>
 returned in 370ms 200 0 
[22/Jul/2022 03:03:47 -0700] submission2  INFO     Submitted: Submission for job '0000000-220722115331462-oozie-oozi-W'. -- 0000000-220722115331462-oozie-oozi-W
[22/Jul/2022 03:03:47 -0700] resource     DEBUG    POST None http://FQDN:11000/oozie/v1/jobs?timezone=America%2FLos_Angeles&user.name=hue&doAs=admin <?xml version="1.0" encoding="UTF-8"?>
<configuration>
<property>
  <name>dryrun</name>
  <value><![CDATA[False]]></value>
</property>

<property>
  <name>hue-id-w</name>
  <value><![CDATA[7]]></value>
</property>

<property>
  <name>jobTracker</name>
  <value><![CDATA[FQDN:8032]]></value>
</property>

<property>
  <name>nameNode</name>
  <value><![CDATA[hdfs://FQDN:8020]]></value>
</property>

<property>
  <name>oozie.use.system.libpath</name>
  <value><![CDATA[True]]></value>
</property>

<property>
  <name>oozie.wf.application.path</name>
  <value><![CDATA[hdfs://FQDN:8020/user/hue/oozie/workspaces/hue-oozie-1658408731.88]]></value>
</property>

<property>
  <name>security_enabled</name>
  <value><![CDATA[False]]></value>
</property>

<property>
  <name>send_email</name>
  <value><![CDATA[False]]></value>
</property>

<property>
  <name>user.name</name>
  <value><![CDATA[admin]]></value>
</property>

</configuration>
 returned in 414ms 201 45 {"id":"0000000-220722115331462-oozie-oozi-W"}
[22/Jul/2022 03:03:47 -0700] submission2  INFO     Using FS <desktop.lib.fs.proxyfs.ProxyFS object at 0x7fe6fc322790> and JT None
[22/Jul/2022 03:03:47 -0700] submission2  DEBUG    Created/Updated /user/hue/oozie/workspaces/hue-oozie-1658408731.88/job.properties
[22/Jul/2022 03:03:47 -0700] resource     DEBUG    PUT None http://FQDN:9864/webhdfs/v1/user/hue/oozie/workspaces/hue-oozie-1658408731.88/job.properties?op=CREATE&doas=admin&user.name=hue&namenoderpcaddress=FQDN:8020&createflag=&createparent=true&overwrite=true&permission=644 oozie.use.system.libpath=True
send_email=False
dryrun=False
nameNode=hdfs://FQDN:8020
jobTracker=FQDN:8032
security_enabled=False returned in 25ms 201 0 
[22/Jul/2022 03:03:47 -0700] resource     DEBUG    PUT http://FQDN:9870/webhdfs/v1 returned in 0ms
[22/Jul/2022 03:03:47 -0700] resource     ERROR    Error logging return call PUT http://FQDN:9870/webhdfs/v1
Traceback (most recent call last):
  File "/opt/cloudera/parcels/CDH-7.1.7-1.cdh7.1.7.p1000.24102687/lib/hue/desktop/core/src/desktop/lib/rest/resource.py", line 122, in _invoke
    resp_content = smart_unicode(resp.content, errors='replace')
AttributeError: 'NoneType' object has no attribute 'content'
[22/Jul/2022 03:03:47 -0700] submission2  DEBUG    Created/Updated /user/hue/oozie/workspaces/hue-oozie-1658408731.88/workflow.xml
[22/Jul/2022 03:03:47 -0700] resource     DEBUG    PUT None http://FQDN:9864/webhdfs/v1/user/hue/oozie/workspaces/hue-oozie-1658408731.88/workflow.xml?op=CREATE&doas=admin&user.name=hue&namenoderpcaddress=FQDN:8020&createflag=&createparent=true&overwrite=true&permission=644 <workflow-app name="Oozie flow con PySpark" xmlns="uri:oozie:workflow:0.5">
    <start to="spark-27ea"/>
    <kill name="Kill">
        <message>Action failed, error message[${wf:errorMessage(wf:lastErrorNode())}]</message>
    </kill>
    <action name="spark-27ea">
        <spark xmlns="uri:oozie:spark-action:0.2">
            <job-tracker>${jobTracker}</job-tracker>
            <name-node>${nameNode}</name-node>
            <master>yarn</master>
            <mode>client</mode>
            <name></name>
            <jar>main_1.py</jar>
            <file>/user/admin/spark/main_1.py#main_1.py</file>
        </spark>
        <ok to="End"/>
        <error to="Kill"/>
    </action>
    <end name="End"/>
</workflow-app> returned in 287ms 201 0 
[22/Jul/2022 03:03:46 -0700] http_client  DEBUG    Setting session adapter for http://FQDN:9864
[22/Jul/2022 03:03:46 -0700] http_client  DEBUG    Setting request Session
[22/Jul/2022 03:03:46 -0700] resource     DEBUG    PUT http://FQDN:9870/webhdfs/v1 returned in 0ms
[22/Jul/2022 03:03:46 -0700] resource     ERROR    Error logging return call PUT http://FQDN:9870/webhdfs/v1
Traceback (most recent call last):
  File "/opt/cloudera/parcels/CDH-7.1.7-1.cdh7.1.7.p1000.24102687/lib/hue/desktop/core/src/desktop/lib/rest/resource.py", line 122, in _invoke
    resp_content = smart_unicode(resp.content, errors='replace')
AttributeError: 'NoneType' object has no attribute 'content'
[22/Jul/2022 03:03:46 -0700] resource     DEBUG    GET http://FQDN:9870/webhdfs/v1 returned in 0ms
[22/Jul/2022 03:03:46 -0700] resource     ERROR    Error logging return call GET http://FQDN:9870/webhdfs/v1
Traceback (most recent call last):
  File "/opt/cloudera/parcels/CDH-7.1.7-1.cdh7.1.7.p1000.24102687/lib/hue/desktop/core/src/desktop/lib/rest/resource.py", line 122, in _invoke
    resp_content = smart_unicode(resp.content, errors='replace')
AttributeError: 'NoneType' object has no attribute 'content'
[22/Jul/2022 03:03:46 -0700] resource     DEBUG    GET None http://FQDN:9870/webhdfs/v1//user/hue/oozie/workspaces/hue-oozie-1658408731.88?op=GETFILESTATUS&user.name=hue&doas=admin  returned in 3ms 200 238 {"FileStatus":{"accessTime":0,"blockSize":0,"childrenNum":3,"fileId":19823,"group":"hue","length":0,"modificationTime":1658415960391,"owner":"admin","pathSuffix":"","permission":"755","replication":0,"storagePolicy":0,"type":"DIRECTORY"}}
[22/Jul/2022 03:03:46 -0700] resource     DEBUG    GET None http://FQDN:9870/webhdfs/v1//user/hue/oozie/workspaces/hue-oozie-1658408731.88?op=GETFILESTATUS&user.name=hue&doas=admin  returned in 3ms 200 238 {"FileStatus":{"accessTime":0,"blockSize":0,"childrenNum":3,"fileId":19823,"group":"hue","length":0,"modificationTime":1658415960391,"owner":"admin","pathSuffix":"","permission":"755","replication":0,"storagePolicy":0,"type":"DIRECTORY"}}
[22/Jul/2022 03:03:46 -0700] resource     DEBUG    GET None http://FQDN:9870/webhdfs/v1//user/hue/oozie/workspaces/hue-oozie-1658408731.88?op=GETFILESTATUS&user.name=hue&doas=admin  returned in 3ms 200 238 {"FileStatus":{"accessTime":0,"blockSize":0,"childrenNum":3,"fileId":19823,"group":"hue","length":0,"modificationTime":1658415960391,"owner":"admin","pathSuffix":"","permission":"755","replication":0,"storagePolicy":0,"type":"DIRECTORY"}}
[22/Jul/2022 03:03:46 -0700] resource     DEBUG    GET None http://FQDN:9870/webhdfs/v1//user/hue/oozie/workspaces/hue-oozie-1658408731.88?op=GETFILESTATUS&user.name=hue&doas=admin  returned in 3ms 200 238 {"FileStatus":{"accessTime":0,"blockSize":0,"childrenNum":3,"fileId":19823,"group":"hue","length":0,"modificationTime":1658415960391,"owner":"admin","pathSuffix":"","permission":"755","replication":0,"storagePolicy":0,"type":"DIRECTORY"}}
[22/Jul/2022 03:03:46 -0700] resource     DEBUG    GET None http://FQDN:9870/webhdfs/v1//user/hue/oozie/deployments/_$USER_-oozie-$JOBID-$TIME?op=GETFILESTATUS&user.name=hue&doas=hue  returned in 10ms 200 237 {"FileStatus":{"accessTime":0,"blockSize":0,"childrenNum":0,"fileId":19754,"group":"hue","length":0,"modificationTime":1658408078822,"owner":"hue","pathSuffix":"","permission":"1777","replication":0,"storagePolicy":0,"type":"DIRECTORY"}}
[22/Jul/2022 03:03:46 -0700] submission2  INFO     Using FS <desktop.lib.fs.proxyfs.ProxyFS object at 0x7fe6fc322790> and JT None
[22/Jul/2022 03:03:46 -0700] http_client  DEBUG    Setting session adapter for http://FQDN:8088
[22/Jul/2022 03:03:46 -0700] http_client  DEBUG    Setting request Session
[22/Jul/2022 03:03:45 -0700] access       INFO     87.10.222.78 admin - "GET /oozie/editor/workflow/submit/7 HTTP/1.1" returned in 81ms 200 5411
[22/Jul/2022 03:03:45 -0700] resource     DEBUG    GET None http://FQDN:11000/oozie/v1/admin/configuration?timezone=America%2FLos_Angeles&user.name=hue&doAs=admin  returned in 7ms 200 48024 {"oozie.email.smtp.auth":"false","oozie.service.ELService.functions.coord-job-submit-data":"\n            coord:dataIn=org.apache.oozie.coord.CoordELFunctions#ph1_coord_dataIn_echo,\n            coord:dataOut=org.apache.oozie.coord.CoordELFunctions#ph1_coord_dataOut_echo,\n            coord:nominalTime=org.apache.oozie.coord.CoordELFunctions#ph1_coord_nominalTime_echo_wrap,\n            coord:actualTime=org.apache.oozie.coord.CoordELFunctions#ph1_coord_actualTime_echo_wrap,\n            coord:dateOffset=org.apache.oozie.coord.CoordELFunctions#ph1_coord_dateOffset_echo,\n            coord:dateTzOffset=org.apache.oozie.coord.CoordELFunctions#ph1_coord_dateTzOffset_echo,\n            coord:formatTime=org.apache.oozie.coord.CoordELFunctions#ph1_coord_formatTime_echo,\n            coord:epochTime=org.apache.oozie.coord.CoordELFunctions#ph1_coord_epochTime_echo,\n            coord:actionId=org.apache.oozie.coord.CoordELFunctions#ph1_coord_actionId_echo,\n            coord:name=org.apache.oozie.coord.CoordELFunctions#ph1_coord_name_echo,\n            coord:conf=org.apache.oozie.coord.CoordELFunctions#coord_conf,\n            coord:user=org.apache.oozie.coord.CoordELFunctions#coord_user,\n            coord:databaseIn=org.apache.oozie.coord.HCatELFunctions#ph1_coord_databaseIn_echo,\n            coord:databaseOut=org.apache.oozie.coord.HCatELFunctions#ph1_coord_databaseOut_echo,\n            coord:tableIn=org.apache.oozie.coord.HCatELFunctions#ph1_coord_tableIn_echo,\n            coord:tableOut=org.apache.oozie.coord.HCatELFunctions#ph1_coord_tableOut_echo,\n            coord:dataInPartitionFilter=org.apache.oozie.coord.HCatELFunctions#ph1_coord_dataInPartitionFilter_echo,\n            coord:dataInPartitionMin=org.apache.oozie.coord.HCatELFunctions#ph1_coord_dataInPartitionMin_echo,\n            coord:dataInPartitionMax=org.apache.oozie.coord.HCatELFunctions#ph1_coord_dataInPartitionMax_echo,\n            coord:dataInPartitions=org.apache.oozie.coord.HCatELFunctions#ph1_coor...
[22/Jul/2022 03:03:44 -0700] access       INFO     87.10.222.78 admin - "GET /desktop/api2/docs/ HTTP/1.1" returned in 22ms 200 681
[22/Jul/2022 03:03:43 -0700] access       INFO     87.10.222.78 admin - "GET /desktop/api2/doc/ HTTP/1.1" returned in 31ms 200 1253
[22/Jul/2022 03:03:43 -0700] access       INFO     87.10.222.78 admin - "GET /desktop/api2/user_preferences/default_app HTTP/1.1" returned in 3ms 200 27
[22/Jul/2022 03:03:43 -0700] access       INFO     87.10.222.78 admin - "GET /desktop/api2/context/computes/oozie HTTP/1.1" returned in 36ms 200 228
[22/Jul/2022 03:03:43 -0700] access       INFO     87.10.222.78 admin - "GET /desktop/api2/context/namespaces/oozie HTTP/1.1" returned in 0ms 200 288
[22/Jul/2022 03:03:43 -0700] access       INFO     87.10.222.78 admin - "GET /oozie/editor/workflow/edit HTTP/1.1" returned in 262ms 200 194745
[22/Jul/2022 03:03:43 -0700] resource     DEBUG    GET None http://FQDN:11000/oozie/v1/admin/configuration?timezone=America%2FLos_Angeles&user.name=hue&doAs=admin  returned in 15ms 200 48024 {"oozie.email.smtp.auth":"false","oozie.service.ELService.functions.coord-job-submit-data":"\n            coord:dataIn=org.apache.oozie.coord.CoordELFunctions#ph1_coord_dataIn_echo,\n            coord:dataOut=org.apache.oozie.coord.CoordELFunctions#ph1_coord_dataOut_echo,\n            coord:nominalTime=org.apache.oozie.coord.CoordELFunctions#ph1_coord_nominalTime_echo_wrap,\n            coord:actualTime=org.apache.oozie.coord.CoordELFunctions#ph1_coord_actualTime_echo_wrap,\n            coord:dateOffset=org.apache.oozie.coord.CoordELFunctions#ph1_coord_dateOffset_echo,\n            coord:dateTzOffset=org.apache.oozie.coord.CoordELFunctions#ph1_coord_dateTzOffset_echo,\n            coord:formatTime=org.apache.oozie.coord.CoordELFunctions#ph1_coord_formatTime_echo,\n            coord:epochTime=org.apache.oozie.coord.CoordELFunctions#ph1_coord_epochTime_echo,\n            coord:actionId=org.apache.oozie.coord.CoordELFunctions#ph1_coord_actionId_echo,\n            coord:name=org.apache.oozie.coord.CoordELFunctions#ph1_coord_name_echo,\n            coord:conf=org.apache.oozie.coord.CoordELFunctions#coord_conf,\n            coord:user=org.apache.oozie.coord.CoordELFunctions#coord_user,\n            coord:databaseIn=org.apache.oozie.coord.HCatELFunctions#ph1_coord_databaseIn_echo,\n            coord:databaseOut=org.apache.oozie.coord.HCatELFunctions#ph1_coord_databaseOut_echo,\n            coord:tableIn=org.apache.oozie.coord.HCatELFunctions#ph1_coord_tableIn_echo,\n            coord:tableOut=org.apache.oozie.coord.HCatELFunctions#ph1_coord_tableOut_echo,\n            coord:dataInPartitionFilter=org.apache.oozie.coord.HCatELFunctions#ph1_coord_dataInPartitionFilter_echo,\n            coord:dataInPartitionMin=org.apache.oozie.coord.HCatELFunctions#ph1_coord_dataInPartitionMin_echo,\n            coord:dataInPartitionMax=org.apache.oozie.coord.HCatELFunctions#ph1_coord_dataInPartitionMax_echo,\n            coord:dataInPartitions=org.apache.oozie.coord.HCatELFunctions#ph1_coor...
[22/Jul/2022 03:03:43 -0700] http_client  DEBUG    Setting session adapter for http://FQDN:11000
[22/Jul/2022 03:03:43 -0700] http_client  DEBUG    Setting request Session
[22/Jul/2022 03:03:39 -0700] access       INFO     87.10.222.78 admin - "GET /desktop/api2/docs/ HTTP/1.1" returned in 9ms 200 116
[22/Jul/2022 03:03:39 -0700] access       INFO     87.10.222.78 admin - "POST /notebook/api/create_session HTTP/1.1" returned in 180ms 200 72
[22/Jul/2022 03:03:39 -0700] base         DEBUG    Selected interpreter java interface=oozie compute=None
[22/Jul/2022 03:03:39 -0700] access       INFO     87.10.222.78 admin - "GET /desktop/workers/aceSqlSyntaxWorker.js HTTP/1.1" returned in 27ms 304 0
[22/Jul/2022 03:03:39 -0700] access       INFO     87.10.222.78 admin - "GET /desktop/workers/aceSqlLocationWorker.js HTTP/1.1" returned in 28ms 304 0
[22/Jul/2022 03:03:39 -0700] access       INFO     87.10.222.78 admin - "GET /notebook/api/get_history HTTP/1.1" returned in 7ms 200 70
[22/Jul/2022 03:03:39 -0700] access       INFO     87.10.222.78 admin - "GET /desktop/api2/user_preferences/default_app HTTP/1.1" returned in 3ms 200 27
[22/Jul/2022 03:03:39 -0700] access       INFO     87.10.222.78 admin - "POST /notebook/api/create_notebook HTTP/1.1" returned in 0ms 200 243
[22/Jul/2022 03:03:38 -0700] access       INFO     87.10.222.78 admin - "GET /editor HTTP/1.1" returned in 370ms 304 0
[22/Jul/2022 03:03:38 -0700] access       INFO     87.10.222.78 admin - "POST /metadata/api/catalog/list_tags HTTP/1.1" returned in 12ms 500 308
[22/Jul/2022 03:03:38 -0700] navigator_client ERROR    Failed to search for entities with search query: {"query": "((originalName:**^3)OR(originalDescription:**^1)OR(name:**^10)OR(description:**^3)OR(tags:**^5))AND((originalName:[* TO *])OR(originalDescription:[* TO *])OR(name:[* TO *])OR(description:[* TO *])OR(tags:[* TO *]))", "filterQueries": ["deleted:false"], "facetFields": ["tags"]}
[22/Jul/2022 03:03:38 -0700] resource     DEBUG    POST http://localhost:7187/api/v9 returned in 0ms
[22/Jul/2022 03:03:38 -0700] resource     ERROR    Error logging return call POST http://localhost:7187/api/v9
Traceback (most recent call last):
  File "/opt/cloudera/parcels/CDH-7.1.7-1.cdh7.1.7.p1000.24102687/lib/hue/desktop/core/src/desktop/lib/rest/resource.py", line 122, in _invoke
    resp_content = smart_unicode(resp.content, errors='replace')
AttributeError: 'NoneType' object has no attribute 'content'
[22/Jul/2022 03:03:38 -0700] navigator_client INFO     {"query": "((originalName:**^3)OR(originalDescription:**^1)OR(name:**^10)OR(description:**^3)OR(tags:**^5))AND((originalName:[* TO *])OR(originalDescription:[* TO *])OR(name:[* TO *])OR(description:[* TO *])OR(tags:[* TO *]))", "filterQueries": ["deleted:false"], "facetFields": ["tags"]}
[22/Jul/2022 03:03:38 -0700] access       INFO     87.10.222.78 admin - "GET /desktop/api2/doc/ HTTP/1.1" returned in 66ms 200 2463
[22/Jul/2022 03:03:38 -0700] access       INFO     87.10.222.78 admin - "GET /notebook/api/get_history HTTP/1.1" returned in 8ms 304 0
[22/Jul/2022 03:03:38 -0700] access       INFO     87.10.222.78 admin - "POST /notebook/api/create_notebook HTTP/1.1" returned in 0ms 200 252
[22/Jul/2022 03:03:38 -0700] access       INFO     87.10.222.78 admin - "POST /desktop/api2/get_config/ HTTP/1.1" returned in 36ms 200 6173
[22/Jul/2022 03:03:37 -0700] access       INFO     87.10.222.78 admin - "GET /desktop/globalJsConstants.js HTTP/1.1" returned in 48ms 304 0
[22/Jul/2022 03:03:37 -0700] resource     DEBUG    GET None http://FQDN:9870/webhdfs/v1//user/admin?op=GETFILESTATUS&user.name=hue&doas=admin  returned in 5ms 200 240 {"FileStatus":{"accessTime":0,"blockSize":0,"childrenNum":2,"fileId":16567,"group":"admin","length":0,"modificationTime":1658408896066,"owner":"admin","pathSuffix":"","permission":"755","replication":0,"storagePolicy":0,"type":"DIRECTORY"}}
[22/Jul/2022 03:03:37 -0700] access       INFO     87.10.222.78 admin - "GET /desktop/globalJsConstants.js HTTP/1.1" returned in 2737ms 304 0
[22/Jul/2022 03:03:37 -0700] resource     DEBUG    GET None http://FQDN:9870/webhdfs/v1//user/admin?op=GETFILESTATUS&user.name=hue&doas=admin  returned in 812ms 200 240 {"FileStatus":{"accessTime":0,"blockSize":0,"childrenNum":2,"fileId":16567,"group":"admin","length":0,"modificationTime":1658408896066,"owner":"admin","pathSuffix":"","permission":"755","replication":0,"storagePolicy":0,"type":"DIRECTORY"}}
[22/Jul/2022 03:03:34 -0700] access       INFO     87.10.222.78 admin - "GET /hue HTTP/1.1" returned in 551ms 200 234941
[22/Jul/2022 03:03:34 -0700] decorators   INFO     args: (True,)
[22/Jul/2022 03:03:34 -0700] decorators   INFO     AXES: Calling decorated function: dt_login
[22/Jul/2022 03:03:34 -0700] access       INFO     87.10.222.78 admin - "GET / HTTP/1.1" returned in 0ms 302 0
[22/Jul/2022 03:03:34 -0700] views        WARNING  User admin is bypassing the load balancer
[22/Jul/2022 03:03:34 -0700] access       INFO     87.10.222.78 admin - "GET / HTTP/1.1" returned in 33ms 302 0
[22/Jul/2022 03:03:34 -0700] webhdfs      DEBUG    Initializing Hadoop WebHdfs: http://FQDN:9870/webhdfs/v1 (security: False, superuser: None)
[22/Jul/2022 03:03:34 -0700] http_client  DEBUG    Setting session adapter for http://FQDN:9870
[22/Jul/2022 03:03:34 -0700] http_client  DEBUG    Setting request Session
[22/Jul/2022 03:03:34 -0700] backend      INFO     Augmenting users with class: <class 'desktop.auth.backend.DefaultUserAugmentor'>
[22/Jul/2022 03:03:20 -0700] access       INFO     10.0.2.28 -anon- - "HEAD /desktop/debug/is_alive HTTP/1.1" returned in 6ms 200 0
[22/Jul/2022 03:03:20 -0700] access       DEBUG    10.0.2.28 -anon- - "HEAD /desktop/debug/is_alive HTTP/1.1" -
[22/Jul/2022 03:02:20 -0700] access       INFO     10.0.2.28 -anon- - "HEAD /desktop/debug/is_alive HTTP/1.1" returned in 7ms 200 0
[22/Jul/2022 03:02:20 -0700] access       DEBUG    10.0.2.28 -anon- - "HEAD /desktop/debug/is_alive HTTP/1.1" -
[22/Jul/2022 03:01:20 -0700] access       INFO     10.0.2.28 -anon- - "HEAD /desktop/debug/is_alive HTTP/1.1" returned in 6ms 200 0
[22/Jul/2022 03:01:20 -0700] access       DEBUG    10.0.2.28 -anon- - "HEAD /desktop/debug/is_alive HTTP/1.1" -
[22/Jul/2022 03:00:20 -0700] access       INFO     10.0.2.28 -anon- - "HEAD /desktop/debug/is_alive HTTP/1.1" returned in 6ms 200 0
[22/Jul/2022 03:00:20 -0700] access       DEBUG    10.0.2.28 -anon- - "HEAD /desktop/debug/is_alive HTTP/1.1" -
[22/Jul/2022 02:59:20 -0700] access       INFO     10.0.2.28 -anon- - "HEAD /desktop/debug/is_alive HTTP/1.1" returned in 7ms 200 0
[22/Jul/2022 02:59:20 -0700] access       DEBUG    10.0.2.28 -anon- - "HEAD /desktop/debug/is_alive HTTP/1.1" -
[22/Jul/2022 02:58:20 -0700] access       INFO     10.0.2.28 -anon- - "HEAD /desktop/debug/is_alive HTTP/1.1" returned in 7ms 200 0
[22/Jul/2022 02:58:20 -0700] access       DEBUG    10.0.2.28 -anon- - "HEAD /desktop/debug/is_alive HTTP/1.1" -
[22/Jul/2022 02:57:20 -0700] access       INFO     10.0.2.28 -anon- - "HEAD /desktop/debug/is_alive HTTP/1.1" returned in 6ms 200 0
[22/Jul/2022 02:57:20 -0700] access       DEBUG    10.0.2.28 -anon- - "HEAD /desktop/debug/is_alive HTTP/1.1" -
[22/Jul/2022 02:56:20 -0700] access       INFO     10.0.2.28 -anon- - "HEAD /desktop/debug/is_alive HTTP/1.1" returned in 7ms 200 0
[22/Jul/2022 02:56:20 -0700] access       DEBUG    10.0.2.28 -anon- - "HEAD /desktop/debug/is_alive HTTP/1.1" -
[22/Jul/2022 02:55:20 -0700] access       INFO     10.0.2.28 -anon- - "HEAD /desktop/debug/is_alive HTTP/1.1" returned in 7ms 200 0
[22/Jul/2022 02:55:20 -0700] access       DEBUG    10.0.2.28 -anon- - "HEAD /desktop/debug/is_alive HTTP/1.1" -
[22/Jul/2022 02:54:20 -0700] access       INFO     10.0.2.28 -anon- - "HEAD /desktop/debug/is_alive HTTP/1.1" returned in 11ms 200 0
[22/Jul/2022 02:54:20 -0700] access       DEBUG    10.0.2.28 -anon- - "HEAD /desktop/debug/is_alive HTTP/1.1" -
[22/Jul/2022 02:53:48 -0700] middleware   INFO     Unloading MimeTypeJSFileFixStreamingMiddleware
[22/Jul/2022 02:53:48 -0700] middleware   INFO     Unloading HueRemoteUserMiddleware
[22/Jul/2022 02:53:48 -0700] middleware   INFO     Unloading SpnegoMiddleware
[22/Jul/2022 02:53:48 -0700] middleware   INFO     Unloading ProxyMiddleware
[22/Jul/2022 02:53:48 -0700] middleware   INFO     Unloading AuditLoggingMiddleware
[22/Jul/2022 02:53:48 -0700] runcherrypyserver INFO     Starting server with options:
{'daemonize': False,
 'host': 'FQDN',
 'pidfile': None,
 'port': 8888,
 'server_group': 'hue',
 'server_name': 'localhost',
 'server_user': 'hue',
 'ssl_certificate': None,
 'ssl_certificate_chain': None,
 'ssl_cipher_list': 'ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-AES256-GCM-SHA384:DHE-RSA-AES128-GCM-SHA256:DHE-DSS-AES128-GCM-SHA256:kEDH+AESGCM:ECDHE-RSA-AES128-SHA256:ECDHE-ECDSA-AES128-SHA256:ECDHE-RSA-AES128-SHA:ECDHE-ECDSA-AES128-SHA:ECDHE-RSA-AES256-SHA384:ECDHE-ECDSA-AES256-SHA384:ECDHE-RSA-AES256-SHA:ECDHE-ECDSA-AES256-SHA:DHE-RSA-AES128-SHA256:DHE-RSA-AES128-SHA:DHE-DSS-AES128-SHA256:DHE-RSA-AES256-SHA256:DHE-DSS-AES256-SHA:DHE-RSA-AES256-SHA:AES128-GCM-SHA256:AES256-GCM-SHA384:AES128-SHA256:AES256-SHA256:AES128-SHA:AES256-SHA:AES:CAMELLIA:DES-CBC3-SHA:!aNULL:!eNULL:!EXPORT:!DES:!RC4:!MD5:!PSK:!aECDH:!EDH-DSS-DES-CBC3-SHA:!EDH-RSA-DES-CBC3-SHA:!KRB5-DES-CBC3-SHA',
 'ssl_no_renegotiation': False,
 'ssl_private_key': None,
 'threads': 50,
 'workdir': None}
[22/Jul/2022 02:53:47 -0700] api          WARNING  Oozie is not enabled
[22/Jul/2022 02:53:47 -0700] __init__     INFO     Couldn't import snappy. Support for snappy compression disabled.
[22/Jul/2022 02:53:47 -0700] hiveserver2  WARNING  Job Browser app is not enabled
[22/Jul/2022 02:53:47 -0700] decorators   DEBUG    Looking for header value HTTP_X_FORWARDED_FOR
[22/Jul/2022 02:53:47 -0700] decorators   DEBUG    Axes is configured to be behind reverse proxy
[22/Jul/2022 02:53:47 -0700] decorators   INFO     Using django-axes 2.2.0
[22/Jul/2022 02:53:47 -0700] decorators   INFO     AXES: BEGIN LOG
[22/Jul/2022 02:53:46 -0700] sslcompat    DEBUG    backports.ssl_match_hostname module is available
[22/Jul/2022 02:53:46 -0700] sslcompat    DEBUG    ipaddress module is available
[22/Jul/2022 02:53:45 -0700] settings     DEBUG    DESKTOP_DB_TEST_USER SET: hue_test
[22/Jul/2022 02:53:45 -0700] settings     DEBUG    DESKTOP_DB_TEST_NAME SET: /opt/cloudera/parcels/CDH-7.1.7-1.cdh7.1.7.p1000.24102687/lib/hue/desktop/desktop-test.db
[22/Jul/2022 02:53:45 -0700] settings     DEBUG    Installed Django modules: DesktopModule(aws: aws),DesktopModule(azure: azure),DesktopModule(hadoop: hadoop),DesktopModule(libanalyze: libanalyze),DesktopModule(liboauth: liboauth),DesktopModule(liboozie: liboozie),DesktopModule(librdbms: librdbms),DesktopModule(libsaml: libsaml),DesktopModule(libsentry: libsentry),DesktopModule(libsolr: libsolr),DesktopModule(libzookeeper: libzookeeper),DesktopModule(Hue: desktop),DesktopModule(About: about),DesktopModule(Hive: beeswax),DesktopModule(File Browser: filebrowser),DesktopModule(Help: help),DesktopModule(Job Designer: jobsub),DesktopModule(Table Browser: metastore),DesktopModule(Oozie Editor/Dashboard: oozie),DesktopModule(Proxy: proxy),DesktopModule(RDBMS UI: rdbms),DesktopModule(User Admin: useradmin),DesktopModule(Data Importer: indexer),DesktopModule(Metadata: metadata),DesktopModule(Notebook: notebook),DesktopModule(Analytics Dashboards: dashboard),DesktopModule(Kafka: kafka)

 

My suspicion is that it fails to http PUT and GET on those URLs because the FQDNs resolve them to a private IP address non-public IP address.

 

What could be the problem?

516 Views
0 Kudos
1 REPLY 1

avatar
author-rank JillAbrams
New Contributor

Created ‎07-26-2022 09:04 PM

I am also trying to figure it out.

480 Views
0 Kudos
Announcements
What's New @ Cloudera
Cloudera Streaming Analytics (CSA) 1.11 with support for Ice...
What's New @ Cloudera
Cloudera Operational Database (COD) supports creating an ope...
What's New @ Cloudera
Cloudera Operational Database (COD) is available as a Techni...
What's New @ Cloudera
Cloudera Operational Database (COD) has removed the COD_ON_G...
Community Announcements
Introducing the new and improved Community!
View More Announcements
Labels