Created 07-22-2022 05:37 AM
Hi averyone,
I tried to run a PySpark job using Oozie by Hue but an error occured:
[22/Jul/2022 03:03:48 -0700] access INFO 87.10.222.78 admin - "GET /500 HTTP/1.1" returned in 8ms 200 705
[22/Jul/2022 03:03:48 -0700] base WARNING Not Found: /jobbrowser/apps
[22/Jul/2022 03:03:48 -0700] decorators INFO args: (True,)
[22/Jul/2022 03:03:48 -0700] decorators INFO AXES: Calling decorated function: dt_login
[22/Jul/2022 03:03:48 -0700] views WARNING User admin is bypassing the load balancer
[22/Jul/2022 03:03:48 -0700] views WARNING User admin is using Hue 3 UI
[22/Jul/2022 03:03:48 -0700] access WARNING 87.10.222.78 admin - "GET /jobbrowser/apps HTTP/1.1" --- 404 not found
[22/Jul/2022 03:03:48 -0700] access INFO 87.10.222.78 admin - "POST /oozie/editor/workflow/submit/7 HTTP/1.1" returned in 1245ms 200 83
[22/Jul/2022 03:03:48 -0700] submission2 INFO Started: Submission for job '0000000-220722115331462-oozie-oozi-W'. -- 0000000-220722115331462-oozie-oozi-W
[22/Jul/2022 03:03:48 -0700] resource DEBUG PUT None http://FQDN:11000/oozie/v1/job/0000000-220722115331462-oozie-oozi-W?action=start&timezone=America%2FLos_Angeles&user.name=hue&doAs=admin <?xml version="1.0" encoding="UTF-8"?>
<configuration>
<property>
<name>user.name</name>
<value><![CDATA[admin]]></value>
</property>
</configuration>
returned in 370ms 200 0
[22/Jul/2022 03:03:47 -0700] submission2 INFO Submitted: Submission for job '0000000-220722115331462-oozie-oozi-W'. -- 0000000-220722115331462-oozie-oozi-W
[22/Jul/2022 03:03:47 -0700] resource DEBUG POST None http://FQDN:11000/oozie/v1/jobs?timezone=America%2FLos_Angeles&user.name=hue&doAs=admin <?xml version="1.0" encoding="UTF-8"?>
<configuration>
<property>
<name>dryrun</name>
<value><![CDATA[False]]></value>
</property>
<property>
<name>hue-id-w</name>
<value><![CDATA[7]]></value>
</property>
<property>
<name>jobTracker</name>
<value><![CDATA[FQDN:8032]]></value>
</property>
<property>
<name>nameNode</name>
<value><![CDATA[hdfs://FQDN:8020]]></value>
</property>
<property>
<name>oozie.use.system.libpath</name>
<value><![CDATA[True]]></value>
</property>
<property>
<name>oozie.wf.application.path</name>
<value><![CDATA[hdfs://FQDN:8020/user/hue/oozie/workspaces/hue-oozie-1658408731.88]]></value>
</property>
<property>
<name>security_enabled</name>
<value><![CDATA[False]]></value>
</property>
<property>
<name>send_email</name>
<value><![CDATA[False]]></value>
</property>
<property>
<name>user.name</name>
<value><![CDATA[admin]]></value>
</property>
</configuration>
returned in 414ms 201 45 {"id":"0000000-220722115331462-oozie-oozi-W"}
[22/Jul/2022 03:03:47 -0700] submission2 INFO Using FS <desktop.lib.fs.proxyfs.ProxyFS object at 0x7fe6fc322790> and JT None
[22/Jul/2022 03:03:47 -0700] submission2 DEBUG Created/Updated /user/hue/oozie/workspaces/hue-oozie-1658408731.88/job.properties
[22/Jul/2022 03:03:47 -0700] resource DEBUG PUT None http://FQDN:9864/webhdfs/v1/user/hue/oozie/workspaces/hue-oozie-1658408731.88/job.properties?op=CREATE&doas=admin&user.name=hue&namenoderpcaddress=FQDN:8020&createflag=&createparent=true&overwrite=true&permission=644 oozie.use.system.libpath=True
send_email=False
dryrun=False
nameNode=hdfs://FQDN:8020
jobTracker=FQDN:8032
security_enabled=False returned in 25ms 201 0
[22/Jul/2022 03:03:47 -0700] resource DEBUG PUT http://FQDN:9870/webhdfs/v1 returned in 0ms
[22/Jul/2022 03:03:47 -0700] resource ERROR Error logging return call PUT http://FQDN:9870/webhdfs/v1
Traceback (most recent call last):
File "/opt/cloudera/parcels/CDH-7.1.7-1.cdh7.1.7.p1000.24102687/lib/hue/desktop/core/src/desktop/lib/rest/resource.py", line 122, in _invoke
resp_content = smart_unicode(resp.content, errors='replace')
AttributeError: 'NoneType' object has no attribute 'content'
[22/Jul/2022 03:03:47 -0700] submission2 DEBUG Created/Updated /user/hue/oozie/workspaces/hue-oozie-1658408731.88/workflow.xml
[22/Jul/2022 03:03:47 -0700] resource DEBUG PUT None http://FQDN:9864/webhdfs/v1/user/hue/oozie/workspaces/hue-oozie-1658408731.88/workflow.xml?op=CREATE&doas=admin&user.name=hue&namenoderpcaddress=FQDN:8020&createflag=&createparent=true&overwrite=true&permission=644 <workflow-app name="Oozie flow con PySpark" xmlns="uri:oozie:workflow:0.5">
<start to="spark-27ea"/>
<kill name="Kill">
<message>Action failed, error message[${wf:errorMessage(wf:lastErrorNode())}]</message>
</kill>
<action name="spark-27ea">
<spark xmlns="uri:oozie:spark-action:0.2">
<job-tracker>${jobTracker}</job-tracker>
<name-node>${nameNode}</name-node>
<master>yarn</master>
<mode>client</mode>
<name></name>
<jar>main_1.py</jar>
<file>/user/admin/spark/main_1.py#main_1.py</file>
</spark>
<ok to="End"/>
<error to="Kill"/>
</action>
<end name="End"/>
</workflow-app> returned in 287ms 201 0
[22/Jul/2022 03:03:46 -0700] http_client DEBUG Setting session adapter for http://FQDN:9864
[22/Jul/2022 03:03:46 -0700] http_client DEBUG Setting request Session
[22/Jul/2022 03:03:46 -0700] resource DEBUG PUT http://FQDN:9870/webhdfs/v1 returned in 0ms
[22/Jul/2022 03:03:46 -0700] resource ERROR Error logging return call PUT http://FQDN:9870/webhdfs/v1
Traceback (most recent call last):
File "/opt/cloudera/parcels/CDH-7.1.7-1.cdh7.1.7.p1000.24102687/lib/hue/desktop/core/src/desktop/lib/rest/resource.py", line 122, in _invoke
resp_content = smart_unicode(resp.content, errors='replace')
AttributeError: 'NoneType' object has no attribute 'content'
[22/Jul/2022 03:03:46 -0700] resource DEBUG GET http://FQDN:9870/webhdfs/v1 returned in 0ms
[22/Jul/2022 03:03:46 -0700] resource ERROR Error logging return call GET http://FQDN:9870/webhdfs/v1
Traceback (most recent call last):
File "/opt/cloudera/parcels/CDH-7.1.7-1.cdh7.1.7.p1000.24102687/lib/hue/desktop/core/src/desktop/lib/rest/resource.py", line 122, in _invoke
resp_content = smart_unicode(resp.content, errors='replace')
AttributeError: 'NoneType' object has no attribute 'content'
[22/Jul/2022 03:03:46 -0700] resource DEBUG GET None http://FQDN:9870/webhdfs/v1//user/hue/oozie/workspaces/hue-oozie-1658408731.88?op=GETFILESTATUS&user.name=hue&doas=admin returned in 3ms 200 238 {"FileStatus":{"accessTime":0,"blockSize":0,"childrenNum":3,"fileId":19823,"group":"hue","length":0,"modificationTime":1658415960391,"owner":"admin","pathSuffix":"","permission":"755","replication":0,"storagePolicy":0,"type":"DIRECTORY"}}
[22/Jul/2022 03:03:46 -0700] resource DEBUG GET None http://FQDN:9870/webhdfs/v1//user/hue/oozie/workspaces/hue-oozie-1658408731.88?op=GETFILESTATUS&user.name=hue&doas=admin returned in 3ms 200 238 {"FileStatus":{"accessTime":0,"blockSize":0,"childrenNum":3,"fileId":19823,"group":"hue","length":0,"modificationTime":1658415960391,"owner":"admin","pathSuffix":"","permission":"755","replication":0,"storagePolicy":0,"type":"DIRECTORY"}}
[22/Jul/2022 03:03:46 -0700] resource DEBUG GET None http://FQDN:9870/webhdfs/v1//user/hue/oozie/workspaces/hue-oozie-1658408731.88?op=GETFILESTATUS&user.name=hue&doas=admin returned in 3ms 200 238 {"FileStatus":{"accessTime":0,"blockSize":0,"childrenNum":3,"fileId":19823,"group":"hue","length":0,"modificationTime":1658415960391,"owner":"admin","pathSuffix":"","permission":"755","replication":0,"storagePolicy":0,"type":"DIRECTORY"}}
[22/Jul/2022 03:03:46 -0700] resource DEBUG GET None http://FQDN:9870/webhdfs/v1//user/hue/oozie/workspaces/hue-oozie-1658408731.88?op=GETFILESTATUS&user.name=hue&doas=admin returned in 3ms 200 238 {"FileStatus":{"accessTime":0,"blockSize":0,"childrenNum":3,"fileId":19823,"group":"hue","length":0,"modificationTime":1658415960391,"owner":"admin","pathSuffix":"","permission":"755","replication":0,"storagePolicy":0,"type":"DIRECTORY"}}
[22/Jul/2022 03:03:46 -0700] resource DEBUG GET None http://FQDN:9870/webhdfs/v1//user/hue/oozie/deployments/_$USER_-oozie-$JOBID-$TIME?op=GETFILESTATUS&user.name=hue&doas=hue returned in 10ms 200 237 {"FileStatus":{"accessTime":0,"blockSize":0,"childrenNum":0,"fileId":19754,"group":"hue","length":0,"modificationTime":1658408078822,"owner":"hue","pathSuffix":"","permission":"1777","replication":0,"storagePolicy":0,"type":"DIRECTORY"}}
[22/Jul/2022 03:03:46 -0700] submission2 INFO Using FS <desktop.lib.fs.proxyfs.ProxyFS object at 0x7fe6fc322790> and JT None
[22/Jul/2022 03:03:46 -0700] http_client DEBUG Setting session adapter for http://FQDN:8088
[22/Jul/2022 03:03:46 -0700] http_client DEBUG Setting request Session
[22/Jul/2022 03:03:45 -0700] access INFO 87.10.222.78 admin - "GET /oozie/editor/workflow/submit/7 HTTP/1.1" returned in 81ms 200 5411
[22/Jul/2022 03:03:45 -0700] resource DEBUG GET None http://FQDN:11000/oozie/v1/admin/configuration?timezone=America%2FLos_Angeles&user.name=hue&doAs=admin returned in 7ms 200 48024 {"oozie.email.smtp.auth":"false","oozie.service.ELService.functions.coord-job-submit-data":"\n coord:dataIn=org.apache.oozie.coord.CoordELFunctions#ph1_coord_dataIn_echo,\n coord:dataOut=org.apache.oozie.coord.CoordELFunctions#ph1_coord_dataOut_echo,\n coord:nominalTime=org.apache.oozie.coord.CoordELFunctions#ph1_coord_nominalTime_echo_wrap,\n coord:actualTime=org.apache.oozie.coord.CoordELFunctions#ph1_coord_actualTime_echo_wrap,\n coord:dateOffset=org.apache.oozie.coord.CoordELFunctions#ph1_coord_dateOffset_echo,\n coord:dateTzOffset=org.apache.oozie.coord.CoordELFunctions#ph1_coord_dateTzOffset_echo,\n coord:formatTime=org.apache.oozie.coord.CoordELFunctions#ph1_coord_formatTime_echo,\n coord:epochTime=org.apache.oozie.coord.CoordELFunctions#ph1_coord_epochTime_echo,\n coord:actionId=org.apache.oozie.coord.CoordELFunctions#ph1_coord_actionId_echo,\n coord:name=org.apache.oozie.coord.CoordELFunctions#ph1_coord_name_echo,\n coord:conf=org.apache.oozie.coord.CoordELFunctions#coord_conf,\n coord:user=org.apache.oozie.coord.CoordELFunctions#coord_user,\n coord:databaseIn=org.apache.oozie.coord.HCatELFunctions#ph1_coord_databaseIn_echo,\n coord:databaseOut=org.apache.oozie.coord.HCatELFunctions#ph1_coord_databaseOut_echo,\n coord:tableIn=org.apache.oozie.coord.HCatELFunctions#ph1_coord_tableIn_echo,\n coord:tableOut=org.apache.oozie.coord.HCatELFunctions#ph1_coord_tableOut_echo,\n coord:dataInPartitionFilter=org.apache.oozie.coord.HCatELFunctions#ph1_coord_dataInPartitionFilter_echo,\n coord:dataInPartitionMin=org.apache.oozie.coord.HCatELFunctions#ph1_coord_dataInPartitionMin_echo,\n coord:dataInPartitionMax=org.apache.oozie.coord.HCatELFunctions#ph1_coord_dataInPartitionMax_echo,\n coord:dataInPartitions=org.apache.oozie.coord.HCatELFunctions#ph1_coor...
[22/Jul/2022 03:03:44 -0700] access INFO 87.10.222.78 admin - "GET /desktop/api2/docs/ HTTP/1.1" returned in 22ms 200 681
[22/Jul/2022 03:03:43 -0700] access INFO 87.10.222.78 admin - "GET /desktop/api2/doc/ HTTP/1.1" returned in 31ms 200 1253
[22/Jul/2022 03:03:43 -0700] access INFO 87.10.222.78 admin - "GET /desktop/api2/user_preferences/default_app HTTP/1.1" returned in 3ms 200 27
[22/Jul/2022 03:03:43 -0700] access INFO 87.10.222.78 admin - "GET /desktop/api2/context/computes/oozie HTTP/1.1" returned in 36ms 200 228
[22/Jul/2022 03:03:43 -0700] access INFO 87.10.222.78 admin - "GET /desktop/api2/context/namespaces/oozie HTTP/1.1" returned in 0ms 200 288
[22/Jul/2022 03:03:43 -0700] access INFO 87.10.222.78 admin - "GET /oozie/editor/workflow/edit HTTP/1.1" returned in 262ms 200 194745
[22/Jul/2022 03:03:43 -0700] resource DEBUG GET None http://FQDN:11000/oozie/v1/admin/configuration?timezone=America%2FLos_Angeles&user.name=hue&doAs=admin returned in 15ms 200 48024 {"oozie.email.smtp.auth":"false","oozie.service.ELService.functions.coord-job-submit-data":"\n coord:dataIn=org.apache.oozie.coord.CoordELFunctions#ph1_coord_dataIn_echo,\n coord:dataOut=org.apache.oozie.coord.CoordELFunctions#ph1_coord_dataOut_echo,\n coord:nominalTime=org.apache.oozie.coord.CoordELFunctions#ph1_coord_nominalTime_echo_wrap,\n coord:actualTime=org.apache.oozie.coord.CoordELFunctions#ph1_coord_actualTime_echo_wrap,\n coord:dateOffset=org.apache.oozie.coord.CoordELFunctions#ph1_coord_dateOffset_echo,\n coord:dateTzOffset=org.apache.oozie.coord.CoordELFunctions#ph1_coord_dateTzOffset_echo,\n coord:formatTime=org.apache.oozie.coord.CoordELFunctions#ph1_coord_formatTime_echo,\n coord:epochTime=org.apache.oozie.coord.CoordELFunctions#ph1_coord_epochTime_echo,\n coord:actionId=org.apache.oozie.coord.CoordELFunctions#ph1_coord_actionId_echo,\n coord:name=org.apache.oozie.coord.CoordELFunctions#ph1_coord_name_echo,\n coord:conf=org.apache.oozie.coord.CoordELFunctions#coord_conf,\n coord:user=org.apache.oozie.coord.CoordELFunctions#coord_user,\n coord:databaseIn=org.apache.oozie.coord.HCatELFunctions#ph1_coord_databaseIn_echo,\n coord:databaseOut=org.apache.oozie.coord.HCatELFunctions#ph1_coord_databaseOut_echo,\n coord:tableIn=org.apache.oozie.coord.HCatELFunctions#ph1_coord_tableIn_echo,\n coord:tableOut=org.apache.oozie.coord.HCatELFunctions#ph1_coord_tableOut_echo,\n coord:dataInPartitionFilter=org.apache.oozie.coord.HCatELFunctions#ph1_coord_dataInPartitionFilter_echo,\n coord:dataInPartitionMin=org.apache.oozie.coord.HCatELFunctions#ph1_coord_dataInPartitionMin_echo,\n coord:dataInPartitionMax=org.apache.oozie.coord.HCatELFunctions#ph1_coord_dataInPartitionMax_echo,\n coord:dataInPartitions=org.apache.oozie.coord.HCatELFunctions#ph1_coor...
[22/Jul/2022 03:03:43 -0700] http_client DEBUG Setting session adapter for http://FQDN:11000
[22/Jul/2022 03:03:43 -0700] http_client DEBUG Setting request Session
[22/Jul/2022 03:03:39 -0700] access INFO 87.10.222.78 admin - "GET /desktop/api2/docs/ HTTP/1.1" returned in 9ms 200 116
[22/Jul/2022 03:03:39 -0700] access INFO 87.10.222.78 admin - "POST /notebook/api/create_session HTTP/1.1" returned in 180ms 200 72
[22/Jul/2022 03:03:39 -0700] base DEBUG Selected interpreter java interface=oozie compute=None
[22/Jul/2022 03:03:39 -0700] access INFO 87.10.222.78 admin - "GET /desktop/workers/aceSqlSyntaxWorker.js HTTP/1.1" returned in 27ms 304 0
[22/Jul/2022 03:03:39 -0700] access INFO 87.10.222.78 admin - "GET /desktop/workers/aceSqlLocationWorker.js HTTP/1.1" returned in 28ms 304 0
[22/Jul/2022 03:03:39 -0700] access INFO 87.10.222.78 admin - "GET /notebook/api/get_history HTTP/1.1" returned in 7ms 200 70
[22/Jul/2022 03:03:39 -0700] access INFO 87.10.222.78 admin - "GET /desktop/api2/user_preferences/default_app HTTP/1.1" returned in 3ms 200 27
[22/Jul/2022 03:03:39 -0700] access INFO 87.10.222.78 admin - "POST /notebook/api/create_notebook HTTP/1.1" returned in 0ms 200 243
[22/Jul/2022 03:03:38 -0700] access INFO 87.10.222.78 admin - "GET /editor HTTP/1.1" returned in 370ms 304 0
[22/Jul/2022 03:03:38 -0700] access INFO 87.10.222.78 admin - "POST /metadata/api/catalog/list_tags HTTP/1.1" returned in 12ms 500 308
[22/Jul/2022 03:03:38 -0700] navigator_client ERROR Failed to search for entities with search query: {"query": "((originalName:**^3)OR(originalDescription:**^1)OR(name:**^10)OR(description:**^3)OR(tags:**^5))AND((originalName:[* TO *])OR(originalDescription:[* TO *])OR(name:[* TO *])OR(description:[* TO *])OR(tags:[* TO *]))", "filterQueries": ["deleted:false"], "facetFields": ["tags"]}
[22/Jul/2022 03:03:38 -0700] resource DEBUG POST http://localhost:7187/api/v9 returned in 0ms
[22/Jul/2022 03:03:38 -0700] resource ERROR Error logging return call POST http://localhost:7187/api/v9
Traceback (most recent call last):
File "/opt/cloudera/parcels/CDH-7.1.7-1.cdh7.1.7.p1000.24102687/lib/hue/desktop/core/src/desktop/lib/rest/resource.py", line 122, in _invoke
resp_content = smart_unicode(resp.content, errors='replace')
AttributeError: 'NoneType' object has no attribute 'content'
[22/Jul/2022 03:03:38 -0700] navigator_client INFO {"query": "((originalName:**^3)OR(originalDescription:**^1)OR(name:**^10)OR(description:**^3)OR(tags:**^5))AND((originalName:[* TO *])OR(originalDescription:[* TO *])OR(name:[* TO *])OR(description:[* TO *])OR(tags:[* TO *]))", "filterQueries": ["deleted:false"], "facetFields": ["tags"]}
[22/Jul/2022 03:03:38 -0700] access INFO 87.10.222.78 admin - "GET /desktop/api2/doc/ HTTP/1.1" returned in 66ms 200 2463
[22/Jul/2022 03:03:38 -0700] access INFO 87.10.222.78 admin - "GET /notebook/api/get_history HTTP/1.1" returned in 8ms 304 0
[22/Jul/2022 03:03:38 -0700] access INFO 87.10.222.78 admin - "POST /notebook/api/create_notebook HTTP/1.1" returned in 0ms 200 252
[22/Jul/2022 03:03:38 -0700] access INFO 87.10.222.78 admin - "POST /desktop/api2/get_config/ HTTP/1.1" returned in 36ms 200 6173
[22/Jul/2022 03:03:37 -0700] access INFO 87.10.222.78 admin - "GET /desktop/globalJsConstants.js HTTP/1.1" returned in 48ms 304 0
[22/Jul/2022 03:03:37 -0700] resource DEBUG GET None http://FQDN:9870/webhdfs/v1//user/admin?op=GETFILESTATUS&user.name=hue&doas=admin returned in 5ms 200 240 {"FileStatus":{"accessTime":0,"blockSize":0,"childrenNum":2,"fileId":16567,"group":"admin","length":0,"modificationTime":1658408896066,"owner":"admin","pathSuffix":"","permission":"755","replication":0,"storagePolicy":0,"type":"DIRECTORY"}}
[22/Jul/2022 03:03:37 -0700] access INFO 87.10.222.78 admin - "GET /desktop/globalJsConstants.js HTTP/1.1" returned in 2737ms 304 0
[22/Jul/2022 03:03:37 -0700] resource DEBUG GET None http://FQDN:9870/webhdfs/v1//user/admin?op=GETFILESTATUS&user.name=hue&doas=admin returned in 812ms 200 240 {"FileStatus":{"accessTime":0,"blockSize":0,"childrenNum":2,"fileId":16567,"group":"admin","length":0,"modificationTime":1658408896066,"owner":"admin","pathSuffix":"","permission":"755","replication":0,"storagePolicy":0,"type":"DIRECTORY"}}
[22/Jul/2022 03:03:34 -0700] access INFO 87.10.222.78 admin - "GET /hue HTTP/1.1" returned in 551ms 200 234941
[22/Jul/2022 03:03:34 -0700] decorators INFO args: (True,)
[22/Jul/2022 03:03:34 -0700] decorators INFO AXES: Calling decorated function: dt_login
[22/Jul/2022 03:03:34 -0700] access INFO 87.10.222.78 admin - "GET / HTTP/1.1" returned in 0ms 302 0
[22/Jul/2022 03:03:34 -0700] views WARNING User admin is bypassing the load balancer
[22/Jul/2022 03:03:34 -0700] access INFO 87.10.222.78 admin - "GET / HTTP/1.1" returned in 33ms 302 0
[22/Jul/2022 03:03:34 -0700] webhdfs DEBUG Initializing Hadoop WebHdfs: http://FQDN:9870/webhdfs/v1 (security: False, superuser: None)
[22/Jul/2022 03:03:34 -0700] http_client DEBUG Setting session adapter for http://FQDN:9870
[22/Jul/2022 03:03:34 -0700] http_client DEBUG Setting request Session
[22/Jul/2022 03:03:34 -0700] backend INFO Augmenting users with class: <class 'desktop.auth.backend.DefaultUserAugmentor'>
[22/Jul/2022 03:03:20 -0700] access INFO 10.0.2.28 -anon- - "HEAD /desktop/debug/is_alive HTTP/1.1" returned in 6ms 200 0
[22/Jul/2022 03:03:20 -0700] access DEBUG 10.0.2.28 -anon- - "HEAD /desktop/debug/is_alive HTTP/1.1" -
[22/Jul/2022 03:02:20 -0700] access INFO 10.0.2.28 -anon- - "HEAD /desktop/debug/is_alive HTTP/1.1" returned in 7ms 200 0
[22/Jul/2022 03:02:20 -0700] access DEBUG 10.0.2.28 -anon- - "HEAD /desktop/debug/is_alive HTTP/1.1" -
[22/Jul/2022 03:01:20 -0700] access INFO 10.0.2.28 -anon- - "HEAD /desktop/debug/is_alive HTTP/1.1" returned in 6ms 200 0
[22/Jul/2022 03:01:20 -0700] access DEBUG 10.0.2.28 -anon- - "HEAD /desktop/debug/is_alive HTTP/1.1" -
[22/Jul/2022 03:00:20 -0700] access INFO 10.0.2.28 -anon- - "HEAD /desktop/debug/is_alive HTTP/1.1" returned in 6ms 200 0
[22/Jul/2022 03:00:20 -0700] access DEBUG 10.0.2.28 -anon- - "HEAD /desktop/debug/is_alive HTTP/1.1" -
[22/Jul/2022 02:59:20 -0700] access INFO 10.0.2.28 -anon- - "HEAD /desktop/debug/is_alive HTTP/1.1" returned in 7ms 200 0
[22/Jul/2022 02:59:20 -0700] access DEBUG 10.0.2.28 -anon- - "HEAD /desktop/debug/is_alive HTTP/1.1" -
[22/Jul/2022 02:58:20 -0700] access INFO 10.0.2.28 -anon- - "HEAD /desktop/debug/is_alive HTTP/1.1" returned in 7ms 200 0
[22/Jul/2022 02:58:20 -0700] access DEBUG 10.0.2.28 -anon- - "HEAD /desktop/debug/is_alive HTTP/1.1" -
[22/Jul/2022 02:57:20 -0700] access INFO 10.0.2.28 -anon- - "HEAD /desktop/debug/is_alive HTTP/1.1" returned in 6ms 200 0
[22/Jul/2022 02:57:20 -0700] access DEBUG 10.0.2.28 -anon- - "HEAD /desktop/debug/is_alive HTTP/1.1" -
[22/Jul/2022 02:56:20 -0700] access INFO 10.0.2.28 -anon- - "HEAD /desktop/debug/is_alive HTTP/1.1" returned in 7ms 200 0
[22/Jul/2022 02:56:20 -0700] access DEBUG 10.0.2.28 -anon- - "HEAD /desktop/debug/is_alive HTTP/1.1" -
[22/Jul/2022 02:55:20 -0700] access INFO 10.0.2.28 -anon- - "HEAD /desktop/debug/is_alive HTTP/1.1" returned in 7ms 200 0
[22/Jul/2022 02:55:20 -0700] access DEBUG 10.0.2.28 -anon- - "HEAD /desktop/debug/is_alive HTTP/1.1" -
[22/Jul/2022 02:54:20 -0700] access INFO 10.0.2.28 -anon- - "HEAD /desktop/debug/is_alive HTTP/1.1" returned in 11ms 200 0
[22/Jul/2022 02:54:20 -0700] access DEBUG 10.0.2.28 -anon- - "HEAD /desktop/debug/is_alive HTTP/1.1" -
[22/Jul/2022 02:53:48 -0700] middleware INFO Unloading MimeTypeJSFileFixStreamingMiddleware
[22/Jul/2022 02:53:48 -0700] middleware INFO Unloading HueRemoteUserMiddleware
[22/Jul/2022 02:53:48 -0700] middleware INFO Unloading SpnegoMiddleware
[22/Jul/2022 02:53:48 -0700] middleware INFO Unloading ProxyMiddleware
[22/Jul/2022 02:53:48 -0700] middleware INFO Unloading AuditLoggingMiddleware
[22/Jul/2022 02:53:48 -0700] runcherrypyserver INFO Starting server with options:
{'daemonize': False,
'host': 'FQDN',
'pidfile': None,
'port': 8888,
'server_group': 'hue',
'server_name': 'localhost',
'server_user': 'hue',
'ssl_certificate': None,
'ssl_certificate_chain': None,
'ssl_cipher_list': 'ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-AES256-GCM-SHA384:DHE-RSA-AES128-GCM-SHA256:DHE-DSS-AES128-GCM-SHA256:kEDH+AESGCM:ECDHE-RSA-AES128-SHA256:ECDHE-ECDSA-AES128-SHA256:ECDHE-RSA-AES128-SHA:ECDHE-ECDSA-AES128-SHA:ECDHE-RSA-AES256-SHA384:ECDHE-ECDSA-AES256-SHA384:ECDHE-RSA-AES256-SHA:ECDHE-ECDSA-AES256-SHA:DHE-RSA-AES128-SHA256:DHE-RSA-AES128-SHA:DHE-DSS-AES128-SHA256:DHE-RSA-AES256-SHA256:DHE-DSS-AES256-SHA:DHE-RSA-AES256-SHA:AES128-GCM-SHA256:AES256-GCM-SHA384:AES128-SHA256:AES256-SHA256:AES128-SHA:AES256-SHA:AES:CAMELLIA:DES-CBC3-SHA:!aNULL:!eNULL:!EXPORT:!DES:!RC4:!MD5:!PSK:!aECDH:!EDH-DSS-DES-CBC3-SHA:!EDH-RSA-DES-CBC3-SHA:!KRB5-DES-CBC3-SHA',
'ssl_no_renegotiation': False,
'ssl_private_key': None,
'threads': 50,
'workdir': None}
[22/Jul/2022 02:53:47 -0700] api WARNING Oozie is not enabled
[22/Jul/2022 02:53:47 -0700] __init__ INFO Couldn't import snappy. Support for snappy compression disabled.
[22/Jul/2022 02:53:47 -0700] hiveserver2 WARNING Job Browser app is not enabled
[22/Jul/2022 02:53:47 -0700] decorators DEBUG Looking for header value HTTP_X_FORWARDED_FOR
[22/Jul/2022 02:53:47 -0700] decorators DEBUG Axes is configured to be behind reverse proxy
[22/Jul/2022 02:53:47 -0700] decorators INFO Using django-axes 2.2.0
[22/Jul/2022 02:53:47 -0700] decorators INFO AXES: BEGIN LOG
[22/Jul/2022 02:53:46 -0700] sslcompat DEBUG backports.ssl_match_hostname module is available
[22/Jul/2022 02:53:46 -0700] sslcompat DEBUG ipaddress module is available
[22/Jul/2022 02:53:45 -0700] settings DEBUG DESKTOP_DB_TEST_USER SET: hue_test
[22/Jul/2022 02:53:45 -0700] settings DEBUG DESKTOP_DB_TEST_NAME SET: /opt/cloudera/parcels/CDH-7.1.7-1.cdh7.1.7.p1000.24102687/lib/hue/desktop/desktop-test.db
[22/Jul/2022 02:53:45 -0700] settings DEBUG Installed Django modules: DesktopModule(aws: aws),DesktopModule(azure: azure),DesktopModule(hadoop: hadoop),DesktopModule(libanalyze: libanalyze),DesktopModule(liboauth: liboauth),DesktopModule(liboozie: liboozie),DesktopModule(librdbms: librdbms),DesktopModule(libsaml: libsaml),DesktopModule(libsentry: libsentry),DesktopModule(libsolr: libsolr),DesktopModule(libzookeeper: libzookeeper),DesktopModule(Hue: desktop),DesktopModule(About: about),DesktopModule(Hive: beeswax),DesktopModule(File Browser: filebrowser),DesktopModule(Help: help),DesktopModule(Job Designer: jobsub),DesktopModule(Table Browser: metastore),DesktopModule(Oozie Editor/Dashboard: oozie),DesktopModule(Proxy: proxy),DesktopModule(RDBMS UI: rdbms),DesktopModule(User Admin: useradmin),DesktopModule(Data Importer: indexer),DesktopModule(Metadata: metadata),DesktopModule(Notebook: notebook),DesktopModule(Analytics Dashboards: dashboard),DesktopModule(Kafka: kafka)
My suspicion is that it fails to http PUT and GET on those URLs because the FQDNs resolve them to a private IP address non-public IP address.
What could be the problem?
Created 07-26-2022 09:04 PM
I am also trying to figure it out.