MantuDeka
Explorer

How I will get Application ID of a job using job n...

by Explorer in Support Questions
‎04-27-2022 12:42 PM
‎04-27-2022 12:42 PM
Hi All,   I need to get application ID of a Pentahu job using job name .Could you please please suggest how to get that? We have Hive LLAP, we are using Ambari 2.6.  Is there any way to get the application ID from HiveServer2 log ? ... View more

Re: HUE WEB UI NOT WORKING

by Explorer in Support Questions
‎06-24-2019 10:41 PM
‎06-24-2019 10:41 PM
Hi  lwang,    Answers are as below -   1) Was the Hue UI working before? Any changes to the Hue service before users noticed the issue?    Ans- Yes,it was working before.No changes.   2) Is this issue happening to single user or multiple users?   Ans- Yes to every users.   3) Have you tried to use different machine/browser to log in and see if this issue resides on server side or client side.   Ans- Different machine means you want to install HUE service in another machine ? Its already running in masternode.    Below is the error in HE Server-       Jun 23, 4:40:58 PM INFO middleware Processing exception: unable to open database file: Traceback (most recent call last): File "/opt/cloudera/parcels/CDH-5.8.3-1.cdh5.8.3.p0.2/lib/hue/build/env/lib/python2.6/site-packages/Django-1.6.10-py2.6.egg/django/core/handlers/base.py", line 112, in get_response response = wrapped_callback(request, *callback_args, **callback_kwargs) File "/opt/cloudera/parcels/CDH-5.8.3-1.cdh5.8.3.p0.2/lib/hue/build/env/lib/python2.6/site-packages/Django-1.6.10-py2.6.egg/django/db/transaction.py", line 370, in inner with self: File "/opt/cloudera/parcels/CDH-5.8.3-1.cdh5.8.3.p0.2/lib/hue/build/env/lib/python2.6/site-packages/Django-1.6.10-py2.6.egg/django/db/transaction.py", line 237, in __enter__ if not connection.get_autocommit(): File "/opt/cloudera/parcels/CDH-5.8.3-1.cdh5.8.3.p0.2/lib/hue/build/env/lib/python2.6/site-packages/Django-1.6.10-py2.6.egg/django/db/backends/__init__.py", line 331, in get_autocommit self.ensure_connection() File "/opt/cloudera/parcels/CDH-5.8.3-1.cdh5.8.3.p0.2/lib/hue/build/env/lib/python2.6/site-packages/Django-1.6.10-py2.6.egg/django/db/backends/__init__.py", line 127, in ensure_connection self.connect() File "/opt/cloudera/parcels/CDH-5.8.3-1.cdh5.8.3.p0.2/lib/hue/build/env/lib/python2.6/site-packages/Django-1.6.10-py2.6.egg/django/db/utils.py", line 99, in __exit__ six.reraise(dj_exc_type, dj_exc_value, traceback) File "/opt/cloudera/parcels/CDH-5.8.3-1.cdh5.8.3.p0.2/lib/hue/build/env/lib/python2.6/site-packages/Django-1.6.10-py2.6.egg/django/db/backends/__init__.py", line 127, in ensure_connection self.connect() File "/opt/cloudera/parcels/CDH-5.8.3-1.cdh5.8.3.p0.2/lib/hue/build/env/lib/python2.6/site-packages/Django-1.6.10-py2.6.egg/django/db/backends/__init__.py", line 115, in connect self.connection = self.get_new_connection(conn_params) File "/opt/cloudera/parcels/CDH-5.8.3-1.cdh5.8.3.p0.2/lib/hue/build/env/lib/python2.6/site-packages/Django-1.6.10-py2.6.egg/django/db/backends/sqlite3/base.py", line 347, in get_new_connection conn = Database.connect(**conn_params) OperationalError: unable to open database file     ... View more

HUE WEB UI NOT WORKING

by Explorer in Support Questions
‎06-19-2019 01:23 AM
‎06-19-2019 01:23 AM
I am gettin the below alert when trying to login HUE WEB UI....Can you please help me out.   Traceback (most recent call last): File "/opt/cloudera/parcels/CDH-5.8.3-1.cdh5.8.3.p0.2/lib/hue/desktop/core/src/desktop/lib/wsgiserver.py", line 1215, in communicate req.respond() File "/opt/cloudera/parcels/CDH-5.8.3-1.cdh5.8.3.p0.2/lib/hue/desktop/core/src/desktop/lib/wsgiserver.py", line 576, in respond self._respond() File "/opt/cloudera/parcels/CDH-5.8.3-1.cdh5.8.3.p0.2/lib/hue/desktop/core/src/desktop/lib/wsgiserver.py", line 588, in _respond response = self.wsgi_app(self.environ, self.start_response) File "/opt/cloudera/parcels/CDH-5.8.3-1.cdh5.8.3.p0.2/lib/hue/build/env/lib/python2.6/site-packages/Django-1.6.10-py2.6.egg/django/core/handlers/wsgi.py", line 206, in __call__ response = self.get_response(request) File "/opt/cloudera/parcels/CDH-5.8.3-1.cdh5.8.3.p0.2/lib/hue/build/env/lib/python2.6/site-packages/Django-1.6.10-py2.6.egg/django/core/handlers/base.py", line 194, in get_response response = self.handle_uncaught_exception(request, resolver, sys.exc_info()) File "/opt/cloudera/parcels/CDH-5.8.3-1.cdh5.8.3.p0.2/lib/hue/build/env/lib/python2.6/site-packages/Django-1.6.10-py2.6.egg/django/core/handlers/base.py", line 236, in handle_uncaught_exception return callback(request, **param_dict) File "/opt/cloudera/parcels/CDH-5.8.3-1.cdh5.8.3.p0.2/lib/hue/desktop/core/src/desktop/views.py", line 335, in serve_500_error return render("500.mako", request, {'traceback': traceback.extract_tb(exc_info[2])}) File "/opt/cloudera/parcels/CDH-5.8.3-1.cdh5.8.3.p0.2/lib/hue/desktop/core/src/desktop/lib/django_util.py", line 227, in render **kwargs) File "/opt/cloudera/parcels/CDH-5.8.3-1.cdh5.8.3.p0.2/lib/hue/desktop/core/src/desktop/lib/django_util.py", line 148, in _render_to_response return django_mako.render_to_response(template, *args, **kwargs) File "/opt/cloudera/parcels/CDH-5.8.3-1.cdh5.8.3.p0.2/lib/hue/desktop/core/src/desktop/lib/django_mako.py", line 125, in render_to_response return HttpResponse(render_to_string(template_name, data_dictionary), **kwargs) File "/opt/cloudera/parcels/CDH-5.8.3-1.cdh5.8.3.p0.2/lib/hue/desktop/core/src/desktop/lib/django_mako.py", line 114, in render_to_string_normal result = template.render(**data_dict) File "/opt/cloudera/parcels/CDH-5.8.3-1.cdh5.8.3.p0.2/lib/hue/build/env/lib/python2.6/site-packages/Mako-0.8.1-py2.6.egg/mako/template.py", line 443, in render return runtime._render(self, self.callable_, args, data) File "/opt/cloudera/parcels/CDH-5.8.3-1.cdh5.8.3.p0.2/lib/hue/build/env/lib/python2.6/site-packages/Mako-0.8.1-py2.6.egg/mako/runtime.py", line 786, in _render **_kwargs_for_callable(callable_, data)) File "/opt/cloudera/parcels/CDH-5.8.3-1.cdh5.8.3.p0.2/lib/hue/build/env/lib/python2.6/site-packages/Mako-0.8.1-py2.6.egg/mako/runtime.py", line 818, in _render_context _exec_template(inherit, lclcontext, args=args, kwargs=kwargs) File "/opt/cloudera/parcels/CDH-5.8.3-1.cdh5.8.3.p0.2/lib/hue/build/env/lib/python2.6/site-packages/Mako-0.8.1-py2.6.egg/mako/runtime.py", line 844, in _exec_template callable_(context, *args, **kwargs) ... View more
Labels:

Re: HUE WEB UI NOT WORKING

by Explorer in Support Questions
‎06-19-2019 12:28 AM
‎06-19-2019 12:28 AM
I am also getting the same error . Can you please help how to install or upgrade RPMs in hue..any guidance. Traceback (most recent call last): File "/opt/cloudera/parcels/CDH-5.8.3-1.cdh5.8.3.p0.2/lib/hue/desktop/core/src/desktop/lib/wsgiserver.py", line 1215, in communicate req.respond() File "/opt/cloudera/parcels/CDH-5.8.3-1.cdh5.8.3.p0.2/lib/hue/desktop/core/src/desktop/lib/wsgiserver.py", line 576, in respond self._respond() File "/opt/cloudera/parcels/CDH-5.8.3-1.cdh5.8.3.p0.2/lib/hue/desktop/core/src/desktop/lib/wsgiserver.py", line 588, in _respond response = self.wsgi_app(self.environ, self.start_response) File "/opt/cloudera/parcels/CDH-5.8.3-1.cdh5.8.3.p0.2/lib/hue/build/env/lib/python2.6/site-packages/Django-1.6.10-py2.6.egg/django/core/handlers/wsgi.py", line 206, in __call__ response = self.get_response(request) File "/opt/cloudera/parcels/CDH-5.8.3-1.cdh5.8.3.p0.2/lib/hue/build/env/lib/python2.6/site-packages/Django-1.6.10-py2.6.egg/django/core/handlers/base.py", line 194, in get_response response = self.handle_uncaught_exception(request, resolver, sys.exc_info()) File "/opt/cloudera/parcels/CDH-5.8.3-1.cdh5.8.3.p0.2/lib/hue/build/env/lib/python2.6/site-packages/Django-1.6.10-py2.6.egg/django/core/handlers/base.py", line 236, in handle_uncaught_exception return callback(request, **param_dict) File "/opt/cloudera/parcels/CDH-5.8.3-1.cdh5.8.3.p0.2/lib/hue/desktop/core/src/desktop/views.py", line 335, in serve_500_error return render("500.mako", request, {'traceback': traceback.extract_tb(exc_info[2])}) File "/opt/cloudera/parcels/CDH-5.8.3-1.cdh5.8.3.p0.2/lib/hue/desktop/core/src/desktop/lib/django_util.py", line 227, in render **kwargs) File "/opt/cloudera/parcels/CDH-5.8.3-1.cdh5.8.3.p0.2/lib/hue/desktop/core/src/desktop/lib/django_util.py", line 148, in _render_to_response return django_mako.render_to_response(template, *args, **kwargs) File "/opt/cloudera/parcels/CDH-5.8.3-1.cdh5.8.3.p0.2/lib/hue/desktop/core/src/desktop/lib/django_mako.py", line 125, in render_to_response return HttpResponse(render_to_string(template_name, data_dictionary), **kwargs) File "/opt/cloudera/parcels/CDH-5.8.3-1.cdh5.8.3.p0.2/lib/hue/desktop/core/src/desktop/lib/django_mako.py", line 114, in render_to_string_normal result = template.render(**data_dict) File "/opt/cloudera/parcels/CDH-5.8.3-1.cdh5.8.3.p0.2/lib/hue/build/env/lib/python2.6/site-packages/Mako-0.8.1-py2.6.egg/mako/template.py", line 443, in render return runtime._render(self, self.callable_, args, data) File "/opt/cloudera/parcels/CDH-5.8.3-1.cdh5.8.3.p0.2/lib/hue/build/env/lib/python2.6/site-packages/Mako-0.8.1-py2.6.egg/mako/runtime.py", line 786, in _render **_kwargs_for_callable(callable_, data)) File "/opt/cloudera/parcels/CDH-5.8.3-1.cdh5.8.3.p0.2/lib/hue/build/env/lib/python2.6/site-packages/Mako-0.8.1-py2.6.egg/mako/runtime.py", line 818, in _render_context _exec_template(inherit, lclcontext, args=args, kwargs=kwargs) File "/opt/cloudera/parcels/CDH-5.8.3-1.cdh5.8.3.p0.2/lib/hue/build/env/lib/python2.6/site-packages/Mako-0.8.1-py2.6.egg/mako/runtime.py", line 844, in _exec_template callable_(context, *args, **kwargs) ... View more

Re: Event Server is failed to start.

by Explorer in Support Questions
‎06-14-2019 04:39 AM
‎06-14-2019 04:39 AM
Hi lwang ,   Thanks lots.It worked. ... View more

Re: Adding drive space on Datanode..

by Explorer in Support Questions
‎03-29-2019 01:39 AM
‎03-29-2019 01:39 AM
Dear Tomas79, Thanks for you response. We have allocated more space on /data/sdc1 , we have increased the space from 477MB to 100 GB. We did not put it on maintenance mode.Just added without stopping any services.. Now the result is we are unable to start that data node.It came up for a while and than went down. We have restarted Namenode , check the configuration directory , re balance it.. NO LUCK. We are unable to make it up. But the region server on that particular node is running fine. Can you please help us on it. ... View more

Adding drive space on Datanode..

by Explorer in Support Questions
‎03-28-2019 05:05 AM
‎03-28-2019 05:05 AM
Hi All,   I need your help to understand the standard procedure of adding drive space to datanode.For example we have five data node .One of our datanode we have less space.   datanode2 - /data/sbc1 has 400 MB only which should be 100 GB.   What is the Cloudera standard process to add this space ? Do we need to decommissioned the node ? Is there some other steps of block setting that we need to follow??   Please help.   Thanks-   Mantu Kumar Deka ... View more
Labels:

Re: Datanode is failed to start after adding disk ...

by Explorer in Support Questions
‎03-27-2019 05:43 PM
‎03-27-2019 05:43 PM
Look like datanode is crashed, Can take backup of  data/sdc1/dfs/dn directory and than clean it on that particular Node, and try to start. Or decomission and recomission , or reconfigure it??     We have replication factor value 2.Does deletion of that particular directory on that particular node will impact on data lost ? ... View more

Re: Datanode is failed to start after adding disk ...

by Explorer in Support Questions
‎03-27-2019 03:12 AM
‎03-27-2019 03:12 AM
Hi Manu, Thanks for your quick response. I have restarted Namenode than started datanode, Still same.Even did rebalance .No luck. Look like the Datanode is cresh. Since we did not decommission it while upgrading drive space.. ... View more

Re: Datanode is failed to start after adding disk ...

by Explorer in Support Questions
‎03-27-2019 02:45 AM
‎03-27-2019 02:45 AM
Below is the log..We increased drive space /data/sdc1 to 100 GB . So after increasing the drive space node stop starting... Mar 26, 7:35:40.174 AM INFO org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.FsDatasetAsyncDiskService Scheduling blk_1076562510_2824178 file /data/sdb1/dfs/dn/current/BP-926926485-10.25.176.190-1423244145752/current/finalized/subdir43/subdir10/blk_1076562510 for deletion Mar 26, 7:35:40.175 AM INFO org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.FsDatasetAsyncDiskService Scheduling blk_1076562511_2824179 file /data/sdc1/dfs/dn/current/BP-926926485-10.25.176.190-1423244145752/current/finalized/subdir43/subdir10/blk_1076562511 for deletion Mar 26, 7:35:40.174 AM INFO org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.FsDatasetAsyncDiskService Deleted BP-926926485-10.25.176.190-1423244145752 blk_1076562512_2824180 file /data/sdb1/dfs/dn/current/BP-926926485-10.25.176.190-1423244145752/current/finalized/subdir43/subdir10/blk_1076562512 Mar 26, 7:35:40.175 AM INFO org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.FsDatasetAsyncDiskService Deleted BP-926926485-10.25.176.190-1423244145752 blk_1076562510_2824178 file /data/sdb1/dfs/dn/current/BP-926926485-10.25.176.190-1423244145752/current/finalized/subdir43/subdir10/blk_1076562510 Mar 26, 7:35:40.176 AM INFO org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.FsDatasetAsyncDiskService Deleted BP-926926485-10.25.176.190-1423244145752 blk_1076562511_2824179 file /data/sdc1/dfs/dn/current/BP-926926485-10.25.176.190-1423244145752/current/finalized/subdir43/subdir10/blk_1076562511 ... View more

Datanode is failed to start after adding disk spac...

by Explorer in Support Questions
‎03-26-2019 06:42 AM
‎03-26-2019 06:42 AM
Hi All,   After disk space increased on one of the drive of a client node, its unable to start datanode. Even not connecting to the namenode. We increased space on /data/sbc1 .   We have started the node than run rebalance .But after a while we can see its again stopped.   Need your help.Below is the log.   Scheduling blk_1076562511_2824179 file /data/sdc1/dfs/dn/current/BP-926926485-10.25.176.190-1423244145752/current/finalized/subdir43/subdir10/blk_1076562511 for deletion ... View more
Labels:

Re: Event Server is failed to start.

by Explorer in Support Questions
‎03-22-2019 11:29 AM
‎03-22-2019 11:29 AM
Thanks lwang for your response . Is this the reason we are not getting health check alert over email?? Even Report manager is also failed to start. Same issue.   Below is the Health Test for both..   Cloudera Manager Descriptor Age . Not enough data to test: Test of whether the Cloudera Manager descriptor is up to date.   WE are getting the eror while tring to restart report manager :     A server error has occurred. Send the following information to Cloudera.   com.cloudera.cmf.command.CmdExecException:com.cloudera.cmf.command.CmdNoopPropagateException: messageId: "message.command.service.bringUp.allTargetRolesUnlicensed" with arguments: "[]" at SeqFlowCmd.java line 120 in com.cloudera.cmf.command.flow.SeqFlowCmd run()     ... View more

Re: Event Server is failed to start.

by Explorer in Support Questions
‎03-20-2019 04:56 PM
‎03-20-2019 04:56 PM
  Hi  gzigldrum ,    lwang Below are the Event Server error logs-   Error starting EventServer java.io.IOException: read past EOF at org.apache.lucene.store.BufferedIndexInput.refill(BufferedIndexInput.java:207) at org.apache.lucene.store.BufferedIndexInput.readByte(BufferedIndexInput.java:39) at org.apache.lucene.store.ChecksumIndexInput.readByte(ChecksumIndexInput.java:40) at org.apache.lucene.store.IndexInput.readInt(IndexInput.java:71) at org.apache.lucene.index.SegmentInfos.read(SegmentInfos.java:260) at org.apache.lucene.index.IndexFileDeleter.<init>(IndexFileDeleter.java:168) at org.apache.lucene.index.IndexWriter.<init>(IndexWriter.java:1155) at com.cloudera.cmf.eventcatcher.server.SingleIndexManager.makeIndexWriter(SingleIndexManager.java:139) at com.cloudera.cmf.eventcatcher.server.SingleIndexManager.<init>(SingleIndexManager.java:112) at com.cloudera.cmf.eventcatcher.server.EventCatcherService.<init>(EventCatcherService.java:282) at com.cloudera.cmf.eventcatcher.server.EventCatcherService.main(EventCatcherService.java:148) ... View more

Re: Why does Alert Publisher require mail server l...

by Explorer in Support Questions
‎03-15-2019 01:26 PM
‎03-15-2019 01:26 PM
You can put this option blank..if you are using SMTP, than no need. ... View more

Event Server is failed to start.

by Explorer in Support Questions
‎03-15-2019 11:05 AM
‎03-15-2019 11:05 AM
In my cluster Event server is faild to start.When I restart it it shows the below error message :   --------- Process Status: This role's process failed to start. Cloudera Manager Descriptor Age Not enough data to test: Test of whether the Cloudera Manager descriptor is up to date Unknown : Not enough data to test: Test of whether the Cloudera Manager descriptor is up to date. ---------------   Someone sugesated to increase Java heap size of Event server 1 GB. I can see its already 1 GB.   Can you guys help me why its failed to start , what other things I can check??   ... View more
Labels:
Contact Me
Online
Offline
Last Visited
‎05-20-2022 11:59 AM
Public Statistics
Date Registered ‎03-14-2019 08:54 PM
Last Visited ‎05-20-2022 11:59 AM
Total Messages Posted 18
; ;