Cloudera Community

Announcements
Celebrating as our community reaches 100,000 members! Thank you!
Govins
user rank
Contributor

Re: How to change kerberos logging path

by Contributor in Support Questions
‎07-03-2020 05:51 AM
‎07-03-2020 05:51 AM
Hello @amitkumarDR :   Kindly check both kdc.conf and krb5.conf.    https://docs.cloudera.com/documentation/enterprise/5-13-x/topics/sg_kerberos_troubleshoot.html     ... View more

Re: Caused by: org.apache.hadoop.ipc.RemoteExcepti...

by Contributor in Support Questions
‎06-29-2020 04:43 AM
‎06-29-2020 04:43 AM
@Lakshu : thanks for quick response 🙂 good to hear that works ....  ... View more

Re: Caused by: org.apache.hadoop.ipc.RemoteExcepti...

by Contributor in Support Questions
‎06-29-2020 04:14 AM
1 Kudo
‎06-29-2020 04:14 AM
1 Kudo
@Lakshu : Seems to be configuration issue, your code doesnt find the correct region as per the configration.   Go through hbase site xml files for the below configuration parameters, if not found add:   hbase.thrift.support.proxyuser --> true hbase.regionserver.thrift.http --> true   Add these configurations and restart the hbase and let me know how this works.  ... View more

Re: Caused by: org.apache.hadoop.ipc.RemoteExcepti...

by Contributor in Support Questions
‎06-29-2020 04:06 AM
‎06-29-2020 04:06 AM
@Lakshu : Did u get this while running a phoenix sqlline ??    Are u trying to run a phoenix sql query within this sqlline utility.. Be precise so that we could get this resolved.  ... View more

Re: org.apache.phoenix.schema.TableNotFoundExcepti...

by Contributor in Support Questions
‎05-28-2020 06:05 AM
‎05-28-2020 06:05 AM
Try your table name with CAPITAL letters. ... View more

Re: Hive select query error in Beeline

by Contributor in Support Questions
‎05-25-2020 05:14 AM
‎05-25-2020 05:14 AM
https://issues.apache.org/jira/browse/HIVE-13037     Perhaps this may make you see some insights   ... View more

Re: SPARK Throwing error while using pyspark on sq...

by Contributor in Support Questions
‎03-03-2020 11:55 PM
‎03-03-2020 11:55 PM
Fixed:   This is what i infered, while running spark the mode is made as client as you see below:   Parsed arguments: master local[*] deployMode null executorMemory null executorCores null totalExecutorCores null propertiesFile /usr/hdp/current/spark2-client/conf/spark-defaults.conf driverMemory 4g driverCores null driverExtraClassPath null driverExtraLibraryPath /usr/hdp/current/hadoop-client/lib/native:/usr/hdp/current/hadoop-client/lib/native/Linux-amd64-64 driverExtraJavaOptions null supervise false queue default numExecutors null files null pyFiles null archives null mainClass null primaryResource pyspark-shell name PySparkShell childArgs [] jars null packages null packagesExclusions null repositories null verbose true         When we use --master yarn this gets success !! . ... View more

Re: SPARK Throwing error while using pyspark on sq...

by Contributor in Support Questions
‎03-03-2020 11:54 PM
‎03-03-2020 11:54 PM
Tried verbose mode and still finding this issues !!  ... View more

SPARK Throwing error while using pyspark on sql co...

by Contributor in Support Questions
‎03-03-2020 11:53 PM
‎03-03-2020 11:53 PM
Welcome to ____ __ / __/__ ___ _____/ /__ _\ \/ _ \/ _ `/ __/ '_/ /__ / .__/\_,_/_/ /_/\_\ version 2.3.0.2.6.5.0-292 /_/ Using Python version 2.7.14 (default, Dec 7 2017 17:05:42) SparkSession available as 'spark'. >>> >>> df=spark.sql('select * from sws_dev.vw_dlx_rpr_ordr_dtl_base limit 1').show() [Stage 0:=====================> (18 + 28) / 46]20/03/03 07:01:08 ERROR DiskBlockObjectWriter: Uncaught exception while reverting partial writes to file /tmp/blockmgr-c5bcbbe3-8da0-44a0-8025-1b183c81d532/03/temp_shuffle_280c5065-f954-4ec8-b3d0-7c1f5c18b581 java.io.FileNotFoundException: /tmp/blockmgr-c5bcbbe3-8da0-44a0-8025-1b183c81d532/03/temp_shuffle_280c5065-f954-4ec8-b3d0-7c1f5c18b581 (Too many open files) at java.io.FileOutputStream.open0(Native Method) at java.io.FileOutputStream.open(FileOutputStream.java:270) at java.io.FileOutputStream.<init>(FileOutputStream.java:213) at org.apache.spark.storage.DiskBlockObjectWriter$$anonfun$revertPartialWritesAndClose$2.apply$mcV$sp(DiskBlockObjectWriter.scala:217) at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1386) at org.apache.spark.storage.DiskBlockObjectWriter.revertPartialWritesAndClose(DiskBlockObjectWriter.scala:214) at org.apache.spark.shuffle.sort.BypassMergeSortShuffleWriter.stop(BypassMergeSortShuffleWriter.java:237) at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:102) at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:53) at org.apache.spark.scheduler.Task.run(Task.scala:109) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:345) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 20/03/03 07:01:08 ERROR Executor: Exception in task 3.0 in stage 0.0 (TID 3) java.io.FileNotFoundException: /tmp/blockmgr-c5bcbbe3-8da0-44a0-8025-1b183c81d532/3c/temp_shuffle_8450fcd1-d97c-4c34-ac52-196e03030bf9 (Too many open files) at java.io.FileOutputStream.open0(Native Method) at java.io.FileOutputStream.open(FileOutputStream.java:270) at java.io.FileOutputStream.<init>(FileOutputStream.java:213) at org.apache.spark.storage.DiskBlockObjectWriter.initialize(DiskBlockObjectWriter.scala:103) at org.apache.spark.storage.DiskBlockObjectWriter.open(DiskBlockObjectWriter.scala:116) at org.apache.spark.storage.DiskBlockObjectWriter.write(DiskBlockObjectWriter.scala:237) at org.apache.spark.shuffle.sort.BypassMergeSortShuffleWriter.write(BypassMergeSortShuffleWriter.java:151) at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:96) at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:53) at org.apache.spark.scheduler.Task.run(Task.scala:109) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:345) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 20/03/03 07:01:08 ERROR Executor: Exception in task 9.0 in stage 0.0 (TID 9) java.io.FileNotFoundException: /tmp/blockmgr-c5bcbbe3-8da0-44a0-8025-1b183c81d532/21/temp_shuffle_19e93f90-4de2-43c9-a715-c8668e96d793 (Too many open files) ... View more
Labels:

Re: Zookeeper average client session timeout

by Contributor in Support Questions
‎02-04-2020 06:22 AM
‎02-04-2020 06:22 AM
The following values are used based on ZooKeeper settings:   minSessionTimeout = ticktime * 2,  maxSessionTimeout=ticktime * 20   If no Session Timeouts are set in the client, the server will use tickTime*2. Hence, any session which establishes to ZooKeeper, will have this value as a minimum timeout.  Likewise, if there are no SessionTimout set, the maximum value will be tickTime*20. Hence, any session which establishes to ZooKeeper will have this value as a maximum timeout.  The sessionTimeout cannot be less than minSessionTimeout (ticktime * 2) or greater than maxSessionTimeout (ticktime * 20).  ... View more
Contact Me
Online
Offline
Last Visited
‎07-10-2020 08:30 AM
Community Statistics
Member Since ‎11-14-2019 12:54 AM
Last Visited ‎07-10-2020 08:30 AM
Posts 18
Kudos received 1