About subhash_parise3

Shelton · ‎08-26-2019

@subhash_parise3 Can you replace these lines with the below blue line with the orange export SPARK_HISTORY_OPTS='-Dspark.ui.filters=org.apache.hadoop.security.authentication.server.AuthenticationFilter -Dspark.org.apache.hadoop.security.authentication.server.AuthenticationFilter.params="type=kerberos,kerberos.principal=HTTP/ip-0-0-0-0@HDPCLUSTER.LOCAL,kerberos.keytab=/etc/security/keytabs/spnego.service.keytab" With the below text block export SPARK_HISTORY_OPTS='-Dspark.org.apache.hadoop.security.authentication.server.AuthenticationFilter. params="type=kerberos,kerberos.principal ={ {spnego_principal}},kerberos.keytab={ {spnego_keytab}}"' Restart and let me know

subhash_parise3 · ‎07-12-2019

We have a kerberized 4 node cluster. We are not able to call Livy Api from a remote windows machine. Command to make the API call curl --negotiate -u : -X GET -H "Content-Type: application/json" "http://******:8999/sessions?from=1&size=1" Response <html> <head> <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/> <title>Error 403 </title> </head> <body> <h2>HTTP ERROR: 403</h2> <p>Problem accessing /sessions. Reason: <pre> java.lang.IllegalArgumentException</pre></p> <hr /><i><small>Powered by Jetty://</small></i> </body> </html> -Same curl command works successfully from any of the cluster machines after getting a kerberos ticket. -Windows machine is not part of the realm. -I am using the same keytab file to get the kerberso ticket on windows machine which I use on cluster machine. -I suspect that the curl command is not sending the correct user to authenticate. Please let us know if why more information is needed. Appreciate any help.

jsensharma · ‎06-19-2019

@subhash parise Here is the reason why you needed to add that "sslfactory=org.postgresql.ssl.NonValidatingFactory" property: Using SSL without Certificate Validation ==================================== In some situations it may not be possible to configure your Java environment to make the server certificate available, for example in an applet. For a large scale deployment it would be best to get a certificate signed by recognized certificate authority, but that is not always an option. The JDBC driver provides an option to establish a SSL connection without doing any validation, but please understand the risk involved before enabling this option. A non-validating connection is established via a custom SSLSocketFactory class that is provided with the driver. Setting the connection URL parameter sslfactory=org.postgresql.ssl.NonValidatingFactory will turn off all SSL validation. If you do not want to use that option "sslfactory=org.postgresql.ssl.NonValidatingFactory" to turn off all SSL validation. Then you might have to do the following: 1. Create a Truststore in Ambari 2. Import your Postgres Certificate inside the Ambari truststore.

subhash_parise3 · ‎05-23-2019

Team, i want to setup HDP 3.1.0 cluster in Azure. Does HDP support azure postgres-sql database for ambari,hivemetastore,ranger service bakends ?

subhash_parise3 · ‎05-27-2019

Hi @Predrag Minovic, Thank you for the sharing your input. No issues with the zookeeper name space, have double checked i,e jdbc:hive2://hadoop-zknode01:2181,hadoop-zknode02:2181,hadoop-zknode03:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2

ask_bill_brooks · ‎05-20-2019

The above was originally posted in the Community Help Track. On Mon May 20 16:29 UTC 2019, a member of the HCC moderation staff moved it to the Data Processing track. The Community Help Track is intended for questions about using the HCC site itself.

subhash_parise3 · ‎04-08-2019

LOAD DATA LOCAL INPATH '/tmp/sample.txt' OVERWRITE INTO TABLE employee; Error: Error while compiling statement: FAILED: HiveAccessControlException Permission denied: Principal [name=hive, type=USER] does not have following privileges for operation LOAD [ADMIN] (state=42000,code=40000) 0: jdbc:hive2://starbucks-spark-job-test:2181> dfs -ls /user/hive; Error: Error while processing statement: Permission denied: Principal [name=hive, type=USER] does not have following privileges for operation DFS [ADMIN] (state=,code=1) 0: jdbc:hive2://starbucks-spark-job-test:2181> dfs -ls /tmp; Error: Error while processing statement: Permission denied: Principal [name=hive, type=USER] does not have following privileges for operation DFS [ADMIN] (state=,code=1) 0: jdbc:hive2://starbucks-spark-job-test:2181> In hive config i have found below property in Advanced HiveServer2-site hive.conf.restricted.list = hive.security.authenticator.manager,hive.security.authorization.manager,hive.security.metastore.authorization.manager,hive.security.metastore.authenticator.manager,hive.users.in.admin.role,hive.server2.xsrf.filter.enabled,hive.security.authorization.enabled do something we need to change above property ?? Please Advice ?

subhash_parise3 · ‎03-14-2019

Dear members, i am connecting Hive by using Hive_warehouse_connector from spark-shell with spark user. getting below error while creating the database java.sql.SQLException: Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. MetaException(message:Got exception: org.apache.hadoop.security.AccessControlException Permission denied: user=anonymous, access=EXECUTE, inode="/warehouse/tablespace/managed/hive/hive_test.db/":hive:hadoop:drwxdrwx--- Here my question is why spark-shell using anonymous user to contact hive database instead of spark user?

bhakti_lad831 · ‎02-14-2019

Hi Thank you for reply.I got the solution. Thanks.

subhash_parise3 · ‎01-10-2019

Hi Vikash, This https://community.hortonworks.com/questions/91265/oozie-hive-action-class-not-found-exception.html help you.

Jim_B · ‎12-12-2018

You might look at the table definition (show create table x) and verify the prefix on the table location. Hive stores the whole filespec including the protocol.

subhash_parise3 · ‎11-26-2018

This problem occurs while the ticket is expired. resolved after generating the ticket by using kinit -kt user.keytab use@realm

subhash_parise3 · ‎11-20-2018

After deployed the services in HDP 3.0.1 Name node is failing to start and throwing Name node is not formatted exception. iwe had got the same issue second time. OS is rhel7 . Error Details: 2018-11-20 15:12:25,711 ERROR namenode.NameNode (NameNode.java:main(1715)) - Failed to start namenode. java.io.IOException: NameNode is not formatted. at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:237) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFSImage(FSNamesystem.java:1090) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:714) at org.apache.hadoop.hdfs.server.namenode.NameNode.loadNamesystem(NameNode.java:632) at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:694) at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:937) at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:910) at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1643) at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1710) 2018-11-20 15:12:25,712 INFO timeline.HadoopTimelineMetricsSink (AbstractTimelineMetricsSink.java:getCurrentCollectorHost(291)) - No live collector to send metrics to. Metrics to be sent will be discarded. This message will be skipped for the next 20 times. 2018-11-20 15:12:25,712 INFO util.ExitUtil (ExitUtil.java:terminate(210)) - Exiting with status 1: java.io.IOException: NameNode is not formatted. 2018-11-20 15:12:25,714 INFO namenode.NameNode (LogAdapter.java:info(51)) - SHUTDOWN_MSG: After manually formatting the namenode we can able to start the namenode from ambari console. Seems this is bug in HDP 3.0.1. Same issue happened Name node HA setup in newly added namenode. Any workaround for this issue ?

subhash_parise3 · ‎11-19-2018

Hello Team, Enable Namenode HA set up went upto Namenode HA Metadata step. After ran below command in second nn2 host hdfs namenode -bootstrapStandby in nn2 we have received the below error: STARTUP_MSG: build = git@github.com:hortonworks/hadoop.git -r 2820e4d6fc7ec31ac42187083ed5933c823e9784; compiled by 'jenkins' on 2018-09-19T10:19Z STARTUP_MSG: java = 1.8.0_112 ************************************************************/ 18/11/19 12:56:51 INFO namenode.NameNode: registered UNIX signal handlers for [TERM, HUP, INT] 18/11/19 12:56:51 INFO namenode.NameNode: createNameNode [-bootstrapStandby] 18/11/19 12:56:52 ERROR namenode.NameNode: Failed to start namenode. java.io.IOException: java.lang.IllegalStateException: Could not determine own NN ID in namespace 'o9cluster'. Please ensure that this node is one of the machines listed as an NN RPC address, or configure dfs.ha.namenode.id at org.apache.hadoop.hdfs.server.namenode.ha.BootstrapStandby.run(BootstrapStandby.java:456) at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1615) at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1710) Caused by: java.lang.IllegalStateException: Could not determine own NN ID in namespace 'o9cluster'. Please ensure that this node is one of the machines listed as an NN RPC address, or configure dfs.ha.namenode.id at com.google The above error looks like wrong configuration in custom hdfs-site.xml. we really not sure why ambari made wrong host-nn2 entry in hdfs-site.xml . we revert back to the original nn2 host entry for the below properties dfs.namenode.http-address.o9cluster.nn2 dfs.namenode.https-address.o9cluster.nn2 dfs.namenode.rpc-address.o9cluster.nn2 still i am facing the same issue while running hdfs namenode -bootstrapStandby in nn2 server. how to overcome this issue and proceed to further ??

subhash_parise3 · ‎11-16-2018

seems issue with the yum.conf , after removing proxy url from yum.conf installation went fine.

subhash_parise3 · ‎10-29-2018

FAILED: SemanticException org.apache.hadoop.hive.ql.metadata.HiveException: Unable to determine if hdfs://SUBHASH/user/hive/warehouse/db.db/etl_othervendor_ids is encrypted: java.io.IOException: Failed on local exception: java.io.IOException: Couldn't setup connection for usreid@HADOOP_SUBHASH.COMPANY.COM to hostname-name/10.74.17.86:8020; Hosts: "jdfdjf2882.cloud.subhash.com":8020;

subhash_parise3 · ‎10-28-2018

2018-10-28T05:45:27,730 ERROR [org.apache.hadoop.hive.ql.txn.AcidOpenTxnsCounterService-0]: txn.AcidOpenTxnsCounterService (AcidOpenTxnsCounterService.java:run(71)) - Serious error in org.apache.hadoop.hive.ql.txn.AcidOpenTxnsCounterService-0 java.lang.NullPointerException at org.apache.hadoop.hive.metastore.txn.TxnHandler.checkRetryable(TxnHandler.java:2022) ~[hive-exec-2.1.0.2.6.2.25-1.jar:2.1.0.2.6.2.25-1] at org.apache.hadoop.hive.metastore.txn.TxnHandler.countOpenTxns(TxnHandler.java:3140) ~[hive-exec-2.1.0.2.6.2.25-1.jar:2.1.0.2.6.2.25-1] at org.apache.hadoop.hive.ql.txn.AcidOpenTxnsCounterService$OpenTxnsCounter.run(AcidOpenTxnsCounterService.java:61) [hive-exec-2.1.0.2.6.2.25-1.jar:2.1.0.2.6.2.25-1] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:1.8.0_171] at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) [?:1.8.0_171] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) [?:1.8.0_171] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) [?:1.8.0_171] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_171] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_171] at java.lang.Thread.run(Thread.java:748) [?:1.8.0_171]

subhash_parise3 · ‎10-26-2018

After restarting the Yarn services jobs are running state. In the Node Manager logs showing error related ats-hbase [time line server] connection refused issue with region server. i have checked the port of region server is 16020. but still this services is trying to connect 17020. Logs: 2018-10-26 09:36:58,460 INFO launcher.ContainerRelaunch (ContainerRelaunch.java:call(87)) - Relaunch container with workDir = /hadoop/hadoop/yarn/local/usercache/yarn-ats/appcache/application_1538447063871_0001/container_e38_1538447063871_0001_02_000002, logDir = /hadoop/hadoop/yarn/log/application_1538447063871_0001/container_e38_1538447063871_0001_02_000002, nmPrivateContainerScriptPath = /hadoop/yarn/local/nmPrivate/application_1538447063871_0001/container_e38_1538447063871_0001_02_000002/launch_container.sh, nmPrivateTokensPath = /hadoop/hadoop/yarn/local/nmPrivate/application_1538447063871_0001/container_e38_1538447063871_0001_02_000002/container_e38_1538447063871_0001_02_000002.tokens, pidFilePath = /hadoop/hadoop/yarn/local/nmPrivate/application_1538447063871_0001/container_e38_1538447063871_0001_02_000002/container_e38_1538447063871_0001_02_000002.pid 2018-10-26 09:36:58,463 INFO container.ContainerImpl (ContainerImpl.java:handle(2093)) - Container container_e38_1538447063871_0001_02_000002 transitioned from RELAUNCHING to RUNNING 2018-10-26 09:36:58,465 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:onStartMonitoringContainer(941)) - Starting resource-monitoring for container_e38_1538447063871_0001_02_000002 2018-10-26 09:36:58,465 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(370)) - launchContainer: [bash, /hadoop/hadoop/yarn/local/usercache/yarn-ats/appcache/application_1538447063871_0001/container_e38_1538447063871_0001_02_000002/default_container_executor.sh] 2018-10-26 09:36:58,518 WARN nodemanager.DefaultContainerExecutor utor.java:logOutput(541)) - Container id: container_e38_1538447063871_0001_02_000002 2018-10-26 09:36:58,518 INFO 018-10-26 09:36:59,657 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(311)) - Exception from container-launch with container ID: container_e38_1538447063871_0001_02_000001 and exit code: 1 ExitCodeException exitCode=1: at org.apache.hadoop.util.Shell.runCommand(Shell.java:1009) at org.apache.hadoop.util.Shell.run(Shell.java:902) at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1227) at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.relaunchContainer(DefaultContainerExecutor.java:345) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.relaunchContainer(ContainerLaunch.java:504) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerRelaunch.call(ContainerRelaunch.java:111) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerRelaunch.call(ContainerRelaunch.java:47) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 2018-10-26 09:36:59,657 INFO nodemanager.ContainerExecutor (ContainerExecutor.java:logOutput(541)) - Exception from container-launch. 2018-10-26 09:36:59,657 INFO nodemanager.ContainerExecutor (ContainerExecutor.java:logOutput(541)) - Container id: container_e38_1538447063871_0001_02_000001 2018-10-26 09:36:59,657 INFO nodemanager.ContainerExecutor (ContainerExecutor.java:logOutput(541)) - Exit code: 1 2018-10-26 09:36:59,657 WARN launcher.ContainerLaunch (ContainerLaunch.java:handleContainerExitWithFailure(598)) - Container launch failed : Container exited with a non-zero exit code 1. 2018-10-26 09:36:59,660 INFO container.ContainerImpl (ContainerImpl.java:doRelaunch(1638)) - Relaunching Container container_e38_1538447063871_0001_02_000001. Remaining retry attempts(after relaunch) : -457. Interval between retries is 30000ms 2018-10-26 09:36:59,660 INFO container.ContainerImpl (ContainerImpl.java:handle(2093)) - Container container_e38_1538447063871_0001_02_000001 transitioned from RUNNING to RELAUNCHING 2018-10-26 09:37:00,389 INFO client.RpcRetryingCallerImpl (RpcRetryingCallerImpl.java:callWithRetries(134)) - Call exception, tries=6, retries=6, started=4192 ms ago, cancelled=false, msg=Call to ip-10-0-10-76.amer.o9solutions.local/10.0.10.76:17020 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: ip-10-0-10-76.amer.o9solutions.local/10.0.10.76:17020, details=row 'prod.timelineservice.entity,yarn-ats!yarn_cluster!ats-hbase��h�<��h��!COMPONENT!!regionserver,99999999999999' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=ip-10-0-10-76.amer.o9solutions.local,17020,1538447132436, seqNum=-1

subhash_parise3 · ‎10-24-2018

Hive metric system not started due to /tmp/hive permission issue. we have given full permissions for /tmp/hive resolved the issue.

mohamed_achelif · ‎02-13-2019

capture-decran-2019-02-12-a-185811.pngHi, Could you explain further please? I have the same problem. When I restart HiveServer2 Interactive via Ambari, the later starts a yarn application named llap0 and still running a moment before it fails. When I check via CLI : hive --service llapstatus --name llap0 I get : SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/usr/hdp/3.0.1.0-187/hive/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/usr/hdp/3.0.1.0-187/hadoop/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] WARN conf.HiveConf: HiveConf of name hive.stats.fetch.partition.stats does not exist WARN conf.HiveConf: HiveConf of name hive.heapsize does not exist LLAPSTATUS -------------------------------------------------------------------------------- LLAP status unknown. Awaiting app launch -------------------------------------------------------------------------------- LLAP status unknown. Awaiting app launch -------------------------------------------------------------------------------- { "state" : "APP_NOT_FOUND", "runningThresholdAchieved" : false } But on the Yarn Applications dashboard, the llap0 is in Running state (see attached picture). Thanks.

tarek.abouzeid · ‎05-11-2019

hi @Rajesh Sampath @subhash parise, i am also having same error, i am trying to read hive external table, can you please tell me how you fixed it ?

rp4345 · ‎06-12-2019

@Aditya Sirna @subhash parise @Jay Kumar SenSharma can we kill this application? it is taking too much time to finish

ivonnycapilitan · ‎10-09-2018

Hi @subhash parise, Thank you! No alerts were observed after the maintenance mode was enabled.

subhash_parise3 · ‎09-27-2018

Hi @Thuy Le , you may need to change java heap size perameters in bootstrap.conf file. Please refer the below document. https://community.hortonworks.com/articles/7882/hdfnifi-best-practices-for-setting-up-a-high-perfo.html

subhash_parise3 · ‎09-26-2018

The above error wiped out once we have added HADOOP_CONF_DIR and YARN_CONF_DIR in .bashrc file in users home directory

czetsuya · ‎03-18-2019

Hi. I have installed and configured Ambari using the guide here: https://cwiki.apache.org/confluence/display/AMBARI/Installation+Guide+for+Ambari+2.7.3. Unfortunately, I got the same error in this page. I already tried reinstalling twice but no success. I'm running Ubuntu on a Virtual Box running on Windows host. Any idea? Thanks.

subhash_parise3 · ‎09-24-2018

Hi @Felix Albani, I have configured required properties in custom spark-default config but still spark in not utilizing those properties. i have used above syntax got worked for me.

gene_mishchenko · ‎05-06-2019

Thanks for posting this answer, Subhash. I thought I was going crazy, because I was using HDP 2.X sandbox before and that's all what one had to do to query HIVE-created tables from Spark: %pyspark from pyspark.sql import HiveContext hive_context = HiveContext(sc) hive_context.sql('show tables').show() Many posts out there say that not having ./conf/hive-site.xml may be the problem, but it DOES exist on the HDP 3.0.1 sandbox, while HiveContext still shows only Spark-created tables (both permanent and temporary). So I have a follow-up question: Is the value "thrift://sandbox-hdp.hortonworks.com:9083" correct for the property "hive.metastore.uris" in ./conf/hive-site.xml? Here's the entry for this host from /etc/hosts: 172.18.0.2 sandbox-hdp.hortonworks.com sandbox-hdp Is this the IP address of one of the hosts in the virtual cluster? (I am using HDP Sandbox 3.0.1) Changing the host IP address to 172.0.0.1 (same as localhost) results in an error while trying to create and use HiveContext - connection refused, probably meaning that the Thrift server is NOT running on port number 9083 of the sandbox VM ???

subhash_parise3 · ‎09-20-2018

Hello Team, we are observing NameNode Last checkpoint alert is continuously appearing in Ambari UI. we have checked Timeperiod and Transaction properties for Namenode checkpoint looks fine. in secondary Namenode Log we getting below error: 2018-09-20 08:58:53,275 ERROR namenode.SecondaryNameNode (SecondaryNameNode.java:doWork(409)) - Exception in doCheckpoint java.io.IOException: Inconsistent checkpoint fields. LV = -63 namespaceID = 156032726 cTime = 0 ; clusterId = CID-a68bebda-c84a-4599-ba9c-fb5a77ba5c44 ; blockpoolId = BP-436455769-10.74.144.26-1533308885101. Expecting respectively: -63; 444167579; 0; CID-11fb5fdb-8c80-416e-bf88-0d68b0b8b96d; BP-1567627602-10.74.144.26-1524757739170. at org.apache.hadoop.hdfs.server.namenode.CheckpointSignature.validateStorageInfo(CheckpointSignature.java:143) at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:541) at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:405) at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$1.run(SecondaryNameNode.java:371) at org.apache.hadoop.security.SecurityUtil.doAsLoginUserOrFatal(SecurityUtil.java:476) at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:367) at java.lang.Thread.run(Thread.java:748) 2018-09-20 08:59:53,322 ERROR namenode.SecondaryNameNode (SecondaryNameNode.java:doWork(409)) - Exception in doCheckpoint java.io.IOException: Inconsistent checkpoint fields. LV = -63 namespaceID = 156032726 cTime = 0 ; clusterId = CID-a68bebda-c84a-4599-ba9c-fb5a77ba5c44 ; blockpoolId = BP-436455769-10.74.144.26-1533308885101. Expecting respectively: -63; 444167579; 0; CID-11fb5fdb-8c80-416e-bf88-0d68b0b8b96d; BP-1567627602-10.74.144.26-1524757739170. at org.apache.hadoop.hdfs.server.namenode.CheckpointSignature.validateStorageInfo(CheckpointSignature.java:143) at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:541) at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:405) at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$1.run(SecondaryNameNode.java:371) at org.apache.hadoop.security.SecurityUtil.doAsLoginUserOrFatal(SecurityUtil.java:476) at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:367) Any one knows how to resolve this issue?

thirun66 · ‎09-11-2018

alter table schema_7539.activityparameters_4ITEM_1 COMPACT 'MAJOR'; in hive then re run query. If that does't work run query in spark hive context.

Online	Offline
Last Visited	‎08-20-2019 02:28 AM

Date Registered	‎12-30-2015 09:04 AM
Last Visited	‎08-20-2019 02:28 AM
Total Messages Posted	161
Total Kudos Received	28

Re: Spark unable to connect Hive database in HDP 3...

Re: ambari cluster + zookeeper snapshot

Re: hdfs dfs -ls command failing with below error ...

Re: install hadoop services are failing due to loc...

Re: LLAP - Status Unknown ( HiveInteractive server...

Re: unable to connect spark history server ui afte...

Issue in making Livy REST Api call in a kerberized...

Re: ambari is unable to make the connection extern...

does HDP3.1.0 supports Azure postgres-sql database...

Re: unable to login hive by using beeline with zoo...

Re: Hive table showing the count and not displayin...

HIve load data local inpath query failing with the...

Creating table by using spark-shell failing from ...

Re: Hive connection with ODBC Driver

Re: Oozie hive action error - hiveComatibilityMain...

Re: Hive queries are failing in Ineractive quey HD...

Re: hdfs dfs -ls command failing with below error ...

Namenode start failed after installation completes...

Enable Namenode Ha Fails in Inetialize Namenode H...

Re: install hadoop services are failing due to loc...

Hive Query Failing with Kerberos Error

Hive queries are failing with java null pointer ex...

Resource manager not allocating the resources even...

Re: hive interactive server (HSI) queries are fail...

Re: LLAP - Status Unknown ( HiveInteractive server...

Re: hive.executeQuery("select * from rh_demand_pla...

Re: why yarn service is launching ats-hbase app i...

Re: Will I be getting an error if I shutdown all s...

Re: Nifi: error (Java Heap space) when load data ...

Re: Spark-shell throwing an error while connecting...

Re: Apache Ambari Cluster Name Error

Re: SPARK + LLAP not working in HDP 3.0?

Re: Spark2 shell is not displaying all Hive databa...

NameNode Last CheckPoint is not triggering correct...

Re: hive insert query is failing and giving the be...