Dear team, We have a HDP cluster of 200 node with HA setup. I want to take fsimage file backup as per enterprise policy. Can some one suggest what is best practice to regularly take fsimage backup ? ... View more

I am trying to read a large avro file (2GB) using spark-shell but I am getting stackoverflow error. I tried to increase driver memory and executor memory but I am still getting same error. How can I read this file ? Is theere a way to partition this file? val newDataDF = spark.read.format("com.databricks.spark.avro").load("abc.avro") java.lang.StackOverflowError at com.databricks.spark.avro.SchemaConverters$.toSqlType(SchemaConverters.scala:71) at com.databricks.spark.avro.SchemaConverters$.toSqlType(SchemaConverters.scala:81) ... View more

I installed Ambari server 2.6.0.0. But previously i installed in same server older version of ambari (2.2.0.0) by mistake and cleaned completely based on one of the article given here. Now I started fresh installation , after Ambari setup , I got below error, when I try to start Ambari-server ============================================================================================== AmbariServer:1073 - Failed to run the Ambari Server org.apache.ambari.server.AmbariException: Current database store version is not compatible with current server version, serverVersion=2.6.0.0, schemaVersion=2.2.0.0 at org.apache.ambari.server.checks.DatabaseConsistencyCheckHelper.checkDBVersionCompatible(DatabaseConsistencyCheckHelper.java:245) at org.apache.ambari.server.controller.AmbariServer.main(AmbariServer.java:1058) ... View more