If we reset ambari server and delete psotgres database and re install does it will delete whole cluster like namenode metadata and datanodes data. How it will work. Please much needed suggestios ... View more

I was trying to upgrade hdp from 2.5 to 2.6 and some how i was not able to upgrade anythig and not able to start any clients on the cluster. when i try to re install this is the error i am getting on it. Error: Error: Unable to run the custom hook script ['/usr/bin/python', '/var/lib/ambari-agent/cache/stack-hooks/before-ANY/scripts/hook.py', 'ANY', '/var/lib/ambari-agent/data/command-22357.json', '/var/lib/ambari-agent/cache/stack-hooks/before-ANY', '/var/lib/ambari-agent/data/structured-out-22357.json', 'INFO', '/var/lib/ambari-agent/tmp', 'PROTOCOL_TLSv1_2', ''] 2018-08-07 14:59:57,751 - The repository with version 2.5.6.0 for this command has been marked as resolved. It will be used to report the version of the component which was installed ... View more

stderr: Traceback (most recent call last): File "/var/lib/ambari-agent/cache/stack-hooks/before-ANY/scripts/hook.py", line 35, in <module> BeforeAnyHook().execute() File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 353, in execute method(env) File "/var/lib/ambari-agent/cache/stack-hooks/before-ANY/scripts/hook.py", line 29, in hook setup_users() File "/var/lib/ambari-agent/cache/stack-hooks/before-ANY/scripts/shared_initialization.py", line 50, in setup_users groups = params.user_to_groups_dict[user], KeyError: u'solr' Error: Error: Unable to run the custom hook script ['/usr/bin/python', '/var/lib/ambari-agent/cache/stack-hooks/before-ANY/scripts/hook.py', 'ANY', '/var/lib/ambari-agent/data/command-21877.json', '/var/lib/ambari-agent/cache/stack-hooks/before-ANY', '/var/lib/ambari-agent/data/structured-out-21877.json', 'INFO', '/var/lib/ambari-agent/tmp', 'PROTOCOL_TLSv1_2', '']Error: Error: Unable to run the custom hook script ['/usr/bin/python', '/var/lib/ambari-agent/cache/stack-hooks/before-START/scripts/hook.py', 'START', '/var/lib/ambari-agent/data/command-21877.json', '/var/lib/ambari-agent/cache/stack-hooks/before-START', '/var/lib/ambari-agent/data/structured-out-21877.json', 'INFO', '/var/lib/ambari-agent/tmp', 'PROTOCOL_TLSv1_2', ''] stdout: 2018-08-07 11:10:11,384 - Stack Feature Version Info: Cluster Stack=2.5, Command Stack=None, Command Version=2.5.6.0 -> 2.5.6.0 2018-08-07 11:10:11,401 - Using hadoop conf dir: /usr/hdp/current/hadoop-client/conf 2018-08-07 11:10:11,589 - Stack Feature Version Info: Cluster Stack=2.5, Command Stack=None, Command Version=2.5.6.0 -> 2.5.6.0 2018-08-07 11:10:11,593 - Using hadoop conf dir: /usr/hdp/current/hadoop-client/conf 2018-08-07 11:10:11,595 - Group['livy'] {} 2018-08-07 11:10:11,596 - Group['spark'] {} 2018-08-07 11:10:11,596 - Group['solr'] {} 2018-08-07 11:10:11,596 - Group['ranger'] {} 2018-08-07 11:10:11,596 - Group['hdfs'] {} 2018-08-07 11:10:11,597 - Group['zeppelin'] {} 2018-08-07 11:10:11,597 - Group['hadoop'] {} 2018-08-07 11:10:11,597 - Group['users'] {} 2018-08-07 11:10:11,597 - Group['knox'] {} 2018-08-07 11:10:11,598 - User['hive'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None} 2018-08-07 11:10:11,599 - User['infra-solr'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None} 2018-08-07 11:10:11,600 - User['atlas'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None} 2018-08-07 11:10:11,601 - User['ams'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None} 2018-08-07 11:10:11,602 - User['falcon'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None} 2018-08-07 11:10:11,603 - User['ranger'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['ranger', 'hadoop'], 'uid': None} 2018-08-07 11:10:11,604 - User['accumulo'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None} 2018-08-07 11:10:11,605 - User['spark'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['spark', 'hadoop'], 'uid': None} Error: Error: Unable to run the custom hook script ['/usr/bin/python', '/var/lib/ambari-agent/cache/stack-hooks/before-ANY/scripts/hook.py', 'ANY', '/var/lib/ambari-agent/data/command-21877.json', '/var/lib/ambari-agent/cache/stack-hooks/before-ANY', '/var/lib/ambari-agent/data/structured-out-21877.json', 'INFO', '/var/lib/ambari-agent/tmp', 'PROTOCOL_TLSv1_2', ''] Error: Error: Unable to run the custom hook script ['/usr/bin/python', '/var/lib/ambari-agent/cache/stack-hooks/before-START/scripts/hook.py', 'START', '/var/lib/ambari-agent/data/command-21877.json', '/var/lib/ambari-agent/cache/stack-hooks/before-START', '/var/lib/ambari-agent/data/structured-out-21877.json', 'INFO', '/var/lib/ambari-agent/tmp', 'PROTOCOL_TLSv1_2', ''] Command failed after 1 tries ... View more

Upgrading from 2.4 to 2.5 getting this error at ambari-server Upgrade. [root@hdp ~]# ambari-server upgrade Using python /usr/bin/python Upgrading ambari-server INFO: Upgrade Ambari Server INFO: Updating Ambari Server properties in ambari.properties ... WARNING: Can not find ambari.properties.rpmsave file from previous version, skipping import of settings INFO: Updating Ambari Server properties in ambari-env.sh ... INFO: Can not find ambari-env.sh.rpmsave file from previous version, skipping restore of environment settings. ambari-env.sh may not include any user customization. ERROR: Unexpected OSError: [Errno 17] File exists For more info run ambari-server with -v or --verbose option ... View more

I am Getting this issue when upgrading 2.4 to 2.6. Ambari Server configured for Embedded Postgres. Confirm you have made a backup of the Ambari Server database [y/n] (y)? y INFO: Upgrading database schema INFO: Return code from schema upgrade command, retcode = 1 ERROR: Error executing schema upgrade, please check the server logs. ERROR: Error output from schema upgrade command: ERROR: Exception in thread "main" org.apache.ambari.server.AmbariException: Unable to find any CURRENT repositories. at org.apache.ambari.server.upgrade.SchemaUpgradeHelper.executeUpgrade(SchemaUpgradeHelper.java:203) at org.apache.ambari.server.upgrade.SchemaUpgradeHelper.main(SchemaUpgradeHelper.java:418) Caused by: org.apache.ambari.server.AmbariException: Unable to find any CURRENT repositories. at org.apache.ambari.server.upgrade.UpgradeCatalog260.getCurrentVersionID(UpgradeCatalog260.java:510) at org.apache.ambari.server.upgrade.UpgradeCatalog260.executeDDLUpdates(UpgradeCatalog260.java:194) at org.apache.ambari.server.upgrade.AbstractUpgradeCatalog.upgradeSchema(AbstractUpgradeCatalog.java:923) at org.apache.ambari.server.upgrade.SchemaUpgradeHelper.executeUpgrade(SchemaUpgradeHelper.java:200) ... 1 more ERROR: Ambari server upgrade failed. Please look at /var/log/ambari-server/ambari-server.log, for more details. ERROR: Exiting with exit code 11. REASON: Schema upgrade failed. ... View more

Hello, We built a Nifi processor that real time extracts attributes and stored as Hbase Tables. But Going forward Data is going to be too huge we need to archive some Data like 6 months in those Tables. IS there any way we can do that. ... View more

Hi, I need Some help with Increasing HDFS disk Space. I have a Disk Mounted to HDFS which is 500 GB. Now its filled to 94% then we increased same disk to 500 to 650 GB. Then I restarted the VM i am able to see in Lsblk Command but not in HDFS Space. I Believe I don't need to Mount it again because that is already mounted in HDFS Direcotry it suppose to be pick it up when we restart right ? ... View more

I am Getting this issues when testing from command line [root@hostnmae~]# beeline -u jdbc:hive2://serverip:10000 user pass Connecting to jdbc:hive2://server ip:10000 18/03/12 10:14:36 [main]: WARN jdbc.HiveConnection: Failed to connect to serverip:10000 Error: Could not open client transport with JDBC Uri: jdbc:hive2://serverip:10000: Peer indicated failure: Unsupported mechanism type PLAIN (state=08S01,code=0) Beeline version 1.2.1000.2.5.6.0-40 by Apache Hive 0: jdbc:hive2://serverip:10000 (closed)> !quit ... View more

After Kerberos regenerated from ambari view not able to run this code Connection cnct1 = DriverManager.getConnection("jdbc:hive2://serverip:10000/test","user","test") HiveConnection:Could not open client transport with JDBC Uri: jdbc:hive2://serverIp:10000/test: Peer indicated failure: Unsupported mechanism type PLAIN ... View more

Hello, I Have root Priviligies in Nifi and able to see all Nifi Properties But not access WEB UI. NO LDAP is Configured But in Place with kerberos. ... View more

I am Not able to find the log where the issue messing around but both Namenode are getting down only weekends and again i am restarting it was working fine. can someone guide me which logs i can better search ... View more

HI Everyone, I Need to automate to copy FTP files from a drive to HDFS. OS : Centos 7 HDP : 2.5 ambari :2.4 Please Guide me how to copy or to automate files from FTP to HDFS or to local Directory. ... View more

By Mistake updated Yum on both Namenodes and now nodes stopped working. Any suggestion ... View more

Not able to open Hive view and Files View. Service 'hdfs' check failed: java.lang.NullPointerException at org.apache.hadoop.security.authentication.util.KerberosName.getShortName(KerberosName.java:383) at org.apache.hadoop.security.User.<init>(User.java:48) at org.apache.hadoop.security.User.<init>(User.java:43) at org.apache.hadoop.security.UserGroupInformation.createRemoteUser(UserGroupInformation.java:1270) at org.apache.hadoop.security.UserGroupInformation.createRemoteUser(UserGroupInformation.java:1254) at org.apache.ambari.view.utils.hdfs.HdfsApi.getProxyUser(HdfsApi.java:78) at org.apache.ambari.view.utils.hdfs.HdfsApi.<init>(HdfsApi.java:66) at org.apache.ambari.view.utils.hdfs.HdfsUtil.connectToHDFSApi(HdfsUtil.java:127) at org.apache.ambari.view.commons.hdfs.HdfsService.hdfsSmokeTest(HdfsService.java:136) at org.apache.ambari.view.filebrowser.HelpService.hdfsStatus(HelpService.java:86) at sun.reflect.GeneratedMethodAccessor726.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60) at com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$ResponseOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:205) at com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75) at com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:302) at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147) at com.sun.jersey.server.impl.uri.rules.SubLocatorRule.accept(SubLocatorRule.java:137) at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147) at com.sun.jersey.server.impl.uri.rules.SubLocatorRule.accept(SubLocatorRule.java:137) ... View more

Hi, I am getting this error from both Active and StandBy node. No Under Replicated Blocks No failed Disk Volumes. This service-level alert is triggered if the increase in storage capacity usage deviation has grown beyond the specified threshold within a week period. ... View more