About pdegave

pdegave · ‎05-16-2018

This might help to other people. This seems like a bug : https://issues.apache.org/jira/browse/AMBARI-21687 The bug is fixed in 2.6.0.0 branch only ( not fixed in 2.4.x.x or 2.5.x.x versions of ambari). So, The available workaround is to add the node via 'Admin' user or use the ambari 2.6.x

pdegave · ‎02-18-2018

You can try adding this "hadoop.ssl.enabled.protocols" property in custom core-site in ambari->HDFS service. See [1] for information on this property : [1] https://hadoop.apache.org/docs/r2.7.2/hadoop-project-dist/hadoop-common/core-default.xml

pdegave · ‎01-03-2018

@Michael Bronson See this link http://henning.kropponline.de/2015/06/07/services-and-state-with-ambari-rest-api/which would helps.

pdegave · ‎12-27-2017

Yes, that's correct. Hortonworks does not support the fair scheduler and it's not suggested to use this in production. See [1] [1] https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.3/bk_release-notes/content/community_features.html

pdegave · ‎12-23-2017

@Tamil Selvan K nice article !!

pdegave · ‎12-23-2017

@Jacqualin jasmin See if you are also facing the warning defined in link [1]. If yes, try the same resolution. [1] https://community.hortonworks.com/articles/11805/how-to-solve-ambari-metrics-corrupted-data.html ref : https://cwiki.apache.org/confluence/display/AMBARI/Cleaning+up+Ambari+Metrics+System+Data

pdegave · ‎11-13-2017

In what scenario we have to choose the binary type or string type in ORC table? It my understanding that, we have to use the type as binary when the datatype string value is more than > 2Gb and If it's below than 2GB then we can go for string data type. Is that correct? I've already seen this : https://orc.apache.org/docs/encodings.html When we use string type value less than 2GB, getting below error but when switched to binary it's working as expected. Any idea what could be the cause. " java.lang.RuntimeException: java.io.IOException: com.google.protobuf.InvalidProtocolBufferException: Protocol message was too large. May be malicious. Use CodedInputStream.setSizeLimit() to increase the size limit. "

pdegave · ‎07-30-2017

Could you share the reference from where you have this information "Currently MR and Tez jobs always have a single reducer"?

pdegave · ‎07-25-2017

@sulanta thanks but my requirement is little different. What I want is to restrict the user from dropping the database but that user should be able to drop the table. Is this possible?

pdegave · ‎07-24-2017

- Is it possible to DROP TABLE but not DROP DATABASE in Hive using Ranger Hive Plugin on latest version of HDP?

pdegave · ‎06-30-2017

@krajguru Thanks !!

pdegave · ‎06-30-2017

pdegave · ‎06-30-2017

pdegave · ‎06-15-2017

@hari Kishore javvaji Dr.who is the default username/static for hadoop core property : "hadoop.htttp.staticuser.user" The description say's : The user name to filter as, on static web filters while rendering content. An example use is the HDFS web UI (user to be used for browsing files) See this: [1] http://hadoop.apache.org/docs/r2.8.0/hadoop-project-dist/hadoop-common/core-default.xml Hope this answered your question.

pdegave · ‎06-11-2017

@Sara Alizadeh Did you mean after enabling maintenance mode on namenode, you can not edit the config changes from ambari ? Please note Without enabling maintenance mode you can change the java heap size. Please see article [1] which talks on how to set namenode heap size. Also, see thread [2] which also talks on same. [1] https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.0/bk_installing_manually_book/content/ref-80953924-1cbf-4655-9953-1e744290a6c3.1.html [2] https://community.hortonworks.com/questions/45351/how-to-set-the-namenode-heap-memory-in-ambari.html

pdegave · ‎06-11-2017

@oula.alshiekh@gmail.com alshiekh Did you resolved the issue? I am also getting the same issue.

pdegave · ‎06-10-2017

My Hive and mysqld services are already running and while starting the Hive metastore I'm getting below error. HDP version: 2.5.5 Ambari version: 2.5.0.3 Closing: 0: jdbc:mysql://pnkj-1.openstacklocal/hive?createDatabaseIfNotExist=true org.apache.hadoop.hive.metastore.HiveMetaException: Schema initialization FAILED! Metastore state would be inconsistent !! Underlying cause: java.io.IOException : Schema script failed, errorcode 2 org.apache.hadoop.hive.metastore.HiveMetaException: Schema initialization FAILED! Metastore state would be inconsistent !! at org.apache.hive.beeline.HiveSchemaTool.doInit(HiveSchemaTool.java:304) at org.apache.hive.beeline.HiveSchemaTool.doInit(HiveSchemaTool.java:277) at org.apache.hive.beeline.HiveSchemaTool.main(HiveSchemaTool.java:526) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.util.RunJar.run(RunJar.java:233) at org.apache.hadoop.util.RunJar.main(RunJar.java:148) Caused by: java.io.IOException: Schema script failed, errorcode 2 at org.apache.hive.beeline.HiveSchemaTool.runBeeLine(HiveSchemaTool.java:410) at org.apache.hive.beeline.HiveSchemaTool.runBeeLine(HiveSchemaTool.java:367) at org.apache.hive.beeline.HiveSchemaTool.doInit(HiveSchemaTool.java:300) ... 8 more *** schemaTool failed ***

pdegave · ‎06-06-2017

@white wartih The ambari-metrics-collector log showing the below message only: ambari-metrics-collector.log : 2017-06-06 05:56:48,415 WARN org.apache.hadoop.yarn.server.applicationhistoryservice.metrics.timeline.query.DefaultPhoenixDataSource: Unable to connect to HBase store using Phoenix. org.apache.phoenix.schema.TableNotFoundException: ERROR 1012 (42M03): Table undefined. tableName=SYSTEM.CATALOG at org.apache.phoenix.query.ConnectionQueryServicesImpl.getAllTableRegions(ConnectionQueryServicesImpl.java:436) at org.apache.phoenix.query.ConnectionQueryServicesImpl.checkClientServerCompatibility(ConnectionQueryServicesImpl.java:939 So, as asked earlier; did you followed all the steps defined in article [1]. If yes and still facing issue then please attach the hbase-ams-master.log file from location of "/var/log/ambari-metrics-collector/hbase-ams-master-<hostname -f>.log" and also share the '/etc/ambari-metrics-monitor/conf/metric_monitor.ini" file from any host where ambari-metrics-monitor is running. Also, Can you try to telnet to ambari-metrics-collector from any host using cmd : telnet c2m.xdata.com 6188 [1] https://community.hortonworks.com/articles/11805/how-to-solve-ambari-metrics-corrupted-data.html

pdegave · ‎06-06-2017

- Is there any way using which we can get the list of user who submitted the Job in the specific queue? Eg : 1) If I am having queue as 'myQueue' then List all user who submitted the Job to 'myQueue' 2) List all user who submitted the specific type of Job : eg List all user who submitted only Hive Job in 'myQueue'.

Online	Offline
Last Visited	‎03-12-2019 12:33 PM

Date Registered	‎03-27-2017 06:14 AM
Last Visited	‎03-12-2019 12:33 PM
Total Messages Posted	20
Total Kudos Received	1

Re: Ambari error: All bootstrapped hosts registere...

Re: Disabling SSL/TLS for HDFS on HDP 2.5

Re: API + how the get status summary for all servi...

Re: Hortonworks only support Capacity Scheduler

Re: Working with Beeline

Re: FATAL org.apache.hadoop.yarn.server.applicatio...

Binary Type vs String type in ORC table

Re: PhoenixStorageHandler single reducer?

Re: Is it possible to DROP TABLE but not DROP DATA...

Is it possible to DROP TABLE but not DROP DATABASE...

Re: Knox is converting a space in the folder name ...

Knox is converting a space in the folder name to '...

How can I get the ranger audits from solr (Ambari ...

Re: TIP: when you get a message in job log user [D...

Re: Change service configuration in Ambari Server ...

Re: httpfs error Operation category READ is not su...

Getting java.io.IOException: Schema script failed,...

Re: AMS:Connection failed: [Errno 111] Connection ...

Is there any way to get the list of user who submi...