Member since
01-04-2016
409
Posts
313
Kudos Received
35
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
5704 | 01-16-2018 07:00 AM | |
1885 | 09-13-2017 06:17 PM | |
3746 | 09-13-2017 05:58 AM | |
2384 | 08-28-2017 07:16 AM | |
4155 | 05-11-2017 11:30 AM |
09-13-2016
10:48 AM
currently using java java -version "1.7.0_111" OpenJDK Runtime Environment (rhel-2.6.7.2.el6_8-x86_64 u111-b01) OpenJDK 64-Bit Server VM (build 24.111-b01, mixed mode)
... View more
03-13-2018
04:20 AM
1 Kudo
This issue may happen when Hive Metastore's 'DBS' table contains a location which doesn't have port. For example, 'hdfs://sandbox-hdp.hortonworks.com/apps/hive/warehouse/dummies.db' I think above is a valid location path, but when HS2 is restarted from Ambari, Ambari replaces not only this 'DBS' location, but also all 'SDS' locations with, for example, like below: old location: hdfs://sandbox-hdp.hortonworks.com:8020/apps/hive/warehouse/dummies.db/emp_part_bckt/department=A new location: hdfs://sandbox-hdp.hortonworks.com:8020:8020/apps/hive/warehouse/dummies.db/emp_part_bckt/department=A
So that next time hiveserver2 is restarted, you don't see this behaviour, but you still need to correct SDS location.
... View more
09-01-2016
06:55 AM
3 Kudos
This issue is resolved after exporting the HIVE home directory:- export HIVE_CONF_DIR=/etc/hive/2.4.2.0-258/0/conf After exporting the directory i got following output Initializing HiveMetaTool.. 16/09/01 06:53:54 INFO metastore.ObjectStore: ObjectStore, initialize called 16/09/01 06:53:54 INFO DataNucleus.Persistence: Property hive.metastore.integral.jdo.pushdown unknown - will be ignored 16/09/01 06:53:54 INFO DataNucleus.Persistence: Property datanucleus.cache.level2 unknown - will be ignored 16/09/01 06:53:55 INFO metastore.ObjectStore: Setting MetaStore object pin classes with hive.metastore.cache.pinobjtypes="Table,Database,Type,FieldSchema,Order" 16/09/01 06:53:56 INFO DataNucleus.Datastore: The class "org.apache.hadoop.hive.metastore.model.MFieldSchema" is tagged as "embedded-only" so does not have its own datastore table. 16/09/01 06:53:56 INFO DataNucleus.Datastore: The class "org.apache.hadoop.hive.metastore.model.MOrder" is tagged as "embedded-only" so does not have its own datastore table. 16/09/01 06:53:56 INFO DataNucleus.Datastore: The class "org.apache.hadoop.hive.metastore.model.MFieldSchema" is tagged as "embedded-only" so does not have its own datastore table. 16/09/01 06:53:56 INFO DataNucleus.Datastore: The class "org.apache.hadoop.hive.metastore.model.MOrder" is tagged as "embedded-only" so does not have its own datastore table. 16/09/01 06:53:56 INFO DataNucleus.Query: Reading in results for query "org.datanucleus.store.rdbms.query.SQLQuery@0" since the connection used is closing 16/09/01 06:53:56 INFO metastore.MetaStoreDirectSql: Using direct SQL, underlying DB is MYSQL 16/09/01 06:53:56 INFO metastore.ObjectStore: Initialized ObjectStore Listing FS Roots.. hdfs://hdptest/db_new.db hdfs://hdptest/db_new1.db hdfs://hdptest/demo_database.db And for second command output is :- /usr/hdp/2.4.2.0-258/hive/bin/schematool -dbType mysql -info WARNING: Use "yarn jar" to launch YARN applications. Metastore connection URL: jdbc:mysql://hdp-test/hive?createDatabaseIfNotExist=true Metastore Connection Driver : com.mysql.jdbc.Driver Metastore connection User: hive Hive distribution version: 1.2.1000 Metastore schema version: 1.2.1000 schemaTool completed
... View more
08-30-2016
07:17 AM
This solution is works for me. Thanks for the immediate reply.
... View more
08-23-2016
02:26 PM
Can you attach screenshot for the policy you are testing? Are you referring to any point in the above doc link ? Also pls let me know how you are testing it.
... View more
08-19-2016
12:12 PM
Hi @Tamas Bihari I think by default, the Control Plane must be given access to the cluster when the instances are being created. Otherwise, the Remote Access CIDR IP field is pointless right now. Or there needs to be an option to input multiple CIDR IPs. Thanks,
KC
... View more
08-22-2016
05:52 AM
Thanks for your reply, Yep i understand the your update, yes i need install the all RPM packages, even if install without using Ambari. I am correcting my question for this and update it
... View more
07-29-2016
06:15 PM
The best summary of the backup status and what is coming in HDP-2.5 is here: https://hortonworks.com/blog/coming-hdp-2-5-incremental-backup-restore-apache-hbase-apache-phoenix/
... View more
02-01-2018
06:28 AM
In HDP 2.6 directory is a little bit different: /usr/hdp/current/zeppelin-server/notebook/
... View more
08-03-2016
08:31 AM
2 Kudos
Foowloing are the changes in cent os 7 :-
New initialization system, systemd. New firewall control, firewalld. This adds a more dynamic and flexible way to control the firewall module in the kernel, which is still netfilter. New bootloader. GRUB2 adds rich scripting support as well as support for the new hardware options offered on modern mainboards. New default filesystem, XFS. XFS adds support for larger single filesystems, faster format times (0 seconds), integrated snapshots, and live filesystem dumps for backup without first unmounting. GNOME 3 – This only really applies to those who use RHEL/CentOS in the desktop, like me. As with any other distro, you aren’t locked into GNOME 3. I personally like it, but KDE is readily available and others can be found on EPEL. If you are used to previous versions you may want to stick with 6. 7 has a lot of command changes And in our env we are using Cent OS 7. Still Didn't face issue with performance etc..
... View more