Member since
03-14-2016
4721
Posts
1111
Kudos Received
874
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 2724 | 04-27-2020 03:48 AM | |
| 5283 | 04-26-2020 06:18 PM | |
| 4448 | 04-26-2020 06:05 PM | |
| 3576 | 04-13-2020 08:53 PM | |
| 5377 | 03-31-2020 02:10 AM |
06-11-2018
01:44 PM
@raghavendra v Were you able to install mysql?
... View more
06-11-2018
01:43 PM
@raghavendra v Ambari Blueprints are used to create clusters based on the Blueprint template. Using blueprint we can not make configuration changes to an existing cluster. It means if you have the Production Cluster Blueprint (exported blueprint) then using that blueprint (cluster configuration) you can create new clusters, However you can not make cluster configuration changes using blueprint. Ambari Blueprints are a declarative definition of a cluster. With a Blueprint, you specify aStack, the Component layout and the Configurations to materialize a Hadoop cluster instance (via a REST API) without having to use the Ambari Cluster Install Wizard. https://cwiki.apache.org/confluence/display/AMBARI/Blueprints
... View more
06-11-2018
01:38 PM
@Manikandan Jeyabal Have you installed the following packages in all your cluster nodes? # yum install snappy snappy-devel . https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.5/bk_command-line-installation/content/install_compression_libraries.html
... View more
06-11-2018
12:03 PM
1 Kudo
@Bhagabati Das If you are using CentOS 7, RHEL7, SLES 12 (Python 2.7) then in order to solve this problem simply configure the Ambari Agent to use TLSv1.2 when communicating with the Ambari Server by editing each Ambari Agent’s "/etc/ambari-agent/conf/ambari-agent.ini" file and adding the following configuration property to the security section: [security]
force_https_protocol=PROTOCOL_TLSv1_2<br> Then restart the ambari agent: # ambari-agent restart For CentOS 6/RHEL6, or SLES 11 (Python 2.6), Edit the java.security file in the JDK being used by the Ambari Server and make the following changes: Locate the jdk.tls.disabledAlgorithms property and remove the 3DES_EDE_CBC reference Save the file, and restart the Ambari Server. More details are available on: HCC Article: https://community.hortonworks.com/articles/188269/javapython-updates-and-ambari-agent-tls-settings.html HCC Thread: https://community.hortonworks.com/questions/120861/ambari-agent-ssl-certificate-verify-failed-certifi.html
... View more
06-09-2018
12:44 AM
@Sami Ahmad I made some changes to your code, it should look like following to work properly: import java.io.IOException;
import org.apache.hadoop.hbase.util.Bytes;
import org.apache.hadoop.hbase.client.HBaseAdmin;
import org.apache.hadoop.hbase.HBaseConfiguration;
import org.apache.hadoop.hbase.HColumnDescriptor;
import org.apache.hadoop.hbase.HTableDescriptor;
import org.apache.hadoop.hbase.client.Admin;
import org.apache.hadoop.hbase.client.Connection;
import org.apache.hadoop.hbase.client.ConnectionFactory;
import org.apache.hadoop.hbase.TableName;
import org.apache.hadoop.conf.Configuration;
public class CreateHbaseTable {
public void createtable(String name, String[] colfamily)throws Exception {
Configuration config = HBaseConfiguration.create();
config.set("hbase.zookeeper.quorum", "hadoop1,hadoop2");
config.set("hbase.zookeeper.property.clientPort", "2181");
config.set("hbase.cluster.distributed", "true");
config.set("zookeeper.znode.parent", "/hbase-unsecure");
HBaseAdmin admin = new HBaseAdmin(config);
HTableDescriptor des = new HTableDescriptor(Bytes.toBytes(name));
for (int i = 0; i < colfamily.length; i++) {
des.addFamily(new HColumnDescriptor(colfamily[i]));
}
if (admin.tableExists(name)) {
System.out.println("Table already exist");
} else {
admin.createTable(des);
System.out.println("Table: " + name + " Sucessfully created");
}
}
public static void main(String args[]) throws Exception {
CreateHbaseTable op = new CreateHbaseTable();
String tablename = "Acadgild";
String[] familys = { "Emp_name", "sal" };
op.createtable(tablename, familys);
}
} . Now in order to compile and run this code please do this: # export CLASSPATH=`hbase classpath`:.
# javac CreateHbaseTable.java
# java CreateHbaseTable
OUTPUT:
.
.
2018-06-09 00:40:18,504 INFO [main] client.HBaseAdmin: Created Acadgild
Table: Acadgild Sucessfully created . Additionally if you want to use Maven Based Simple HBase client then please refer to: https://github.com/jaysensharma/MiddlewareMagicDemos/tree/master/HDP_Ambari/HBase/HBase_Client
... View more
06-08-2018
11:22 AM
@priyal patel If it is ambari managed cluster then you shoudl make the changes from Ambari UI Ambari UI --> Spark --> Configs --> Advanced-- "Advanced spark2-env"
Ambari UI --> Spark --> Configs --> Advanced-- "Advanced spark-env" Then after saving the changes ambari will show restart required icon for the host components that requires restart and during restart of spark components it will push the spark-env. (spark2-env) related changes to the respective hsots.
... View more
06-07-2018
12:53 PM
Followed by: # systemctl start mysqld.service - Obtain a randomly generated MySQL root password: # grep 'A temporary password is generated for root@localhost' /var/log/mysqld.log |tail -1 . - Reset the MySQL root password. Enter the following command. You are prompted for the password you obtained in the previous step. MySQL then asks you to change the password. # /usr/bin/mysql_secure_installation .
... View more
06-07-2018
12:51 PM
@raghavendra v Please try the "localinstall" option with yum: # yum localinstall https://dev.mysql.com/get/mysql57-community-release-el7-8.noarch.rpm
# yum install mysql-community-server -y .
... View more
06-07-2018
07:55 AM
1 Kudo
@Michael Bronson When we want to do GC log rotation then in that case we will have to define few properties together to make it work appropriately like following along with the "-Xloggc" option. -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=5 -XX:GCLogFileSize=2M Just defining NumberOfGClogFiles option will lead to inconsistent JVM options and JVM will not boot like: So please try this: HBASE_MASTER_OPTS=" -XX:PermSize=64m -XX:MaxPermSize={{hbase_master_maxperm_size}} -Xms{{hbase_heapsize}} -Xmx{{hbase_heapsize}} -Xmn{{hbase_master_xmn_size}} -XX:CMSInitiatingOccupancyFraction=70 -XX:+UseCMSInitiatingOccupancyOnly -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=3 -XX:GCLogFileSize=20M" . NOTE: Also in your case the JVM was not booting because there is a Typo in your case "-XX:NumberOfGClogFiles" (here you used lowercase log) where as the correct option has Uppercase L in the option like "-XX:NumberOfGCLogFiles"
... View more
06-07-2018
07:42 AM
1 Kudo
@Michael Bronson The Logs (like collector-gc.log Or gc.log) produced by the JVM following are not controlled by the Log4j So there is no way to control them or their rotations using Log4j -Xloggc:/var/log/ambari-metrics-collector/collector-gc.log-201806070708
-Xloggc:/var/log/ambari-metrics-collector/gc.log-201806070708 In order to control those GC log files you will need to rely on the OS utilities like "logrotate" or "cronjobs" to clear those logs. . JVM provides some options like "-XX:+UseGCLogFileRotation" however they are responsible for rotating the GC logs when the JVM process is keep running. However You can however control the AMS component logs like HMaster logs or AMS collector logs using the log4j settings like: log4j.appender.file.MaxFileSize={{ams_log_max_backup_size}}MB
log4j.appender.file.MaxBackupIndex={{ams_log_number_of_backup_files}} .
... View more