Member since
01-04-2016
8
Posts
39
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1117 | 12-26-2017 05:00 PM |
12-27-2017
07:20 AM
1 Kudo
@Freddy, Since you're using Hive-view , I'd suggest you take a look at hive view logs to debug this further. If you're using hive-view 1.5, logs are available : /var/log/ambari-server/hive-next-view/hive-view.log For hive-view 2.0, the logs can be found at path : /var/log/ambari-server/hive20-view/hive20-view.log
... View more
12-26-2017
05:00 PM
1 Kudo
Yes, one Ambari view server can manage multiple remote clusters. Please refer the article : https://hortonworks.com/blog/introduction-ambari-views-2-4-new-feature-remote-cluster-configuration/
... View more
12-26-2017
10:26 AM
This setting (use.hive.interactive.mode=true) is available in Hive View 2.0 since it's inception in HDP 2.5
... View more
03-15-2017
10:53 AM
9 Kudos
Hive view is a web GUI that lets you easily interact with HIVE, which comes pre-deployed in the Ambari managed cluster. Ambari 2.5.0 comes with the new version of Hive view (2.0.0). The hive view 2.0 supports a lot of new features, one of them is Table Manager. Before Ambari 2.5.0, managing and creating table had to done through query tab, by writing queries. Table manager in Hive 2.0.0 provides a GUI wizard to create a table definition, or create a table, alter a table and load data by uploading the file of format CSV, JSON or XML. This article is an introduction to Table manager in Hive View 2.0 Creating a new Hive View 2.0 Instance
Ambari comes with auto created instances of Hive view. If you wish to create a new instance of hive view, follow the steps: Click Manage Ambari to open the Ambari Administration user interface. Click Views, expand the Hive View, and click Create Instance. On the Create Instance page, select the Version as 2.0.0.
Table Manager Wizard
To create a table using Table manager wizard, open a Hive view 2.0 instance, navigate to Tables tab
Create a managed table Create a new table by, clicking on the ‘+’ icon, which opens the create table wizard. Enter table name, column name and choose a data type from the dropdown 2. If you wish to create a partitioned column or clustered column, click on the gear icon against the column 3. Create table allows to set advance hive properties mentioned below: Transactional : Turn on transaction support in Hive, by checking this flag. Note that the table must be bucketed and stored using an ACID compliant format (such as ORC). Location : Hive stores the table data for managed tables in the Hive warehouse directory in HDFS which is configured in hive-site.xml with property hive.metastore.warehouse.dir. The default location is /apps/hive/warehouse. The location can be changed using the Location text field. File Format : The default file format for CREATE TABLE statement is ORC. choose a format from the file format dropdown. Row Format : Select a row format such as Field terminator, Lines terminator, and Stored File type. 4. Set Additional Table properties as key value pairs : After setting all the required properties, click on create table button. Once the table is created, tables tab view shows the table details and storage information.
Create table by uploading a file If you have a data file of the format CSV,JSON or XML, Upload table feature allows to creates a table from the data file. To upload and create a table, click on Upload Table on create table wizard Choose file type and format according to the file being uploaded. File can be uploaded from HDFS or local machine accessing the view If the first row of the CSV is a header row, check the ‘Is first row header?’ Checkbox. File name would be set as table name, which can be changed. Create a partitioned column or clustered column, using the gear icon against the column. Advance properties and table properties can be set as explained before. Note: Once a table is created by uploading a file, uploading more files to the same table is not supported. The json files should follow the format given below: [{
"col1Name": "value-1-1",
"col2Name": "value-1-2"
}, {
"col1Name": "value-2-1",
"col2Name": "value-2-2"
}]
Alter Table Once a table is created, table can be altered to add new columns or change the column name or column datatype. You can also rename the table or delete the table. Note: Alter table does not allow altering a clustered or partitioned column. It does not allow adding a new column that is clustered or partitioned. Also, removing an existing table property is not allowed
... View more
Labels:
08-31-2016
03:36 AM
16 Kudos
In the following article, Ambari Views Server is the Standalone Ambari Server used for hosting Views and Ambari Server is the Operational Ambari Server which manages a Hadoop Cluster Before Ambari 2.4, when Ambari Views Servers are setup, the only way to configure views was to use ‘Custom Configuration’. In this method details had to be manually entered for several fields. For example, to configure Files View, all the entries as described in Ambari Views Documentaion for 2.2 had to be made. This is made easier in Ambari 2.4 with ‘Remote Cluster Configuration’ . The remote cluster configuration is used to set up an Ambari Views Server to host views for a remote Ambari server, regardless of the cluster configuration.Once a remote cluster configuration is set, all it takes to create a new view is to select the 'Remote Cluster' option in 'Cluster configuration' and select a cluster name in create view wizard. How to define a new remote cluster configuration? Note: If remote Ambari server is either Kerberised or if SSL is enabled, please refer to the end of the article to complete the pre-requisite setup before continuing further. To create a remote cluster configuration in Views server, go to ‘Manage Ambari’ under admin, Click on ‘Remote Clusters’. Click on ‘Register Remote Cluster’. Provide the following values to register a remote Ambari Server: Cluster Name: This value will be used while creating views using the remote cluster configuration. This need not be same as the cluster name of remote cluster. Ambari Cluster URL: This is the URL of the remote cluster to be configured. http://<remote_server_url>:<port>/api/v1/clusters/<remote_cluster_name>;
For example,
http://prod.example.com:8080/api/v1/clusters/cl1 If the remote cluster has SSL enabled for Ambari, the url would start with https instead of http. Cluster user: Ambari User in remote cluster with ‘Cluster Admin’ permission. Password : Ambari login password for the above user. Once Registered, the remote clusters would be listed as follows: Once the remote cluster configuration is set, multiple instances of the any view are can be created. Here is an example for creating a new Files view using the above remote cluster configuration: Please take note of ‘Remote Cluster’ in the above screenshot. There is no need to enter any further details once this is selected. Optionally the 'Settings' section can be changed. Once saved, click on 'Go to Instance' to go the the newly created Files view. Screenshot of the working Files View:
Pre-requisite if Remote Ambari Server is either Kerberised or SSL is enabled If the Remote Ambari server is kerberized, then the following steps need to be completed in the Ambari Views server: Copy the following from the Remote Ambari Server to the Ambari Views Server:
/etc/krb5.conf Ambari server user keytab For example, copy /etc/security/keytabs/ambari.server.keytab Find the Ambari server's kerberos principal name from the above file, for example,
klist -kt /etc/security/keytabs/ambari.server.keytab
Keytab name: FILE:/etc/security/keytabs/ambari.server.keytab
KVNO Timestamp Principal
---- ------------------- ------------------------------------------------------
1 08/19/2016 08:14:54 ambari-server-cl1@EXAMPLE.COM
1 08/19/2016 08:14:54 ambari-server-cl1@EXAMPLE.COM
1 08/19/2016 08:14:54 ambari-server-cl1@EXAMPLE.COM
1 08/19/2016 08:14:54 ambari-server-cl1@EXAMPLE.COM
1 08/19/2016 08:14:54 ambari-server-cl1@EXAMPLE.COM Stop ambari-server process in Ambari Views Server ambari-server stop Enable kerberos JAAS config for Ambari Views Server by running ambari-server setup-security and choosing option 3
ambari-server setup-security
Using python /usr/bin/python
Security setup options...
===========================================================================
Choose one of the following options:
[1] Enable HTTPS for Ambari server.
[2] Encrypt passwords stored in ambari.properties file.
[3] Setup Ambari kerberos JAAS configuration.
[4] Setup truststore.
[5] Import certificate to truststore.
===========================================================================
Enter choice, (1-5):3
Setting up Ambari kerberos JAAS configuration to access secured Hadoop daemons...
Enter ambari server's kerberos principal name (ambari@EXAMPLE.COM): ambari-server-cl1@EXAMPLE.COM
Enter keytab path for ambari server's kerberos principal: /etc/security/keytabs/ambari.server.keytab
Ambari Server 'setup-security' completed successfully. Start Ambari Server for the view server ambari-server start If the Remote Ambari Server has SSL enabled, then the following steps need to be completed in the View server: Copy truststore (all.jks), for example, '/etc/security/serverKeys/all.jks' of the remote Ambari server to Views server. Stop Ambari Server on Views Server ambari-server stop
Setup truststore for Ambari Views Server by running ambari-server security and choosing option 4 ambari-server setup-security
Using python /usr/bin/python
Security setup options...
===========================================================================
Choose one of the following options:
[1] Enable HTTPS for Ambari server.
[2] Encrypt passwords stored in ambari.properties file.
[3] Setup Ambari kerberos JAAS configuration.
[4] Setup truststore.
[5] Import certificate to truststore.
===========================================================================
Enter choice, (1-5):4
Do you want to configure a truststore [y/n] (y)? y
TrustStore type [jks/jceks/pkcs12] (jks):jks
Path to TrustStore file :/etc/security/serverKeys/all.jks
Password for TrustStore:
Re-enter password:
Ambari Server 'setup-security' completed successfully.
Start Ambari server on the Views server ambari-server start
... View more
Labels: