@sivakumar sudhakarannair girijakumari Step 1: Build geometry-api (this is a pre-requisite for the spatial framework for hadoop) clone this repository: https://github.com/Esri/geometry-api-java edit pom.xml to use Java 1.8, Hive 1.2 and Hadoop 2.7 save pom.xml and build with mvn Step 2: build spatial framework for hadoop clone this repository https://github.com/Esri/spatial-framework-for-hadoop edit pom.xml to use Java 1.8, Hive 1.2 and Hadoop 2.7 save pom.xml and build with mvn Build with ant is also supported, see build.xml. Some changes are necessary. ... View more

@sivakumar sudhakarannair girijakumari If you want the function to be available globally, across multiple sessions, you need to create a permanent function,e.g. create function ST_AsText as 'com.esri.hadoop.hive.ST_AsText'; You should issue "create function" statements via a global script. Assuming that you modified a function, in order to recreate it, you would need first to drop it. This script should be executed as part of Hive service start/restart such that functions will still be available. drop function ST_AsText as 'com.esri.hadoop.hive.ST_AsText'; ... View more

@sivakumar sudhakarannair girijakumari If you wish to use a function only during the active session, use temporary keyword in its creation statement. Examples: create temporary function ST_AsText as 'com.esri.hadoop.hive.ST_AsText'; create temporary function ST_Intersects as 'com.esri.hadoop.hive.ST_Intersects'; This is not specific for ESRI spatial functions. It works similarly for any user defined function (UDF) when invoked in Hive. ... View more

@sivakumar sudhakarannair girijakumari ESRI spatial framework for Hadoop could use to store geometry data as text or as json. For example, you can store the following MULTIPOLYGON data as text (string in Hive, for example) 'MULTIPOLYGON (((-158.91661716771827 10.33741051185143, -67.59825779273768 10.33741051185143,-67.59825779273768 53.55389082595917, -158.91661716771827 53.55389082595917, -158.91661716771827 10.33741051185143)))' If you wish to apply one of operations supported by ESRI framework for Hive, e.g. ST_Intersects, you need first to convert text to geometry using ST_GeomFromText function. Most of the ESRI spatial functions would require you to convert text to geometry first. ESRI spatial framework for Hive supports also json. The approach is similar. You need to convert json to geometry before applying a function like ST_Intersects. More details about JSON format here: https://github.com/Esri/spatial-framework-for-hadoop/wiki/JSON-Formats ... View more

@Yan Chen\ For example, I would use the API corresponding for the Hive version. Here is an example for 0.13, which I heavily relied on the following to do something somehow similar with what you are trying to do: https://hive.apache.org/javadocs/r0.13.1/api/metastore/org/apache/hadoop/hive/metastore/HiveMetaStoreClient.html https://hive.apache.org/javadocs/r0.13.1/api/metastore/org/apache/hadoop/hive/metastore/MetaStoreUtils.html I used some resources from here: http://www.javased.com/index.php?api=org.apache.hadoop.hive.metastore.api.MetaException Let me know if this helps or you need more help. ... View more

@Karthik Rajamanickam In embedded mode, the Collector will capture and write metrics to the local file system on the host where the Collector is running, not HDFS. As well, all the Collector runs in a single process on that host. If you are interested where the files, you could open your Ambari http://hostname:8080/#/main/services/AMBARI_METRICS/configs and check the general configs for Amabari Metrics. Usually, they go to: /var/log/ambari-metrics-collector I would suggest to use the existent API and a GET command looks like this: GET http://<ambari-metrics-collector>:6188/ws/v1/timeline/metrics?metricNames=AMBARI_METRICS.SmokeTest.FakeMetric&appId=amssmoketestfake&hostname=<hostname>&precision=seconds&startTime=1432075838000&endTime=1432075959000 More details here: https://cwiki.apache.org/confluence/display/AMBARI/Metrics+Collector+API+Specification ... View more