@Rahul P Could you please point me to the doc which says we can use spark in hive as execution engine? AFAIK we don't have option directly to set spark execution in hive. What is new is a HiveWarehouseConnector for Spark. Since all the tables in Hive will be transactional form HDP3.0, A HiveWarehouseConnector was introduced in spark to access hive tables. Ref: https://docs.hortonworks.com/HDPDocuments/HDP3/HDP-3.0.0/migrating-data/content/hive_hivewarehouseconnector_for_handling_apache_spark_data.html ... View more

I don't think we have a way to write a .xslx file, However you can write csv or tsv which are compatible with excel. ... View more

Could you please add more details of the issue? ... View more

@Bhushan Kandalkar So the issue is with how python returns the os name. You can see the full details in this SO thread. If you want a new python version you can use anaconda and install the python in another path and leave the default one as it is. ... View more

@Bhushan Kandalkar It seems the OS type is not supported. Agent os type: debianjessie/sid 18Jul201807:33:54,768 WARN [qtp-ambari-agent-82]HeartBeatHandler:387-Received registration request from host withnot supported os type, hostname=hadmgrndcc03-1.lifeway.org, serverOsType=ubuntu14, agentOsType=debianjessie/sid ... View more

@Luiz Fernando Lacerda Prina As per the jira it should be configurable. Please refer below from hbase official doc. ""Recent versions of HBase also support setting time to live on a per cell basis. See HBASE-10560 for more information. Cell TTLs are submitted as an attribute on mutation requests (Appends, Increments, Puts, etc.) using Mutation#setTTL. If the TTL attribute is set, it will be applied to all cells updated on the server by the operation. There are two notable differences between cell TTL handling and ColumnFamily TTLs: Cell TTLs are expressed in units of milliseconds instead of seconds. A cell TTLs cannot extend the effective lifetime of a cell beyond a ColumnFamily level TTL setting.""" ... View more

@Mukesh Chouhan In order to use the jars present in local filesystem. Please follow below. 1. Place the jars in a directory on livy node and add the directory to `livy.file.local-dir-whitelist`.This configuration should be set in livy.conf. 2. Add all the required jars to "jars" field in the curl command, note it should be added in URI format with "file" scheme, like "file://<livy.file.local-dir-whitelist>/xxx.jar". ... View more

@Sundar Lakshmanan "sort" was for the requirement this is mentioned in the question details. You can use the command which @rguruvannagari has mentioned in the above comment to sort with the date (3rd column). ... View more