https://community.cloudera.com/t5/Archives-of-Support-Questions/Improving-performance-on-spark-for-hive/m-p/211067#M69421 <P>Hi <A rel="user" href="https://community.cloudera.com/users/39249/gayathrimtechcse.html" nodeid="39249">@Gayathri Devi</A>,</P><P>You can use <STRONG>spark sql</STRONG> to <STRONG>get data</STRONG> from <STRONG>Hive table</STRONG> and create a dataframe.</P><P>There is another best way to get data from HBase table, <STRONG>in this method we are going to construct HbaseRDD from scratch and this is more scalable,better fit for spark catalyst engine</STRONG></P><P>You can refer to the below links how to get data directly from HBase without using Hive table.</P><P><A href="https://hortonworks.com/blog/spark-hbase-connector-a-year-in-review/" target="_blank">https://hortonworks.com/blog/spark-hbase-connector-a-year-in-review/</A></P><P><A href="https://hortonworks.com/blog/spark-hbase-dataframe-based-hbase-connector/" target="_blank">https://hortonworks.com/blog/spark-hbase-dataframe-based-hbase-connector/</A></P><P><A href="https://github.com/hortonworks-spark/shc" target="_blank">https://github.com/hortonworks-spark/shc</A></P> Wed, 11 Oct 2017 20:08:45 GMT Shu_ashu 2017-10-11T20:08:45Z https://community.cloudera.com/t5/Archives-of-Support-Questions/Improving-performance-on-spark-for-hive/m-p/211066#M69420 Wed, 11 Oct 2017 17:36:11 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/Improving-performance-on-spark-for-hive/m-p/211066#M69420 Gayathridevi 2017-10-11T17:36:11Z https://community.cloudera.com/t5/Archives-of-Support-Questions/Improving-performance-on-spark-for-hive/m-p/211067#M69421 <P>Hi <A rel="user" href="https://community.cloudera.com/users/39249/gayathrimtechcse.html" nodeid="39249">@Gayathri Devi</A>,</P><P>You can use <STRONG>spark sql</STRONG> to <STRONG>get data</STRONG> from <STRONG>Hive table</STRONG> and create a dataframe.</P><P>There is another best way to get data from HBase table, <STRONG>in this method we are going to construct HbaseRDD from scratch and this is more scalable,better fit for spark catalyst engine</STRONG></P><P>You can refer to the below links how to get data directly from HBase without using Hive table.</P><P><A href="https://hortonworks.com/blog/spark-hbase-connector-a-year-in-review/" target="_blank">https://hortonworks.com/blog/spark-hbase-connector-a-year-in-review/</A></P><P><A href="https://hortonworks.com/blog/spark-hbase-dataframe-based-hbase-connector/" target="_blank">https://hortonworks.com/blog/spark-hbase-dataframe-based-hbase-connector/</A></P><P><A href="https://github.com/hortonworks-spark/shc" target="_blank">https://github.com/hortonworks-spark/shc</A></P> Wed, 11 Oct 2017 20:08:45 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/Improving-performance-on-spark-for-hive/m-p/211067#M69421 Shu_ashu 2017-10-11T20:08:45Z