Good to know @Mohammad Shamim! Please if the issue is solved, I'd kindly ask you to accept the answer. This will help the other HCC users to find the best answer faster and will encourage the other users to keep doing a good job as well 🙂 ... View more

Hi @Mohammad Shamim! Could you confirm if the user has permission on that directory? or is there any space quota set? Otherwise, try to enable the debug for the logs: hive --hiveconf hive.root.logger=DEBUG,console Hope this helps! ... View more

Hello @Nilesh! Did you made any override to the staging_trading_volume-0 topic? If so, what was it? E.g. [root@node1 bin]# ./kafka-topics.sh --zookeeper node2:2181,node3:2181,node1:2181 --topic fake-topic --partitions 3 --replication-factor 3 --create Created topic "fake-topic". [root@node1 bin]# ./kafka-configs.sh --zookeeper node2:2181,node3:2181,node1:2181 --entity-type topics --entity-name fake-topic --add-config compression.type=snappy --alter Completed Updating config for entity: topic 'fake-topic'. [root@node1 bin]# ./kafka-configs.sh --zookeeper node2:2181,node3:2181,node1:2181 --entity-type topics --entity-name fake-topic --describe Configs for topic 'fake-topic' are compression.type=snappy In the case above the kafka-configs will only show the parameters changed for the topics at the client level, at the "global" level those are only visible at the broker configuration (server.properties or ambari). Hope this helps! ... View more

Hello @Nandan B R! Maybe the sqoop options work in this case, but, I didn't test it. https://sqoop.apache.org/docs/1.4.2/SqoopUserGuide.html#_using_options_files_to_pass_arguments Another way would be to use shell variables and create a script which replaces the --query value by $variable. Or you can try the sqoop 2 using the JDBC Conn https://sqoop.apache.org/docs/1.99.7/user/connectors/Connector-GenericJDBC.html Hope this helps! ... View more

Good to know @Mani! I'd kindly ask you, if you found the answer helpful and did answer your question completely, please accept this as an answer. This will encourage other HCC users to keep doing a good job, hence they will find the answer faster by just searching for the "best answer". Thanks! 🙂 ... View more

Hello @Shane B! Thanks for the words, but you know, I'm just a humble guy trying to help here, but I appreciate it 😄 I'm not a hive specialist, but, looking at the apache hive, you may find something on these links: https://github.com/apache/hive/blob/cacb1c09574c89ac07fcffc0b8c3fad18e283aec/serde/src/java/org/apache/hadoop/hive/serde2/avro/AvroSerDe.java https://github.com/apache/hive/blob/ae008b79b5d52ed6a38875b73025a505725828eb/serde/src/java/org/apache/hadoop/hive/serde2/avro/AvroSerializer.java https://github.com/apache/hive/blob/ae008b79b5d52ed6a38875b73025a505725828eb/serde/src/java/org/apache/hadoop/hive/serde2/avro/AvroDeserializer.java https://github.com/apache/hive/blob/ff67cdda1c538dc65087878eeba3e165cf3230f4/serde/src/java/org/apache/hadoop/hive/serde2/avro/AvroObjectInspectorGenerator.java https://github.com/apache/hive/blob/c2940a07cf0891e922672782b73ec22551a7eedd/ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java Hope this helps! ... View more

Hello @Anjali Shevadkar! Take a look at the comment made by @Sindhu, seems you're hitting this issue https://community.hortonworks.com/content/supportkb/171945/errordag-submit-failed-due-to-invalid-tasklaunchcm.html Hope this helps 🙂 ... View more

Hello @Anjali Shevadkar! Not sure If I get it, but AFAIK you can't use OFFSET clause in Hive. If you're using a version >= than hive 2.0, you're able to use this feature: https://cwiki.apache.org/confluence/display/Hive/LanguageManual+Select#LanguageManualSelect-LIMITClause Otherwise using a window function like (row number) should work to do this. Ps: I made a quick search here, and there'an incubating project called HiveMall, they have a function related to rowid. https://github.com/apache/incubator-hivemall/blob/a31d0aab3f419812cae7da426f6dcdc9a7be72b5/docs/gitbook/tips/rowid.md Hope this helps! ... View more

Hi @Gaurang Shah! Did you try to execute beeline with your user? beeline -u 'jdbc:hive2://HS2_SERVER:10000/default' -n gaurang.shah !sh ls -lh /home/gaurang.shah/ Hope this helps ... View more

Hi @Anji Raju! In this case, you'll need to use the LATERAL VIEW to use the inline function with another column. hive> select c.*,'Vini' from default.customer_details lateral view inline(Customers.customer_details) c; OK Anji Raju 06/24/1278 14 duck st boston OH USA Vini Jeet Anu 06/24/1279 tuttles groove denver CA USA Vini Test1 Test_last 006/24/1280 Sleek street cali MA USA Vini Time taken: 0.094 seconds, Fetched: 3 row(s) Hope this helps! ... View more