Support Questions
Find answers, ask questions, and share your expertise

Unable to move files from hdfs on HIVE server to localfs on Edge node

Explorer

Hello,

 

I am having HDP 3.1.4 cluster.

 

I have couple of hql scripts on the Edge node.

I am executing the hql scripts on Edge node.
Queries are getting processed on HIVE server but unable to move the processed files from HIVE server to the Edge server.

 

How to make sure that after processing, the files are moved from HDFS fs on HIVE server to  the Edge node? Thanks.

 

Regards,

Amey.

1 REPLY 1

Explorer

As a work around I copied the existing directory structure on the server running HIVE server service and that helped.

 

The query gets executed and the output is copied on HIVE server.
I copy the output manually to the Edge node for developers.

Not sure if there are any techniques so that we can copy the processed HDFS data directly on local fs of Edge node.