Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

How to HDFS access via C#

How to HDFS access via C#

Method: 1

- Import CSV file into HBase (using Importtsv)
- Perform aggregation results into HBase using Map-Reduce Job.
- Save Map-Reduce job results as CSV file into HDFS
- Access CSV file into C# application (Windows)

*There is no manual intervention on above tasks

Method: 2

- Import CSV file into HBase (using Importtsv)
- Perform aggregation results into HBase using Map-Reduce Job.
- Save Map-Reduce job results as CSV file into HDFS
- Import output CSV file into SQL server
- Access SQL server in C# application.

Questions:

1. Is that possible to access Ubuntu HDFS files in C# application?
2. Method 1 or Method 2 which is one better (or any other methods are greatly appreciated). (I prefer Method 1 Because We can able to cut down import timing from CSV file into SQL) ?


Kindly help me i am little bit confusing now.

1 REPLY 1

Re: How to HDFS access via C#

Master Guru
There is no official C# library that can talk to HDFS, but checkout https://code.msdn.microsoft.com/windowsdesktop/Hadoop-Net-HDFS-File-Access-18e9bbee perhaps. It may just work with CDH as well, given HDFS has had wire compatibility for a while now.