Reply
Highlighted
Contributor
Posts: 29
Registered: ‎05-11-2016
Accepted Solution

How can I connect HDFS through .NET ?

How can I connect HDFS through .NET ?

I want to pass some value via .NET, search the value in HDFS files and return the file name based on matching value.

If not possible to connect HDFS directly through .NET, then can I connect HIVE using ODBC connection throught .NET ?

 

Using CDH 5.3.3

 

Please suggest.

Posts: 1,903
Kudos: 435
Solutions: 307
Registered: ‎07-31-2013

Re: How can I connect HDFS through .NET ?

The Cloudera ODBC connector is available for Windows, and .NET does support ODBC: http://www.cloudera.com/downloads/connectors/hive/odbc.html

There's no direct client for HDFS in .NET, but HDFS offers a REST API via its WebHDFS component. This REST API is documented at http://archive.cloudera.com/cdh5/cdh/5/hadoop/hadoop-project-dist/hadoop-hdfs/WebHDFS.html, and you can use your .NET HTTP client to make use of it.