Support Questions

Find answers, ask questions, and share your expertise

How can I connect HDFS through .NET ?

avatar
Contributor

How can I connect HDFS through .NET ?

I want to pass some value via .NET, search the value in HDFS files and return the file name based on matching value.

If not possible to connect HDFS directly through .NET, then can I connect HIVE using ODBC connection throught .NET ?

 

Using CDH 5.3.3

 

Please suggest.

1 ACCEPTED SOLUTION

avatar
Mentor
The Cloudera ODBC connector is available for Windows, and .NET does support ODBC: http://www.cloudera.com/downloads/connectors/hive/odbc.html

There's no direct client for HDFS in .NET, but HDFS offers a REST API via its WebHDFS component. This REST API is documented at http://archive.cloudera.com/cdh5/cdh/5/hadoop/hadoop-project-dist/hadoop-hdfs/WebHDFS.html, and you can use your .NET HTTP client to make use of it.

View solution in original post

1 REPLY 1

avatar
Mentor
The Cloudera ODBC connector is available for Windows, and .NET does support ODBC: http://www.cloudera.com/downloads/connectors/hive/odbc.html

There's no direct client for HDFS in .NET, but HDFS offers a REST API via its WebHDFS component. This REST API is documented at http://archive.cloudera.com/cdh5/cdh/5/hadoop/hadoop-project-dist/hadoop-hdfs/WebHDFS.html, and you can use your .NET HTTP client to make use of it.