Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

How can I connect HDFS through .NET ?

SOLVED Go to solution

How can I connect HDFS through .NET ?

Contributor

How can I connect HDFS through .NET ?

I want to pass some value via .NET, search the value in HDFS files and return the file name based on matching value.

If not possible to connect HDFS directly through .NET, then can I connect HIVE using ODBC connection throught .NET ?

 

Using CDH 5.3.3

 

Please suggest.

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: How can I connect HDFS through .NET ?

Master Guru
The Cloudera ODBC connector is available for Windows, and .NET does support ODBC: http://www.cloudera.com/downloads/connectors/hive/odbc.html

There's no direct client for HDFS in .NET, but HDFS offers a REST API via its WebHDFS component. This REST API is documented at http://archive.cloudera.com/cdh5/cdh/5/hadoop/hadoop-project-dist/hadoop-hdfs/WebHDFS.html, and you can use your .NET HTTP client to make use of it.
1 REPLY 1
Highlighted

Re: How can I connect HDFS through .NET ?

Master Guru
The Cloudera ODBC connector is available for Windows, and .NET does support ODBC: http://www.cloudera.com/downloads/connectors/hive/odbc.html

There's no direct client for HDFS in .NET, but HDFS offers a REST API via its WebHDFS component. This REST API is documented at http://archive.cloudera.com/cdh5/cdh/5/hadoop/hadoop-project-dist/hadoop-hdfs/WebHDFS.html, and you can use your .NET HTTP client to make use of it.