top button
Flag Notify
    Connect to us
      Site Registration

Site Registration

Hadoop: How Client communicates with HDFS?

+1 vote
435 views
Hadoop: How Client communicates with HDFS?
posted Dec 29, 2014 by Amit Kumar Pandey

Share this question
Facebook Share Button Twitter Share Button LinkedIn Share Button

1 Answer

0 votes

Client communicates with HDFS using Hadoop HDFS API.

Client applications talk to the NameNode whenever it wish to locate a file, or when it want to add/copy/move a file on HDFS. The NameNode responds the successful requests by returning a list of relevant DataNode servers. Client applications can talk directly to a DataNode, once the NameNode has provided the location of the data.

answer Dec 30, 2014 by Salil Agrawal
Similar Questions
+2 votes

Is there a way to mount HDFS directly on a Linux and Windows client? I believe I read something about there being some limitations, but that there is possibly a FUSE solution. Any information on this (with links to a how-to) would be greatly appreciated.

0 votes

The reason behind this is I want to have my custom user who can create anything on the entire hdfs file system (/).
I tried couple of links however, none of them were useful. Is there any way by adding/modifying some property tags I can do that ?

+2 votes

YARN application would benefit from maximal bandwidth on HDFS reads. But I'm unclear on how short-circuit reads are enabled. Are they on by default?

Can our application check programmatically to see if the short-circuit read is enabled?

0 votes

Our hadoop cluster is using HDFS Federation, but when use the following command to report the HDFS status

$ ./hdfs dfsadmin -reportreport: FileSystem viewfs://nsX/ is not an HDFS file system
Usage: hdfs dfsadmin [-report] [-live] [-dead] [-decommissioning]

It gives me the following message that viewfs is NOT HDFS filesystem. Then how can I proceed to report the hdfs status

+2 votes

Does anyone know if the NFS HDFS gateway is currently supported on secure clusters using Kerberos for Hadoop 2.2.0? We are using HDP 2.0 and looking to use NFS gateway

...