The Hadoop Distributed File System: Architecture and Design

http://lucene.apache.org
Posted by wensong 376 days ago



The Hadoop Distributed File System (HDFS) is a distributed file system designed to run on commodity hardware. It has many similarities with existing distributed file systems. However, the differences from other distributed file systems are significant. HDFS is highly fault-tolerant and is designed to be deployed on low-cost hardware. HDFS provides high throughput access to application data and is suitable for applications that have large data sets. HDFS relaxes a few POSIX requirements to enable streaming access to file system data. HDFS was originally built as infrastructure for the Apache Nutch web search engine project. HDFS is part of the Apache Hadoop project, which is part of the Apache Lucene project.

 

11 Comments | Trackback | Tags: filesystem cluster hadoop | Category: storage | Add this link to... | Tell a friend

 


Comments


Log in to comment or register here.


Who voted for this story