Datadir on HDFS : Software reason why 1MB Blocksize is fucking Stupid
HDFS (Hadoop File System) is open source distributed fault tolerant filesystem. Its easily scalable by adding more HDFS nodes. Eg: your current HDFS capacity is 3TB. You can easily add 3 raspi of 1TB each to give total capacity of 6TB.
In marketing term this is effectively unlimited linearly scalable storage. The raspi hardware doesn't need to improve for you to increase your storage capacity.
HDFS is proven tech. Its the open source equivalent of Google's GFS. Its free to use. It can be used by businesses big and small. Large enterprises can add massive servers to their HDFS storage. Enthusiasts can add Raspi to extend their HDFS storage.
How does this relate to Bitcoin? When running a Bitcoin node your datadir is generally on the local filesystem. If instead of specifying the local filesystem you specified HDFS, storage is no longer an issue. In fact, storage was never a technical area of concern.
[link] [comments]