dfs + filesystem + storage

Ordina per: Data / Titolo / URL

MFS
MFS is a proven foundation of highly reliable storage systems. The file system designed for petabyte class clusters crunching mission critical data 24/7. MFS – unlimited and fault tolerant space for your files.
2009-06-08 to , , , , , , , , by lorello
Cleversafe.org
Cleversafe uses Cauchy Reed-Solomon Information Dispersal Algorithms (IDAs) to separate data into unrecognizable Data Slices and distribute them, via secure Internet connections, to multiple storage locations on a Dispersed Storage Network (dsNet).
2009-04-24 to , , , , , , , by lorello
Cassandra
a distributed storage system for managing structured data that is designed to scale to a very large size across many commodity servers, with no single point of failure. Reliability at massive scale is a very big challenge. At this scale, small and large components fail continuously. Cassandra manages the persistent state in the face of these failures drives the reliability and scalability of the software systems relying on this service.
2008-10-13 to , , , , , , by lorello
IBM GPFS (General Parallel File System)
The IBM General Parallel File System™ (GPFS™) is a high-performance scalable file management solution that provides fast, reliable access to a common set of file data from a single computer to hundreds of systems. GPFS integrates into your environment by bringing together mixed server and storage components to provide a common view to enterprise file data. GPFS provides online storage management, scalable access and integrated information lifecycle tools capable of managing petabytes of data and billions of files.
2008-09-16 to , , , , , , by lorello
Lustre
Lustre is a scalable, secure, robust, highly-available cluster file system. It is designed, developed and maintained by Sun Microsystems, Inc. The central goal is the development of a next-generation cluster file system which can serve clusters with 10,000's of nodes, provide petabytes of storage, and move 100's of GB/sec with state-of-the-art security and management infrastructure. Lustre runs on many of the largest Linux clusters in the world, and is included by Sun's partners as a core component of their cluster offering (examples include HP StorageWorks SFS, and the Cray XT3 and XD1 supercomputers). Today's users have also demonstrated that Lustre scales down as well as it scales up, and runs in production on clusters as small as 4 and as large as 25,000 nodes. The latest version of Lustre is always available from Sun Microsystems, Inc. Public Open Source releases of Lustre are available under the GNU General Public License. These releases are found here, and are used in production supercomputing environments worldwide. To be informed of Lustre releases, subscribe to the lustre-announce mailing list. Lustre development would not have been possible without funding and guidance from many organizations, including several U.S. National Laboratories, early adopters, and product partners.
2008-09-16 to , , , , , , by lorello
KFS - Kosmos Filesystem
Web-scale applications require a scalable storage infrastructure to process vast amounts of data. Kosmos filesystem is an open-source high performance distributed filesystem designed to meet such an infrastructure need: KFS is implemented in C++ using standard system components such as STL, boost libraries, aio, log4cpp. KFS is integrated with Hadoop and Hypertable. This enables applications bult on those systems to seamlessly use KFS as the underlying data store. KFS is deployed on Solaris and Linux platforms for storing web log data, crawler data, etc. Kosmos filesystem source code is released under the terms of the Apache License Version 2.0.
2008-09-15 to , , , , , , by lorello
Hadoop
[WWW] Hadoop is a framework for running applications on large clusters built of commodity hardware. The Hadoop framework transparently provides applications both reliability and data motion. Hadoop implements a computational paradigm named Map/Reduce, where the application is divided into many small fragments of work, each of which may be executed or reexecuted on any node in the cluster. In addition, it provides a distributed file system (HDFS) that stores data on the compute nodes, providing very high aggregate bandwidth across the cluster. Both Map/Reduce and the distributed file system are designed so that node failures are automatically handled by the framework.
2008-06-30 to , , , , , , , , by lorello

Precedente / Seguente / Pagina 1 di 1