29 projects tagged "storage"

No download Website Updated 04 Jan 2013 Bitvec

Screenshot
Pop 12.33
Vit 22.62

Bitvec is a PHP implementation of bit vectors using SplFixedArray for economy of storage.

Download Website Updated 21 Feb 2013 Zfswatcher

Screenshot
Pop 48.84
Vit 1.00

Zfswatcher is ZFS storage pool monitoring and notification daemon. It periodically inspects the zpool status and sends configurable notifications on status changes such as disk failures. It also controls the disk enclosure LEDs. There is an embedded Web interface for displaying status and logs.

Download Website Updated 23 May 2013 UnQLite

Screenshot
Pop 46.70
Vit 19.32

UnQLite is a in-process software library which implements a self-contained, serverless, zero-configuration, transactional NoSQL database engine.It is a document store database similar to MongoDB, Redis, CouchDB, etc. as well a standard key/value store similar to BerkeleyDB, LevelDB, etc. It reads and writes directly to ordinary disk files. A complete database with multiple collections is contained in a single disk file. The database file format is cross-platform, and you can freely copy a database between 32-bit and 64-bit systems or between big-endian and little-endian architectures.

No download No website Updated 17 Dec 2013 Concerted

Screenshot
Pop 30.56
Vit 12.81

Concerted is a highly scalable multivariate in-memory data storage library. It has built in support for multivariate queries and performs well over many styles of workloads. The data is read and stored in various data structures, and the data from data structures written to disk. It is fully ACID compliant, has APIs that abstract details from the user, and provides an easy to use interface. Many different types of indexes are provided along with various systems that provide access for data analytics.

No download No website Updated 22 Dec 2013 btier

Screenshot
Pop 25.55
Vit 12.60

btier is a Linux kernel module that creates an auto tiering block device. It can be used to aggregate various types of storage into a virtual block device. btier will automatically optimize data placement on the underlying devices according to a policy that can be set. The size of a btier device is equal to the combined size of all block devices that were assigned to it. Only a small amount of space is used to store the metadata of the device. A btier device can contain up to 16 physical devices or files. Next to the built-in data migration engine, btier also provides an user space API the allows user to write custom data migration engines. Python, C, and bash example code is included. btier can use raw devices or (sparse) files (even hard mounted NFS) as part of the tiering device. The last tier can therefore reside on a deduplicating or compressing filesystem when needed. The devices that are used with btier should be redundant, since a btier device will lose all data when one of the underlying devices is lost. The performance of btier is determined by the devices that are used for the first tier. It is known to scale up to 130k IOPS with a RAID1 that consisted of modern PCIe SSD's. btier has support for SSD trim / discard, and can be configured in writeback or writethrough mode.

No download No website Updated 24 Dec 2013 io-util

Screenshot
Pop 20.52
Vit 12.54

io-util is a small, scalable Java library for slicing and dicing fixed width tables on disk. The objective is to provide reusable blocks of code for building efficient, custom binary data stores. It allows you to build, search, and maintain a large, externally stored, fixed width, sorted table. The library user specifies the row width (in bytes), a row comparison function (which implicitly defines any given row's key), and an optional delete codec.

Download Website Updated 08 May 2014 Skylable SX

Screenshot
Pop 150.00
Vit 2.17

Skylable SX is a reliable, powerful, fully distributed cluster solution for your data storage needs. It can aggregate the disk space available on multiple servers and merge it into a single storage system. The cluster makes sure that your data is always replicated over multiple nodes (the exact number of copies is defined by the sysadmin) and synchronized. It has built-in support for deduplication, client-side encryption, on-the-fly compression, and much more.

No download No website Updated 10 Apr 2014 Catharsis.NET.Repository

Screenshot
Pop 57.17
Vit 7.07

Catharsis.NET.Repository is a library that provides an abstraction over persistent data storages by introducing common repository pattern interfaces over popular ORM frameworks (NHibernate, Entity Framework, LINQ2SQL).

No download No website Updated 14 May 2014 LibreS3

Screenshot
Pop 127.14
Vit 2.01

LibreS3 is a robust open source implementation of the Amazon S3 service, supporting a subset of the S3 REST API. Standard S3 client libraries and tools (for example python-boto, s3cmd, DragonDisk, etc.) can be used to access it. LibreS3 uses Skylable SX as the storage backend, which automatically provides data deduplication and replication.

Screenshot

Project Spotlight

cdrtools

A tool for creating disk-at-once and track-at-once CDs, DVDs, and BluRays.

Screenshot

Project Spotlight

taccGL

A Canvas Library for GPU accelerated 3D/2D HTML animations.