HPCC (High Performance Computing Cluster) stores and processes large quantities of data, processing billions of records per second using massive parallel processing technology. Large amounts of data across disparate data sources can be accessed, analyzed, and manipulated in fractions of seconds. HPCC functions as both a processing and a distributed data storage environment capable of analyzing terabytes of information.
MapReduce-BitDew is an implementation of the MapReduce programming model proposed by Google for Internet Desktop Grids. Using MapReduce-BitDew, you can execute MapReduce applications on resources like Desktop PCs distributed on the Internet. MapReduce-BitDew features a firewall-friendly protocol, fault-tolerance, result-certification, 2-level schedulers, and more.
Splunk is an engine for machine data. Use Splunk to collect, index, and harness the fast moving machine data generated by all your applications, servers, and devices: physical, virtual, and in the cloud. Search and analyze all your real-time and historical data from one place. Splunking your machine data lets you troubleshoot problems and investigate security incidents in minutes, not hours or days. Monitor your end-to-end infrastructure to avoid service degradation or outages. Meet compliance mandates at lower cost. Correlate and analyze complex events spanning multiple systems. Gain new levels of operational visibility and intelligence for IT and the business.
Pythonect is an experimental general-purpose dataflow programming language based on Python. It provides both a visual programming language and a text-based scripting language. The text-based scripting language aims to combine the quick and intuitive feel of shell scripting with the power of Python. The visual programming language is based on the idea of a diagram with “boxes and arrows”.
UniModeling is a big data analytics tool for unified modeling and reasoning in outdoor and indoor spaces. It supports the construction of unified graph models of outdoor and indoor spaces and RFID deployments in these spaces. It enables probabilistic incorporation of RFID data, facilitating the tracking of moving objects and enables the search for them to be optimized. Also included are three reasoning applications that pertain to the positioning of RFID readers in outdoor and indoor spaces and the points of potential traffic (over)load in these spaces.
freeDatamap is a business intelligence tool that transforms raw data into meaningful information by providing a unique way to browse any kind of data. It is a Web application that provides the possibility to navigate into structured and unstructured data. With its unique algorithm, freeDatamap is able to create a tree structure from flat data. It takes a CSV file as input and produces a tree with raw or computed attributes for each node.
BitDew is a programmable environment for the management and distribution of data for grid, desktop grid, and cloud systems. It can easily be integrated into large scale computational systems such as XtremWeb, BOINC, Hadoop, Condor, Glite, Unicore, OpenStack, and Eucalyptus. It provides key P2P, grid, and cloud technologies (DHT, BitTorrent, Amazon S3, DropBox) and high level programming interfaces with a simple API for creating, accessing, storing, and moving data with ease, even in highly dynamic and volatile environments.