More about data fusion...

In our last post, we were discussing how Qbase is able to handle data fusion in realtime. The secret is in how we use RAM (Random Access Memory). The indexes we create are highly compressed, but contain all required key fields. The in-memory indexes can then be distributed across a huge number of large memory servers. Scoring algorithms are all absolute, based on a ‘0-to-1’ continuum of values which allow queries to be efficiently fanned out to hundreds of servers and then collated back into a single ranked answer set. Qbase personnel have developed systems where data from thousands of sources were fused into a collection of approximately eight billion records, all stored in RAM. Response time averaged less than 0.25 seconds for core queries. Data was distributed across 150 large memory machines totaling nearly five terabytes of physical memory. In fact, Qbase projects involving geospatial imagery currently process and store over 200 terabytes of data and support expansion to 12 petabytes. Improve your decision response time and results with Qbase.