real-time

Driving Relevance with Real-Time and Historical Data

Driving Relevance with Real-Time and Historical Data

As technology weaves into our daily lives, our expectations of it continue to increase. Consider mobile devices and location information. Recently 451 Research released data that 47% of consumers would like to receive personalized information based on immediate location. Source: 451 Research Addressing this requires the ability to track real-time and historical data and to put both in context. Let’s examine that spectrum. Incoming High Value Content With a focus on ‘immediate,’ the highest...


Lambda Architecture

Real-Time Stream Processing Architecture with Hadoop and MemSQL

With Hadoop Summit Europe underway today, we wanted to share some thoughts on how MemSQL fits in to the Hadoop ecosystem. While MemSQL and Hadoop are both data stores, they fill different roles in the data processing and analytics stack. The Hadoop Distributed File System (HDFS) enables businesses to store large volumes of immutable data, but by design, it is used almost exclusively for batch processing. Moreover, newer execution frameworks, that are faster and storage agonistic, are...


high-speed-counters

Turn Up the Volume With High-Speed Counters

Scaling tends to make even simple things, like counting, seem difficult. In the past, businesses used specialized databases for particular tasks, including high-speed, high-throughput event counters. Due to the constraints of legacy systems, some people still assume that relational databases cannot  handle high-throughput tasks at scale. However, due to advances like in-memory storage, high-throughput counting no longer requires a specialized, single-purpose database. Why do we even need...


MemSQL Does Oracle’s Own Demo Ten Times As Fast, Sixty Times Cheaper

In preparation for Open World, I asked some of our engineers to recreate a demo that Oracle has been using over the last year to show off their “in-memory option.” It’s impressive to look at: the demo shows the database searching through billions of records from Wikipedia search trend data for popular terms in less than a second. The thing about Oracle’s demo is it runs on a gigantically expensive server. In fact it is the biggest one they have at 32TB of RAM and hundreds of CPU cores....