Author: Gary Orenstein

hybrid cloud

The Real-Time Data Warehouse for Hybrid Cloud

As companies move to the cloud, the ability to span on-premises and cloud deployments remains a critical enterprise enabler. In this post, we’ll review the basics of a hybrid cloud model for MemSQL deployments to fit conventional and future needs. MemSQL Background MemSQL is a real-time data warehouse optimized for hybrid cloud deployments, and excels at operational use cases. MemSQL users are drawn to the ability to load and persist live data at petabyte scale while simultaneously querying...


AI's Secret Weapon: The Data Corpus

As industries latch on to the rise of machine learning and artificial intelligence, we see firsthand that the key to success is often the data itself. While discussions on the latest algorithms and learning models capture mainstream attention, the real determining factor of a company’s success is its ability to leverage a corpus of data. Recently our CEO Eric Frenkiel delivered a talk on this topic, Machines and the Magic of Fast Learning. The premise was simple, and inspired by a discussion...


The Analytics Race Amongst The World's Largest Companies

The Analytics Race Amongst The World’s Most Valuable Companies Data is fueling the world’s most valuable companies. Today the list is topped by Apple, Google, Microsoft, Amazon, and Facebook. These top companies harness data to drive outsized value. While the companies are unique, they share a more common approach to analytics than you might expect. The Rapid Rise of Data Capture for Analytics In a short span, entire industries have been born that didn’t exist previously. Each of these...


real-time nano marketing

Real-Time and The Rise of Nano-Marketing

The tracking and targeting of our online lives is no secret. Once we browse to a pair of shoes on a website, we are reminded about them in a retargeting campaign. Lesser known efforts happen behind the scenes to accumulate data and scan through it in realtime, delivering the perfect personalized campaign. Specificity and speed are converging to deliver nano-marketing. If you are a business leader, you’ll want to stay versed in these latest approaches. If not, as a consumer, you’ll likely...


big data changing

From Big to Now: The Changing Face of Data

Data is changing. You knew that. But the dialog over the past 10 years around big data and Hadoop is rapidly moving to data and real-time. We have tackled how to capture big data at scale. We can thank the Hadoop Distributed File System for that, as well as cloud object stores like AWS S3. But we have not yet tackled the instant results part of big data. For that we need more. But first, some history. Turning Point for the Traditional Data Warehouse Internet scale workloads that emerged in the...


MemSQL Design Principles

Design Principles at MemSQL

At MemSQL, we believe that every company should have the opportunity to become a real-time enterprise. We believe that data drives business, and that data management performance leads to successful business results. Specifically related to our products, we believe in: The Need for Performance To compete in a 24×7 business world, companies must be able to ingest data quickly, execute low latency queries, and support a large number of analytics users and data volume, all at the same time. The...


ArcGIS, Spark & MemSQL Integration

This is a guest post by Mansour Raad of Esri. We were fortunate to catch up with him at Strata+Hadoop World San Jose. This post is replicated from Mansour’s Thunderhead Explorer blog ArcGIS, Spark & MemSQL Integration Just got back from the fantastic Strata + Hadoop 2017 conference where the topics ranged from BigData, Spark to lots of AI/ML and not so much on Hadoop explicitly, at least not in the sessions that I attended. I think that is why the conference is renamed Strata + Data from...


Jumping the Database S-Curve

Adaptation and Reinvention Long term success hinges on adaptation and reinvention, especially in our dynamic world where nothing lasts forever. Especially with business, we routinely see the rise and fall of products and companies. The long game mandates change, and the database ecosystem is no different. Today, megatrends of social, mobile, cloud, big data, analytics, IoT, and machine learning place us at a generational intersection. Data drives our digital world and the systems that shepherd...


SQL: The Technology That Never Left Is Back!

The Prelude The history of SQL, or Structured Query Language, dates back to 1970, when E.F. Codd, then of IBM Research, published a seminal paper titled, “A Relational Model of Data for Large Shared Data Banks.” Since then, SQL has remained the lingua franca of data processing, helping build the relational database market into a $36 billion behemoth. The Rise And Fall of NoSQL Starting in 2010, many companies developing datastores tossed SQL out with the bathwater after seeing the challenges...


Everything We’ve Known About Data Movement Has Been Wrong

Data movement remains a perennial obstacle in systems design. Many talented architects and engineers spend significant amounts of time working on data movement, often in the form of batch Extract, Transform, and Load (ETL). In general, batch ETL is the process everyone loves to hate, or put another way, I’ve never met an engineer happy with their batch ETL setup. In this post, we’ll look at the shift from batch to real time, the new topologies required to keep up with data flows, and the...