real-time

Delivering Scalable Self-Service Analytics

Within 48 hours of launching Google Analytics as a free product, virtually all of Google’s servers crashed. Eric Schmidt called this Google’s “most successful disaster.” Why would a free product, whose hardware requirements melted down a datacenter, be worth it? Wesley Chan, the creator of Google Analytics, later said that, “Google Analytics generates about three billion dollars in extra revenue,” as noted in Steven Levy’s book, In The Plex. Google Analytics allowed Google’s...


Image Recognition at the Speed of Memory Bandwidth

MemSQL is a real-time data warehouse and a perfect system for large scale operational analytics. MemSQL provides millisecond response times for analytical queries and is a part of the critical path for real-time applications. We often hear from our customers that they want to do various types of artificial intelligence (AI) and machine learning (ML) model evaluations for IoT data, as well as imagery, in real time. A good example of this is when you need to find similar images in a large corpus...


hybrid cloud

The Real-Time Data Warehouse for Hybrid Cloud

As companies move to the cloud, the ability to span on-premises and cloud deployments remains a critical enterprise enabler. In this post, we’ll review the basics of a hybrid cloud model for MemSQL deployments to fit conventional and future needs. MemSQL Background MemSQL is a real-time data warehouse optimized for hybrid cloud deployments, and excels at operational use cases. MemSQL users are drawn to the ability to load and persist live data at petabyte scale while simultaneously querying...


real-time data warehousing

Real-Time Data Warehousing for the Real-Time Economy

In the age of manual decision making based on predictable data formats, data feeds, and batch processing times, enterprise businesses stayed current with ad hoc analyses and periodic reports. To generate analyses and reports, businesses relied on the traditional data warehouse. Using extraction, transformation, and load batch processes, the traditional data warehouse standardized disparate data into normalized schemas and pre-computed cubes. With the data shaped into pre-configured dimensions...


The Analytics Race Amongst The World's Largest Companies

The Analytics Race Amongst The World’s Most Valuable Companies Data is fueling the world’s most valuable companies. Today the list is topped by Apple, Google, Microsoft, Amazon, and Facebook. These top companies harness data to drive outsized value. While the companies are unique, they share a more common approach to analytics than you might expect. The Rapid Rise of Data Capture for Analytics In a short span, entire industries have been born that didn’t exist previously. Each of these...


real-time analytics at UBER

Video: Real-Time Analytics at UBER Scale

At Strata+Hadoop World, James Burkhart, technical lead on real-time data infrastructure at Uber, shared how Uber supports millions of analytical queries daily across real-time data with Apollo, Uber’s internal analytics querying language. James covers architectural decisions and lessons learned from building an exactly-once ingest pipeline that captures raw events across in-memory row storage and on-disk columnar storage. He also details how Uber uses a custom metalanguage and query layer by...


real-time nano marketing

Real-Time and The Rise of Nano-Marketing

The tracking and targeting of our online lives is no secret. Once we browse to a pair of shoes on a website, we are reminded about them in a retargeting campaign. Lesser known efforts happen behind the scenes to accumulate data and scan through it in realtime, delivering the perfect personalized campaign. Specificity and speed are converging to deliver nano-marketing. If you are a business leader, you’ll want to stay versed in these latest approaches. If not, as a consumer, you’ll likely...


big data changing

From Big to Now: The Changing Face of Data

Data is changing. You knew that. But the dialog over the past 10 years around big data and Hadoop is rapidly moving to data and real-time. We have tackled how to capture big data at scale. We can thank the Hadoop Distributed File System for that, as well as cloud object stores like AWS S3. But we have not yet tackled the instant results part of big data. For that we need more. But first, some history. Turning Point for the Traditional Data Warehouse Internet scale workloads that emerged in the...


ml facial recognition

Machines and the Magic of Fast Learning (Strata Keynote Recording)

How can big data and machine learning be used for good? In our keynote at Strata+Hadoop World, MemSQL CEO Eric Frenkiel shared how we are working with Thorn to provide a new approach to machine learning and real-time image recognition to combat child exploitation. About Thorn Thorn partners across the technology companies and government organizations to combat predatory behavior, rescue victims, and protect vulnerable children. Thorn has to sift through a massive amount of images daily. Images...


High-Speed Ingest

Guest Post: Real-Time Big Data Ingestion with Meterial

This post originally appeared on the Myntra Engineering Blog. Learn how Myntra gained real-time insights on rapidly growing data using their new processing and reporting framework. Background I got an opportunity to work extensively with big data and analytics in Myntra. Data Driven Intelligence being one of the core values at Myntra, so crunching and processing data and reporting meaningful insights for the company is of utmost importance. Everyday millions of users visit Myntra on our App...