real-time

real-time data warehousing

Real-Time Data Warehousing for the Real-Time Economy

In the age of manual decision making based on predictable data formats, data feeds, and batch processing times, enterprise businesses stayed current with ad hoc analyses and periodic reports. To generate analyses and reports, businesses relied on the traditional data warehouse. Using extraction, transformation, and load batch processes, the traditional data warehouse standardized disparate data into normalized schemas and pre-computed cubes. With the data shaped into pre-configured dimensions...


The Analytics Race Amongst The World's Largest Companies

The Analytics Race Amongst The World’s Most Valuable Companies Data is fueling the world’s most valuable companies. Today the list is topped by Apple, Google, Microsoft, Amazon, and Facebook. These top companies harness data to drive outsized value. While the companies are unique, they share a more common approach to analytics than you might expect. The Rapid Rise of Data Capture for Analytics In a short span, entire industries have been born that didn’t exist previously. Each of these...


real-time analytics at UBER

Video: Real-Time Analytics at UBER Scale

At Strata+Hadoop World, James Burkhart, technical lead on real-time data infrastructure at Uber, shared how Uber supports millions of analytical queries daily across real-time data with Apollo, Uber’s internal analytics querying language. James covers architectural decisions and lessons learned from building an exactly-once ingest pipeline that captures raw events across in-memory row storage and on-disk columnar storage. He also details how Uber uses a custom metalanguage and query layer by...


real-time nano marketing

Real-Time and The Rise of Nano-Marketing

The tracking and targeting of our online lives is no secret. Once we browse to a pair of shoes on a website, we are reminded about them in a retargeting campaign. Lesser known efforts happen behind the scenes to accumulate data and scan through it in realtime, delivering the perfect personalized campaign. Specificity and speed are converging to deliver nano-marketing. If you are a business leader, you’ll want to stay versed in these latest approaches. If not, as a consumer, you’ll likely...


big data changing

From Big to Now: The Changing Face of Data

Data is changing. You knew that. But the dialog over the past 10 years around big data and Hadoop is rapidly moving to data and real-time. We have tackled how to capture big data at scale. We can thank the Hadoop Distributed File System for that, as well as cloud object stores like AWS S3. But we have not yet tackled the instant results part of big data. For that we need more. But first, some history. Turning Point for the Traditional Data Warehouse Internet scale workloads that emerged in the...


ml facial recognition

Machines and the Magic of Fast Learning (Strata Keynote Recording)

How can big data and machine learning be used for good? In our keynote at Strata+Hadoop World, MemSQL CEO Eric Frenkiel shared how we are working with Thorn to provide a new approach to machine learning and real-time image recognition to combat child exploitation. About Thorn Thorn partners across the technology companies and government organizations to combat predatory behavior, rescue victims, and protect vulnerable children. Thorn has to sift through a massive amount of images daily. Images...


High-Speed Ingest

Guest Post: Real-Time Big Data Ingestion with Meterial

This post originally appeared on the Myntra Engineering Blog. Learn how Myntra gained real-time insights on rapidly growing data using their new processing and reporting framework. Background I got an opportunity to work extensively with big data and analytics in Myntra. Data Driven Intelligence being one of the core values at Myntra, so crunching and processing data and reporting meaningful insights for the company is of utmost importance. Everyday millions of users visit Myntra on our App...


How to Move Analytics to Real Time

How to Move Analytics to Real-Time

3x Spend Increase “Between 2016 and 2019, spending on real-time analytics will grow three times faster than spending on non-real-time analytics.” Every organization uses some form of analytics to monitor and improve their business. The growth of data has increased the impact of analytics and is a critical ingredient for delivering a successful digital business strategy. Companies are using more real-time analytics, because of the pressure to increase the speed and accuracy of...


451 Research Webcast: In-Memory Computing Market Predictions 2017

Adoption of in-memory technology solutions is happening faster than ever. This stems from a three pronged demand – first, a greater number of users, analysts, and businesses need access to data. Second, the number of transactions is increasing globally, so companies need faster ingest and analytics engines. Finally, performance inconsistencies are the nail in the coffin for companies competing in the on-demand economy – these enterprises need the responsiveness in-memory technology...


The State of Real Time for Property Insurers

The State of Real Time for Property and Casualty Insurers

In some industries, a hesitance remains in recognizing the commodification forces of real-time solutions. These industries often rely on orthodox tenets as barriers to marketplace entry, such as regulatory compliance, traditional value propositions, brand recognition, and market penetration. The term “ripe for disruption” often characterizes these industries and their respective leaders. Arguably, an illustrative industry in the midst of responding to commodification, adapting to real-time...