Apache Spark

Spark Summit 2017

The Machine Learning Track at Spark Summit

Spark Summit 2017 kicks off in less than two weeks with a program that includes more than 175 talks led by top experts in the Apache Spark ecosystem. From developer tutorials and research demos to real-world case studies and data science applications, these 5 sessions will take your machine learning skills to the next level. 5 Machine Learning talks to check out at Spark Summit 2017: Apache Spark MLlib’s Past Trajectory and New Directions (Joseph Bradley, Databricks) – This talk...


Durable Storage for Real-Time Analytics with MemSQL and Spark

Apache Spark has made a name for itself as a powerful data processing engine for transforming large datasets in a swift, distributed manner. After using Spark to complete such transformations, you often want to store your data in a persistent and efficient format for long-term access. The common solution of storing data in HDFS solves the issue of persistence, but suffers efficiency issues as a result of the HDFS disk-based architecture. The MemSQL Spark Connector solves both of these issues by...


Video: Building the Ideal Stack for Real-Time Analytics

Building a real-time application starts with connecting the pieces of your data pipeline. To make fast and informed decisions, organizations need to rapidly ingest application data, transform it into a digestible format, store it, and make it easily accessible. All at sub-second speed. A typical real-time data pipeline is architected as follows: Application data is ingested through a distributed messaging system to capture and publish feeds. A transformation tier is called to distill...


Manage Case Study

How Manage Accelerated Data Freshness by 10x

Success in the mobile advertising industry is achieved by delivering contextual ads in the moment. The faster and more personalized a display ad, the better. Any delay in ad delivery means lost bids, revenue, and ultimately, customers. Manage, a technology company specializing in programmatic mobile marketing and advertising, helps drive mobile application adoption for companies like Uber, Wish, and Amazon. In a single day, Manage generates more than a terabyte of data and processes more than 30...