Author: Gary Orenstein

Jumping the Database S-Curve

Adaptation and Reinvention Long term success hinges on adaptation and reinvention, especially in our dynamic world where nothing lasts forever. Especially with business, we routinely see the rise and fall of products and companies. The long game mandates change, and the database ecosystem is no different. Today, megatrends of social, mobile, cloud, big data, analytics, IoT, and machine learning place us at a generational intersection. Data drives our digital world and the systems that shepherd...


SQL: The Technology That Never Left Is Back!

The Prelude The history of SQL, or Structured Query Language, dates back to 1970, when E.F. Codd, then of IBM Research, published a seminal paper titled, “A Relational Model of Data for Large Shared Data Banks.” Since then, SQL has remained the lingua franca of data processing, helping build the relational database market into a $36 billion behemoth. The Rise And Fall of NoSQL Starting in 2010, many companies developing datastores tossed SQL out with the bathwater after seeing the challenges...


Everything We’ve Known About Data Movement Has Been Wrong

Data movement remains a perennial obstacle in systems design. Many talented architects and engineers spend significant amounts of time working on data movement, often in the form of batch Extract, Transform, and Load (ETL). In general, batch ETL is the process everyone loves to hate, or put another way, I’ve never met an engineer happy with their batch ETL setup. In this post, we’ll look at the shift from batch to real time, the new topologies required to keep up with data flows, and the...


MemSQL Performance Benchmark

New Performance Benchmark for Live Dashboards and Fast Updates

Newest Upsert Benchmark showcases critical use case for internet billing with telcos, ISPs, and CDNs MemSQL achieves 7.9 million upserts per second, 6x faster than Cassandra Benchmark details and scripts now available on GitHub The business need for fast updates and live dashboards Businesses want insights from their data and they want it sooner rather than later. For fast-changing data, companies must rapidly glean insights in order to make the right decisions. Industry applications like IoT...


Third Normal Form, Star Schema, and a
Performance Centric Data Strategy

Keeping it Straight Data value comes from sharing, so staying organized and providing common data access methods across different groups can bring big payoffs. Companies struggle daily to keep data formats consistent across applications, departments, people, divisions, and new software systems installed every year. Passing data between systems and applications is called ETL, which stands for Extract, Transform, and Load. It is the process everyone loves to hate. There is no glamour in...


Novus Partners Case Study

Serving Investment Managers Novus is a portfolio intelligence platform that helps the world’s top investors generate higher returns. The company works with 100+ of the world’s top investment managers and institutional investors, managing approximately $2 trillion. The platform helps the industry’s top investors collectively innovate and gain valuable insights into their investments. Changing How the World Invests Novus aims to change how the world invests by allowing their users to explore...


in-memory database

Close Encounters with a Third Kind of Database

For years, we have lived in a data processing world with two primary kinds of database systems, one for capturing incoming data and managing transactions, and another for answering questions and analyzing the data for insight and intelligence. The first system is what we know as a database, a system designed so you can put data in and get data out reliably and quickly. The second system is generally referred to as a data warehouse. There has long been a historical divide between these two...


MemSQL in May

Visit MemSQL in May: GEOINT, Informatica World,
In-Memory Computing Summit

MemSQL has a full show schedule in May and we hope you can visit us at one of these events. GEOINT: May 15-18, Orlando http://geoint2016.com/ May 15-18, 2016, Gaylord Palms Resort and Convention Center, Orlando, Florida MemSQL is at booth 1514 GEOINT Symposium is the nation’s largest gathering of industry, academia, and government to include Defense, Intelligence and Homeland Security Communities. GEOINT is hosted by USGIF, the United States Geospatial Intelligence Foundation MemSQL will be...


Geospatial White Paper

Always-on Geospatial Analytics

In the past ten years technology shifts have re-crafted the geospatial applications and analytics landscape. The iPhone and Android ecosystems have fostered a world where almost everyone is a beacon of information Large scale computing capabilities have provided companies like Google and Facebook the ability to keep track of billions of things, and companies like Amazon and Microsoft are making similar computing power available to everyone Global internet coverage continues to expand, including...


IoT Infrastructure

Choosing the Right Infrastructure for IoT

The infrastructure of IoT will have a real-time database behind every sensor. Soon every device with a sensor will blend seamlessly into the Internet of Things, from drones to vehicles to wearables. Device and sensor count predictions range from billions to trillions. With this tidal wave of new devices comes an increasing number of new data streams, converging to make instant analytics on real-time data a tenant of any digital transformation. Our penchant for instant gratification extends to...