Database

How Careful Engineering Led to Processing Over a Trillion Rows Per Second

On March 13, we published a blog demonstrating the performance of MemSQL in the context of ad hoc analytical queries. Specifically, we showed that the query SELECT stock_symbol, count(*) as c FROM trade GROUP BY stock_symbol ORDER BY c desc LIMIT 10; 12345 SELECT stock_symbol, count(*) as cFROM tradeGROUP BY stock_symbolORDER BY c descLIMIT 10; can process 1,280,625,752,550 rows per seconds on a MemSQL cluster...


Matching Modern Databases with ML and AI

Introduction Machine Learning (ML) and Artificial Intelligence (AI) have stirred the technology sector into a flurry of activity over the past couple of years. However, it is important to remember that it all comes back to data. As Hilary Mason, a prominent data scientist, noted in Harvard Business Review*, …you can’t do AI without machine learning. You also can’t do machine learning without analytics, and you can’t do analytics without data infrastructure. Over the last year we...


Operationalizing MemSQL

In a recent webcast, we shared some tips and tricks on how you can operationalize MemSQL for configuring MemSQL Ops and MemSQL root user passwords; memory settings and health metrics; and how you can take backups and add nodes securely to your cluster. Here are the topics we covered: Permissioning a new cluster by adding a super-user to MemSQL Ops and via GRANT statements on the cluster itself   Best practices for configuring memory limits Best practices for basic cluster monitoring, and how...


blog header

Just Like IoT, Enterprises Have Been Using AI All Along

Just like IoT, around in various forms for years, AI has been prevalent in nearly every enterprise for decades. The catch? It was hidden inside the databases and data warehouses in use under the banner of Query Optimization. Query optimization is the process where a database or data warehouse takes the input from a user’s question, and reworks that question to deliver a quick response with as few compute resources as possible. The number of query plan choices reach far beyond what a human can...


blog header

Go Beyond Legacy Data with Change Data Capture, MemSQL, and Real-Time Applications

Data is driving innovative customer experiences, operation optimization, and new revenue streams. Data infrastructure teams are being asked to update their legacy infrastructure to respond to changing business conditions without disrupting existing operations. The future of data management is modernizing legacy systems using real-time data synchronization with modern databases that can accelerate innovation without impacting existing applications. The Challenge of Legacy Systems A constant...


A Brief Introduction to MemSQL

A Brief Introduction to MemSQL

We know choosing or evaluating a new database technology can be challenging due to the variety of choices available. In a recent webcast, we shared various use cases businesses face with traditional database and data warehouse technologies, key differentiators and architectures of MemSQL, sample applications and customer case studies, and a quick demo of MemSQL. MemSQL provides an adaptable database for real-time applications that unite transactions and analytics in a single high-performance...


Using MemSQL within the AWS Ecosystem

The database market is large and filled with many solutions. In this post, we will take a look at what is happening within AWS, the overall data landscape, and how customers can benefit from using MemSQL within the AWS ecosystem. Understanding the AWS Juggernaut At AWS re:Invent in December 2017, AWS CEO Andy Jassy revealed that the business is at a revenue run rate of $18 billion, growing 42 percent per year. Those numbers are staggering and showcase the importance Amazon Web Services now plays...


An Engineering Approach to Database Evaluations

Whether you’re the CTO of the Rebel Alliance or the Galactic Empire, it could be very difficult to decide on your next database technology with the distraction of both sides constantly at war. In 2018, you’ll need to make a database choice for an existing or new application. Here are the things you need to keep in mind as you shop for your next database. 8 Criteria To Keep In Mind While Looking For Your Next Database 1) Pick the right language: SQL The history of SQL, or Structured...


Scaling Distributed Joins

Most users of SQL databases have a good understanding of the join algorithms single-box databases employ. They understand the trade-offs and uses for nested loop joins, merge joins, and hash joins. Distributed join algorithms, on the other hand, tend not to be as well understood. Distributed databases need to make a different set of tradeoffs to account for table data that is spread around a cluster of machines instead of stored on a single machine, like in a traditional database. Because these...