engineering

How Careful Engineering Led to Processing Over a Trillion Rows Per Second

On March 13, we published a blog demonstrating the performance of MemSQL in the context of ad hoc analytical queries. Specifically, we showed that the query SELECT stock_symbol, count(*) as c FROM trade GROUP BY stock_symbol ORDER BY c desc LIMIT 10; 12345 SELECT stock_symbol, count(*) as cFROM tradeGROUP BY stock_symbolORDER BY c descLIMIT 10; can process 1,280,625,752,550 rows per seconds on a MemSQL cluster...


Operationalizing MemSQL

In a recent webcast, we shared some tips and tricks on how you can operationalize MemSQL for configuring MemSQL Ops and MemSQL root user passwords; memory settings and health metrics; and how you can take backups and add nodes securely to your cluster. Here are the topics we covered: Permissioning a new cluster by adding a super-user to MemSQL Ops and via GRANT statements on the cluster itself   Best practices for configuring memory limits Best practices for basic cluster monitoring, and how...


blog header

Full-Text Search in MemSQL

Today, we are sharing that MemSQL now has Full-Text Search, a highly requested feature, built into the product. Thanks to customer feedback, we are delighted to make it available for all companies building real-time applications. What is Full-Text Search? You might be thinking, “MemSQL is pretty fast at searching things and they already support large strings, so why do they need to add anything?” So let’s start with a description of Full-Text Search (FTS). Full-Text Search is different...


blog header

Recapping An Evening with MemSQL Engineering

Recently, we hosted a special meetup at our headquarters in San Francisco for the community, and shared some great talks. The slides for each talk and the video presentations have been made available below. Drew Paroski, MemSQL VP of Engineering and Adam Prout, MemSQL Chief Architect delivered a fun talk about taking a methodical approach for making a decision, dug into interesting tradeoffs, and gave tips about what to look for under the hood and how to evaluate the tech behind the database,...


JSON Streaming And The Future Of Data Ingest

As businesses continue to become technology focused, data is more prevalent than ever. In response, companies have adopted a handful of common formats to help manage this explosive growth in data. Data Formats Today For a long time, XML has been the giant in terms of data interchange formats. Recently, JSON has become popular, catching a wave of interest due to its lightweight streaming support, and general ease of use. JSON is a common format for web applications, logging, and geographical...


Psyduck: The MemSQL Journey to Containers

One of the main themes at DockerCon 2017 was the challenge of migrating legacy applications to containers. At MemSQL, we’re early adopters. We are already into our third year of running Docker at scale in production for our distributed software testing regime, where the performance, isolation, and cost benefits of containers are very attractive. The Challenge Before I take you through our journey to containers, let me start by outlining some of the general challenges of testing a distributed...


Streamliner Python

Introducing a Performance Boost for Spark SQL, Plus Python Support

This month’s MemSQL Ops release includes performance features for Streamliner, our integrated Apache Spark solution that simplifies creation of real-time data pipelines. Specific features in this release include the ability to run Spark SQL inside of the MemSQL database, in-browser Python programming, and NUMA-aware deployments for MemSQL. We sat down with Carl Sverre, MemSQL architect and technical lead for Ops development, to talk about the latest release. Q: What’s the coolest thing...


How We Hire Engineers

How We Hire Remarkable Engineers

To achieve our vision of building the next great database company, we seek the highest caliber engineers. Each team member brings expertise in areas like storage systems, code generation, query optimization, infrastructure testing, and more to MemSQL, with previous roles at companies like Facebook, Microsoft, Oracle, and Google. Our engineering team includes graduates of top university programs, including MIT, Stanford, and Carnegie Mellon University, and highly-rated competition programmers...


The Internet of Furbies

At MemSQL engineering there are few things we love as much as building great products. One, however, is a good laugh. This past weekend a team from MemSQL set out to make our mothers proud at Cultivated Wit’s Comedy Hack Day, an event for comedians and hackers to get together in attempt to make the funniest hack. And drink whiskey. I’m very excited to share with you our product today, the grand prize winner, and the future of wearable technology. Engineering at MemSQL goes to great lengths...


Google's Code Jam World Finals - Two Senior MemSQL Engineers Make Top 25

MemSQL is proud to announce that David Stolp (Pieguy) and Nika Jimsheleishvili (nika) are on their way to Google’s London office to compete in the 2013 Code Jam World Finals. Pieguy and Nika will compete in the final competition this August for a chance to win $15,000 and the prestigious title of 2013 Code Jam Champion. To qualify for the chance to become Code Jam Champion, Pieguy and Nika have competed in four online qualifying competitions and finished in the top 25 out of more than...