Why we built stand-alone Instant Datasets
Because I sometimes write my SQL queries like a monkey.
Fixed an issue by introducing a check, but the check missed a filter in the query. Worked with test data, caused havoc as soon as hit production.
Faked a JSON column in code and wrote tests as Ruby hash by accident. The application expected symbols, but the database returned string keys. Feature crashed immediately.
Build a feature and forgot an index. App ran smoothly in development because the table was empty. Went down as soon as it hit production.
Friends don’t let friends test with mock data.
Keeping that data fresh and having to restore the same backup over and over to get a clean slate was insane.
Without production-like data it’s very easy to have issues due to the discrepancies between environments.
Downloading backups of over 40GB multiple times into my local machine to run migration scripts was not fun.
A query that was not using the right index brought our servers to their knees. But it worked on my machine!
We couldn't test with prod data because it was too big. We’d release code and pray! If things went wrong, it would take days or weeks to find bugs, diagnose, and fix them.
Back when I worked on SQL databases, I brought the site down by removing a row. It worked with my mock data, but failed in production.
Instant Datasets helps you:
- Easily clone production and other data needed by your environments
- Test code against real-world scenarios and edge cases to quickly resolve bugs that only appear with production-like data
- Protect sensitive data with encryption and masking options
- Reduce storage costs by pausing datasets on schedule or when not in use
- Automate your data replication workflows with APIs and integrations
Production-like data in 3 steps
Connect your cloud account
Create your dataset pool
Build and test with your data
Works with your databases and cloud platforms
We are constantly adding new integrations and services. Google and Azure clouds are coming, and soon you will be able to connect your CloudSQL, MangoDB Atlas and other databases.
Resources to get you started
Instant Datasets Quick-Start
All you need to know about Instant Datasets in an easy guide.
Introducing Standalone Instant Datasets
Release Instant Datasets in now a standalone product allowing everyone to build and test with production-like data.
Ephemeral environments with production-like data
Instant Datasets is a core feature of the Release platform. Learn how it works along with ephemeral environments.