0% found this document useful (0 votes)
68 views

Lift and Shift To MariaDB SkySQL

This document discusses migrating from on-premises or other cloud-hosted MariaDB databases to MariaDB SkySQL. Some key benefits of MariaDB SkySQL include usage-based billing, fully managed infrastructure with automated backups and monitoring, and support from MariaDB experts. The lift-and-shift migration process involves understanding instance sizing needs, deploying SkySQL services, importing data, testing, and cutting over applications. MariaDB Corporation can assist with each step of the migration.

Uploaded by

Vlad Vikernes
Copyright
© © All Rights Reserved
Available Formats
Download as PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
68 views

Lift and Shift To MariaDB SkySQL

This document discusses migrating from on-premises or other cloud-hosted MariaDB databases to MariaDB SkySQL. Some key benefits of MariaDB SkySQL include usage-based billing, fully managed infrastructure with automated backups and monitoring, and support from MariaDB experts. The lift-and-shift migration process involves understanding instance sizing needs, deploying SkySQL services, importing data, testing, and cutting over applications. MariaDB Corporation can assist with each step of the migration.

Uploaded by

Vlad Vikernes
Copyright
© © All Rights Reserved
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 17

LIFT AND SHIFT

TO MARIADB
SKYSQL

WHITEPAPER
TABLE OF CONTENTS
1 LIFT AND SHIFT TO MARIADB SKYSQL
1 KEY BENEFITS

2 BENEFITS OF MARIADB SKYSQL

4 LIFT-AND-SHIFT MIGRATION PROCESS


4 UNDERSTAND THE MOVE
5 DEPLOY DATABASE SERVICES
6 IMPORT DATA TO SKYSQL
8 KEEP DATA UPDATED AFTER INITIAL IMPORT
8 TESTING
9 APPLICATION CUTOVER

10 LEVERAGING SKYSQL AS A PIVOT POINT

11 WHAT CHANGES WHEN YOU MOVE TO A DBAAS?

13 SUPPORT FROM MARIADB CORPORATION

14 NEXT STEPS

Lift and Shift to MariaDB SkySQL WHITEPAPER


LIFT AND SHIFT TO
MARIADB SKYSQL
Current users of MariaDB Server on premises or through cloud platforms can unlock the benefits
of MariaDB Enterprise Server through a lift-and-shift migration to the MariaDB SkySQL cloud
database. This paper discusses the benefits of MariaDB SkySQL, the considerations when
adopting a database-as-a-service (DBaaS), and a proven path for migration.

Migration is the process of permanently moving data from one database to another.

Lift-and-shift is a type of migration where no material application or data changes are needed since the underlying
database platforms have the same functional capabilities. The “lift” is preparing your data and applications for the
migration, and the “shift” is the migration.

Which database types work with this approach?

• Existing SkySQL instances, backed by MariaDB Enterprise Server


• On-premises deployments of MariaDB Enterprise Server
• On-premises deployments of MariaDB Community Server
• Amazon RDS for MariaDB, based on MariaDB Community Server
• Microsoft Azure for MariaDB, based on MariaDB Community Server
• Other cloud, VPS, shared or hosted database services that are backed by MariaDB Community Server

The process outlined here is focused on migrations from MariaDB Server to MariaDB Enterprise Server running on
MariaDB SkySQL. Migrations from Oracle database, MySQL, IBM DB2 and Microsoft SQL Server are also possible, but
require more robust planning and execution since these databases are not 100% compatible with MariaDB Server.

Key benefits
• On-demand spin-up of new instances, and billing based on what you use
• Right-sized service for your application, with availability from multiple regions in a range of database instance
sizes and storage sizes
• Fully managed infrastructure, including automated nightly backups and monitoring
• MariaDB Platform for predictable life cycle and advanced enterprise features, optimized for transactional,
analytical and HTAP workloads
• Support from MariaDB Corporation database experts and engineers

1 Lift and Shift to MariaDB SkySQL WHITEPAPER


BENEFITS OF MARIADB SKYSQL
No expensive hardware or data center to maintain
• On-demand instances through the SkySQL portal let you spin up a service when it is needed, stop it when it is
not in use, and delete it when you are done.
• Usage-based billing enables customers to estimate pricing based on the parameters chosen when you create a
service, such as provider, topology, instance and storage size, and region.
• The SkySQL service includes standard support and access to MariaDB Platform products on SkySQL.

• Discounts are typically offered for one-year and three-year commitments.

Right-sized for day-to-day operations and spikes in demand


• Ready-made instance sizes allow you to easily match existing service sizes, size down for a limited test
environment, or test larger configurations in advance of an upgrade.
• There’s no need to procure and deploy hardware in advance, a sizable savings when considering short-term
usage spikes, testing and application migrations.
• SkySQL Power is a premium service offering for MariaDB SkySQL customers who have the most critical
requirements for uptime, availability, performance and support.
• See the latest release notes for current instance sizes and regions.

Fully managed infrastructure


• MariaDB SkySQL is a multi-cloud, full-featured DBaaS; MariaDB handles all of the hardware and infrastructure
needs, and nightly backups and monitoring.
• Services are currently delivered using GCP (Google Cloud Platform) and GKE (Google Kubernetes Engine),
providing isolation and self-healing.
• Transactional services operate on persistent SSD block storage, and analytical services operate on scalable and
elastic object storage.

• SkySQL offers isolation, firewalls, data-at-rest encryption and data-in-transit encryption to meet GRC
(governance, risk management and compliance) and infosec challenges faced by modern applications; DPA
(GDPR) and BAA (HIPAA) are available.

2 Lift and Shift to MariaDB SkySQL WHITEPAPER


MariaDB Platform
• MariaDB Enterprise Server delivers a predictable life cycle, with advanced features building on the
capabilities of MariaDB Community Server.

• Platform configurations are optimized for ACID-compliant transactional (InnoDB), analytical (MariaDB
ColumnStore) and distributed SQL (MariaDB Xpand) workloads.

• MariaDB MaxScale delivers load balancing and high availability (HA).

• Advanced features also include temporal tables, MariaDB Enterprise Audit, and InnoDB Instant ALTER
TABLE.

• MariaDB Platform offers compatibility with most programming languages for off-the-shelf integration to
your stack.

Support from MariaDB Corporation


• Support is provided by the same people who engineered the software.

• Standard support is included; Enterprise and Platinum support plans are available.

• Instances are subject to SLA; SkySQL Power customers are provided an elevated SLA.

3 Lift and Shift to MariaDB SkySQL WHITEPAPER


LIFT-AND-SHIFT MIGRATION
PROCESS
The following process has been formed with the expertise of MariaDB Corporation to help ensure your success.
MariaDB assistance is available at each step of this process.

Understand the move


• Based on your existing and planned workloads, which SkySQL service types will you use? SkySQL includes
services for transactional, analytical, HTAP and distributed workloads.

• Based on your existing and planned workloads, what SkySQL instance sizes would be appropriate?

• For multi-node configurations appropriate for mission-critical workloads, how many instances do you
plan to deploy? Primary/replica transactional service offers read scaling based on instance count, while
distributed transactional service (backed by MariaDB Xpand) offers both read and write scaling based on
instance count.

• Based on current and planned storage capacity, including data retention requirements, how much
storage will your database require? Transactional storage is provisioned in advance and is a factor in disk
performance (IOPS), while object storage for analytical databases is elastic and scalable.

• Which version of MariaDB Enterprise Server (10.5 or 10.4) will you deploy? Your existing server version and
the MariaDB Enterprise Server software life cycle may be considerations. Enterprise Server 10.5 is EOL in
July 2025, and 10.4 is EOL in July 2024.

MariaDB Corporation is available to assist with sizing and cost estimation.

If you are currently running an on-premises database and are considering your first move to the cloud, see “What
Changes When You Move to a DBaaS?” below.

4 Lift and Shift to MariaDB SkySQL WHITEPAPER


Deploy database services
Database services on MariaDB SkySQL can be deployed on demand through the MariaDB SkySQL portal at https://
cloud.mariadb.com/.

When starting a database service, you will be prompted for instance and storage sizing, region and service name.

When it comes time to deploy your SkySQL service, it can take up to 25 minutes for the initial deployment in a region
to afford time for your Kubernetes cluster to be provisioned. Consecutive database deployments will use the same
Kubernetes environment and take significantly less time.

The real-time benefits come every day after, when you’re operating at scale. A database node fault could take a short
five minutes or less for Kubernetes self-healing, instead of an eight-hour bare metal rebuild as you might see on
premises or on other cloud platforms.

5 Lift and Shift to MariaDB SkySQL WHITEPAPER


Import data to SkySQL
The method used to import data to SkySQL depends on the service used (transactional or analytical). In any case,
you have the option to import your own data or to engage with SkySQL Support.

When importing larger and production data sets, working with SkySQL Support is recommended. They will
coordinate the efficient handoff of data for secure and direct loading to the service. Data can be loaded from a
customer-provided S3 bucket, a customer-provided SFTP server or a SkySQL-supplied GCP GCS (Google Cloud
Storage) bucket.

Remember to create database accounts (CREATE USER) as needed for testing.

Importing into transactional services


For transactional services, logical backup tools such as mariadb-dump and mysqldump can be used to produce a
data dump, which is then loaded to the SkySQL service. Connection details for your SkySQL service (hostname, TCP
port, username, default password and certificate authority chain) can be found in the SkySQL portal.

mariadb-dump --host server.example.com --port 3307 \


--user db_user --password \
--ssl-verify-server-cert \
--ssl-ca ~/trust_chain.pem \
--all-databases \
--ignore-database=mysql \
--single-transaction \
--events \
--routines \
--default-character-set=utf8mb4 \
> mariadb_dump.sql

mariadb --host example.skysql.net --port 5001 \


--user db_user --password \
--ssl-verify-server-cert \
--ssl-ca ~/Downloads/skysql_chain.pem \
--default-character-set=utf8mb4 \
< mariadb_dump.sql

If your backup contains any CREATE VIEW, CREATE FUNCTION, CREATE PROCEDURE or CREATE EVENT
statements, special actions will be needed. See “Importing Transactional Data into MariaDB SkySQL” in the SkySQL
documentation for details.

6 Lift and Shift to MariaDB SkySQL WHITEPAPER


Importing into analytical services
For analytical services, data in TSV (tab-delimited) or CSV (comma-delimited) format can be imported into the SkySQL
service using LOAD DATA LOCAL INFILE, which is optimized behind the scenes to leverage cpimport for rapid
loading. See “Importing Analytical Data into MariaDB SkySQL” in the SkySQL documentation for additional details,
including instructions for producing TSV and CSV files. Connection details for your SkySQL service (hostname, TCP
port, username, default password and certificate authority chain) can be found in the SkySQL portal.

mariadb --host example.skysql.net --port 5001 \


--user db_user --password \
--ssl-verify-server-cert \
--ssl-ca ~/Downloads/skysql_chain.pem \
--default-character-set=utf8 \
--local-infile

# TSV
LOAD DATA LOCAL INFILE ‘contacts.tsv’
INTO TABLE accounts.contacts;

# CSV
LOAD DATA LOCAL INFILE ‘contacts.csv’
INTO TABLE accounts.contacts
FIELDS TERMINATED BY ‘,’;

MariaDB-assisted import
Physical-level backups of the filesystem, such as those produced using tar or mariabackup (MariaDB Enterprise
Backup) can be used but data restore must be performed by SkySQL Support since SkySQL accounts do not have file
system–level access.

A physical-level backup of your transactional database can be produced with mariabackup:

mariabackup --backup \
--target-dir=/var/mariadb/backup/ \
--user=mariabackup --password=mypassword

mariabackup --prepare \
--target-dir=/var/mariadb/backup/

7 Lift and Shift to MariaDB SkySQL WHITEPAPER


Keep data updated after initial import
If deploying a Primary/replica transactional service, you can work with SkySQL Support to deploy replication from
your source database to your SkySQL service. Replication setup occurs after initial data loading to enable you to keep
your SkySQL service up to date.

Your source server must be configured for replication, and have enough days of binary log retention to cover the
period from the present back to when the backup was taken.

log-bin=mariadbd-bin
expire-logs-days=7

Prior to performing the backup, work with SkySQL Support to finalize the command to create the grants necessary to
support replication. SkySQL Support will provide the needed IP address. At the time of contact with SkySQL Support,
please notify if you are using GTIDs and provide details of your existing replication configuration.

CREATE USER ‘replication_user’@’<SKYSQL-IP>’ IDENTIFIED BY ‘<PASSWORD>’;

GRANT REPLICATION SLAVE ON *.* TO ‘replication_user’@’<SKYSQL-IP>’;

Immediately following the restore, SkySQL Support can perform the needed operations to establish replication to
your SkySQL service, CHANGE MASTER and START SLAVE.

SkySQL Support can provide you notification when the replication lag is close to zero; that is, when replication is
caught up. Replication can also be monitored through the SHOW SLAVE STATUS\G command. SkySQL Support
can grant your account the REPLICATION CLIENT privilege so this command can be used. Testing should not
commence until your replica is fully in sync with the primary, and has close to zero replication lag.

Testing
MariaDB’s approach for migrations has been honed over many years. One of the migration steps most critical to
your success is testing. The specific testing to perform for migration may differ from your organization’s typical
application- or system-level tests. Testing generally requires the deployment of test application nodes which connect
to the SkySQL service.

• Data validity tests to confirm loaded data matches source data

• Data integrity tests to confirm referential integrity of loaded data

• Application-level or query-level performance testing

• Concurrency and latency testing

• Tests of all procedures, triggers and functions

8 Lift and Shift to MariaDB SkySQL WHITEPAPER


• Query output validation, to confirm result sets match

• If using an ORM, confirmation that valid queries are generated

• Review of data collected by any existing application-level instrumentation

• Data and data structure tests covering client applications, APIs, batch jobs

• Additional testing per business requirements, e.g., for compliance

A mix of manual testing and automated script-driven testing should be applied. Automated testing allows for more
repeatable testing at scale. Compare test results with checksums, counts, smoke tests, randomized reads, writes
and stored code calls. Review and retain test results. Ensure stakeholder sign–off as required by your business.

Once all other testing has been completed, you may wish to conduct a full-scale migration test to validate your
fallback planning.

• Test migration to validate fallback plan

Application cutover
Application cutover should occur on a scheduled basis, only after testing has successfully concluded. Remember to
communicate application cutover plans within your business.

During application cutover, the following changes occur:

1. The application is briefly paused or placed in a read-only maintenance mode

2. Inbound replication from your source database to your SkySQL service is stopped

3. Outbound replication from your SkySQL service to your source database is started

4. Application nodes are reconfigured to point at your SkySQL service

Replication changes are made with the assistance of SkySQL Support. Prior coordination is recommended.

Use of a wire-on/wire-off or switchboard configuration mechanism within your application can reduce complexity
and changeover time.

Repeat non-destructive application testing against your SkySQL service to validate proper application operation. In
the event of a problem, remediate the issue or enact your fallback plan. A good fallback plan minimizes moving parts
while reversing the application cutover process.

After running on SkySQL for some business-defined period of time, typically weeks, decommission the old database.

9 Lift and Shift to MariaDB SkySQL WHITEPAPER


LEVERAGING SKYSQL AS A
PIVOT POINT
Some critics of lift-and-shift migrations point out that despite cost and feature benefits, problems in the source
environment are often carried forward into the new environment – “same mess, new address.”

MariaDB SkySQL includes features to help break this cycle:

• MariaDB Enterprise Server maintains extensive feature compatibility with MariaDB Enterprise Server and
MariaDB Community Server, enabling frictionless migration to MariaDB SkySQL.

• MariaDB Enterprise Server’s pluggable storage engine architecture enables optimization for replicated
transactional workloads, for analytical workloads and for distributed SQL with fault tolerance.

• With operations activities such as nightly backups, infrastructure management and version upgrades handled
by SkySQL, you free staff time to focus on your core business requirements.

• SkySQL enables the creation of multiple production-like environments in parallel for on-demand testing, and
environments can be stopped when not in use and deleted when they are no longer needed.

• SkySQL-to-SkySQL migrations can be used to increase or reduce instance sizes, change application
architecture, and test optimizations, all with a fallback path.

• Features such as SkySQL Monitoring and SkySQL Workload Analysis, both currently available as a Technical
Preview, support diagnosis of bottlenecks and opportunities for optimization.

10 Lift and Shift to MariaDB SkySQL WHITEPAPER


WHAT CHANGES WHEN YOU
MOVE TO A DBAAS?
A DBaaS is a database in the cloud that provides database application owners with access to a database while
the database service provider takes responsibility for maintaining the infrastructure and resources to manage the
database.

With SkySQL, our platform and experts handle the infrastructure needs, allowing you to focus on your core business.
When you choose MariaDB SkySQL, you forgo the capital expenditure of buying hardware, the delay of waiting
for new systems to ship every time you need to scale up or scale out, and the overhead and opportunity cost of
tuning, monitoring and upgrading your database. SkySQL also handles routine tasks such as nightly backups and
infrastructure maintenance.

And if you need ultimate control, and have the necessary skills and resources to hand-pick instances and tune
configurations, the SkySQL Power tier delivers all of the on-premises benefits without the capital expense (capex)
and operational overhead. SkySQL Power also includes cross-region replicas for disaster recovery (DR) and an
elevated SLA.

With SkySQL, certain operational activities are handled for you:

• Infrastructure maintenance

• Automated nightly backups

• Configuration management

• Monitoring

• Firewall configuration

• Data-at-rest encryption

• Scheduled database upgrades

The table on the following page outlines special considerations when moving to a DBaaS.
Special considerations when moving to a DBaaS include

11 Lift and Shift to MariaDB SkySQL WHITEPAPER


Special considerations when moving to a DBaaS

Latency Round-trip time (RTT) between database servers and application servers should be minimized by

hosting servers in the same region or leveraging VPC peering.

Available regions Assess regional coverage versus your business requirements, including the country where data is

hosted. MariaDB SkySQL is available today in many GCP (Google Cloud Platform) regions around

the world. Contact us if additional regions are needed.

Available instance sizes Assess sizing based on workload requirements. MariaDB SkySQL offers a range of standard

instance sizes, including high memory options. SkySQL Power customers also have access to

custom instance sizes.

Frequency of software Software upgrades are provided by the DBaaS vendor. In the case of MariaDB SkySQL, software
updates updates are available shortly after each new release of MariaDB Enterprise Server and are

deployed based on a jointly agreed upon schedule.

Service-level agreement Assess based on your operational requirements. Subject to SkySQL SLA terms, multi-node
(SLA) service deployments are subject to a 99.95% SLA, and SkySQL Power customers receive an

elevated SLA of 99.995%.

Vendor lock-in Vendor lock-in is common among many database providers but is not a practice of MariaDB

Corporation. MariaDB SkySQL is backed by MariaDB Enterprise Server, which extends the features

of the widely available MariaDB Community Server. MariaDB SkySQL features make it easy to get

your data in and out of the platform. SkySQL is available both on demand and with discounted

pricing based on a one-year or three-year commitment.

Compliance Assess based on your business requirements. MariaDB SkySQL includes standard security

features such as isolation, IP firewalling, data-at-rest encryption and data-in-transit encryption.

Business Associate Addendum (BAA) for HIPAA and Data Processing Addendum (DPA) for GDPR

are available.

Available support Assess based on your operational requirements. With MariaDB SkySQL, standard support is

included with all instances. Enterprise and Platinum support options are available to meet the

needs of mission-critical deployments requiring 24x7 support.

12 Lift and Shift to MariaDB SkySQL WHITEPAPER


SUPPORT FROM MARIADB
CORPORATION
MariaDB SkySQL is operated by a team of site reliability engineers (SREs) and MariaDB-certified database
administrators (SkyDBAs) – and supported by MariaDB engineers themselves, the only people with the knowledge
and experience necessary to troubleshoot difficult database issues and build hotfixes if needed.

• All instances are backed by MariaDB Enterprise Server.

• Subject to SLA terms, multi-node service deployments are subject to a 99.95% SLA, and SkySQL Power
customers receive an elevated SLA of 99.995%.

• Standard support is included with all instances. Activities like performance tuning and assistance with schema
changes is not included in standard support.

• Enhanced support plans are available to meet the needs of mission-critical deployments requiring 24x7
support. Enterprise and Platinum support plans are optional and include consultative support.

• An option available to customers with Enterprise or Platinum support plans, SkyDBA further extends the
premium support experience and the capabilities of your in-house DBAs with backing from a global team
of expert MariaDB DBAs, available 24x7 for the most severe (S1) issues. MariaDB’s SkyDBAs manage your
MariaDB SkySQL databases both reactively (break/fix) and proactively (analyze/enhance) so you can focus on
your core business.

• MariaDB Corporation’s geo-distributed team is an excellent complement to your disaster recovery and
business continuity plan, extending your in-house capabilities.

• The MariaDB SkySQL documentation includes detailed instructions and reference material.

13 Lift and Shift to MariaDB SkySQL WHITEPAPER


NEXT STEPS
When adopting MariaDB SkySQL, it is common for a business to explore potential use cases and perform a proof of
concept (POC) implementation.

MariaDB Corporation offers a $500 credit to get you started.

Instructions are provided:

• Sign up for a SkySQL account

• Provision a service

• Connect to your database

• Import data to your database

• Manage your database

An end-to-end walk-through from sign-up to deployment of a sample application is also provided.

Extended information is available in the SkySQL documentation at https://r.mariadb.com/skysql.

Contact us if you have questions or are ready to advance with migration planning: https://mariadb.com/contact/.

14 Lift and Shift to MariaDB SkySQL WHITEPAPER


THE SKY IS
TRULY
THE LIMIT
SKYSQL. The ultimate MariaDB cloud is here.

EASY TO USE + POWERFUL


SkySQL is the first database-as-a-service (DBaaS) to unlock the full power of MariaDB Platform
in the cloud. Engineered for mission-critical applications, SkySQL does away with common
limitations and combines automation with the expertise and experience necessary to support
production deployments in the cloud.

Get started with a $500 credit:

mariadb.com/skyview

You might also like