Complete Snowflake Tutorial & Hands on Guide- Zero To Hero Data Engineering Simplified ↗

[Version:2023-06-03]
Snowflake Introduction & History ●
●
Watch: General Overview & Tabs
Watch: Top left/right menus
● Watch: Feature 17 - Snowflake Partner Connect
● Watch: Feature 18 - Snowflake Data Marketplace
●
●
Watch: List stage objects before copying
Watch: Loading Data from stage to table
Episode-01 is a 20-min long video where you will learn ● Watch: Navigation Tree ● Watch: Copy & Copy History
● Watch: Query Pan ● Watch: Role of file format in copy command
about Snowflake history and why it has come into existence. It
explores the evolution of the Cloud Data Platform and how
● Watch: Query History Container Hierarchy Concept ● Watch: Query stage data without loading
● Watch: Account Tab ● Watch: Stage file validation during copy command
Snowflake fits into modern data architecture. The video Episode-07 This chapter focuses on the hierarchy concept of ● Watch: Role of VWH size & compression during data loading
highlights the value of a Cloud Data Platform and emphasizes the databases, schemas, tables, and containers. It provides hands-on
concept of having one platform, one copy of data, and multiple Snowsight - Modern WebUI exercises for creating tables with different types, constraints, and
workloads.
Episode-05 This video tutorial covers every function and
data loading methods, including standard and external tables and Continuous Data Loading
● Watch: Snowflake History & Co-founders insert statements, create as select, insert as select, and copy
● Watch: Evolution of Cloud Data Platform feature of the Snowsight, including worksheet, folder, filter, commands. The tutorial also covers topics such as not null Episode-10 This guide covers continuous data loading and data
● Watch:Modern Data Architecture & Snowflake sharing, dashboard, visualization, and many more features, constraints, case sensitivity with table names, describing tables, ingestion in Snowflake. The tutorial provides a hands-on approach to
● Watch:The Value of Cloud Data Platform described in detail with a hands-on guided tour. Snowsight's primary and unique key constraints, and querying external stages in help data developers ingest streaming and micro-batch data using
● Watch:One platform, one copy of data & many workload dashboard is compared with Tableau dashboard and PowerBI Snowflake. The video includes a sub-topic tree map and concludes Snowpipe, a SQL object designed to support streaming data, delta
dashboard due to its powerful features and supported sharing with a quick recap of the main points and a thank-you note. data, and CDC data into Snowflake. The tutorial covers Snowpipe's
Snowflake Free Trial Edition capabilities within the organization. The Snowsight preview app
brings productivity to the developer community and makes
● Watch: Snowflake Container Hierarchy
● Watch: Container - Database - Schema - Table
architecture, components, internal stages, and Python program, as
well as monitoring and pausing/resuming pipes. The video guide
Episode-02 is a 20+ min long video and covers the overall navigation smooth and sleek. ● Watch: Database, Schema, Table Creation & Describe includes live examples to explain Snowpipe's most important
● Watch: Why and Why Not Snowsight ● Watch: Snowflake Table DDL & Data Types features. This tutorial is a comprehensive guide to continuous data
Snowflake free trial registration process in detail. When we work
● Watch: Snowsight quick feature review ● Watch: Desc Table & get_ddl() loading and data ingestion in Snowflake.
for an organization, we get a predefined setup and our exposure
is very limited to explore this tool and that's why it becomes so ● Watch: Live Demo - How to access ● Watch: Fully Qualified name for table ● Watch: What so special about pipe
important for us to do a self registration process and understand ● Watch: Live Demo - Feather Map (All Menus) ● Watch: Snowflake Table DDL & string/varchar datatype ● Watch: Snowpipe Auto Ingest Process
how it really works and what all matters when selecting the ● Watch: Live Demo - Profile ● Watch: Load data via SnowSQL & Put Command ● Watch: Introduction - Snowpipe Hands-on
underlying cloud providers, regions, edition and pricing policies ● Watch: Live Demo - Worksheet ● Watch: SQL Constructs (Snowpipe Hands-on)
● Watch: Live Demo - Worksheet Formatting ● Watch: Python Code for Auto Ingest (Snowpipe Hands-on)
● Watch: Snowflake Feature Matrix
● Watch: Snowflake Pricing
● Watch: Live Demo - Worksheet Filter New/Different Objects In Snowflake ● Watch: Key Pair Association (Snowpipe Hands-on)
● Watch: Live Demo - Dashboard ● Watch: Monitoring Pipe (Snowpipe Hands-on)
● Watch: 05:36 Snowflake Free Registration
● Watch: Live Demo - Dashboard Filter
Episode-08 This chapter focuses on the new objects introduced ● Watch: View Pipe in Snowsight (Snowpipe Hands-on)
● Watch: Welcome Snowflake Worksheet, Tabs & Roles by Snowflake that data developers and leads should know. The video
● Watch: Live Demo - Data ● Watch: Pause & Resume Pipe (Snowpipe Hands-on)
● Watch: MFA Multi Factor Authentication explains how knowing the purpose and power of these objects can
● Watch: Live Demo - Compute
● Watch: Live Demo - Accounts save time and optimize cost and solution. The video covers live
Snowflake 3 Layered Architecture ● Watch: Live Demo - Classic Console & Switch Account demos of Sequence Objects, File Format Objects, Stage Objects, External Table Snowflake
Integration Objects, Pipe Objects, Stream Objects, Task Objects, and
Episode-03 is a 30 + min long video covering the Snowflake Resource monitor. Episode-11 This tutorial covers how to work with external
architecture & design approach in detail. In general, the Snowflake Unique Features ● Watch: What so special about snowflake new objects tables in Snowflake . The video guide provides a visual and
snowflake is known as a cloud-native platform that supports ● Watch: All About Sequence Objects hands-on approach to demonstrate how to connect to a cloud data
storage & computes decoupling but how it achieve this is now
Episode-06 Covers building ETL Workflow in snowflake is not ● Watch: All About File Format Objects lake and view different data sets such as CSV, Parquet, ORC, Avro,
known to us and this video chapter helps you understand this an easy task and if you have to build an end to end ETL workflow (or ● Watch: All About Stage Objects JSON, and XML. The tutorial answers questions such as what
concept in detail.. ETL workflow) we need to use pipe, stream and task components ● Watch: All About Integration Objects external tables are in Snowflake, how to create them, and how to
along with external stages and orchestrate all the activities. This ● Watch: All About Pipe Objects map them with external stages like AWS S3. It also covers
● Watch: Traditional Data Warehouse Architecture
episode is a comprehensive 60 min practical guide with handson ● Watch: All About Stream Objects auto-ingestion via external tables, working with Parquet files, and
● Watch: Snowflake 3 Layer Unique Architecture
exercise to demonstrate you how it works. ● Watch: All About Task Objects more. This tutorial offers a comprehensive guide to working with
● Watch: Decode Snowflake Storage Layer
● Watch: What so special about snowflake ● Watch: All About Resource monitor external tables in Snowflake.
● Watch: Decode Snowflake Compute Layer
● Watch: Decode Snowflake Cloud Service Layer ● Watch: Traditional ETL/ELT Challenges ● Watch: Why External Table
● Watch: Feature 1 - Cloud Provide Support ● Watch: Create External Table
● Watch: Lifecycle of a query in Snowflake World
● Watch: Developer's day - Snowflake At a Glance ● Watch: Feature 2 - Unlimited Storage & Compute Fast, Bulk & Batch Data Ingestion ● Watch: External Table & External Stage Mapping
● Watch: Feature 3 - Data Platform as Service ● Watch: External Table & Partition
● Watch: Feature 4 - Unique 3 Layer Architecture
Episode-09 This tutorial helps data developers understand bulk
● Watch: External Table & Auto Ingest
Snowflake Legacy WebUI ● Watch: Feature 5 - Virtue Warehouse (compute) data loading and data ingestion concepts in Snowflake, with different
stages and file formats to support various use cases. The video covers
● Watch: External Table Functions & Table Functions
● Watch: Feature 6 - Support for semi structure data ● Watch: External Table & Semistructured Data (Parquet & ORC)
Episode-04 This tutorial on the Snowflake Classic Legacy WebUI ● Watch: Feature 7 - Snowflake Time Travel user stage, table stages, internal stages, query stages, file formats, ● Watch: External Table & SnowPipe
covers every feature of the Snowflake Web Interface. The tutorial ● Watch: Feature 8 - Snowflake Zero Copy Clone and the copy command. It explains how to perform file validation,
aims to help data developers and analysts use the tool effectively by ● Watch: Feature 9 - Continuous Data Loading optimize compression and warehouse size, and copy semi-structured
providing a visual guide to the structure and layout of the web UI. The ● Watch: Feature 10 - Support for ANSI SQL + Extended SQL data. The tutorial provides a hands-on visual guide with live Snowflake End To End ETL Flow
video covers every tab along with its relationship with user roles and ● Watch: Feature 11 - Snowflake Micropartition/ Clustering examples and covers essential features.
when it works and doesn't work. The tutorial covers topics such as ● Watch: Feature 12 - Snowflake Data Security & Encryption ● Watch: What so special about snowflake new objects Episode-12 This chapter offers a comprehensive guide on
navigation tree, query history, and account tab. The video also ● Watch: Feature 13 - Snowflake RBACC & DAC ● Watch: Why to subscribe this channel working with Snowflake virtual warehouse beyond SQL syntax. It
includes a quiz time section and ends with a thank you note and ● Watch: Feature 14 - Data Sharing & Reader's Account ● Watch: Stage Concepts and type of stages covers topics such as standard and multi-cluster virtual
disclaimer. ● Watch: Feature 15 - Data Replication & Failover ● Watch: User Stage & list them warehouses, enabling auto-resume and auto-suspend features,
● Watch: Feature 16 - Snowflake Connectors & Drivers ● Watch: Table Stage & list them scaling policies, setting up a resource monitor, and validating virtual
● Watch: Legacy WebUI Introduction
 Complete Snowflake Tutorial & Hands on Guide- Zero To Hero Data Engineering Simplified ↗

warehouse workload. The video also explains the challenges of ● Watch: Table Storage Cost for Time Travel Feature answering questions such as how Snowflake Stream works, how it not an easy task and if you have to build end to end ETL
fixed capacity compute models and Snowflake's compute sizing and tracks changes, what offsets are, and whether it is expensive. The workflow (or ETL workflow) we need to use pipe, stream and
pricing model. Additionally, it discusses the Virtual Warehouse SQL episode also addresses how long Stream holds the CDC dataset. task components along with external stages and orchestrate all
construct and how it works with SnowSight. Snowflake Zero Copy Clone ● Watch: What you don't know about snowflake streams? the activities. This episode is a comprehensive 60 min practical
● Watch: What is stream and how does it work? guide with handson exercise to demonstrate you how it works.
● Watch: Snowflake virtual warehouse & beyond Episode-15 Snowflake's Clone Feature is a useful and versatile
● Watch: Challenges with fixed capacity compute model
● Watch: Snowflake Compute Sizing and Pricing Model
feature that can greatly benefit development teams who rely on
● Watch: Type of stream in snowflake
● Watch: Can I create multiple stream on a source table
Work With Snowflake ODBC Driver
data operation teams. Cloning can be applied not only to tables, but
● Watch: Virtual Warehouse SQL Construct
also to schemas, databases, and other objects within schemas. The
● Watch: Can I clone a stream Episode-24.2 The Snowflake ODBC driver is a popular tool for
● Watch: Multi Cluster Auto Scaling ● Watch: What is offset and how it works in stream? BI tools like PowerBI or Tableau, but using it to bring data from
34-minute episode introduces cloning (also known as zero copy
● Watch: How to calculate virtual warehouse workload ● Watch: Snowflake Stream Hands on. Snowflake to MS Excel and apply transformations is not as widely
clone) and answers questions such as whether clone and zero copy
● Watch: Virtual Warehouse Resource Monitor ● Watch: Stream on standard table known. This guide is designed to help analysts who are skilled at
clone are the same, whether cloning costs anything and if so, how
● Watch: Virtual Warehouse & SnowSight ● Watch: Append Only Stream analyzing data in Excel but not familiar with programming or BI tools,
much and when, how to clone an object, what objects are not
● Watch: Stream on transient table to fetch data into their worksheets. The guide covers installation and
cloneable, what happens if a pipe is cloned, and whether internal
● Watch: Data Retention Period for Time Travel & Stream.
Snowflake Micro Partition Concept stages or external tables can be cloned.
● Watch: Scenario-5 How to consume stream data
usage of the Snowflake ODBC driver in MS Excel, along with answers
to common questions, such as setup, configuration parameters,
● Watch: What you need to know about clones? ● Watch: Scenario-6 Stream on external table
Episode-13 This tutorial covers the concept of micro partitions ● Watch: What is cloning in snowflakes? fetching data, and transforming data with Power Query. It also
used by Snowflake to make its cloud data warehouse fast and ● Watch: Schema level cloneable objects. provides information on configuring the driver in Linux or Mac OS,
cost-effective. It covers various aspects of micro partitions, ● Watch: List of direct cloneable objects? Snowflake Task & Task Tree programming language compatibility, downloading the driver,
including how they work, their appearance, and the number of ● Watch: Clone Feature Hands-on
Episode-18 Snowflake Tasks and Task Tree are two essential
sample connection strings, and the latest version.
micro partitions created by Snowflake. It also explains micro ● Watch: Table cloning & Understand Zero Copy Clone
partition clustering depth and overlap. SQL commands for micro ● Watch: How Transient & Temporary Table Cloning Works components in Snowflake that allow you to automate your SQL
partition and cluster key are also provided. Finally, the tutorial ● Watch: Object Dependency with Cloning scripts and workflows. By utilizing these features, you can achieve
discusses the relationship between micro partitions, query profiles, ● Watch: How External Table Cloning Works significant automation and efficiently move data from the ingestion Snowflake Python Connector
clustering depth, and cluster overlap. ● Watch: How File Format & Sequences Cloning Works to consumption layer. These components are native to Snowflake
● Watch: So secretive about Micro Partition ● Watch: How Pipe Objects Cloning Works and function effectively when designed correctly. Episode-24.3 This tutorial covers the installation,
● Watch: How Stream Objects Cloning Works configuration, and authentication approaches of the Snowflake
● Watch: List, Range, Hash Partitions Vs Micro Partition ● Watch: What you don't know about snowflake tasks?
● Watch: How Task Objects Cloning Works Python connector. It also offers hands-on experience with running
● Watch: How Does the Snowflake Micro Partition Work? ● Watch: What is a snowflake task and how does it work?
● Watch: How A large database Cloning Works DDL and DML operations, getting data from Snowflake into Pandas
● Watch: What does a micro partition look like? ● Watch: Why to subscribe this channel
data frames, managing asynchronous queries, and loading data to
● Watch: How many micro partitions are created? ● Watch: Task DDL and SQL Construct
stage location via the Snowflake Python API.
● Watch: Clustering depth and clustering overlap?
● Watch: Micro partition summary and benefit Snowflake Data Sharing ● Watch: Task Scheduling (Non-Cron)
● Watch: Task Scheduling Using Cron Keyword
● Watch: Python Version Requirement for Snowflake Connector
● Watch:Install Snowflake Python Connector on Windows
● Watch: SQL for Micro partition & cluster key Episode-16 Snowflake Data Sharing is a game-changing ● Watch: Serverless Task
● Watch:Snowflake Python Connector Example
● Watch: Micro Partition & Query Profile ● Watch: Snowflake Task Tree (Workflow & Orchestration)
feature that enables secure data sharing and supports many ● Watch: Python Connector Authentication Key Pair & MFA
● Watch: Micro Partition - Clustering Depth/Overlap ● Watch: Snowflake Task & Stored Procedure
previously impossible use cases. The 25-minute episode provides ● Watch:Snowflake Python Connector DDL & DML Example
an introduction to the feature and helps answer questions such as ● Watch:Snowflake Python Connector Execute Many Example
Time Travel Feature In Snowflake whether a Snowflake account is necessary for consumption,
whether account sharing is possible in the same cloud and region,
Snowflake End To End ETL Flow ● Watch: Python Connector Asynchronous Query Example
● Watch: Python Connector Pandas Dataframe Example
Episode-14 Snowflake's Time Travel Feature is a powerful who pays for data and compute for direct share and reader Episode-19 Covers building ETL Workflow in snowflake is ● Watch:Snowflake Python Connector Data Loading Example
utility that can save time and effort in managing complex data accounts, whether only permanent tables can be shared, and not an easy task and if you have to build an end to end ETL
whether changes made by providers are immediately reflected at
projects. Time travel offers more than just the ability to view past
data, it opens up new possibilities for designing and operating the consumer side.
workflow (or ETL workflow) we need to use pipe, stream and task
components along with external stages and orchestrate all the
PowerBI & Snowflake Integration
data projects. The 30-minute episode introduces time travel and ● Watch: What you don't know about data sharing? activities. This episode is a comprehensive 60 min practical guide Episode-25.1 To Be Published Shortly.
answers questions such as what time travel is and how it works ● Watch: Cloneable vs Data Sharing with handson exercise to demonstrate you how it works.
conceptually, whether all editions of Snowflake support time ● Watch: Account to account direct sharing ● Watch: Customer Order Use Case for Snowflake
travel, whether time travel and fail-safe are the same, how time ● Watch: Cross cloud & cross region data sharing ● Watch: How many objects are needed for this ETL Tableau & Snowflake Integration
travel works for transient and temporary tables, whether time ● Watch: Data sharing using snowflake reader account ● Watch: Practice it together
travel is expensive, whether time travel and data retention ● Watch: Data sharing hands-on section ● Watch: Part-1: Creating Landing Layer DDLs Episode-25.2 To Be Published Shortly.
parameters are the same, what is extended SQL for time travel, ● Watch: Scenario-1 Share only database ● Watch: Part-2: Creating Curated Layer DDLs
and whether time travel is applicable only for tables or for ● Watch: Scenario-2 Share table and views ● Watch: Part-3: Creating Consumption Layer DDLs
databases and schemas as well. ● Watch: Scenario-3 Share via reader's account ● Watch: Part-4: Stages & Pipes for Landing Layers
● Watch: What problem does time-travel solve? ● Watch: Scenario-4 Cross Cloud & Cross Region ● Watch: Part-5: Stream & Tasks for Landing Layers
● Watch: What is time travel? ● Watch: Part-6: Stream & Tasks for Curated Layers
● Watch: Difference Between Time Travel & Fails Safe?
● Watch: Time Travel for Transient/Temporary Tables? Change Data Capture - Streams ● Watch: Part-7: Data Loading via WebUI (Delta Load)
● Watch: Delta Load via S3 Bucket
● Watch: How to enable time travel?
● Watch: Drop & Undrop Table, Database, Schema SQLs?
Episode-17 Snowflake Stream & Change Data Capture is a Snowflake End To End ETL Flow
powerful feature that simplifies CDC architecture. The 27-minute
● Watch: Clone (Create Table) with Time Travel SQL. Episode-19 Covers building ETL Workflow in snowflake is
episode introduces the feature and elaborates on stream objects,
● Watch: Create Table As Select Using CTAS with Time Travel