Snowflake Mastery: An easy step by step approach to be an expert in snowflake
What you will learn
You will learn about the Snowflake Architecture and Performance management
Deep Dive in to the Access management and the type of Db objects
Understand in full detail how the data moves from external system to Snowflake
Deep knowledge on Dynamic data masking and visualization
Extensive knowledge on Data Sharing and Data Protection
Description
Are you a technology professional or college graduate who have thought multiple times to learn snowflake but couldn’t learn it so far?
Is your self snowflake learning a struggle? As a busy technology professional, do you feel overwhelmed and frustrated with all the ‘answers’ to master snowflake, but still not sure which one is right for you?
Have you wondered, how many days , weeks and months are passed in just thinking about learning snowflake? The time is NOW to get started.
In this course, you will discover exactly what you need to focus on to master snowflake. We will take you through an easy step by step approach to learn and master snowflake in shortest period of time with out overwhelm.
Cloud is the new norm, almost all tech giants are moving towards cloud platform for the solutions which are cost effective and scalable. Cloud data-warehousing aka Snowflake warehouse is one the fastest growing technology which most of the technology companies are adopting. This is going to be big in future, hence this is the right time to get into the ship to learn and equip ourselves will all the knowledge of snowflake and prepare ourselves for better career today and in future. So if you find yourself saying “May be I will try it another time “. I would say THE TIME IS NOW. Don’t let yourself go another day, another week, another month of learning procrastination. It’s time RIGHT NOW to get on the journey of learning and have the life knowledge and excellent career you have designed for you.
Following modules will be covered in a very easily step by step approach
- Snowflake Architecture and Performance Management
- Introduction
- Create Trial account
- Know your UI interface
- Shared and Non Shared Disk Architecture
- High Level Architecture
- Create Virtual Warehouses
- Scaling Policy
- Create First Database and Table
- Load CSV from public S3 bucket
- Snowflake Architecture
- Snowflake Editions
- Credits
- Credit Usage Scenarios
- Credit to Dollar Storage cost
- Credit Storage Consumption
- Performance Management
- Performance Improvement Methods
- Dedicated Virtual Warehouses
- Dedicated Virtual Warehouses Creation
- Scale Up and Scale Down
- Scale Out and Scale In
- Maximize Caching
- Maximize Caching demonstration
- Clustering Keys
- Clustering Cost
- Clustering Performance
- Micropartitions
- Access management and snowflake objects
- Access management
- Access control and RBAC
- Securable objects
- Roles
- Tables in snowflake
- Table Types
- Database and schema type
- User Defined Functions (UDF’s) and Stored Procedures
- User defined functions (UDF’s)
- Stored procedures (SP’s)
- Secure UDF’s and SP’s
- Views
- Non Materialized views
- Materialized views
- Data Movement – Techniques and Unloading
- Data Loading techniques
- Types of Data load
- Know snowflake stages
- Install Snowsql
- Internal Stages
- Userstage
- Tablestage
- Namedstage
- External Stages
- COPY Command
- COPY Transformation
- File Format Object
- COPY OPTIONS
- ON ERROR
- SIZE LIMIT
- RETURN_FAILED_ONLY
- ENFORCE_LENGTH / TRUNCATECOLUMNS
- FORCE / LOAD_UNCERTAIN_FILES
- LOAD_HISTORY
- VALIDATION MODE
- Logging rejected records
- Data loading best practices
- Data Unloading
- Data unloading theory
- COPY into location – Internal Stage -> User stage
- Resolving max_workers must be greater than 0
- COPY into location – Internal Stage -> Table stage
- COPY into location – Internal Stage -> Named Internal Stage
- Unloading using Query
- Unloading to Multiple Files
- Data Movement – Data loading
- Loading from AWS
- Create AWS free-tier account
- Create S3 bucket, file and role
- Storage integration object
- Load file from AWS
- Unload data to AWS
- Loading from Azure
- Create Azure free trial account
- Create storage and container
- Integration object
- Load data from Azure
- Unload data to Azure
- Loading from GCP
- Create GCP free trial account, create bucket and upload file
- Integration object
- Load data from GCP
- Unload data to GCP
- Loading Semi-Structured Data
- Introduction
- Process and understanding the demo data
- JSON: Load raw data and analyze nested objects
- JSON: FLATTEN
- Array/Objects
- Hierarchical
- JSON: Data transformation and load
- JSON: Querying Data
- PARQUET: File load and transformation
- Snowpipe
- Overview
- Create snowpipe, load and configure
- Troubleshooting and pipe refresh
- Manage snowpipe
- Dynamic Data Masking and Visualization
- Dynamic data masking
- Overview
- Create masking policy
- Change, Unset and replace masking policy
- Conditional masking
- Dynamic data masking
- Data Visualization
- Snowsight – Dashboard and Visualization
- Getting started with Tableau
- Tableau visualization from snowflake data
- Partner Connect
- Overview
- Partner connect categories
- Data Sharing and Data Protection
- Data Sharing
- Overview
- Data sharing demo of Table, External tables and UDF’s.
- Data share to a reader account
- Imported privileges
- Data share – entire database
- Data share operations – DDL and DML affect
- Sharing views and materialized views
- Time Travel
- Overview and retrieve data using “at” and “before”
- Data restoration using direct method
- Data restoration using indirect method
- UNDROP
- Understanding retention time
- Fail-Safe
- Overview
- Fail Safe demo
- Zero-Copy Cloning
- Overview
- Cloning permanent tables
- Copy grants and clone temporary external tables
- Clone schema and database
- Swap
- Clone using time travel and understand sharing vs cloning
- Streams
- Overview
- Consuming streams using insert, update and delete
- Types of streams – default, append only. Consume stream using false condition
- Insert only streams for external tables
- Multiple consumers with streams
- Changes clause
- Streams consideration and stale after attribute
- Recreate, rename and clone effect on stream
- Tasks
- Understanding tasks
- Create task using procedure when and troubleshoot task
- Scheduling tasks using CRON
- CRON – Daylight savings considerations
- DAG – Tree of tasks
- Task with stream
- User managed tasks and warehouse considerations
- Sampling Data
- Overview
- Row sampling method
- System block method
- Access management in practice
- System defined roles and its users
- Custom roles and its users
- Create objects from sysadmin role and assign to developer role
- Create custom users – developer1, developer2,qa1 and reader1
- Problems due to unassigned custom roles
- Solution of the problems
- Public Role
- Best Practices
- Auto resume, success and failure and long running queries
- Resource monitor
- Columns storage cost and benchmarking the queries
Enjoy and Happy Learning !
Content