Home

All courses

100 Snowflake Cost Optimization Techniques

IT & Software

Operations

100 Snowflake Cost Optimization Techniques

by World-Class Snowflake Expert

4.6

(82)

3511 enrolled on this course

Last updated 11/2021

None

₹ 3099.0

₹ 4599.0

Buy Now

30-Day Money-Back Guarantee

Lessons

Quizzes

Duration

13 Hours

Skill level

Beginner

Language

English

Certificate

Yes

Full lifetime access

Yes

Description

What You Will Learn About Spending
How to use even bigger virtual warehouses for less expensive queries.
How to avoid huge cost traps in Snowflake by changing different parameter values.
How to optimize queries, compute, storage and overall costs in Snowflake.
How to properly consolidate underutilized warehouses.
How each serverless feature in Snowflake works and how to estimate their cost.
How to use parallel data transfer and processing everywhere you can.
How to combine different Snowflake editions in your organization.
How to use better data visualizations to estimate spending.
How to reduce your spending on all your Snowflake accounts.
I also offer over 300 high-quality presentation slides with the summary on each tip or technique!
Where You May Use This Knowledge
Drastically reduce costs on your own Snowflake accounts.
Create more Snowflake accounts - with different editions - and use them efficiently.
Help your clients reduce spending on their Snowflake accounts.
Help your employer reduce costs on Snowflake in your own organization.
Learn to recognize the traps most people fall into when using Snowflake.
Create not just highly performant, but also cost-effective SQL queries.
Learn how to get cheaper queries with huge warehouses, using hundreds of nodes.
I also offer an open-source GitHub repository with dozens of hands-on exercises and experiments!
What You Will Learn About Snowflake
Learn all about the virtual warehouses.
Learn how to monitor and optimize queries.
Learn about resource monitors and budgets.
Learn query acceleration and search optimization
Estimate efficient automatic clustering and maintenance of materialized views.
Learn all that matters about time travel and zero-copy cloning.
Learn how to efficiently deploy and combine Snowflake with other applications.
I have many brief but focused hands-on presentations of different Snowflake features!
Who I Am
The only world-class expert from Canada selected for the Snowflake Data Superhero program in 2021.
SnowPro Certification SME (Subject Matter Expert) - many SnowPro exam questions have been created by me.
Passed four SnowPro certification exams to date (with no retakes): Core, Architect, Data Engineer, Data Analyst.
Specialized in Snowflake for the past few years: I worked for Snowflake Partner companies, I served dozens of clients in this capacity or as an independent consultant, today I share my knowledge with highly specialize courses on Snowflake.
This is truly "the" Bible on Snowflake spending!
No other course, book or documentation around will offer as much insights, hands-on experiments and knowledge transfer on optimizing the cost on Snowflake as my course here, guaranteed!
Enroll today, and keep this course forever!
Who this course is for:
Snowflake account owners who want to reduce their spending
Snowflake consultants who want to advise their clients on Snowflake spending
Anyone using Snowflake in their organization who wants to control their costs
Managers looking to cut their Snowflake spending by half
Technical persons who want to learn about all ways to cut spending on this data warehouse
Data Engineers and Architects looking to create cost-effective apps around Snowflake
Data Scientists who want to avoid spending traps when using Snowflake for Data Science apps

What you'll learn

Create and run cost-effective queries

Consolidate underutilized warehouses

Monitor and improve query performance

How using a bigger warehouse could cost you less

Watch over longest running and frequently executed queries

Serverless features in detail: cost and how they work

Avoid cost traps by setting different parameter values

How to combine different Snowflake editions

Save on costs with parallel data transfer and processing

Design and architect applications with cost impact in mind

Requirements

You will need a copy of Adobe XD 2019 or above. A free trial can be downloaded from Adobe.
No previous design experience is needed.
No previous Adobe XD skills are needed.

Course Content

27 sections • 95 lectures

Expand All Sections

1-Introduction

1.1-Course Structure and Content

1.2-Best Ways to Benefit from this Course

1.3-SnowPro Snowflake Certifications: Added Material!

1.4-Create a Free Trial Snowflake Account

1.5-Free Hands-On Project Setup

2-Virtual Warehouses

2.1-Introduction to Virtual Warehouses

2.2-Tip #1: Larger Virtual Warehouses May Actually Cost You Less

2.3-Tip #2: Auto-Suspend Any Warehouse After One Minute

2.4-Tip #3: Any Resumed Warehouse Will Cost You at Least One Minute

2.5-Tip #4: Never Auto-Suspend Any Warehouse After Less Than One Minute

2.6-Tip #5: X-Small Warehouses Could Be Powerful Enough

2.7-Tip #6: Resized Warehouses are for More Complex Queries

2.8-Tip #7: Multi-Cluster Warehouses are for Multiple Users and Concurrency

2.9-Tip #8: Multi-Cluster Warehouses Should Always Have Min Clusters 1

2.10-Tip #9: Use Economy Scaling Policy To Save Money

2.11-Tip #10: When to Use Snowpark-Optimized Warehouses

2.12-Test Your Knowledge

3-Compute Workloads

3.1-Introduction to Compute Workloads

3.2-Tip #11: Use Resource Monitors

3.3-Tip #12: Use Account-Level Budgets

3.4-Tip #13: Prevent Never-Ending Queries

3.5-Tip #14: Manually Kill Running Queries

3.6-Tip #15: Reduce Warehouse Sizes

3.7-Tip #16: Consolidate All Warehouses

3.8-Tip #17: Use Parallel Jobs for Batch Transformations

3.9-Tip #18: Avoid Checking Too Much on Metadata

3.10-Tip #19: Charts for Warehouse Monitoring

3.11-Tip #20: Revisit the Main Traps with Warehouses

3.12-Test Your Knowledge

4-Snowflake Accounts

4.1-Introduction to Snowflake Accounts

4.2-Tip #21: What to Choose for a Free Trial Account

4.3-Tip #22: When to Use a Free Trial Account

4.4-Tip #23: Understand Price Tables for Virtual Warehouse Compute Services

4.5-Tip #24: Understand Price Tables for Cloud and Serverless Services

4.6-Tip #25: Understand Price Tables for Storage and Data Transfer

4.7-Tip #26: Use the Account Overview Interface in Snowsight

4.8-Tip #27: Use Organization Accounts

4.9-Tip #28: Limit Warehouse Changes with Access Control

4.10-Tip #29: Adjust Default Values of Account-Level Parameters

4.11-Tip #30: Careful with Reader Accounts

4.12-Test Your Knowledge

5-Snowflake Editions

5.1-Introduction to Snowflake Editions

5.2-Tip #31: When to Choose Enterprise over Standard Edition

5.3-Tip #32: How to Avoid Multi-Cluster Warehouses

5.4-Tip #33: When to Use Incremental Materializations

5.5-Tip #34: How to Emulate Materialized Views

5.6-Tip #35: The Case for Extended Time Travel

5.7-Tip #36: Use Standard Edition Account for Analytics

5.8-Tip #37: Use Separate Standard Edition Account for Common Queries

5.9-Tip #38: How to Reduce Costs to Zero for an Inactive Paid Account

5.10-Tip #39: When to Choose the Business Critical Edition

5.11-Tip #40: When to Choose the Virtual Private Snowflake (VPS) Edition

5.12-Test Your Knowledge

6-Query Monitoring

6.1-Introduction to Query Monitoring

6.2-Tip #41: Monitor Longest Running Queries

6.3-Tip #42: Interpret Query History

6.4-Tip #43: More Charts for Query Monitoring

6.5-Tip #44: Use Query Tags

6.6-Tip #45: Reduce Frequency of Simple Queries

6.7-Tip #46: Reduce Frequency of Metadata Queries

6.8-Tip #47: Reduce Frequency of SHOW Commands

6.9-Tip #48: Clone Less Frequently

6.10-Tip #49: Change Query Schedules

6.11-Tip #50: Parallel over Sequential Transfer and Processing

6.12-Test Your Knowledge

7-Query Optimization

7.1-Introduction to Query Optimization

7.2-Tip #51: Use the Query Profile

7.3-Tip #52: Use the Explain Statement

7.4-Tip #53: Use Data Caching

7.5-Tip #54: Queries on Data Lakes

7.6-Tip #55: Use Vectorized Python UDFs

7.7-Tip #56: Use Batch Commands to Prevent Transaction Locks

7.8-Tip #57: Reduce Query Complexity and Compilation Time

7.9-Tip #58: Check for Cross Joins and Exploding Joins

7.10-Tip #59: Process Only New or Updated Data

7.11-Tip #60: Remote Spillage Optimization

7.12-Test Your Knowledge

8-Serverless Features

8.1-Introduction to Serverless Features

8.2-Tip #61: Monitor the Cost of Automated Jobs

8.3-Tip #62: Estimate Cost of Scheduled Tasks

8.4-Tip #63: When to Use Serverless Tasks

8.5-Tip #64: Replace Snowpipe with Snowpipe Streaming

8.6-Tip #65: Estimate Cost of Automatic Clustering on Tables

8.7-Tip #66: Estimate Cost of the Query Acceleration Service (QAS)

8.8-Tip #67: Estimate Cost of the Search Optimization Service (SOS)

8.9-Tip #68: Reduce Materialized Views Maintenance Cost

8.10-Tip #69: Reduce Database Replication Cost

8.11-Tip #70: Estimate Cost of Hybrid Tables

8.12-Test Your Knowledge

9-Data Storage

9.1-Introduction to Data Storage

9.2-Tip #71: Use On-Demand Storage When You Don’t Know Your Spending Pattern

9.3-Tip #72: Copy and Keep Less Data

9.4-Tip #73: Lower Data Retention with No Time Travel

9.5-Tip #74: Estimate Storage Cost of the Fail-Safe

9.6-Tip #75: Use Transient or Temporary Tables

9.7-Tip #76: Use Zero-Copy Cloning

9.8-Tip #77: Clone Less Data

9.9-Tip #78: Ensure Tables Are Clustered Correctly

9.10-Tip #79: Drop Unused Tables and Other Objects

9.11-Tip #80: Remove Old Files from Stage Areas

9.12-Test Your Knowledge

10-Data Transfer

10.1-Introduction to Data Transfer

10.2-Tip #81: Data In is Free, Data Out is Expensive

10.3-Tip #82: Choose the same Provider and Region Where Your Data Is

10.4-Tip #83: External Access Integrations vs External Functions

10.5-Tip #84: Use Data Compression

10.6-Tip #85: Use Batch Transfer with Path Partitioning

10.7-Tip #86: Use Bulk Loads instead of Single-Row Inserts

10.8-Tip #87: Use Parallel Data Uploading

10.9-Tip #88: Design Cost-Effective Data Pipelines

10.10-Tip #89: Use External Tables in a Data Lake

10.11-Tip #90: Query Parquet Files instead of CSV

10.12-Test Your Knowledge

11-Snowflake Apps

11.1-Introduction to Snowflake Apps

11.2-Tip #91: Estimate Cost Impact of Data Sharing in Snowflake

11.3-Tip #92: Estimate Cost Impact of Client and Server (Snowpark) Applications

11.4-Tip #93: Estimate Cost Impact of Streamlit in Snowflake and Native Applications

11.5-Tip #94: Estimate Cost Impact of Data Science Applications

11.6-Tip #95: Check All Connected Applications

11.7-Tip #96: Third-Party Apps Saving Money Will Spend Money

11.8-Tip #97: Free Marketplace Native Apps Will Cost Money

11.9-Tip #98: Keep App Versions Updated

11.10-Tip #99: Cache Data in Third-Party Tools

11.11-Tip #100: Auto-Abort Running Queries from Disconnected Apps

11.12-Test Your Knowledge

12-The SnowPro Advanced Architect Certification

12.1-About this Added Material

12.2-General Info about all SnowPro Snowflake Certifications

12.3-Overview of the Advanced Architect Certification

12.4-Sample Questions for the Advanced Architect Exam

12.5-SnowPro Advanced Architect: Practice Tests

13-Wrapping Up

13.1-Congratulations, You Made It!

13.2-Bonus Lecture

Course Categories

Popular Courses

100 Snowflake Cost Optimization Techniques

Description

What you'll learn

Requirements

Course Content

You May Like