technifyedWeekly list

Snowflake

Apache Iceberg: From Zero to Production Data Lakehouse

via Coursera

Overview

This course is designed for data engineers, analytics engineers, data platform engineers, and data architects who work with data lakes and want to modernize their data infrastructure. It's also valuable for software engineers transitioning into data roles and technical leads evaluating Apache Iceberg for their data.

By the end of this course, you will be able to:

- Build and configure an Apache Iceberg lakehouse using catalogs, object storage, and query engines like Spark and Trino

- Design optimal table structures using hidden partitioning, sort orders, and column metrics to maximize query performance

- Migrate existing data from Hive tables, Parquet files, CSV, and databases into Iceberg using snapshot, migrate, and reserialization approaches

- Implement production workflows using Write-Audit-Publish for validation, branching for testing, and rollback for recovery

- Evolve table schemas and partition specifications without downtime or rewriting data

- Execute maintenance operations including data file compaction, metadata compaction, and snapshot expiration

- Configure write strategies (merge-on-read vs copy-on-write) and distribution modes for different workload requirements

- Manage concurrent operations and avoid conflicts in multi-writer scenarios

To be successful in this course, you should have:

- Working knowledge of SQL and relational database concepts (tables, schemas, queries)

- Basic understanding of data engineering concepts including ETL/ELT, data warehouses, and data lakes

- Familiarity with command-line interfaces and Docker for running the course environment

- Comfort reading and understanding code examples in Python/PySpark (code is provided; you don't need to write from scratch)

- Experience with Apache Spark or distributed computing is helpful but not required—core concepts are explained throughout the course

Apache Iceberg, Iceberg, Apache, and the Apache feather logo are either registered trademarks or trademarks of The Apache Software Foundation. No endorsement by The Apache Software Foundation is implied by the use of these marks.

Advantages and disadvantages

Advantages

  • Structured courses with graded quizzes, assignments and deadlines you can reset.
  • A shareable certificate from the university or company when you pay.
  • Financial aid is often approved for students in India (apply 15 days before you need it).
  • Self-paced: start any time.

Disadvantages

  • Paid after a 7-day free trial (Coursera Plus or per course).
  • Some courses can be audited for free, but graded work and certificates need payment.

Some points apply to every course of this kind; see how we rank.

This course is paid. Here is how to take it for free

  • Free trials: You can start a 7-day free trial for many individual courses, Specializations, or a Coursera Plus subscription to test full course features. Cancel before the seventh day if you do not want to be charged.
  • Financial aid: If you cannot afford the fee for a certificate, you can apply for financial aid through the link on the course home page by filling out an application about your background and goals.

Snowflake is in Tier 3: good universities, respected companies, nonprofits and well-known teachers of our institution ranking (74/100).

Similar courses

Compare these

Harvard University

Fundamentals of TinyML

4.567 ratings

Focusing on the basics of machine learning and embedded systems, such as smartphones, this course will introduce you to the “language” of TinyML.

  • Free to audit
  • 5 weeks, 2 - 4 hours per week

Harvard University

Introduction to Data Science with Python

4.3174 ratings

Learn the concepts and techniques that make up the foundation of data science and machine learning.

  • Free to audit
  • 8 weeks, 3 - 5 hours per week

Harvard University

CS50's Introduction to Computer Science

An introduction to the intellectual enterprises of computer science and the art of programming.

  • Free to audit
  • 12 weeks, 5 - 14 hours per week

Harvard University

Data Science: Building Machine Learning Models

4.4133 ratings

Build a movie recommendation system and learn the science behind one of the most popular and successful data science techniques.

  • Free to audit
  • 8 weeks, 2 - 3 hours per week

Massachusetts Institute of Technology

MIT 14.310x Data Analysis for Social Scientists, Spring 2023

Instructors: Esther Duflo and Sara Ellison View the complete course: https://ocw.mit.edu/courses/14-310x-data-analysis-for-social-scientists-spring-2023 This course introduces methods for harnessing data to answer questions of cultural, social, economic, and policy interest. We will start with esse…

  • Free video
  • 23 videos, 28 hours

Harvard University

CS50's Introduction to Programming with Python

An introduction to programming using Python, a popular language for general-purpose programming, data science, web programming, and more.

  • Free to audit
  • 10 weeks, 3 - 6 hours per week