Rust Data Engineering

Overview

What you'll learn

• Leverage Rust's robust data structures and collections for efficient data manipulation.
• Use Rust's safety and security features to build reliable and secure data engineering solutions.
• Utilize Rust's libraries and tools specific to data engineering, such as Diesel, async, Polars, and Apache Arrow.
• Interface effectively with databases, data processing systems, REST and gRPC protocols, and leverage AWS SDK for cloud-based data operations in Rust.
• Design and implement comprehensive data processing systems in Rust.
• Apply the principles of concurrent programming in Rust to build high-performance data processing applications.
• Identify and mitigate common data engineering problems using Rust's unique features, like its strong type system and memory safety guarantees.
• Develop command-line applications and multi-threaded servers in Rust, focusing on efficient, safe, and concurrent processing of data.
• Create practical projects, gaining hands-on experience in Rust for data engineering.

Skills you'll practise

gRPCData PipelinesData EngineeringData IngestionReal World DataData Processing SystemsData StoreRust (Programming Language)Application Programming Interface (API)CollectionsData StructuresWorkflow ManagementData SecurityExtract Transform Load (ETL)

Advantages and disadvantages

Some points apply to every course of this kind; see how we rank.

Taught by

• Noah GiftExecutive in Residence and Founder of Pragmatic AI Labs