sciwork 2023

Shuhsi Lin

I'm a versatile professional with expertise in data engineering, Python programming, and computational biology. My professional interests span software/data architecture, IoT applications, cloud/web services, and engineering culture. Passionate about sharing insights in the data engineering field through both online and offline channels.

See more in https://www.linkedin.com/in/shu-hsi-lin-48262b54

The speaker's profile picture

Sessions

12-09
13:40
30min
Data Contracts: Empowering Data Quality Enforcement
Shuhsi Lin

In the realm of modern data engineering, ensuring data quality and fostering effective collaboration across teams are paramount. The introduction of DBT model contracts marks a pivotal advancement in this domain. These contracts provide a structured framework for defining and enforcing expectations about the output of data models. By examining the significance of DBT model contracts, this talk delves into their role in elevating data reliability, streamlining debugging processes, and optimizing resource utilization. We will explore the compelling advantages of using model contracts, from fostering collaborative data culture to enhancing change management. However, the journey isn't without its challenges. Limited platform support, potential complexity, and the need for effective communication are among the hurdles to overcome. By comprehending the transformative potential and navigating potential pitfalls, this talk aims to empower data practitioners with insights to leverage DBT model contracts effectively, ultimately elevating data quality, team efficiency, and decision-making across the organization.

Track
NYCU