InfoQ Homepage Presentations Effective Data Pipelines: Data Mngmt from Chaos
Effective Data Pipelines: Data Mngmt from Chaos
Summary
Katharine Jarmul discusses best practices when approaching data pipeline architecture, but also implementation decisions for those looking for a practical recommendation on the “what” and “how” of data automation workflows.
Bio
Katharine Jarmul is a Python engineer and educator. She runs a data science consulting company, Kjamistan, and offers several private and public courses on data automation, cleaning and acquisition. She has worked on data extraction and analysis since 2008. She offers several data science and engineering workshops and courses via Safari and other online partnerships.
About the conference
Software is changing the world. QCon empowers software development by facilitating the spread of knowledge and innovation in the developer community. A practitioner-driven conference, QCon is designed for technical team leads, architects, engineering directors, and project managers who influence innovation in their teams.