InfoQ Homepage Presentations Data Cleansing and Understanding Best Practices
Data Cleansing and Understanding Best Practices
49:31
Summary
Casey Stella talks about discovering missing values, values with skewed distributions and discovering likely errors within data, as well as a novel approach to finding data interconnectedness based on usage using unsupervised learning. He describes the impact of these lessons on team construction and how to avoid some of the most painful lessons.
Bio
Casey Stella is a committer and PMC member on the Apache Metron project in the engineering team at Hortonworks. Previously, he worked as an architect and senior engineer at a healthcare informatics startup spun out of the Cleveland Clinic, as a developer at Oracle and as a Research Geophysicist in the Oil & Gas industry.
About the conference
Software is changing the world. QCon empowers software development by facilitating the spread of knowledge and innovation in the developer community. A practitioner-driven conference, QCon is designed for technical team leads, architects, engineering directors, and project managers who influence innovation in their teams.
Mar 23, 2017