Failed to generate summary.
Joining each and every one of your colleagues in creating an inclusive workspace;
Owning, maintaining, and supporting the reliability, architecture, and evolution of our production machine learning and delivery platform;
Designing, operating, and improving large scale Databricks/Spark pipelines and workflows
Partner with our data scientists to productionize new data and ML-powered products;
Leading improvements on the software integration layers between data pipelines and product workflows;
Growing the team via mentorship and leadership, reviewing technical documents, improving code quality, and improving team performance and processes;
Acting as a senior technical owner in debugging complex production issues and improving system observability;
Collaborating with cross-functional teams to support their data infrastructure needs.
Extensive hands-on software engineering experience, with a strong track record of delivering production data pipelines or platforms in a mission critical environment
Strong experience with Python in production systems
Experience integrating ML models into reliable production data pipelines, including batch inference and model serving patterns
Experience building and operating Databricks (or Spark) based pipelines
Experience with SQL
Experience with at least one major cloud infrastructure provider (GCP, AWS, Azure)
Experience with supporting business-critical systems with on-call ownership
Passion, energy, and excitement for progressive and philanthropic causes and all things digital.
5+ years of professional experience;
Experience building data-intensive applications and warehouses with Databricks;
Experience with integrating production level applications with AWS;
Experience supporting ML training or inference pipelines;
Experience working with cross-functional teams in a dynamic environment.