Responsibilities
- Ingest and process data from Salesforce (Investments), Dynamics 365 & Coupa (Finance), Workday (HR), Concur (Operations), and external program/partner data (e.g., Health, Education).
- Build and maintain pipelines in Databricks, DBT, and Snowflake to deliver curated datasets for AI/ML.
- Design simple, reusable data models to support training and inference.
- Implement data quality tests, documentation, and lineage in DBT
- Ensure performance optimization, cost efficiency, and compliance with governance standards.
- Collaborate with Knowledge Management (AI/Data Science) team to provide feature ready datasets.
Requirements
- Hands-on experience with Databricks (PySpark/SQL, Unity Catalog), DBT (models, tests, docs), and Snowflake (SQL, performance tuning).
- Strong background in ETL/ELT pipeline development.
- Experience with enterprise SaaS systems (Salesforce, D365, Coupa, Workday, Concur).
- Solid SQL and Python skills; knowledge of data quality frameworks.
