Responsibilities
- Create and manage dependable data pipelines and data lake infrastructure supporting both batch and real-time streaming scenarios, including systems that handle large data volumes with minimal latency
- Enhance monitoring, alerting mechanisms, and service level objectives across data platforms to enable proactive issue detection and easier system oversight
- Refine ETL and ELT processes to improve efficiency, scalability, and resilience against failures
- Implement dbt-based workflows to integrate Evaluation Partners and generate daily reports for partner performance analysis
- Develop and maintain event-driven systems and scalable platform elements
- Support the automation and orchestration of data workflows to increase operational efficiency
- Ingest and integrate data from complex financial APIs and external third-party sources into internal data ecosystems
- Partner with analytics, product, and machine learning engineering teams to deliver trustworthy data solutions
- Build pipelines that prepare feature data for machine learning model development and deployment
- Uphold strong practices in code quality, testing rigor, and system dependability
- Engage in Agile rituals and contribute to a cooperative, learning-focused team environment
Work Arrangement
Remote (Worldwide)
Team
Data & Analytics team