Responsibilities
- Build scalable production-grade data pipelines and real-time data streams.
- Write and design scalable, cloud-ready applications.
- Lead technical projects through architecture, design and implementation phases.
- Collaborate with Machine Learning, Data Science, Design, Software Engineering and Business teams to triage data or ETL issues.
- Build tests and health checks to maintain code and data quality.
- Monitor and analyze data flowing through various systems by adding appropriate visualizations and dashboards.
- Provide updates and offer guidance to clients.
Requirements
- Advanced Python and SQL
- Experience in ETL design, implementation, and maintenance.
- Experience in AWS (preferred), GCP, or Azure delivering data-centric product experiences
- 5+ years experience in related role
- Experience with in-memory and disk-based databases, relational and non-relational databases, full-text search engines, database design, development, and maintenance. (Such as MySQL, MongoDB, OpenSearch, and DynamoDB, with bonus for Graph Databases like Neo4j)
- Experience in data warehousing and multidimensional data models (columnar data modeling)
- Working knowledge in Data Lake, Data warehouse and massive parallel processing
- Strong problem-solving ability and ability to work through ambiguity and incomplete specifications
Nice to Have
- Working knowledge in IAM, Federated Authentication, SSO, SAML, Encryption, Security, APIs, Disaster Recovery or Backup
- Strong ability in distributed systems for large-scale data processing
- Experience with Spark and Pandas
- Experience with Open Tables (Hudi, Delta Lake, DataBricks, Iceberg as related to Data Lakehouse)
- Experience with Infrastructure as Code and CI/CD Pipelines
- Experience with QuickSight and DataViz
Work Arrangement
Remote (Worldwide)
Additional Information
- Excellent English required
- CV written in English
- Work entirely in English for meetings, customer calls and business communications
