Weekday is looking for a Data Engineer to join our team. You will focus on designing, building, and managing data pipelines and infrastructure on Azure and other Big Data platforms to enable data-driven decision-making across the company.
What You'll Do
- Design, construct, and maintain scalable data pipelines on Azure and other Big Data platforms.
- Implement data storage solutions that ensure high availability, reliability, and performance.
- Collaborate with data analysts and business teams to understand data requirements and translate them into technical solutions.
- Optimize data processing systems for efficiency and cost-effectiveness.
- Monitor data platform performance and troubleshoot issues proactively.
What We're Looking For
- Proven experience as a Data Engineer with a focus on Azure cloud services.
- Strong proficiency in building and managing Big Data platforms and data lakes.
- Expertise in data pipeline and workflow management tools.
- Solid understanding of data modeling, ETL/ELT processes, and data warehousing principles.
- Experience with programming languages commonly used in data engineering (e.g., Python, Scala, SQL).
Technical Stack
- Cloud Platform: Microsoft Azure (Data Factory, Synapse Analytics, Databricks, Data Lake Storage).
- Big Data Technologies: Spark, Hadoop, Kafka.
- Languages: SQL, Python, Scala.
- Orchestration: Apache Airflow or similar.
Weekday is an equal opportunity employer.
