Responsibilities
- Design and implement enterprise-level cloud infrastructures using AWS technologies such as EC2, S3, Lambda, Kinesis, IAM, Redshift, Glue, and EMR.
- Develop Databricks Lakehouse implementations incorporating Delta Lake, Unity Catalog, Spark performance tuning, governance policies, and MLOps workflows.
- Construct scalable ETL and ELT data pipelines, real-time data streaming systems, and modular data integration frameworks.
- Produce comprehensive high-level and low-level architectural designs that prioritize security, regulatory compliance, cost optimization, system reliability, and performance efficiency.
- Experience preferred in designing hybrid cloud and on-premises data platforms using Azure components including Azure Data Lake, Azure Data Factory, Azure Databricks, and Synapse Analytics.
- Lead discovery sessions to gather requirements and convert business objectives into technical architecture strategies and implementation roadmaps.
- Develop architectural documentation including high-level designs, detailed design specifications, data flow diagrams, integration approaches, deployment models, and security reference models.
- Manage full lifecycle delivery of solutions, providing technical guidance to engineering and DevOps teams during development and optimization phases.
- Conduct architectural reviews and propose enhancements to improve system scalability, fault tolerance, and operational cost-efficiency.
- Deliver strategic technical direction and hands-on support to data engineering, analytics, DevOps, and platform development teams.
- Define and enforce standards for coding practices, data governance, CI/CD pipelines, infrastructure as code, and environment configuration management.
- Evaluate and integrate new cloud-based tools, technologies, and frameworks applicable to advanced analytics and modern data architectures.
- Serve as a technical subject matter expert in client engagements, workshops, and leadership-level presentations.
- Explain complex technical architectures in clear terms to both technical and non-technical stakeholders.
- Collaborate with business leaders to shape solution vision, define strategic roadmaps, and establish measurable success outcomes.
- Supervise enterprise-wide data engineering initiatives and architectural standards.
- Drive execution of high-priority, cross-functional technology projects.
- Ensure all technical strategies support broader organizational objectives and business outcomes.
- Offer strategic counsel to executive stakeholders on technology direction and architectural governance.
