As a Senior Data Pipeline Engineer, you will take full ownership of the data platform that underpins our key data products. From designing scalable ingestion systems to maintaining high-availability infrastructure, your work will directly impact how data flows across the organization. You'll report to the Data Engineering Manager and serve as the primary technical authority for platform stability, security, and performance.
Key Responsibilities
- Lead the operation and evolution of our core data infrastructure, ensuring reliability, scalability, and cost efficiency
- Manage cloud resources using AWS services including EC2, RDS, VPC, S3, and MWAA, with a focus on secure and compliant configurations
- Administer and optimize Databricks environments, including Unity Catalog and cluster management
- Develop, monitor, and troubleshoot data pipelines in Airflow/MWAA, minimizing failure rates and improving uptime
- Design and implement new data ingestion workflows from operational sources such as CRM, telephony, and transaction systems
- Support critical business initiatives like speed-to-match by enabling timely access to fresh data
- Manage PostgreSQL/RDS instances, including replica promotion, security group policies, and VPC peering setups
- Ensure infrastructure meets SOC-2 compliance requirements through proper access controls, audit readiness, and secure networking
- Configure and maintain authentication systems including SSO and VPN (Pritunl) access
- Collaborate closely with data engineers and analysts to align infrastructure with analytical needs
- Mentor team members on infrastructure best practices and promote reusable, maintainable solutions
- Drive long-term platform strategy by identifying opportunities to simplify architecture and reduce operational overhead
Required Qualifications
- 8+ years of experience in data engineering or platform-focused roles
- Proven expertise with Databricks administration and lakehouse design patterns
- Hands-on experience with Apache Airflow and MWAA for pipeline orchestration
- Strong AWS proficiency across EC2, RDS, VPC, S3, and managed services
- Experience managing infrastructure-as-code using Terraform across multiple environments
- Proficiency in Python, including PySpark for data processing
- Direct experience administering PostgreSQL/RDS with replica management and network configuration
- Familiarity with Pritunl or similar VPN solutions deployed on EC2
- Configuration experience with SSO and identity providers
- Excellent communication skills with the ability to collaborate across technical and non-technical teams
Preferred Qualifications
- Background in SOC-2 compliant environments
- Industry experience in real estate, fintech, or digital marketplaces
Technology Stack
Our platform runs on AWS with infrastructure managed through Terraform. Core components include Databricks, Airflow/MWAA, PostgreSQL/RDS, S3, VPC peering, security groups, PySpark, Unity Catalog, Pritunl, and SSO integrations.
Benefits
- Comprehensive medical, dental, vision, and life insurance
- 18 days of paid time off, increasing with tenure
- 10 paid holidays annually
- Annual learning and development stipend
- Paid sabbaticals for long-term employees
- Homeownership benefits for employees
- Work-from-home stipend to support remote setups
- 401(k) plan administered through Guideline
- 6–12 weeks of paid parental leave
- Free mental health counseling sessions
- Optional weekly meditation sessions
Compensation & Work Environment
This is a remote position open to candidates across the United States. The salary range is $200,000 to $240,000, plus bonus. The role offers full autonomy to shape technical direction while contributing to a platform that powers data-driven decision-making at scale.
Our Mission
We're transforming how people buy, sell, and manage real estate by combining advanced technology with deep domain knowledge. Our platform has already helped consumers save over $210 million in fees, and we're building the next generation of tools to make real estate transactions more efficient, transparent, and accessible.
Equal Opportunity Employer
We are committed to equal employment opportunities for all individuals. We do not discriminate based on race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by applicable laws at the federal, state, or local level.
