Oscilar is looking for a Sr./Staff Backend Engineer to focus on designing, implementing, and optimizing services that leverage Apache Kafka for high-throughput, real-time data streams. You will be responsible for scaling databases like Postgres, Redis, DynamoDB, and ClickHouse within our AWS infrastructure. This is a senior technical leadership role involving cross-team collaboration, mentoring, and driving system scalability, performance, and reliability.
What You'll Do
- Design, develop, and maintain scalable backend services using Java and AWS technologies.
- Lead the architecture, deployment, and optimization of Apache Kafka to support real-time data streaming across distributed systems.
- Build and manage Kafka topics, brokers, producers, and consumers, ensuring optimal performance and data consistency.
- Implement streaming solutions with Kafka Streams and Kafka Connect, focusing on high availability and low-latency processing.
- Collaborate with product, frontend, and data engineering teams to define technical requirements and deliver reliable, performant services.
- Design and maintain high-performance data storage solutions using Postgres, Redis, ClickHouse, and DynamoDB.
- Optimize database performance through schema design, indexing strategies, and resource partitioning.
- Implement best practices for infrastructure security, performance monitoring, and data integrity.
- Establish and maintain CI/CD pipelines for automated testing, deployment, and monitoring.
- Provide mentorship to junior engineers, conduct code reviews, and promote best practices in software development.
- Proactively identify and resolve performance bottlenecks and technical challenges in both streaming and database systems.
What We're Looking For
- 8+ years of experience with Java in large-scale, distributed environments.
- Extensive experience with Apache Kafka, including Kafka Streams, Kafka Connect, partitioning, replication, and consumer group management.
- Strong experience with AWS services (e.g., MSK, EC2, RDS, DynamoDB, S3, Lambda).
- Solid understanding of distributed system design, messaging patterns, and eventual consistency.
- Proven ability to diagnose and resolve bottlenecks in streaming and database systems.
Nice to Have
- Experience integrating Kafka with analytics solutions like ClickHouse.
- Knowledge of event-driven architecture and streaming patterns like CQRS and event sourcing.
- Hands-on experience with monitoring tools (e.g., Prometheus, Grafana, Kafka Manager).
- Experience automating infrastructure with tools like Terraform or CloudFormation.
- Proficiency with Postgres, Redis, ClickHouse, and DynamoDB. Experience with data modeling, query optimization, and high-transaction databases.
- Familiarity with encryption, role-based access control, and secure API development.
Technical Stack
- Languages & Frameworks: Java, Apache Kafka, Kafka Streams, Kafka Connect
- Cloud & Infrastructure: AWS, MSK, EC2, RDS, DynamoDB, S3, Lambda
- Databases: Postgres, Redis, ClickHouse
- Monitoring & Tooling: Prometheus, Grafana, Kafka Manager, Terraform, CloudFormation
Team & Environment
You will collaborate across teams and mentor other engineers. Oscilar's culture is built on mission-driven teams, extreme ownership, innovating at the cutting edge, and is a family-friendly, AI-first company. Over 50% of the company is in Engineering and Product, and both Co-Founders are engineers at heart.
Benefits & Compensation
- Competitive salary and equity packages
- 401k
- 100% Employer covered comprehensive health, dental, and vision insurance with a top tier plan for you and your dependents (US and Canada)
- Unlimited PTO policy
- Home office setup assistance
- Regular team events and offsites
- Unparalleled learning and professional development opportunities
Work Mode
This is a global position.
Oscilar is an equal opportunity employer.
