Software Team Lead – Data Platform & Streaming
Confirmed live in the last 24 hours
Cybereason
Job Description
We have the technology, and now we are looking to expand our talent! Join a market leader and a diverse team of passionate professionals who win as one, put customers first, and never give up on reversing the adversary’s advantage.
Role Overview
We are seeking an experienced Backend Team Lead – Data Platform & Streaming to lead the engineering team responsible for the core data backbone of the Phoenix XDR platform.
This team owns the ingestion, normalization, streaming, and storage layers that power everything built on top of Phoenix. From Redpanda-based event streaming to real-time processing and ClickHouse schema governance, this role ensures that billions of daily security events are reliably ingested, structured, enriched, and made available for downstream intelligence systems.
This is a hands-on technical leadership role focused on distributed systems, large-scale data pipelines, and real-time stream processing in a high-throughput, multi-tenant environment.
Key Duties & Responsibilities
Technical Leadership (Hands-On)
- Architect and evolve the real-time data ingestion backbone of Phoenix
- Own Redpanda (Kafka-compatible) infrastructure, topic design, partitioning strategy, and consumer scalability
- Lead development of high-throughput streaming pipelines processing billions of events daily
- Design and maintain real-time transformation, enrichment, and rule-based processing
- Define and govern ClickHouse schemas, ensuring efficient storage, query performance, and schema evolution across integrations
- Build and optimize distributed ETL pipelines with strict latency and ordering guarantees
- Ensure data reliability, fault tolerance, and exactly-once or near-exactly-once processing semantics
- Design scalable multi-tenant data architectures supporting MSSP environments
- Improve ingestion performance, backpressure handling, and stream reprocessing strategies
- Drive observability and monitoring for streaming systems
- Lead and mentor a team of backend and data engineers building distributed systems
- Collaborate closely with Correlation & Intelligence teams to ensure data is structured and consumable
- Partner with DevOps and SRE teams to ensure high availability and performance at scale
- Own roadmap planning for new integrations and platform scaling initiatives
Skills & Qualifications Required
Required Qualifications
- Bachelor’s degree in Computer Science, or a related technical field — or equivalent practical experience
- 5+ years of experience in data engineering, distributed backend systems, or large-scale platform engineering
- 3+ years of experience leading engineering teams (5–10 engineers)
- Deep expertise in distributed streaming systems (Kafka / Redpanda or similar)
- Strong hands-on experience with stream processing frameworks
- Experience designing and evolving schemas in high-performance analytical databases
- Proven experience building high-throughput, low-latency ingestion systems at scale
- Strong understanding of distributed systems principles (partitioning, replication, consistency, fault tolerance)
- Strong coding skills in one of - Rust, Java, Typescript, C++
- Data-driven mindset with strong ownership of reliability, SLAs, and performance metrics
More About Cybereason:&
Similar Jobs
E.ON Next
Engineering Manager - Frontend
Southwest Airlines
Content Developer
Onto Innovation
Software Engineer 3
Nasdaq
Software Developer Senior Specialist
Northern Trust
Lead, Cyber Security Engineer
Dexcom