Skip to main content

Senior Site Reliability Engineer - AI Compute

ByteDance
  • Dublin, Ireland
  • Posted 11 Nov
  • Visa not mentioned
  • English-language posting

Sign in to see how your CV matches this job

Job description

Job Description The Data Infrastructure SRE team is responsible for the reliability, scalability, and efficiency of the compute platform that powers our products and data workloads. We operate large-scale Kubernetes environments and AI infrastructure across heterogeneous CPU and GPU resources, including cluster control planes, worker nodes, workload scheduling, container runtimes, and resource management systems. Our focus is to keep shared compute services available, predictable, and cost-efficient while enabling product and platform teams to run critical workloads safely at scale. This role includes participation in a rotational on-call schedule to provide continuous coverage for critical compute infrastructure. You will respond to, troubleshoot, and resolve production incidents involving Kubernetes clusters, CPU and GPU nodes, containers, scheduling, and resource availability. Our team works across multiple time zones and follows rigorous change management and post-incident review practices to maintain platform stability. As a Site Reliability Engineer focused on compute and AI Infra, you will operate and improve large-scale Kubernetes platforms, manage cluster and node lifecycle changes, diagnose workload and scheduling failures, and automate repetitive tasks. You will work with senior engineers and partner teams to improve the reliability, performance, and efficiency of the compute platform.

Responsibilities:

  • Kubernetes and AI Infra reliability: Own the reliability of large-scale Kubernetes and GPU clusters. Lead incident response, root-cause analysis, and corrective actions across control planes, nodes, container runtimes, scheduling, and host-level dependencies.
  • Cluster and node lifecycle management: Operate CPU and GPU clusters through provisioning, upgrades, scaling, configuration changes, repair, replacement, and decommissioning. Build safe rollout, rollback, and validation mechanisms for cluster-level changes.
  • Heterogeneous resource management and scheduling: Improve placement, utilization, isolation, and availability for online, batch, data, and AI/ML workloads across CPU and GPU resources. Optimize quotas, priorities, preemption, affinity, autoscaling, and accelerator-aware scheduling.
  • Capacity, performance, and cost: Own compute capacity planning, resource forecasting, and performance tuning across clusters and failure domains. Balance workload demand, reliability, utilization, and infrastructure cost.
  • SLOs, observability, and operational readiness: Define SLOs and error budgets for compute and AI Infra services. Improve monitoring, alerting, runbooks, production-readiness reviews, and failure recovery for clusters and workloads.
  • Automation and technical leadership: Build maintainable tooling and automated remediation to reduce operational toil and improve deployment safety. Partner with workload owners and infrastructure teams on platform standards, design reviews, and operational practices.

Wording is the employer's. Read the original on their site.

More English-speaking jobs: All cities