Automation & Reliability Engineer

Job Description

Overview

Reporting to the VP of Automation & Reliability Engineering, this position is critical to the mission of the Automation & Reliability Engineering team as part of the Global Infrastructure Services group. The core purpose of the role is to ensure that our complex technologies and systems are designed and operated for high efficiency and low risk. This includes participating in planning and designing infrastructure, monitoring solutions, metrics collection and reporting, and automation systems. The postholder has a background as an operations generalist and can work closely with our engineering and product development teams from the early stages of design all the way through identifying and resolving production issues. The ideal candidate will be passionate about a data and metrics-driven operations role that involves work across multiple IT and broadcast technologies and will also believe that automation is a key component to operating large-scale systems.

Position Highlights

Based in London, the postholder is part of a team supporting our three global Technology Operations Centers based in Sterling, VA, London, UK, and Krakow, PL. As a function these are the 24/7 Command & Control Hub for our media distribution and IT support services. The position is key to ensuring organizational improvements, consistently improving and maintaining our availability and uptime, establishing effective automation and monitoring solutions to deliver successes and areas of opportunity.

The Automation & Reliability Engineering team partners with engineering and workforce technology teams to advocate sensible, scalable systems design as well as building the best tools to diagnose, resolve and prevent issues. The postholder is an ambassador for automation and good design within GT&O and so should be a great communicator and enthusiastic champion of operational excellence.
In advocating and participating in good design practices and data-driven process and systems improvement, Automation & Reliability Engineers service the internal needs of the Technology Operations team, the broader GT&O organization, as well internal customers across myriad technology and business teams.

The postholder may be assigned on a permanent or rotating basis to a focus area that could include:
- Monitoring tool ownership, including establishment, configuration, administration, and operation of one or more monitoring tools or platforms.
- Technology operations service improvements, involving metrics collections and reporting as well as configuration, incident, problem, and change management workflow and automation analysis and design.
- Enterprise and digital platform and application performance and capacity assessment and design in the service of increasing efficiency, exceeding availability and performance SLA's, and meeting disaster recovery requirements.
The Postholder is expected to work regular office hours but during large events should expect to work outside of this including weekends and nights occasionally.

Responsibilities
- Own or assist in the configuration of monitoring and alerting systems in support of observability goals for myriad systems and services, including our public-facing services.
- Evaluate incident response requirements and workflows and contribute towards constant improvement through process improvement and application of automation.
- Gain deep knowledge of our complex applications
- Assist in the roll-out and deployment of new product features and installations to facilitate our rapid iteration and constant growth.
- Drive efficiencies in systems and processes: capacity planning, configuration management, performance tuning, monitoring and root cause analysis
- Participate in objective no-blame post-incident analysis and review process
- On behalf of operations be on point for capacity planning and to help the team anticipate and prepare for growth
- Develop tools to improve our ability to rapidly deploy and effectively monitor custom applications
- Support the creation of end-to-end availability and performance of mission critical services. Build automation to prevent problem recurrence. Partner with specialists to build automated responses for non-exceptional service conditions.
- Develop reliability tools and frameworks for use by all operations teams
- Ensure all key services are measured, monitored and raising alerts when needed
- Partner with specialists on automating the deployment and configuration processes
- Develop tools to improve our ability to rapidly deploy and effectively monitor custom applications in a large-scale UNIX and Windows environment.
- Function well in a fast-paced, rapidly-changing environment.
- Be on-call when required to support our operations centers

Qualifications
- Bachelor's degree in Computer Science, Information Technology, Mathematics, Software or Broadcast Engineering, or other technical discipline, or related practical experience.
- 3+ years experience with troubleshooting in Unix/Linux
- Good programming skills in one or more of C/C++, Java, Javascript, Python, Perl, Go and an ability to pick up new ones.
- Experience in the Linux environment and a good understanding of its fundamentals and internals: filesystems and modern memory management, threads and processes, the user/kernel-space divide, etc.
- Background in Configuration and management of large scale platforms. (Virtualization, Cloud, Unix, Linux, Java, SQL, Oracle)
- A good understanding of large-scale distributed systems in practice, including multi-tier architectures, application security, monitoring and storage systems.
- Working knowledge of the TCP/IP stack, internet routing and load balancing
- Working exposure to linear and digital broadcasting and platforms preferred
- Knowledge of most of these: data structures, relational and non-relational databases, networking, Linux internals, filesystems, web architecture, and related topics
- Previous experience working with geographically-distributed coworkers.
- Strong verbal, written, interpersonal communication and customer service skills and ability to work well in a global diverse, team-focused environment
- Good organizational and conceptual skills combined with proven critical thinking, analytic, problem solving, and decision-making abilities
- Ability to multi task within related functions
- Positive attitude and can-do mentality
- Experience of working for a Media Company/Broadcast is desirable but not essential

Jobcode: Reference SBJ-d55v81-18-117-183-172-42 in your application.