Sr Data Engineer, Data Ops

Job Description

Overview and Responsibilities

The Lead Data Engineer for Data Operations will be responsible for implementing best practices and managing all alerting and monitoring of the data engineering subsystems including scheduled data ingestion and transformation jobs and streaming data processes. We are looking for a seasoned data operations leader that will utilize technical knowledge, problem solving and troubleshooting skills to manage data operations and lead a team of offshore operations engineers.

Working as part of the Data Engineering team which is responsible for managing all data feeds and collecting analytical streaming data from all our client software. This is a very fast paced environment dealing with very large volume and high velocity of data. This position will be responsible for supporting Pluto TV's Data Engineering team by ensuring the smooth running of all our data processes and making sure we can maintain 100% uptime and seamlessly support internal and external clients. This position will be responsible for managing all aspects of data operations with the support of a team of offshore engineers. This position will require working closely with other senior data engineers and create and manage unified ways to add monitoring and alerting to all data projects. You must have a background demonstrating strong organizational and prioritization skills. This is a critical role with a wide range of responsibilities, including:
• 12+ years experience working with data
• Demonstrated ability to lead teams of engineers both on and off shore
• Demonstrated understanding and experience with end to end big data pipelines
• Demonstrated experience in engineering operations with a focus on data systems
• Demonstrated ownership and ability to manage multiple projects
• Demonstrated strong time-management, prioritization and organizational skills
• Demonstrated strong troubleshooting and problem-solving skills
• Strong interpersonal skills, with the ability to cultivate relationships and negotiate with internal clients
• Ability to manage expectations and deadlines
• Ability to motivate and mentor team members
• Proven strong written and oral communication skills
• Bachelor's Degree or Equivalent

Basic Qualifications

We believe the right individual will have the following skills and experience in order to be successful in this role:
• Strong knowledge of SQL and familiarity with modern cloud databases like Snowflake
• Strong knowledge of AWS services (CloudWatch, VPC, Kubernetes, EC2, Lambda etc)
• Good understanding of Airflow and SQL driven ETL
• Good understanding of streaming solutions like Kafka and Kinesis
• Experience with tools like Grafana or Prometheus for monitoring data systems
• Knowledge of programming languages like Python or Java
• At least 7 years of hands-on experience data engineering and data operations
• Ability to leads teams of engineers
• Ability to plan and manage project roadmaps
• Strong analytical and troubleshooting skills
• Effectively and clearly communicate and manage open project risks and dependencies with leadership

Jobcode: Reference SBJ-r7q2q9-3-141-244-201-42 in your application.