Sr Data Engineer, Data Quality

Job Description

Overview and Responsibilities

The Lead Data Engineer for Data Quality will be responsible for implementing best practices and managing all aspects of data quality for the data engineering sub-systems. We are looking for a seasoned leader that will utilize technical knowledge, problem solving and troubleshooting skills to manage all data quality efforts and lead a team of offshore data quality engineers.

Working as a key Lead for the Data Engineering team and responsible for managing all data feeds and collecting analytical streaming data from all our client software. This is a very fast paced environment dealing with very large volume and high velocity of data, and this role will be responsible for ensuring that data quality is of the highest level across all data projects. This position will lead all aspects of data operations with the support of a team of offshore engineers. This role requires strong analytical, problem solving, organizational, and prioritization skills.

This critical role has a wide range of responsibilities, including:
• 12+ years experience working with data with emphasis on data quality
• Demonstrated ability to lead teams of engineers both on and off shore
• Demonstrated understanding and experience with big data pipelines
• Demonstrated expert level understanding of Airflow and Spark
• Demonstrated ownership and ability to manage multiple projects
• Demonstrated strong time-management, prioritization and organizational skills
• Demonstrated strong troubleshooting and problem-solving skills
• Strong interpersonal skills, with the ability to cultivate relationships and negotiate with internal clients
• Ability to manage expectations and deadlines
• Ability to motivate and mentor team members
• Proven strong written and oral communication skills
• Bachelor's Degree or Equivalent

Basic Qualifications

We believe the right individual will have the following skills and experience in order to be successful in this role:
• Strong knowledge of SQL and familiarity with modern cloud databases like Snowflake
• Strong knowledge of AWS services (CloudWatch, VPC, Kubernetes, EC2, Lambda etc)
• Good understanding of Airflow and SQL driven ETL
• Good understanding of streaming solutions like Kafka and Kinesis
• Experience with full testing life cycle
• Experience with building tools to improve data quality
• Knowledge of programming languages like Python or Java
• At least 7 years of hands-on experience data engineering and data operations
• Ability to leads teams of engineers
• Ability to plan and manage project roadmaps
• Strong analytical and troubleshooting skills
• Effectively and clearly communicate and manage open project risks and dependencies with leadership

Jobcode: Reference SBJ-rzoeo1-3-145-115-195-42 in your application.