Data Engineering Lead

Job Description

This role will be responsible for the technical implementation and ongoing operations of SME's data platform. This environment requires processing large volumes of data in a variety of formats within cloud-based architectures to power a set of analytical tools and digital products.

What you'll do:
• Own end-to-end technical architecture and engineering for SME's internal data platform: Data Ingestion, Data Processing, Data Storage, Data APIs, Data Enablement.
• Manage and work closely with technical leads as well as engineers under each track (internal and consultants). As such this person will be responsible for running and facilitating technical meetings, taking an active role on technical discussions.
• Work closely with technical leads and architect(s) to review, define and align on technical architecture and engineering solutions.
• Work with multiple teams and collaborate on estimation efforts.
• Define, drive and execute POCs involving new technology components to determine fit into the data platform.
• Define development standards, best practices and make sure solutions are built to perform and scale.
• Collaborate with CloudOps team to identify infrastructure and pipeline improvements.
• Perform design and code reviews with architects and the engineering leads/team.
• Collaborate with Product Lead to align roadmap items and releases with appropriate technical solutions.
• Collaborate with QA Manager to assist on definition of performance and stress testing approach.
• Collaborate with InfoSec to understand security requirements and make sure they are embedded in every aspect of the solutions and architecture.
• Collaborate with Privacy/Compliance departments to ensure privacy by design is part of the solutions and architecture.
• Define NFRs and make sure they are incorporated in the engineering specifications.
• Collaborate with multiple teams to help define platform's operational model and best practices behind it (monitoring, alerting, SOPs, recovery, reporting, etc).
• Work closely with multiple teams to assist in platform cost optimization.
• Collaborate with InfoSec to understand security requirements and make sure they are embedded in every aspect of the solutions and architecture.

Who you are:
• AWS and GCP data products - Cloudwatch, Lambda, S3, Step Functions, Postgres, Big Table
• Fivetran data integration
• Databricks
• Snowflake
• ETL tools and data processing technologies
• CI/CD processes and technologies
• Spark, Python, SQL
• Performance/Stress Testing
• Big data and datawarehousing processes and technologies
• APIs and data integration technologies

What we give you:
• You join an inclusive, collaborative and global community where you have the opportunity to fuel the creative journey
• A modern office environment designed to foster productivity, creativity, and teamwork
• An attractive and comprehensive benefits package including medical, dental, vision, life & disability coverage, and 401K + employer matching
• Voluntary benefits like company-paid identity theft protection and resources for pets, mental health and meditation resources, industry-leading fertility coverage, fully paid leave for childbirth or bonding, fully paid leave for caregivers, programs for loved ones with developmental disabilities and neurodiversity, subsidized back-up child and elder care, and reimbursement for adoption, surrogacy, tuition and student loans
• We invest in your professional growth & development
• Time off for a winter recess

Jobcode: Reference SBJ-gqm42x-3-15-4-244-42 in your application.