Job Description
Sr Data Engineer
The SPE BI Sr Data Engineer is a multi-domain specific engineering role supporting specific platforms and technologies to deliver product features supporting business outcomes. The role will require out of the box thinking and innovative techniques to connect and transform data for the SPE Bi Eco-System. The selected candidate should have a customer focused mind set, ability to apply engineering best practices, possess critical thinking and seamlessly work with teams spanning time-zones. This role will require experience in working with Scrum/Kanban agile teams and contribute to agile events to ensure successful BI product and service delivery.
The SPE BI Senior Data Engineer is responsible for the development of and maintenance of data pipelines that support the SPE BI Eco-System
• All AWS Services for SPE BI Account (MWAA, S3, Lambda, Sage-Maker, ECS)
• All AWS Hosted Services: Snowflake DW & Teradata DW
• Implementation and development of all integration patterns and file types/formats
• Implementation of Data Quality Frameworks
• Implementation of ML Services for Data Monitoring Implementation of RPA for Data Loading
Responsibilities will include:
• Review and QC External Vendor Code
• Provide guidance and mentorship to the Data Engineering Team
• Deliver Working Code following SPE Development Practices
• Develop and Maintain Test Scripts
• Work Closely with Product Owners and Architecture Team to deliver solutions
• Work closely with Info-Sec to enable and whitelist services.
• Create Terraform Starter Kits for Business User Accounts
• Code, configure and design on the application technology platform to deliver priority business stories and support business outcomes. Work with product owners and business team members for clarity on various functional scenarios and requirements.
• Collaborate with product owners and engineering team members to identify functional testing scenarios that can be used to derive unit testcases to ensure application components deliver the expected functionality. Have a test-driven mind …
• Collaborate with other team members across time zones in an agile delivery model. Incorporate agile principles into daily delivery with focus on transparency and streamlining operations. Contribute in agile events to make the overall delivery cycle
• Understand the conceptual, logical models and design physical data models considering effective usage of the data and performance of the integration and access systems.
In summary the SPE BI Senior Data Engineer role involves working on developing & implementing BI Data Pipelines leveraging multiple cloud technologies and integration patterns. The role will be responsible for designing and developing core integration services for SPE
Preferred Education:
• MS Computer Science of EE Preferred
• +15 Years of experience working in a similar role.
Certification/Licenses:
AWS Solution Architect Professional
• AWS DevOps Engineer Professional
• AWS Data Analytics
• AWS Advanced Networking
Other:
• Terraform (Mandatory)
• SQL
• Network Experience
• IBM Datastage
• AWS Glue
• Python based Integration Development
Knowledge of:
• Amazon Web Services certification
• Database platforms like Teradata, Snowflake, BIG Query
• ETL Tools like DataStage, Informatica, Alteryx, AWS Glue
• Data Management Platform – Lake formation/ Data Lakes
• R and Python scripting languages
• Reporting tools like Business Objects, MicroStrategy
• Visualization tools like Tableau and Power BI
• Terraform and GitHub repo
• Airflow/MWAA
• Containerization, Docker deployments
• Data Modelling – able to build conceptual models and understanding logical and physical models
• Container management wanted (Docker, k8s, etc.)
• Advanced Python Programming
• Agile Development methodologies
Skill In:
• Strong interpersonal skills are required. Ability to work effectively with team members, clients, and other areas of the IT environment
• Strong written and oral communications
• Excellent problem-solving abilities, strong decision-making skills and make sound judgment decisions.
Ability To:
• Work effectively with team members, clients, and other areas of IT
• Handle multiple tasks and be flexible in a fast-paced environment
• Deliver on time
*As part of our commitment to health and safety, all US non-union and O.P.E.I.U. Local 174 applicants and employees must submit proof of vaccination against COVID-19 or request and obtain approval of a reasonable accommodation based on disability or a sincerely held religious belief, practice or observance. To request an accommodation for purposes of participating in the hiring process, you may contact us at SPE_Accommodation_Assistance@spe.sony.com.
* Sony Pictures - CA - Culver City Area & Studios
Jobcode: Reference SBJ-g32b04-18-232-179-191-42 in your application.