We are looking for a Senior Data Engineer, You! WHAT YOU WILL BE DOING Support current technology stack (MS*Server, SSIS & Talend, Databricks) for one of our key teams: the International team! Design, develop, test data pipelines and modernize it for scale and stability Partner with our product, engineering, operations and BI teams regularly as part of the development life cycle Document your work and help maintain our existing documents using Confluence, Google Docs, Lucid Charts and other such tools stack Work with our vendors and data providers Tinker and explore use cases for Machine Learning WHAT YOU NEED TO KNOW (or TECHNICAL SKILLS) You hold a Bachelors or Masters degree in Computer Science, Data Science, Mathematics or equivalent Engineering discipline You have experience building Data Lakes, Data Warehouses using the Big data & cloud stack dimensional/star schema data modeling You know agile development methodologies and development life cycles You know how to translate user stories into technical requirements and in turn into a code and a tangible reliable workflow You are curious and enjoy problem solving in the data world using Data Science tools stack You understand metadata and help catalog and build as part of the development life cycle Nice to have: Databricks, Snowflake, Teradata, Oracle, Google BigQuery, Hadoop and related stack Good to have: diverse data sources and data formats (xml, json, yaml, parquet, avro, delta) and respective use cases Good to have: knowledge of version control systems such as git and CI/CD workflows and practices You love learning, are motivated and a self starter Agile development methodologies using the Atlassian suite: Jira, Confluence Support and stabilize production environments Excellent communication skills ETL design, development using SQL Server Integration Services (SSIS) and Talend Nice to have ANSI SQL and Spark SQL Nice to have work flow automation, orchestration using Airflow, Nice to have: cloud services from Amazon AWS, Google GCP and Microsoft Azure Nice to have: streaming (Kafka) and batch based data sources LIFE AT TICKETMASTER We are proud to be a part of Live Nation Entertainment, the world's largest live entertainment company.
