Senior Data Engineer - Data Streaming

Job Description

Overview & Responsibilities:

The Sr. Data Engineer for streaming will be responsible for supporting and enhancing our Kafka and Kinesis based streaming data collection platforms. The ideal candidate will have strong experience with Kafka (open-source or Confluent) and AWS Kinesis, as well as cloud platforms. The candidate should also be strong with AWS and Kafka components (Topics, Producer/Consumer, KStream, KTable, and KSQL), Kinesis components including streams, firehose and data analytics, and be experienced working with streaming systems that handle very high volume and velocity data. This will require a strong understanding of streaming architectures, and experience with AWS, CI/CD tools, and infrastructure as code. Working as part of the Data Engineering team responsible for managing data feeds and collecting analytical streaming data from our client software. In this fast-paced environment, you will deal with high volume and high velocity data, and demonstrate your strong analytical, problem solving, organizational, and prioritization skills.

Basic Qualifications:
• 3+ years of Java, Python or Scala
• 3+ Kafka (Topics, Producer/Consumer, KStream, KTable, KSQL)
• 3+ AWS Kinesis (streams, firehose and data analytics)
• 7 years of hands-on experience with data streaming systems and 10 or more years of data engineering

Additional Qualifications:
• Demonstrated expertise with streaming data
• Deep level understanding of Kafka
• Assume ownership and ability to lead simultaneous projects
• Strong time-management, prioritization, and organizational skills
• Problem-solving and investigation skills
• Strong interpersonal skills, with the ability to cultivate relationships and negotiate with internal clients
• Ability to meet deadlines and partner timelines
• Strong written and oral communication skills
• Bachelor's Degree or Equivalent
• SQL and familiarity with modern cloud databases like Snowflake
• Frameworks: Spring Framework, Flink, JUnit, Mockito, Apache Flink.
• Cloud Technologies: AWS (VPC, Kubernetes, EC2, Lambda, CloudWatch, etc)
• Deployment Tools: Jenkins, Docker, Helm, Terraform
• Monitoring tools: Grafana, Prometheus
• CI/CD tools
• Strong analytical and troubleshooting skills
• Effective and clear communication of open project risks and team dependencies

ViacomCBS is an equal opportunity employer (EOE) including disability/vet.

Jobcode: Reference SBJ-d22vm2-13-58-151-231-42 in your application.