Data Operations Specialist

Job Description

DATA ENGINEERING
What We Do
Our mission is to provide a world-class platform that empowers the business to leverage data that will enhance, monitor, and support our products. We are responsible for data ingestion systems, processing pipelines, and various data stores all operating in the cloud. We operate at a petabyte scale, and support near real-time use cases as well as more traditional batch approaches.
What You'll Do
We're looking for a hands-on Data Operations Specialist to manage unstructured data workflows in a hybrid storage environment. You'll be the first dedicated member of the MetaHuman Data Management team, supporting 3Lateral Services and the R&D groups within the MetaHuman division and, on occasion, the wider Epic Games group.
You will be instrumental in ensuring that all captured data is managed efficiently and that a consistent approach is provided to data management. A successful candidate not only has strong technical expertise but also excels in communication and teamwork. It's not intended for those pursuing careers in structured data pipelines or data analytics platforms.
In this role, you will
• Wrangle unstructured data across a globally distributed hybrid environment (on-prem and cloud), supporting VFX & RND pipelines (dataset file querying, sorting, naming, optimizing, structuring, moving, deleting and curating)
• Ensure data flow for the capture and processing pipeline, maintaining and reporting in detail on storage capacity and usage across multiple sites in parallel
• Manage archive, including data restoration
• Own and drive data management processes to support operational workflows
• Write scripts to automate data deletion processes and execute data deletions in close collaboration with the MH team
• Work on establishing data life cycle and deletion policies and support the metadata tagging process
• Interact with MetaHuman and Epic stakeholders to ensure alignment across data operations
What we're looking for
• Experience managing unstructured data across mixed storage environments, including on-prem file shares and cloud-based storage
• Understanding of storage infrastructure (data locations, server features, archive, capacity, availability, projections, etc) and pipeline.
• Understanding of storage protocols (NFS, SMB, S3) and storage concepts
• Proficient knowledge of Python and Bash scripting (e.g., automating file ops, batch cleanup, logging)
• Familiarity with command-line tools (e.g., find, du, rsync, robocopy, rclone)
• Strong organizational skills, flexibility, and curiosity
• Excellent communication skills and the ability to respectfully interact with co-workers at all levels in a professional environment
• Problem-solving skills and the ability to show initiative and proactively engage in implementing solutions when appropriate
• Ability to work independently or as part of a team and without direct supervision
• A methodically consistent approach to repetitive tasks; values accuracy and acute attention to detail
• Bachelor's degree 6.2 or relevant industry experience

Note to Recruitment Agencies: Epic does not accept any unsolicited resumes or approaches from any unauthorized third party (including recruitment or placement agencies) (i.e., a third party with whom we do not have a negotiated and validly executed agreement). We will not pay any fees to any unauthorized third party. Further details on these matters can be found here.

Jobcode: Reference SBJ-neex71-216-73-216-62-42 in your application.