Sr Data Engineer - Hulu Audience Integration

Disney Entertainment and ESPN Product & Technology

Technology is at the heart of Disney’s past, present, and future. Disney Entertainment and ESPN Product & Technology is a global organization of engineers, product developers, designers, technologists, data scientists, and more – all working to build and advance the technological backbone for Disney’s media business globally.

The team marries technology with creativity to build world-class products, enhance storytelling, and drive velocity, innovation, and scalability for our businesses. We are Storytellers and Innovators. Creators and Builders. Entertainers and Engineers. We work with every part of The Walt Disney Company’s media portfolio to advance the technological foundation and consumer media touch points serving millions of people around the world. 

Here are a few reasons why we think you’d love working here:

• Building the future of Disney’s media: Our Technologists are designing and building the products and platforms that will power our media, advertising, and distribution businesses for years to come.

• Reach, Scale & Impact: More than ever, Disney’s technology and products serve as a signature doorway for fans' connections with the company’s brands and stories. Disney+. Hulu. ESPN. ABC. ABC News…and many more. These products and brands – and the unmatched stories, storytellers, and events they carry – matter to millions of people globally. 

• Innovation: We develop and implement groundbreaking products and techniques that shape industry norms, and solve complex and distinctive technical problems.

Product Engineering is a unified team responsible for the engineering of Disney Entertainment & ESPN digital and streaming products and platforms. This includes product engineering, media engineering, quality assurance, engineering behind personalization, commerce, lifecycle, and identity.

The Hulu Audience Integration team is a cross-functional team with focus on data along with supporting services. We maintain the Nova system: the only system supporting Hulu lifecycle marketing activities. The system is a blend of both data and services including data storage, data pipeline, data serving, web services, 3rd party channel integrations, monitor & alert, etc. We also maintain multiple core services to ensure the quality and stability of our data and messaging campaigns, as well as all the integration with upstream data sources and downstream channels.

This person will be working on the ACP project, the unification and migration project of subscription data model. The person will be working in a cross-team environment, pairing with the lead data engineer to design and implement the new data pipeline in an on-prem environment while ensuring backward compatibility and zero downtime.

This person will be engaging the Nova modernization project to help on refactoring legacy data pipelines including all facet data of demographic, subscription, watch behavior, web page interactions, etc. The person will optimize the data quality with new sources and support integrations with different systems. The person will have the opportunity to be exposed to both Hadoop ecosystem (hdfs, hive, spark, spark) and modern cloud-based data technologies (redshift, snowflake, etc) and services (java spring boot). The one will be having the opportunity to deal with both batch and real-time data. 

Responsibilities and Duties of the Role:

• Contribute to the Nova system. Add new features and continuously optimize the current asset. Contributing to ACP and Nova modernization project.

• Promote and support Agile methodologies such as Scrum, Kanban, and Scrumban by actively participating in regular ceremonies such as stand-up, retrospectives and sprint planning.

• On-call support

• Collaborate with your squad, Product Managers, Designers, QA, Operations, and other stakeholders to understand requirements and articulate technical decisions and outcomes.

Required Education, Experience/Skills/Training:

Basic Qualifications 

• Minimum of 5 of years related work experience.

• Experience with building batch/real-time data pipelines in Spark

• Experience and/or certification with Hadoop ecosystem (Hive, hdfs, etc)

• Experience in a Java and/or alternative JVM application development environments (Scala)

• Excellent understanding of software development fundamentals 

• Experience with standard CI/CD procedures & tools like Jenkins, GitHub action, spinnaker 

• Experience working in a modern, agile software team with version control & project management tools (e.g., Git, SVN, Jira, Basecamp) 

Preferred Qualifications 

• Experience with Flink

• Knowledge or certification with AWS services, including ECS (Docker), S3, EC2, Lambda, CloudWatch

• Experience with big data technologies & tools including Databricks, EMR, Flink

• Experience with Terraform or other infrastructure as code tooling 

• Experience with graph-based data workflows such as Apache Airflow, Meson 

• Experience building scalable, fault-tolerant, high-uptime systems 

• Experience with writing unit, integration, and functional tests 

• Proven ability to integrate with service APIs and/or SDKs 

• Creative and inventive problem solving 

• Experience mentoring other developers

Required Education  

• Bachelor's degree in computer science, Information Systems, Software, Electrical or Electronics Engineering, or comparable field of study, and/or equivalent work experience. 

#DISNEYTECH

The hiring range for this position in Santa Monica, CA/Glendale, CA is $138,900.00-$186,200.00 per year, in San Francisco, CA is $152,100.00 - $203,900 and in Seattle, WA is $145,400.00 to $195,000.00 per year. The base pay actually offered will take into account internal equity and also may vary depending on the candidate’s geographic region, job-related knowledge, skills, and experience among other factors. A bonus and/or long-term incentive units may be provided as part of the compensation package, in addition to the full range of medical, financial, and/or other benefits, dependent on the level and position offered.