Lead Data Engineer
New York, NY, United States
Company Description
We create world-class content, which we distribute across our portfolio of film, television, and streaming, and bring to life through our theme parks and consumer experiences. We own and operate leading entertainment and news brands, including NBC, NBC News, MSNBC, CNBC, NBC Sports, Telemundo, NBC Local Stations, Bravo, USA Network, and Peacock, our premium ad-supported streaming service. We produce and distribute premier filmed entertainment and programming through Universal Filmed Entertainment Group and Universal Studio Group, and have world-renowned theme parks and attractions through Universal Destinations & Experiences. NBCUniversal is a subsidiary of Comcast Corporation.
Comcast NBCUniversal has announced its intent to create a new publicly traded company ('SpinCo') comprised of most of NBCUniversal's cable television networks, including USA Network, CNBC, MSNBC, Oxygen, E!, SYFY and Golf Channel along with complementary digital assets Fandango, Rotten Tomatoes, GolfNow, GolfPass, and SportsEngine. The well-capitalized company will have significant scale as a pure-play set of assets anchored by leading news, sports and entertainment content. The spin-off is expected to be completed during 2025.
As a company uniquely positioned to educate, entertain and empower through our platforms, Comcast NBCUniversal stands for including everyone. Our Diversity, Equity and Inclusion initiatives, coupled with our Corporate Social Responsibility work, is informed by our employees, audiences, park guests and the communities in which we live. We strive to foster a diverse, equitable and inclusive culture where our employees feel supported, embraced and heard. Together, we'll continue to create and deliver content that reflects the current and ever-changing face of the world.
Job Description
Help manage a high-performance team of Data Engineers. Contribute to and help lead team in designing, building, testing, scaling and maintaining data pipelines from a variety of source systems and streams (Internal, third party, cloud based, etc.), according to business and technical requirements. Deliver observable, reliable and secure software, embracing “you build it you run it” mentality, and focus on automation and GitOps. Continually work on improving the codebase and have active participation and oversight in all aspects of the team, including agile ceremonies. Take an active role in story definition, assisting business stakeholders with acceptance criteria. Work with Principal Engineers and Architects to share and contribute to the broader technical vision. Develop and champion best practices, striving towards excellence and raising the bar within the department. Develop solutions combining data blending, profiling, mining, statistical analysis, and machine learning, to better define and curate models, test hypothesis, and deliver key insights. Operationalize data processing systems (dev ops).
Fully Remote: This position has been designated as fully remote, meaning that the position is expected to contribute from a non-NBCUniversal worksite, most commonly an employee’s residence.
Qualifications
Bachelor’s degree in Computer Science, Computer Engineering, Data Engineering, Physics, or a related field (or foreign degree equivalent).
• The position requires five (5) years of experience in the job offered, as a Software Engineer, or in a related occupation.
• The position requires each of the following skills, which must have been gained through five (5) years of experience:
- Programming skills in one or more of the following: Python, Java, Scala, R, SQL;
- Writing reusable/efficient code to automate analysis and data processes;
- Developing data catalogs and data cleanliness to ensure clarity and correctness of key business metrics.
The position requires the following skill, which must have been gained through four (4) years of experience:
- Building and maintaining dimensional data warehouses in support of BI tools.
The position requires each of the following skills, which must have been gained through three (3) years of experience:
- Near Real Time & Batch Data Pipeline development for Big Data;
- Processing structured and unstructured data into a form suitable for analysis and reporting, including integration with a variety of data metric providers (advertising, web analytics, and consumer devices);
- Hands on programming of the following (or similar) technologies: Apache Beam, Scio, Apache Spark, and Snowflake;
- Progressive data application development, working in large scale/distributed SQL, NoSQL, and/or Hadoop environment.
The position requires the following skill, which must have been gained through two (2) years of experience:
- Building streaming data pipelines using Kafka, Spark or Flink.
The position requires the following skill, which must have been gained through one (1) year of experience:
- Implementing scalable, distributed, and highly available systems using Google Cloud.
This position is eligible for company sponsored benefits, including medical, dental and vision insurance, 401(k), paid leave, tuition reimbursement, and a variety of other discounts and perks. Learn more about the benefits offered by NBCUniversal by visiting the Benefits page of the Careers website.
Salary range: $175,947- $176,000 per year
Full-time: 40 hours/week
Additional Information
As part of our selection process, external candidates may be required to attend an in-person interview with an NBCUniversal employee at one of our locations prior to a hiring decision. NBCUniversal's policy is to provide equal employment opportunities to all applicants and employees without regard to race, color, religion, creed, gender, gender identity or expression, age, national origin or ancestry, citizenship, disability, sexual orientation, marital status, pregnancy, veteran status, membership in the uniformed services, genetic information, or any other basis protected by applicable law.
If you are a qualified individual with a disability or a disabled veteran and require support throughout the application and/or recruitment process as a result of your disability, you have the right to request a reasonable accommodation. You can submit your request to AccessibilitySupport@nbcuni.com.
For LA County and City Residents Only: NBCUniversal will consider for employment
qualified applicants with criminal histories, or arrest or conviction records, in a manner
consistent with relevant legal requirements, including the City of Los Angeles' Fair Chance
Initiative For Hiring Ordinance, the Los Angeles' County Fair Chance Ordinance for Employers, and the California Fair Chance Act, where applicable.
Job Profile
Fully remote
Benefits/PerksCompany sponsored benefits Corporate social responsibility Dental Discounts Discounts and perks Diversity and inclusion initiatives Fully remote Fully remote work Inclusion initiatives Inclusive culture Medical Other discounts and perks Paid leave Tuition reimbursement Vision Insurance
Tasks- Design and maintain data pipelines
- Develop best practices
- Development
- Improve codebase
- Manage data engineering team
- Operationalize data processing systems
- Participate in Agile ceremonies
- Testing
Acceptance Criteria Agile Analytics Application Development Automation Best Practices Big Data Business Cloud Computer Science Data Blending Data engineering Data Pipeline Data Pipeline Development Data Pipelines Data processing Data Profiling Data Warehouses Development DevOps Engineering GitOps Integration Java Kafka Machine Learning Metrics NoSQL Programming Python R Reporting Scala Snowflake Spark SQL Statistical analysis Technical Technical Requirements Testing Writing
Experience5 years
EducationAnalytics Bachelor Bachelor's degree Business Computer Engineering Computer Science Data Engineering Engineering IT Physics Related Field
TimezonesAmerica/Anchorage America/Chicago America/Denver America/Los_Angeles America/New_York Pacific/Honolulu UTC-10 UTC-5 UTC-6 UTC-7 UTC-8 UTC-9