Senior Data Engineer- Python- REMOTE- FreeWheel

FreeWheel, a Comcast company, provides comprehensive ad platforms for publishers, advertisers, and media buyers. Powered by premium video content, robust data, and advanced technology, we’re making it easier for buyers and sellers to transact across all screens, data types, and sales channels. As a global company, we have offices in nine countries and can insert advertisements around the world.

Job Summary

The FreeWheel Data Processing and Data Warehouse team is responsible for creating and managing the frameworks for large scale ETL using modern frameworks such as DBT and Spark. We also are responsible for managing the Data Models that enable downstream data products to retrieve information. Our ETL framework must enable strict SLA in terms of how fast the data is ingested for downstream consumption.

Job Description

Core Responsibilities

• Collaborates with project stakeholders to identify product and technical requirements. Conducts analysis to determine integration needs.
• Designs and builds data processing pipeline using cutting edge AWS services, 3rd party open-source/commercial software, and internally developed software to ingest, process, and deliver data at scale.
• Continually acquires new data sources to develop an increasingly rich dataset that characterizes audiences.
• Collaborates with the serving team, report team, and Data engineers to translate complex product requirements into working high-quality cloud-native data solutions.
• Works with Lead Engineers and Architects to share and contribute to the broader technical vision.
• Continually works on improving the codebase and has active participation and oversight in all aspects of the team, including agile ceremonies.
• Displays in-depth knowledge of and ability to apply, process design, and redesign skills. Presents and defends architectural, design, and technical choices to internal audiences.
• Oversees the documentation of all development activities.
• Provides guidance and support to other Engineers.
• Consistent exercise of independent judgment and discretion in matters of significance.
• Regular, consistent and punctual attendance. Must be able to work nights and weekends, variable schedule(s) and overtime as necessary.
• Other duties and responsibilities as assigned.
• ​

Requirements:

• Must be a team player with proven collaborative and communication skills. Must have experience working in fast paced environment
• Must be able to adapt to different situations and complexities
• Must be proficient in at-least one language such as Python, Scala or Java (Python preferred and we cherish the ability to understand multiple languages)
• Must understand secure coding practices on any cloud platform (We use AWS)
• Must understand infra as code practices using Terraform or similar frameworks
• Must be proficient in SQL …