Sr. Data Engineer - DataOps
New York, NY OR US-Remote
We're seeking an innovative, solution-oriented Sr. Data Engineer to join our dynamic Data Ops team. Your mission is to develop, maintain, and scale a sophisticated platform for product and event analytics capable of handling vast amounts of data. This exciting role will see you at the heart of transformative projects, turning complex datasets into accessible insights that drive strategic decisions. As part of our team, you'll be shaping the future of data in our organization, crafting scalable data systems that can keep pace with our rapid growth. We can't wait to meet you if you're passionate about data and ready to push boundaries.
Our platform has robust analytics tools that can tell video creators where people are from, where they click, and even track where in a video someone stopped watchingâgiving you insight into creating engaging content in the future.
While working as a peer to both technical and non-technical staff throughout the company, you will drive the improvement process of our products and business operations. You will help define data access and discoverability requirements and work to create infrastructure and services that provide access to event streams.
What you'll do:
- Design, develop and maintain Vimeoâs product and event analytics platform that processes billions of records every day in real-time to enable analytics and event-driven systems
- Partner with analytics leaders and analysts to ensure adherence to data governance and data modeling best practices
- Partner with product engineering teams to enhance the efficiency of product analytics clients and data collection mechanisms
- Contribute software designs, code, tooling, testing, and operational support to a multi-terabyte analytics platform
- Provide technical leadership to the data engineering team and actively lead design discussions
- Constantly monitor our data platform and make recommendations to enhance system architectureÂ
- Work collaboratively with other data engineers, analysts, and business stakeholders to understand and plan technical requirements for projects
- Prioritize project intake, perform cost/benefit analysis, and make decisions about what work to pursue that best balances our platformâs users, stakeholders, and technology
Skills and knowledge you should possess:
- 5+ years of engineering experience in a fast-paced environment; 3+ years of experience in scalable data architecture, fault-tolerant ETL, and monitoring of data quality in the cloud
- Deep understanding of distributed data processing architecture and tools such as Kafka and Spark
- Working knowledge of design patterns âŚ
This job isn't fresh anymore!
Search Fresh JobsJob Profile
Bonus Bonus or commission Generous 401k match Paid Time Off Restricted Stock Units RSUs Wellbeing resources Wide range of benefits and perks
Tasks- Provide technical leadership
Airflow Amplitude Analytics Analytics tools AWS Azure Celery Data engineering Data Modeling DataOps Docker ETL Git Google Cloud Platform Java Kafka Kubernetes Leadership Linux Python Segment Snowflake Spark SQL System architecture
Experience5 years
Education TimezonesAmerica/Anchorage America/Chicago America/Denver America/Los_Angeles America/New_York Pacific/Honolulu UTC-10 UTC-5 UTC-6 UTC-7 UTC-8 UTC-9