Senior Data Engineer - Autonomous Vehicle Performance Metrics

Mission Summary

We are seeking a highly skilled and experienced Senior Data Engineer to play a critical role in evaluating and improving the performance of our autonomous vehicle (AV) technology. This position demands a strong software development background with expertise in Python, coupled with a deep understanding of data engineering principles and the ability to design and build robust data pipelines. A key focus of this role will be the development and implementation of metrics and data infrastructure to effectively measure, analyze, and report on the performance of our AV systems. The ideal candidate will be passionate about autonomous vehicles and possess the technical acumen to transform complex AV data into actionable insights.

What You’ll Be Doing

Design and Development of AV Performance Metrics: Collaborate with cross-functional teams, including systems engineers, software engineers, AI scientists, control engineers, simulation engineers, and validation teams to understand their needs and define, design, and implement key metrics to evaluate various aspects of autonomous vehicle performance (e.g., lane change capability performance, oscillation and braking metrics).

Software Development for Metrics and Analysis: Leverage strong Python programming skills to develop framework, libraries and tools for calculating, aggregating, and visualizing AV performance metrics from large datasets.

Building Scalable Data Pipelines for AV Data: Design, develop, and maintain efficient and scalable data pipelines to ingest, process, transform, and store vast amounts of data generated by autonomous vehicles (e.g., sensor data, simulation data, logs, annotations).

Data Modeling and Storage for AV Metrics: Design and implement data models and schemas optimized for storing and querying AV performance metrics, considering factors like granularity, temporal aspects, and dimensionality.

Data Quality and Validation for AV Data: Implement rigorous data quality checks and validation processes to ensure the accuracy, reliability, and integrity of the data used for performance evaluation.

Performance Optimization of AV Data Infrastructure: Identify and implement performance optimizations for data pipelines and storage solutions to handle the high volume and velocity of AV data.

Cloud Infrastructure for AV Data: Design, build, and manage data infrastructure on cloud platforms (e.g., AWS, GCP) specifically tailored for AV data processing and storage.

Automation and Infrastructure as Code: Implement automation for data pipeline deployments, infrastructure provisioning, and metric calculation processes using Infrastructure as Code (IaC) principles and tools.

Documentation and Knowledge Sharing: Create clear and concise documentation for data pipelines, metrics definitions, and analysis tools. Share knowledge and best practices with the wider engineering team.

Staying Current with AV and Data Engineering Technologies: Continuously learn and evaluate new technologies and methodologies relevant to autonomous vehicles and data engineering.

What We're Looking For

• Minimum of 5-7 years of experience in data engineering roles.
• Bachelor's degree in Computer Science, Engineering, Robotics, or a related field. A Master's degree is a plus.
• Expert-level proficiency in Python and strong understanding of software development principles.
• Hands-on experience with one or more data pipeline orchestration tools.
• Experience with distributed data processing frameworks.
• Strong understanding of relational databases and data warehousing concepts.
• Experience working with cloud data services on AWS, Azure, or GCP.
• Proven ability to design and implement effective data models for complex data.
• Deep understanding of ETL and ELT concepts and best practices.
• Proficient with Git and related version control workflows.
• Strong analytical and problem-solving skills, particularly in the context of complex system performance evaluation.
• Excellent communication and collaboration skills, with the ability to effectively communicate technical concepts to diverse audiences.
• Ability to work independently and as part of a multidisciplinary team.
• Strong attention to detail and a commitment to data quality and accuracy.
• Proactive and self-motivated with a passion for autonomous vehicle technology.
• Comfortable working in a fast-paced, continuous delivery environment.

Bonus Points (not required)

• Experience working with autonomous vehicle sensor data (e.g., LiDAR, camera, radar).
• Familiarity with simulation environments and data generated from AV simulations.
• Experience with data visualization tools (e.g., Looker) for presenting performance metrics.
• Knowledge of statistical analysis and machine learning techniques relevant to performance evaluation.
• Experience with real-time data processing and streaming technologies.
• Familiarity with data annotation pipelines and tools.
• Familiarity with Ray and Ray clusters for scaling Python applications and AI/ML tasks.

Success Metrics

• Successful design and implementation of key autonomous vehicle performance metrics.
• Development of robust and scalable data pipelines for AV data processing and metric calculation.
• Improvement in the efficiency and effectiveness of AV performance evaluation processes.
• Timely and accurate delivery of data and insights to AV development teams.
• Contribution to the overall advancement and safety of our autonomous vehicle technology.

This is a unique opportunity to make a meaningful impact at Motional by enhancing our data platform and accelerating development speed for our industry-leading autonomous vehicle metrics and capabilities ecosystem. We take pride in having some of the brightest and most dedicated talent in the world on our team. If you're innovative, driven, and eager to tackle challenges, we’d love to have you join us!

The salary range for this role is an estimate based on a wide range of compensation factors including but not limited to specific skills, experience and expertise, role location, certifications, licenses, and business needs. The estimated compensation range listed in this job posting reflects base salary only. This role may include additional forms of compensation such as a bonus or company equity. The recruiter assigned to this role can share more information about the specific compensation and benefit details associated with this role during the hiring process. 

Candidates for certain positions are eligible to participate in Motional’s benefits program. Motional’s benefits include but are not limited to medical, dental, vision, 401k with a company match, health saving accounts, life insurance, pet insurance, and more.

Motional is a driverless technology company making autonomous vehicles a safe, reliable, and accessible reality. We’re driven by something more.

Our journey is always people first.

We aren't just developing driverless cars; we're creating safer roadways, more equitable transportation options, and making our communities better places to live, work, and connect. Our team is made up of engineers, researchers, innovators, dreamers and doers, who are creating a technology with the potential to transform the way we move.

Higher purpose, greater impact.

We’re creating first-of-its-kind technology that will transform transportation. To do so successfully, we must design for everyone in our cities and on our roads. We believe in building a great place to work through a progressive, global culture that is diverse, inclusive, and ensures people feel valued at every level of the organization. Diversity helps us to see the world differently; it’s not only good for our business, it’s the right thing to do.  

Scale up, not starting up.

Our team is behind some of the industry's largest leaps forward, including the first fully-autonomous cross-country drive in the U.S, the launch of the world's first robotaxi pilot, and operation of the world's longest-standing public robotaxi fleet. We’re driven to scale; we’re moving towards commercialization of our technology, and we need team members who are ready to embrace change and challenges.

Formed as a joint venture between Hyundai Motor Group and Aptiv, Motional is fundamentally changing how people move through their lives. Headquartered in Boston, Motional has operations in the U.S and Asia. For more information, visit  www.Motional.com and follow us on Twitter, LinkedIn, Instagram and YouTube.

Motional AD Inc. is an EOE. We celebrate diversity and are committed to creating an inclusive environment for all employees. To comply with Federal Law, we participate in E-Verify. All newly-hired employees are queried through this electronic system established by the DHS and the SSA to verify their identity and employment eligibility.