Principal Data Engineer

Job Description:

Principal Data Engineer

Collaborate with Innovative 3Mers Around the World

Choosing where to start and grow your career has a major impact on your professional and personal life, so it’s equally important you know that the company that you choose to work at, and its leaders, will support and guide you. With a diversity of people, global locations, technologies and products, 3M is a place where you can collaborate with other curious, creative 3Mers.

This position provides an opportunity to transition from other private, public, government or military environments to a 3M career.

The Impact You’ll Make in this Role

The Principal Data Engineer will join the Corporate Research Systems Lab (CRSL) to develop scalable Data Systems. As part of an agile team, you will enable applications in diverse markets including energy, manufacturing, personal safety, transportation, electronics, and consumer. You will have the opportunity to design and support an Enterprise Data Mesh to empower informatics and digital technologies for users across the globe:

• Architect, design, and build scalable, efficient, and fault-tolerant data operations.

• Collaborate with senior leadership, analysts, engineers, and scientists to implement new mesh domain nodes and data initiatives.

• Drive technical architecture for accelerated solution designs, including data integration, modeling, governance, and applications.

• Explore and recommend new tools and technologies to optimize the data platform.

• Improve and implement data engineering and analytics engineering best practices.

• Collaborate with data engineering and domain nodes teams to design physical data models and mappings.

• Work with scientists and informaticians to develop advanced digital solutions and promote digital transformation and technologies.

• Perform code reviews, manage code performance improvements, and enforce code maintainability standards.

• Develop and maintain scalable data pipelines for ingesting, transforming, and distributing data streams.

• Advise and mentor 3M businesses, data scientists, and data consumers on data standards, pipeline development, and data consumption.

Your Skills and Expertise 

To set you up for success in this role from day one, 3M requires (at a minimum) the following qualifications:

• Bachelor’s degree or higher (completed and verified prior to start) from an accredited university.

• Twelve (12) years of professional experience in data warehouse/lakehouse design and development in a private, public, government or military environment 

• Completely proficient in advanced SQL, Python/PySpark/Scala (any object-oriented language concepts), ML Libraries

• Must have hands-on experience in Python to extract data from APIs, build data pipelines.

Additional qualifications that could help you succeed even further in this role include:

• Exceptional …