Senior Data Engineer

Summary

The Senior Data Engineer at Workiva will be an instrumental part of data workflows throughout the organization. You will build distributed services to support multiple data analytics teams and business intelligence engineers reliably and at scale using AWS cloud environments. You will provide cutting-edge, reliable, and easy-to-use systems for ingesting and processing data and help the teams that build data-intensive applications be successful. 

This role will collaborate with many cross functional teams on the planning, execution, and successful completion of technical projects with the ultimate purpose of improving customer experience. You will build and maintain batch and real-time data flows used for business intelligence, analytics, and machine learning within all organizations across Workiva. This also involves storing and exposing data via a Database, Data Lake, and other APIs. Senior Data Engineers work primarily with other Data Engineers but also with Data Scientists, ML Engineers, and business partners to ensure quality, reliability, and performance at the highest level.

What You'll Do

• Develop data extraction and integration code modules for batch and incremental data flow from various data sources using new and existing patterns

• Use existing tools and processes to deploy to integration and production environments

• Maintain the deployment processes

• Maintain the health of the data ecosystem by configuring monitors, defining alerts on common failure points, and giving feedback on data quality to data owners and business partners

• Test software, validate data, and write automated tests (unit, integration, functional, etc.)

• Review peer code and submit thorough and actionable feedback based on team standards and industry best practices

• Triage and resolve production issues. Communicate with individual business partners on status and escalate as needed

• Design data lake storage and access patterns to match customer requirements and conform to naming standards

• Understand the data at a deep level, apply security appropriately, and escalate as needed

• Tune processes and SQL to reduce cost and wait time. Implement systems to balance data volume, latency and customer requirements

• Work with business partners to write requirements and test deployed code

• Join rotation to support production workflows during off hours

What You'll Need

Minimum qualifications

• 4+ years of relevant experience in the data engineering role, including data warehousing and business intelligence tools, techniques, and technology, or experience in analytics, business analysis or comparable consumer analytics solutions

• Undergraduate Degree or equivalent combination of education and experience in a related field

Preferred qualifications

• Bachelor’s degree in Computer Science, Engineering, Math, …