Principal Data Engineer (Remote)
New York, New York, United States
Title: Principal Data Engineer
Department: Technology
Salary: $120K - $125K USD
Location: Remote (Candidates based in the US)
Description:
The Principal Data Engineer will be responsible for designing, developing, and maintaining our data architecture, with a focus on Snowflake and ETL processes. The ideal candidate will have a deep background in data engineering, expertise with Snowflake's cloud data platform, and highly proficient in ETL tools and methodologies. As part of our data team, you will play a crucial role in elevating our data infrastructure, ensuring scalability, reliability, and efficiency in handling large volumes of data.
Duties included but not limited to:
- Integrate diverse data sources by designing and implementing scalable high performance data pipelines, architecture and infrastructure.
- Build and implement ETL processes using a variety of methods to facilitate efficient movement of data between systems
- Develop culture to incorporate best practices to ensure data pipelines are robust and include error handling and alerting
- Design data models that turn complex organizational data into easy to use data structures ensuring seamless flow for WES’S operational, analytics and reporting needs
- Use DBT or Snowflake native capabilities to transform data and ensure data is accurate and up to date
- Optimize data structures and queries to ensure efficient data storage and retrieval.
- Implement and enforce data quality standards to ensure the accuracy and reliability of educational data used in academic assessments globally.
- Collaborate with cross-functional teams, including analysts and business stakeholders, to understand unique data requirements for data processing or analytics needs
- Implement and maintain data security measures to protect sensitive information, ensuring compliance with international data privacy regulations.
- Develop and maintain practices for effective data warehousing, transformations, data sharing, and structured management
- Create and maintain comprehensive documentation for data engineering processes, systems, and workflows
- Provide technical leadership and mentorship to junior members of the data engineering team, fostering a collaborative environment dedicated to excellence in handling educational data
- Utilize Tableau to deliver data insights using impactful visualizations in a meaningful and actionable manner
Requirements:
- Education: in Computer Science, Information Technology, or a related field, with a strong emphasis on Data related technologies
- 8+ years’ experience in a data engineering role, with a focus on designing and implementing scalable data solutions
- Highly proficient in …
This job isn't fresh anymore!
Search Fresh JobsJob Profile
- Collaborate with cross functional teams
- Create and maintain documentation
- Implement ETL processes
- Provide technical leadership and mentorship
AWS Azure ETL Google Cloud Platform Java Machine Learning NoSQL Python Scala Snowflake SQL Tableau
EducationComputer Science Information Technology
TimezonesAmerica/Anchorage America/Chicago America/Denver America/Los_Angeles America/New_York Pacific/Honolulu UTC-10 UTC-5 UTC-6 UTC-7 UTC-8 UTC-9