Sr Azure Data Engineer - Team Lead

United States - Remote

Zealogics

USD 160K+ Contract Senior

Company preview All jobs at Zealogics

Apply Job profile

Published 1 week ago

Responsibilities: Able to participate in business discussions and assist gathering data requirements. Good analytical and problem-solving skills to help address data challenges.
Proficiency in writing complex SQL queries for data extraction, transformation, and analysis. Knowledge of SQL functions, joins, subqueries, and performance tuning. Able to navigate source systems with minimal guidance to understand how data is related and use like data profiling to gain a better understanding of the data. Hands on experience with PySQL/Pyspark etc.
Hands on Experience in creating and managing data pipelines using Azure Data Factory. Understanding of data integration, transformation, and workflow orchestration in Azure environments.
Knowledge of data engineering workflows and best practices in Databricks. Able to understand existing templates and patterns for development. Hands on experience with Unity Catalog and Databricks workflow.
Proficiency in using Git for version control and collaboration in data projects. Ability to work effectively in a team environment, especially in agile or collaborative settings.
Clear and effective communication skills to articulate findings and recommendations for other team members. Ability to document processes, workflows, and data analysis results effectively.
Willingness to learn new tools, technologies, and techniques as the field of data analytics evolves. Being adaptable to changing project requirements and priorities.
Skills
Azure Databricks, Data Lakehouse architectures, and Azure Data Factory.
Expertise in optimizing data workflows and predictive modeling.
Designing and implementing data pipelines using Databricks, Spark,
Expertise in batch and streaming data solutions, automating workflows with CI/CD tools like Jenkins and Azure DevOps, and ensuring data governance with Delta Lake
Spark, PySpark, Delta Lake, Azure DevOps, Python.
Advance SQL expertise

Apply

Job Profile

Regions

North America

Countries

United States

Tasks

Create and manage data pipelines
Document processes and workflows
Gather data requirements
Optimize data workflows
Participate in business discussions
Write complex SQL queries

Skills

Agile Analytical Azure CI/CD Databricks Data engineering Data Factory Data Governance Data Lakehouse Data Pipelines Data Profiling Git Performance Tuning Predictive Modeling PySpark Python SQL Workflow Orchestration

Timezones

America/Anchorage America/Chicago America/Denver America/Los_Angeles America/New_York Pacific/Honolulu UTC-10 UTC-5 UTC-6 UTC-7 UTC-8 UTC-9

Remote Jobs in North America Remote Jobs in Europe Remote Jobs in Asia/Pacific Remote Jobs in South America Remote Jobs in Africa Remote Jobs in Middle East Full Time Remote Jobs Part Time Remote Jobs Contract Remote Jobs Internship Remote Jobs Temporary Remote Jobs Freelance Remote Jobs Mid-Level Remote Jobs Senior-Level Remote Jobs Entry-Level Remote Jobs Exec-Level Remote Jobs Lead-Level Remote Jobs