Lead Data Engineer - Remote, (Eastern Time)
Home Base, NJ
With a company culture rooted in collaboration, expertise and innovation, we aim to promote progress and inspire our clients, employees, investors and communities to achieve their greatest potential. Our work is the catalyst that helps others achieve their goals. In short, We Enable Possibility℠.
Job Summary
The Senior ETL developer will work with the Corporate IT team to maintain and develop data integration solutions to support our Analytics platform. The solutions must align with data vault, data mart, dimensional modeling, and ETL standards and guidelines. The data modeling and data integration solutions will be based on Matillion with Snowflake data warehouses/databases & Power BI for reporting platform.
The ideal candidate will need to understand business and technical requirements and translate this into data integration designs and deliverables by working with the Corporate Data Architect. The position also requires supporting the Agile process in terms of Development, testing, deployment and post-production support.
Responsibilities
Handle multiple projects in parallel, participate and deliver solution design while working closely with the architecture
Design and Develop/Review ETL programs primarily using modern ETL tools like Matillion, DBT , and Python
Coach and guide the technical team in terms development of ETL jobs
Provide performance improvement and tuning of data pipeline.
Perform technical reviews, data validation, and end to end testing of ETL objects, source data analysis and data profiling
Create necessary documentation as per the standards and update the project documentation
Support QA on end-to-end testing and provide daily/weekly project status to the project manager
Work with deployment team in the code migration across the environments
Triage the Production issues and work on the code fixes
Proven experience in database administration with cloud data platforms like Snowflake
Frees up data engineers and analysts from administrative tasks
Education and Experience
10+ years of experience in implementation of BI projects in a large-scale enterprise data warehouse environment
Hands-on experience in building large cloud data warehouses using Snowflake; including database architecture design, data transformations, stored procedures, account and security principles, performance management, etc.
Experience with cloud computing services, particularly deploying and running services in Azure
Expert-level understanding of Agile, SDCL, CI/CD, DevOps, GitOps, and ProdOps.
A team player with excellent verbal and written communication skills
Experience with other ETL tools like Matillion, ADF, and DBT
Advance SQL knowledge and familiar with relational, Vault, and dimensional modeling
knowledge of Power BI
Financial industry data fluency is preferred but not required
Required knowledge and skills would typically be a acquired through a bachelor’s degree in information technology or related field
#LI-ZP1
#LI-REMOTE
For individuals assigned or hired to work in the location(s) indicated below, the base salary range is provided. Range is as of the time of posting. Position is incentive eligible.
$148,614 - $201,066/year
Total individual compensation (base salary, short & long-term incentives) offered will take into account a number of factors including but not limited to geographic location, scope & responsibilities of the role, qualifications, talent availability & specialization as well as business needs. The above pay range may be modified in the future.
Click here to learn more on available benefits.
Do you like solving complex business problems, working with talented colleagues and have an innovative mindset? Arch may be a great fit for you. If this job isn’t the right fit but you’re interested in working for Arch, create a job alert! Simply create an account and opt in to receive emails when we have job openings that meet your criteria. Join our talent community to share your preferences directly with Arch’s Talent Acquisition team.
10200 Arch Capital Services LLC ApplyJob Profile
NJ
Benefits/PerksCollaboration Incentive eligible Innovation Short & long-term incentives
Tasks- Coach technical team
- Create documentation
- Database administration
- Develop data integration solutions
- Handle multiple projects
- Perform data validation
- Solution Design
- Support analytics platform
- Support qa testing
- Triage production issues
ADF Agile Analytics Azure CI/CD Cloud Computing Collaboration Communication Data analysis Database Administration Database Architecture Data Integration Data Mart Data Modeling Data Profiling Data Vault Dbt DevOps Dimensional Modeling Documentation Education ETL GitOps IT Matillion Performance Management Power BI ProdOps Python Reporting SDLC Snowflake SQL Talent Acquisition
Experience10 years
EducationBachelor's degree Degree Information Technology Related Field
TimezonesAmerica/Anchorage America/Chicago America/Denver America/Los_Angeles America/New_York Pacific/Honolulu UTC-10 UTC-5 UTC-6 UTC-7 UTC-8 UTC-9