Databricks Data Engineer
USA - Remote, United States
Since 1869 we've connected people through food they love. We’re proud to be stewards of amazing brands that people trust. Our portfolio includes the iconic Campbell’s brand, as well as Michael Angelo’s, noosa, Pace, Pacific Foods, Prego, Rao’s Homemade, Swanson, and V8. In our Snacks division, we have brands like Cape Cod, Goldfish, Kettle Brand, Lance, Late July, Pepperidge Farm, Snack Factory, and Snyder’s of Hanover.
Here, you will make a difference every day. You will be supported to build a rewarding career with opportunities to grow, innovate and inspire. Make history with us.
Why Campbell’s…
- Benefits begin on day one and include medical, dental, short and long-term disability, AD&D, and life insurance (for individual, families, and domestic partners).
- Employees are eligible for our matching 401(k) plan and can enroll on the first day of employment with immediate vesting.
- Campbell’s offers unlimited sick time along with paid time off and holiday pay.
- If in WHQ – free access to the fitness center. Access to on-site day care (operated by Bright Horizons) and company store.
- Giving back to the communities where our employees work and live is very important to Campbell’s. Our “Campbell’s Cares” program matches employee donations and/or volunteer activity up to $1,500 annually.
- Campbell’s has a variety of Employee Resource Groups (ERGs) to support employees.
How you will make history here…
- Collaborate with solution architects to understand the overall solution concept in support of a project or continuous improvement effort.
- Work closely with customers and stakeholders in partnership with solution architects to understand business needs with respect to data and analytics to determine optimal solutions.
What you will do…
- Design and build data solutions/pipelines for development and testing of enterprise-wide data lake house.
- Integrate data from various source systems into the data lake.
- Develop high-level and detailed design documents for projects and continuous improvement efforts.
- Participate in code reviews with the development team, ensuring adherence to development standards and overall best practices.
- Facilitate software change management across development, test, and production landscapes.
- Assess the impact of any change to the overall architecture and guide the offshore development team to complete the work.
- Document and transition the completed work to support team for maintenance and monitoring.
- Work closely with the Security, Data Governance & Data Catalog teams to create discoverable data products and ensure data security.
- Contribute ideas and actions towards continual improvement projects.
- Stay abreast of emerging trends and technologies in data and CPG landscape to continuously enhance our digital capabilities.
- Familiarity with Azure Devops CI/CD processes and ADO to manage and track work.
What you bring to the table…
Job Requirements (Must Have)
- Bachelor's or Master's degree in Data Science, Computer Science or related field.
- 5+ years of experience as a Data Engineer or in a similar role.
- Proven experience in data analysis, data warehousing, and data reporting.
- Proven experience in Azure Databricks (python, pyspark, databricks sql), Azure Data Factory, ADLS.
- Experience with Business Intelligence tools like Power BI.
- Experience with any enterprise scheduling tools like Stone branch.
- Proficiency in querying languages like SQL.
- Strong problem-solving skills and attention to detail.
- Proven ability to translate business requirements into technical solutions.
- Excellent communication and presentation skills, with the ability to effectively communicate complex concepts to both technical and non-technical audiences.
- Ability to work effectively in a team environment.
- Knowledge of data governance and data cataloging practices.
- Experience in developing high-level and detailed design documents.
- Understanding of software change management processes.
It would be great to have…
(Nice to Have)
- Microsoft Certified: Azure Data Analytics Associate or other related data analytics certification.
- Databricks Certified Engineer.
- Understanding of data privacy regulations and compliance.
- Experience with Snowflake.
Travel required to WHQ Camden, NJ at least once a quarter
Compensation and Benefits:
The target base salary range for this full-time, salaried position is between
$108,100-$155,400Individual base pay depends on work location and additional factors such as experience, job-related skills, and relevant education or training. Total pay may include other forms of compensation. In addition, we offer competitive health, dental, 401k and wellness benefits beginning on the first day of employment. Please ask your Talent Acquisition Partner for more information about our total rewards package.
The Company is committed to providing equal opportunity for employees and qualified applicants in all aspects of the employment relationship, including consideration for employment, without regard to race, color, sex, sexual orientation, gender identity, national origin, citizenship, marital status, protected veteran status, disability, age, religion, or any other classification protected by law.
ApplyJob Profile
401(k) matching Dental Disability Insurance Donation-matching program Employee Resource Groups Fitness Center Access Holiday Pay Life Insurance Medical On-site Day Care Paid Time Off Unlimited sick time
Tasks- Collaborate with security and governance teams
- Contribute to improvement projects
- Design and build data solutions
- Develop design documents
- Document and transition work
- Facilitate software change management
- Integrate data from source systems
- Participate in code reviews
Adls Azure Databricks Azure Data Factory Change Management Communication Continuous Improvement Data analysis Databricks SQL Data catalog Data Governance Data Reporting Data Warehousing Development DevOps Enterprise Scheduling Tools Power BI Problem-solving PySpark Python SQL Teams Teamwork Training
Experience5 years
EducationBachelor's Computer Science Data Science Master's Related Field
TimezonesAmerica/Anchorage America/Chicago America/Denver America/Los_Angeles America/New_York Pacific/Honolulu UTC-10 UTC-5 UTC-6 UTC-7 UTC-8 UTC-9