Data Platform Engineer

Job Title: Data Platform Engineer
Position Type: 4 months contract
Location: Remote anywhere in the USA
Salary Range / Rate (Currency): $60-$62/hr. on w2 (This role does not accept C2C)
Job ID#: 352142

Job Summary (Responsibilities and Requirements):

• Setup and maintain production scale Databricks environment on public cloud such as Microsoft Azure and AWS
• Setup and maintain production scale data storage such as ADLS and S3 for multiple tenant teams using our Data Platform
• Set up and maintain production scale microservices to support the daily operation of our data platform. Services include job scheduling, security, financial, and administrative services, etc.
• Provide triage and guidance to the team on various support issues raised by our tenants
• Develop tools and automation solutions for configuration management, service deployments, monitoring, and alerting to assist with daily RTB operations
• Assure security and privacy compliance and implement client Security & Compliance solutions to lock down data stored in our data lake
• Explore GenAI technologies and find opportunities to integrate them with our data platform, providing technical enhancement or improving user experience in the end
• Work with various 3rd party vendors for troubleshooting, proof of concept, and other collaborative projects to enhance our product.

Preferred Skills:
Cloud Infrastructure Administration and Automation:

• AWS
• Azure

Proficient with the following storage technologies:

• ADLS Gen2
• S3
• Minio
• MongoDB
• Vector Databases

Setup and operation of:

• Databricks
• Airflow
• Azure Kubernetes Service or Elastic Kubernetes Service

Ability to setup monitoring and alerting with:

• DBX System Tables
• Prometheus
• Splunk
• ELK

Familiar with how to troubleshoot and maintain:

• Servers with Linux system
• Kubernetes environment

Knowledge to operate with:

• Jira
• Service Now

IntelliPro, a global leader in connecting individuals with rewarding employment opportunities, is dedicated to understanding your career aspirations. https://intelliprogroup.com/

Equal Opportunity Employer: IntelliPro values diversity and is an equal-opportunity employer. We do not discriminate based on race, color, religion, sex, sexual orientation, gender identity, national origin, age, genetic information, disability, or any other legally protected group status.

Inclusivity Commitment: IntelliPro embraces candidates of all abilities and is dedicated to ensuring that our hiring and interview processes accommodate the needs of all applicants.

Compensation: The pay offered to a successful candidate will be determined by various factors, including education, work experience, location, job responsibilities, certifications, and more. Additionally, IntelliPro provides a comprehensive benefits package, all subject to eligibility.