Associate Data Engineer - Remote, United States
Overview
As an Associate Data Engineer, you will work with the team to build complex data pipelines using a new cutting-edge Data Ingestion Platform as well as several new and exciting products in the Big Data/Advanced Analytics space. You will operate in a fast-paced environment where multiple project deliverables are coordinated within specified deadlines. The primary responsibility of this role is to deliver accurate and timely data across various products to enable revenue for the company. The ideal candidate would have data analysis and data pipeline development experience using big data tools (like Spark, Scala, Hive), relational databases, intermediate SQL skills. Healthcare knowledge is a plus.
Responsibilities
- Build data pipelines as per data transformation specifications to convert source data to be loaded into data lake using proprietary big data processing platform
- Supports and improves current data ingestion processes for our proprietary healthcare data applications and systems
- Develop and maintain data engineering processes using a variety of tools including T-SQL, Spark and Scala, and shell scripting. Generally focused on data ingestion for healthcare data management, data validation, statistical report generation, and program validation.
- Develop tools and techniques for improving process efficiencies and data performance.
- Review & test the data to ensure accuracy & validity of the data prior to uploading the data to the data lake.
- Data Troubleshooting and Analysis
- Perform data analysis, data mining and investigations and identify root cause of issues using several cutting-edge data analysis tools.
- Work with Technical Operations to troubleshoot complex database issues related to the entire environment including OS, storage, and servers. Provide off hours support to resolve production issues when necessary
Qualifications
- MUST: Solid understanding of Linux environments; strong knowledge of shell scripting and …
Hey, this job isn't fresh anymore!
Search Fresh JobsJob Profile
Regions Countries Benefits/Perks17-27 days of Paid Time Off (PTO) per year 401(k) savings plans 9 paid holidays per year Competitive benefits package Dental Disability Life Insurance Life insurance coverage Medical Medical, dental, vision, disability, and life insurance coverage Paid Family Leave Paid holidays Paid Time Off Vision
SkillsAgile Analytics Computer Computer Science Data analysis Data Integration Data Mining ETL ETL tools Hadoop Hive Operations Oracle RDBMS Scala Science Shell scripting Spark SQL SQL Server T-SQL
Tasks- Build data pipelines
- Data Analysis
- Data integration
- Data Management
- Develop and maintain data engineering processes
- Perform data troubleshooting and analysis
- Report Generation
- Reporting
- Review & test data
- Support data ingestion processes
0-2 years
EducationBachelor's degree in Computer Science Business Computer Science Engineering Junior Related Field
TimezonesAmerica/Anchorage America/Chicago America/Denver America/Los_Angeles America/New_York Pacific/Honolulu UTC-10 UTC-5 UTC-6 UTC-7 UTC-8 UTC-9