Sr. Data Engineer (Streaming Services) - Remote, USA
Aliso Viejo, California, United States
Compensation: $120,000-160,000 per year. You are eligible to a Short-Term Incentive Plan with the target at 7.5% of your annual earnings, terms and conditions apply
Sr. Data Engineer (Streaming Services) – Remote, USA
As a Sr. Data Engineer at Ambry you’ll approach tasks with a customer-based, cloud-first mindset to support and enhance various data platform products, including Ambry’s data lakes, streams, and warehouses. This role will be primarily responsible for building, monitoring, and operationalizing our data streams which are hydrated via CDC (change data capture) from a suite of ~20 on-prem and cloud databases.
Essential Functions
- REQUIRED: Experience participating in the development and implementation of real-time data streaming solutions, including event-driven architectures, data ingestion, transformation, and consumption using technologies like Apache Kafka, Apache Flink, and AWS Managed Streaming for Kafka (MSK).
- Build Kafka connectors to sync updates from source data stores
- Build partitioned Kafka topics to sync updates to destination data marts
- Build multiplexed data analytics workloads using Apache Flink to monitor streaming metrics and perform real-time data transformations
- Build dashboards using Datadog and Cloudwatch to ensure system health and user support
- Build opinionated but accommodating schema registries that ensure data governance
- Work closely with your West Coast based scrum team to submit and review PRs daily, maintain documentation and backlogs, validate builds across multiple environments, and deploy at a 2-4 week sprint cadence
- Design reasonable database schemas with query access patterns as the forethought
- Build and maintain CI/CD pipelines using infrastructure-as-code
- Iteratively migrate on-prem ETL jobs written in PHP into AWS Flink and Glue processes
- Partner with QA Engineers in building automated test suites
- Partner with end-users to resolve service disruptions and evangelize our data product offerings
- Other duties as assigned
Qualifications
- REQUIRED: Strong familiarity with any combination of our tech stacks in order of importance: Apache Kafka (MSK flavor preferred), Debezium, Kinesis Python, Apache Flink or PySpark Streaming, MySQL (RDS flavors preferred), Python, CDK or Terraform, Athena, Glue, Lambda, Appflow, HANA/4, PHP, Redis, Docker, Javascript
- 6+ years’ experience working with professional scrum teams and/or equivalent schooling
- 4+ experience using Git versioning control
- 3+ years experience designing and indexing relational databases
- 2+ years experience building and operationalizing real-time data streams
- 1+ years experience in building dashboards for system monitoring and error logging
Preferred
- Master’s degree in computer, data, math, or life sciences
- Basic understanding of genomic concepts and terminology
- Experience building data APIs and offering Data as a Service
- Experience integrating with SaaS platforms such as SAP and Salesforce
- Experience or willingness to learn working with PHP MVC frameworks such as Symfony
- Experience with system diagramming tools such as Miro, LucidCharts, or Visio
About Us:
Ambry Genetics Corporation is a CAP-accredited and CLIA-licensed molecular genetics laboratory based in Aliso Viejo, California. We are a genetics-based healthcare company that is dedicated to open scientific exchange so we can work together to understand and treat all human disease faster.
At Ambry, everyone is welcome. A career at Ambry Genetics is a chance to be part of a dynamic company that aims to improve health by understanding the relationships between genetics and human disease. We earned our reputation as industry leaders by responsibly introducing cutting-edge genetic testing solutions and continually sharing what we learn with the global scientific community.
At Ambry you will be learning, challenging yourself, and having fun while collaborating with teammates through the open exchange of ideas. Our outstanding benefits program includes medical, dental, vision, 401k with a 4% employer match, FSA, paid sick leave and generous paid time off (PTO) program.
You can learn more about the benefits here. Ambry Genetics is an Equal Opportunity Employer (EOE) and we maintain a drug-free work environment. Ambry Genetics is an Equal Opportunity Employer (EOE) and we maintain a drug-free work environment.
The Company believes in second chance employment. Qualified applicants with arrest or conviction history will be considered regardless of their arrest or conviction history, consistent with local laws such as Los Angeles County Fair Chance Ordinance and the California Fair Chance Act. You do not need to disclose your criminal history or participate in a background check until a conditional job offer is made to you. After making a conditional offer and running a background check, if the Company is concerned about conviction that is directly related to the job, you will be given the chance to explain the circumstances surrounding the conviction, provide mitigating evidence, or challenge the accuracy of the background report. For the purpose of the above job description, “Essential Functions” are “Material Job Duties”.
Our salary ranges are determined by role, level, and location. The range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position across all US locations. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training.
All qualified applicants will receive consideration for employment without regard to race (and traits historically associated with race, including, but not limited to hair texture and protective hairstyles such as braids, locks, and twists), color, creed, religion, sex, sexual orientation, gender identity, gender expression (including transgender status), national origin, ancestry, age, marital status or protected veteran status and will not be discriminated against on the basis of disability, protected medical condition as defined by applicable state or local law, genetic information, or any other characteristic protected by applicable federal, state, or local laws and ordinances. If you have a disability or special need that requires accommodation, please contact us at careers@ambrygen.com
Ambry does not accept unsolicited resumes from individual recruiters, third party recruiting agencies, outside recruiters or firms without an executed contract in place. We are not responsible for any fees related to resumes that are unsolicited or are received by Ambry. Such resumes will be deemed the sole property of Ambry and will be processed accordingly.
PRIVACY NOTICES
To review Ambry’s Privacy Notice, Click here: https://www.ambrygen.com/legal/privacy-policy
To review the California privacy notice, click here: California Privacy Notice | Ambry Genetics
To review the UKG privacy notice, click here: California Privacy Notice | UKG
#LI-REMOTE #LI-NK1
ApplyJob Profile
Dental FSA Medical Medical, Dental, Vision Paid Sick Leave Paid Time Off Remote work flexibility Short-Term Incentive Short term incentive plan Vision
Tasks- Build and monitor data streams
- Create dashboards for system health
- Develop real-time data streaming solutions
- Other duties as assigned
Analytics Apache Flink Apache Kafka AppFlow Athena AWS CAP CDK Change Data Capture CI/CD CLIA CloudWatch Computer Dashboards Data APIs Datadog Data Governance Data Lakes Data Warehouses Docker ETL Event-driven architecture Genetics Git Glue Healthcare Javascript Lambda Math Molecular genetics MVC MySQL PHP Python Real-time Data Streaming Redis Relational databases SaaS Integration Salesforce Scrum Symfony System Monitoring Terraform Training
Experience6 years
EducationBachelor's degree Education Equivalent Genetics Master's degree
Certifications TimezonesAmerica/Anchorage America/Chicago America/Denver America/Los_Angeles America/New_York Pacific/Honolulu UTC-10 UTC-5 UTC-6 UTC-7 UTC-8 UTC-9