Senior Data Engineer
Austin - United States - Austin, Texas 78702 United States; Remote - Remote; San Francisco - United States - San Francisco, California 94104 United States
Overview
Working at Atlassian
Atlassians can choose where they work – whether in an office, from home, or a combination of the two. That way, Atlassians have more control over supporting their family, personal goals, and other priorities. We can hire people in any country where we have a legal entity. Interviews and onboarding are conducted virtually, a part of being a distributed-first company.
Responsibilities
Atlassian is looking for a Senior Data Engineer to join our Go-To Market Data Engineering (GTM-DE) team which is responsible for building our data lake, maintaining our big data pipelines / services and facilitating the movement of billions of messages each day. We work directly with the business stakeholders and plenty of platform and engineering teams to enable growth and retention strategies at Atlassian. We are looking for an open-minded, structured thinker who is passionate about building services that scale.
On a typical day you will help our stakeholder teams ingest data faster into our data lake, you’ll find ways to make our data pipelines more efficient, or even come up ideas to help instigate self-serve data engineering within the company. Then you will move on to building micro-services, architecting, designing, and enabling self serve capabilities at scale to help Atlassian grow.
We are a team with little legacy in our tech stack and as a result you’ll spend less time paying off technical debt and more time identifying ways to make our data usable and improve our users experience.
Qualifications
As a Senior Data Engineer in the GTM-DE team, you will have the opportunity to apply your strong technical experience building highly reliable services on managing and orchestrating a multi-petabyte scale data lake. You enjoy working in a fast paced environment and you are able to take vague requirements and transform them into solid solutions. You are motivated by solving challenging problems, where creativity is as crucial as your ability to write code and test cases.
On your first day, we'll expect you to have:
A BS in Computer Science or equivalent experience
At least 5+ years professional experience as a Sr. Software Engineer or Sr. Data Engineer
Strong programming skills (Python, Java or Scala preferred)
Experience writing SQL, structuring data, and data storage practices
Experience with data modeling
Knowledge of data warehousing concepts
Experience building data pipelines, platforms, micro services, and REST APIs
Experience with Spark, Hive, Airflow and other streaming technologies to process incredible volumes of streaming data
Experience in modern software development practices (Agile, TDD, CICD)
Strong focus on data quality and experience with internal/external tools/frameworks to automatically detect data issues, anomalies.
A willingness to accept failure, learn and try again
An open mind to try solutions that may seem crazy at first
Experience working on Amazon Web Services (in particular using EMR, Kinesis, RDS, S3, SQS and the like)
It's preferred, but not technically required, that you have:
Experience building self-service tooling and platforms
Built and designed Kappa architecture platforms
Built pipelines using Databricks and well versed with their API’s
Contributed to open source projects
Compensation
At Atlassian, we strive to design equitable, explainable, and competitive compensation programs. To support this goal, the baseline of our range is higher than that of the typical market range, but in turn we expect to hire most candidates near this baseline. Base pay within the range is ultimately determined by a candidate's skills, expertise, or experience. In the United States, we have three geographic pay zones. For this role, our current base pay ranges for new hires in each zone are:
Zone A: $163,400 - $217,800
Zone B: $147,000 - $196,000
Zone C: $135,600 - $180,800
This role may also be eligible for benefits, bonuses, commissions, and equity.
Please visit go.atlassian.com/payzones for more information on which locations are included in each of our geographic pay zones. However, please confirm the zone for your specific location with your recruiter.
Our perks & benefits
Atlassian offers a variety of perks and benefits to support you, your family and to help you engage with your local community. Our offerings include health coverage, paid volunteer days, wellness resources, and so much more. Visit go.atlassian.com/perksandbenefits to learn more.
About Atlassian
At Atlassian, we're motivated by a common goal: to unleash the potential of every team. Our software products help teams all over the planet and our solutions are designed for all types of work. Team collaboration through our tools makes what may be impossible alone, possible together.
We believe that the unique contributions of all Atlassians create our success. To ensure that our products and culture continue to incorporate everyone's perspectives and experience, we never discriminate based on race, religion, national origin, gender identity or expression, sexual orientation, age, or marital, veteran, or disability status. All your information will be kept confidential according to EEO guidelines.
To provide you the best experience, we can support with accommodations or adjustments at any stage of the recruitment process. Simply inform our Recruitment team during your conversation with them.
To learn more about our culture and hiring process, visit go.atlassian.com/crh.
ApplyJob Profile
Bonuses Commissions Competitive compensation Equity Flexible work location Health coverage Paid volunteer days Remote-first company Support for personal goals Variety of perks Virtual interviews and onboarding Wellness resources
Tasks- Architect and design self-serve capabilities
- Build data lake
- Build micro-services
- Collaboration
- Development
- Facilitate data movement
- Improve data pipeline efficiency
- Ingest data faster
- Maintain big data pipelines
Agile Airflow Amazon Web Services APIs Architecture Atlassian AWS Big Data C CI/CD Collaboration Creativity Databricks Data engineering Data Modeling Data Pipelines Data Quality Data Warehousing Design EMR Go Health Coverage Hive IT Java Kinesis Legal Microservices Modeling Onboarding Programming Python RDS REST REST APIs S3 Scala Software Development Software Products Spark SQL SQS TDD Team Collaboration Wellness Resources Writing
Experience5 years
EducationB.S. in Computer Science Business Computer Science Engineering Equivalent experience
TimezonesAmerica/Anchorage America/Chicago America/Denver America/Los_Angeles America/New_York Pacific/Honolulu UTC-10 UTC-5 UTC-6 UTC-7 UTC-8 UTC-9