Principal Data Engineer (Databricks Platform)
New York, NY, USA
Job Summary:
WHO ARE WE?
Live Nation Entertainment is the world’s leading live entertainment company, comprised of global market leaders: Ticketmaster, Live Nation Concerts, and Live Nation Media & Sponsorship. Ticketmaster is the global leader in event ticketing with over 500 million tickets sold annually and more than 12,000 clients worldwide. Live Nation Concerts is the largest provider of live entertainment in the world promoting more than 40,000 shows and 100+ festivals annually for nearly 4,000 artists in over 40 countries. These businesses allow Live Nation Media & Sponsorship to create strategic music marketing programs that connect over 1,000 brands with the 98 million fans that attend Live Nation Entertainment events each year. For additional information, visit www.livenationentertainment.com.
WHO ARE YOU?
Passionate and motivated. Driven, with an entrepreneurial spirit. Resourceful, innovative, forward thinking and committed. At Live Nation Entertainment, our people embrace these qualities, so if this sounds like you then please read on!
THE TEAM
Core Data Services team is at the center of Data and Analytics initiatives. We are building a modern data platform to support enterprise data needs. Our mission and yours too should you choose to, is to empower and enable our data community of data engineers, data scientists, analysts, product teams and decision makers to create value.
The Core Data Services team consists of Platform Engineering, Data Engineering, Data Enablement and Operations teams. We are building a highly functional, performant modern enterprise Data Lake while supporting our current data platforms, so the focus is on maximizing functionality, creating value and content/data assets, cost optimizations and usability of the data delivery and services and all this is our measure of our success and defines us The Core Data Services Team! We are looking for a Data Engineer - Platform, You!
WHAT THIS ROLE WILL DO
This is a hands-on Data role with strong Python/PySpark coding skills
Collaborate with stakeholders to understand and translate business requirements into technical specifications and designs.
Design, develop, and maintain scalable data pipelines, ETL processes, and data warehouses to support data ingestion, transformation, and storage.
Evaluate and select appropriate technologies, tools, and frameworks for data processing, storage, and analytics, considering security, scalability, performance, and cost factors.
Define and enforce data engineering best practices, standards, and guidelines to ensure data quality, reliability, and consistency.
Architect and implement solutions for real-time data processing, streaming analytics, and batch processing.
Conduct performance optimization, tuning, and troubleshooting of data infrastructure components to ensure optimal performance and resource utilization.
Stay abreast of emerging trends, technologies, and best practices in data engineering, cloud computing, and big data analytics.
Consistent exercise of independent judgment and discretion in matters of significance.
Participate in on-call rotations/Pagerduty for data platform support.
Other duties and responsibilities as assigned.
WHAT THIS PERSON WILL BRING: TECHNICAL SKILLS/COMPETENCIES
Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.
12+ years of software engineering experience, with a focus on designing and implementing data platforms.
Proven track record of successfully architecting and delivering large-scale data solutions, e.g. platforms that process millions of streaming events per second or Petabytes of data daily.
Strong proficiency in programming languages such as Python, Java, or Scala.
Hands-on experience with data processing frameworks like Apache Spark or Apache Flink.
Hands on experience using version control systems such as Git and CI/CD workflows and practice
Extensive knowledge of data warehousing, data modeling, relational databases, and NoSQL databases.
Hands-on experience with AWS and cloud-based data services and solutions (e.g., Databricks).
Hands-on experience with data compliance (eg. CCPA, GDPR, etc) and governance
Excellent problem-solving skills, analytical thinking, and the ability to thrive in a fast-paced, dynamic environment.
Strong communication and collaboration skills, with the ability to work effectively with cross-functional teams.
BENEFITS & PERKS
Our motto is ‘Taking Care of Our Own’ through 6 pillars of benefits:
HEALTH: Medical, Vision and Dental benefits for you and your family, including Flexible Spending Accounts (FSA) and Health Savings Accounts (HSAs)
YOURSELF: Generous paid time off policy including paid holidays, sick time and paid days off for your birthday, Free concert tickets
WEALTH: 401(k) program with company match, Stock Program
FAMILY: New parent programs & support including caregiver leave and childcare cash, infertility support
CAREER: Tuition reimbursement, student loan repayment internal growth and development programs & trainings
OTHERS: Volunteer time off, crowdfunding network
Live Nation’s policy regarding vaccinations and masking related to a pandemic or other infectious disease control measures, acts of God, health and safety mandates and/or restrictions imposed by applicable local, state or federal governments has evolved over time. Currently, we strongly encourage employees to be fully vaccinated from such infectious diseases for which vaccinations are available. You are expected to follow Live Nation’s health and safety protocols and policies as they change from time to time.
EQUAL EMPLOYMENT OPPORTUNITY
We are passionate and committed to our people and go beyond the rhetoric of diversity and inclusion. You will be working in an inclusive environment and be encouraged to bring your whole self to work. We will do all that we can to help you successfully balance your work and homelife. As a growing business we will encourage you to develop your professional and personal aspirations, enjoy new experiences, and learn from the talented people you will be working with. It’s talent that matters to us and we encourage applications from people irrespective of their gender, race, sexual orientation, religion, age, disability status or caring responsibilities.
Live Nation strongly supports equal employment opportunity for all applicants regardless of age (40 and over), ancestry, color, religious creed (including religious dress and grooming practices), family and medical care leave or the denial of family and medical care leave, mental or physical disability (including HIV and AIDS), marital status, domestic partner status, medical condition (including cancer and genetic characteristics), genetic information, military and veteran status, political affiliation, national origin (including language use restrictions), citizenship, race, sex (including pregnancy, childbirth, breastfeeding and medical conditions related to pregnancy, childbirth or breastfeeding), gender, gender identity, and gender expression, sexual orientation, or any other basis protected by applicable federal, state or local law, rule, ordinance or regulation.
We will consider qualified applicants with criminal histories in a manner consistent with the requirements of the Los Angeles Fair Chance Ordinance, San Francisco Fair Chance Ordinance and the California Fair Chance Act and consistent with other similar and / or applicable laws in other areas.
We also afford equal employment opportunities to qualified individuals with a disability. For this reason, Live Nation will make reasonable accommodations for the known physical or mental limitations of an otherwise qualified individual with a disability who is an applicant consistent with its legal obligations to do so, including reasonable accommodations related to pregnancy in accordance with applicable local, state and / or federal law. As part of its commitment to make reasonable accommodations, Live Nation also wishes to participate in a timely, good faith, interactive process with a disabled applicant to determine effective reasonable accommodations, if any, which can be made in response to a request for accommodations. Applicants are invited to identify reasonable accommodations that can be made to assist them to perform the essential functions of the position they seek. Any applicant who requires an accommodation in order to perform the essential functions of the job should contact a Human Resources Representative to request the opportunity to participate in a timely interactive process. Live Nation will also provide reasonable religious accommodations on a case by case basis.
HIRING PRACTICES
The preceding job description has been designed to indicate the general nature and level of work performed by employees within this classification. It is not designed to contain or be interpreted as a comprehensive inventory of all duties, responsibilities, and qualifications required of employees assigned to this job
Live Nation recruitment policies are designed to place the most highly qualified persons available in a timely and efficient manner. Live Nation may pursue all avenues available, including promotion from within, employee referrals, outside advertising, employment agencies, internet recruiting, job fairs, college recruiting and search firms.
#LI-RemoteUnitedStates
#LI-EF1
----------
The expected compensation for this position is:
$163,000.00 USD - $204,000.00 USD** Pay is based on a number of factors including market location, qualifications, skills, and experience.
ApplyJob Profile
Communication Dental Equal employment opportunity Free concert tickets Generous paid time off policy Inclusive environment Internal growth and development programs Medical New parent programs & support Paid Time Off Tuition reimbursement Vision Volunteer time off
Tasks- Collaborate with stakeholders
- Conduct performance optimization
- Define data engineering best practices
- Design and maintain data pipelines
- Evaluate technologies for data processing
- Implement real-time data solutions
- Troubleshooting
Advertising Analytical Analytics Apache AWS Big Data Big data analytics CI/CD Cloud Computing Coding Collaboration Communication Compliance Computer Databases Databricks Data engineering Data Lake Data Modeling Data Pipelines Data Platforms Data processing Data Quality Data Warehouses Data Warehousing Design Engineering ETL Git Go Governance Java Marketing NoSQL Performance Optimization Problem-solving PySpark Python Recruitment Scala Security Software Engineering Spark Streaming Analytics Technical Specifications Ticketing Troubleshooting
Experience12 years
EducationBachelor's Business Computer Science Data Analytics Design Engineering Marketing Master's Related Field
TimezonesAmerica/Anchorage America/Chicago America/Denver America/Los_Angeles America/New_York Pacific/Honolulu UTC-10 UTC-5 UTC-6 UTC-7 UTC-8 UTC-9