Senior Software Engineer, Data- Remote

About ClickHouse

We are the company behind the popular open-source, high performance columnar OLAP database management system for real-time analytics. ClickHouse works 100-1000x faster than traditional approaches. By offering a true column-based DBMS, it allows for systems to generate reports from petabytes of raw data with sub-second latencies. With an amazing community already adopting our open-source technology, we are now embracing our journey in delivering Cloud first solutions to delight our customers. 

With top adopters such as Lyft, Cisco, and eBay - not only do our products work at lightning speed, so do we. 

We are an open and collaborative company. Our colleagues are curious, engaged and excited about what they do. If you want to work in an environment where you can learn, grow, be an agent of change and have your voice heard - then please read on!

The Cloud AutoScaling team is dedicated to implementing robust vertical and horizontal auto-scaling capabilities within the ClickHouse cloud environment. We seek exceptional software engineers to develop and maintain the auto-scaling infrastructure to transform ClickHouse into a fully functional serverless database solution. Collaborating closely with the core database team, we are actively working on evolving ClickHouse into a cloud-native database system. Additionally, we engage with other cloud teams to drive continuous improvements in cloud infrastructure for enhanced performance and scalability.

What will you do?

• Build a cutting-edge Cloud Native platform on top of the public cloud.
• Improve the metrics pipeline and build algorithms to generate better autoscaling statistics and recommendations.
• Work on the autoscale and Kubernetes operator to support seamless Vertical and Horizontal Auto-scaling.
• Work closely with our ClickHouse core development team and other data plane teams, partnering with them to support auto-scaling use cases as well as other internal infrastructure improvements.
• Architecting and building a robust, scalable, and highly available distributed infrastructure

About you:

• You have 5+ years of relevant software development industry experience building and operating scalable, fault-tolerant, distributed systems.
• Hands-on experience building and estimating statistical models and time-series forecasting with large-scale, real-world datasets.
• Experience using SQL, Python (Pandas, NumPy, Scikit-Learn, etc.)/R or equivalent.
• Experience with Data Storage, Ingestion, and Transformation (Spark, Kafka or similar tools).
• You are passionate about solving data problems at Scale.
• Expertise with a public cloud provider (AWS, GCP, Azure) and their infrastructure …