Software Engineer - Algorithms & Data Processing Magician

About Pathway

Pathway is the company that brings Live AI to enterprise.

• In our current product portfolio, our primary developer offering is an ultra-performant Data Processing Framework (unified streaming + batch) with a Python API, distributed Rust engine, and capabilities for data source integration & transformation at scale (Kafka, S3, databases/CDC,...),
• Major data use cases are around RAG/LLM, event-stream data (including real-world data such as IoT), and graph data that changes over time.
• Our enterprise offering is currently used by major players such as NATO and national postal services. Pathway has been featured in Gartner's market guide for LLM Infrastructure and for Event Stream Processing.
• Learn more at http://pathway.com/ and https://github.com/pathwaycom/.

Pathway is VC-funded, with amazing BAs from the AI space and industry. We have operations across Europe and in the US.

The Team

Headed by co-founder & CEO, Zuzanna Stamirowska, the team’s leading AI experts include co-founder & CTO Jan Chorowski, co-author of the Nobel Prize winner, Geoff Hinton. Pathway is backed by Business Angel Lukasz Kaiser, who co-authored Transformers (the “T” in ChatGPT) and is the key researcher behind GPT o1 from OpenAI.

The Opportunity

We are currently searching for 1 or 2 R&D Engineers with a strong track record in designing efficient data storage systems and/or algorithms, to help develop and improve the core data processing components of our solution.

TL;DR: If you like Rust and hearing “distributed Van Emde Boas tree” would put a smile on your face, this is the job for you.

You Will

• create code to optimize index-like data structures used in our core data processing and data storage components.
• help to design algorithms and data structures which work in a dynamic distributed manner.
• contribute to other aspects of the system, for example related to persistency.

The results of your work will play a crucial role in building and optimizing both the foundations of our data processing product, and its core algorithms library.

Requirements

Cover letter

It's always a pleasure to say hi! If you could leave us 2-3 lines, we'd really appreciate that.

In order to ensure the coherence of our team, you are expected to meet at least 2 of the 6 criteria below

1. You got mostly A-grades in a university Computer Science Bachelor/Master program which included: Algorithms, Formal Methods, Graph Theory, Calculus, Probability, and an introduction to …