Hi! Thanks for taking the time to read our job description.

COMPANY OVERVIEW

We're Kolena, an early stage startup focused on building an ML testing platform for teams to ship their ML products with confidence.

One of the hardest problems that ML teams face is the lack of ability to identify (and track) the success and failure modes of their models. Data scientists currently rely on statistical metrics like precision, recall, F1 score, etc. to understand areas of strengths and weaknesses. However, these techniques leave huge blind spots that fail to capture the full behavior of the model. Metrics reported in terms of these aggregated statistics don’t provide information on failures across various types of cases, attributes, and scenarios. Even when a model is improved to report a higher overall accuracy, surprising shifts can occur in the distribution of errors — including new ones. Our mission at Kolena is to solve this problem by building a dynamic test harness, empowering teams to proactively define quality for their models — before they deploy to prod!

We've recently raised a large seed round from top tier funds in the Silicon Valley, and are looking use this funding to build our initial team of engineers. If you are passionate about defining the standards for how engineering teams think about model quality, we would love to hear from you!

ABOUT THE ROLE

Our company is working closely with our customers / design partners in the CV and NLP space to build a testing platform that will allow teams to organize their data, build test cases, orchestrate test runs, analyze results, and communicate summaries. We're looking for someone who can work closely with our solution engineers and design partners to grok their computer vision development processes, keep up to date with with the latest research in CV, and creatively design / build testing processes that take advantage of advancements in the CV world. This role involves all types of CV development: from traditional CV and image processing to advanced neural networks for classification, detection, and image search using visual embeddings.

On the non-technical side, we're looking for someone driven and excited, but also not afraid to have some fun and bring their own personality to the company. We plan on working on this for the long haul, so our goal is to build an authentic culture that includes your passions and personality. We want you to be proud to be part of Kolena.

You'll have the opportunity to work with a talented founding team, with experience building product and leading development at Amazon, Palantir, Twilio, and Rakuten. We've also built a previous startup (Synapse Technology Corporation) to a successful exit. Moreover, as one of our initial engineers, you will have the agency to influence our software development process — ranging from the technology, to the architecture, to the meta-processes of how engineers work.

QUALIFICATIONS

As a small startup, we think the most valuable initial engineers are generalists who are excited to learn on the job. As such, we aren't looking for the unicorn candidate who checks every box on this list, but rather someone who grasps many of these concepts well.