QA & Release Engineer

About the Role

We are looking for an engineer to ensure the quality of the product. Your work spans hands-on manual testing, automated test scripts, and LLM evaluation setup. Because our product generates creative visual outputs, “correct” is often a judgment call, and you will help us turn that judgment into repeatable checks.

Our Core Engineering Philosophy: We highly value simple solutions to complex problems. We do not build architecture astronauts or over-engineered abstractions. We want clean, minimal test code and tooling that is easy to reason about, maintain, and debug. If you take pride in catching the bug before a customer does, and in replacing a fragile manual process with a simple, reliable one, you will fit right in.

What You Will Do

• Own Manual & Exploratory Testing: Test new features end to end the way real customers use them, from connecting a brand’s website and social accounts to generating, editing, and exporting posts for Instagram and LinkedIn. Find the edge cases nobody thought to write down, and write clear, reproducible bug reports.

• Write Automated Test Scripts: Build and maintain lean end-to-end, API, and regression test suites for our web app and Python/FastAPI backend. Keep them fast, stable, and free of flakiness so the team trusts a red build.

• Set Up & Run LLM Evals: Work with engineering to build evaluation datasets and harnesses for our generation pipelines. Combine automated checks (schema adherence, rendering, brand rules) with structured human review so that output quality is measured, tracked, and protected against regressions.

• Turn Quality Judgment into Rubrics: Define what “good” looks like for generated visuals and create scoring guidelines that both humans and models can apply consistently.

• Monitor Production Quality: Set up smoke tests and lightweight post-release checks, watch for regressions in errors and output quality, and close the loop between customer-reported issues and new test coverage.

What We Look For

• 3–5 Years in QA, Test Automation, or Release Engineering: You have owned quality for a web product at a fast-moving startup, ideally one shipping frequently with a small team.

• Sharp Eye & Strong Judgment: You are a meticulous manual tester who notices what’s off, and you know when a manual pass is the right answer and when something has earned automation.

• Practical Automation Skills: Hands-on experience writing test scripts in Python and testing REST APIs. You write test code that is as clean as production code.

• LLM & Eval Experience: You have tested systems with non-deterministic output and understand how LLMs fail in practice. Experience building eval datasets, rubrics, or model-graded checks is a strong plus.

• Work authorization: Applicants must be currently authorized to work in the United States on a full-time basis. We are unable to sponsor or take over sponsorship of employment visas (e.g., H-1B) at this time.