AI Testing Assistant

Company: Blue Oak Consulting

We are looking for an AI Testing Assistant to evaluate the accuracy and reliability of artificial intelligence tools used within our financial advisory work. You will spend your time testing automated outputs to ensure they meet our standards for disciplined logic and data integrity.
About Blue Oak Consulting
Blue Oak Consulting provides independent advisory on pricing, portfolio economics, capital allocation, and acquisition assumptions. We are not a traditional consulting firm focused on broad transformation programs or high level strategy decks. Instead, we interrogate specific commercial decisions where the financial stakes are high and the existing narrative is not sufficient. Our team looks past corporate language and P&L complexity to identify where value is leaking or capital is trapped. We work across sectors like software, manufacturing, and healthcare to test whether the assumptions behind a growth plan or an acquisition actually hold under pressure. We are a small, principal led firm where the people who do the work are the ones accountable for the results. We do not take transaction contingent fees, which allows us to be completely honest about whether the economics of a decision make sense. Our goal is to provide clarity through financial discipline and a healthy amount of skepticism.
The Role
As an AI Testing Assistant, you will work in a fully remote capacity on a part time contract. This is a junior position focused on the interrogation of AI outputs. Rather than accepting the first answer a model provides, you will be tasked with finding the flaws, hallucinations, and logical gaps in the data provided by various AI tools. You will assist our senior advisors by ensuring that the technology we use to gather information remains a tool for clarity, not a source of error. This role requires a quiet environment where you can focus on technical details and compare complex datasets side by side.
What You Will Be Doing
* Running specific test cases on AI models to verify the accuracy of financial calculations.
* Comparing AI generated research summaries against original source documents to identify discrepancies.
* Documenting instances where AI prompts result in illogical or inconsistent financial assumptions.
* Reviewing AI generated code or spreadsheet formulas for errors in basic accounting logic.
* Maintaining a log of AI performance across different types of advisory tasks.
* Collaborating with the team to refine the instructions used to generate market analysis.
* Testing new AI tools as they are introduced to determine if they meet our firm's standards for skepticism and rigour.
* Assisting with the cleaning and preparation of data sets used for internal testing purposes.
What You Bring
* A background or current enrollment in finance, economics, data science, or a related field.
* A high level of comfort using common AI language models and an interest in how they process information.
* Strong attention to detail and the ability to spot small errors in large blocks of text or data.
* A logical and investigative mindset that enjoys checking work for accuracy.
* The ability to write clear, concise reports on your findings without using corporate jargon.
* Self discipline to manage your own schedule and tasks in a remote environment.
* Basic familiarity with spreadsheet software like Microsoft Excel or Google Sheets.
* A healthy sense of skepticism regarding automated answers and a preference for verified facts.
What We Offer
* Competitive pay that is attractive for an entry level role in the current market.
* A fully remote work arrangement that offers significant flexibility in where you work.
* Direct exposure to the analytical methods used by senior principals in the advisory field.
* Hands on experience at the intersection of financial analysis and AI technology.
* A professional environment that values honest feedback and rigorous thinking over hierarchy.
* Practical training on how to evaluate commercial assumptions and financial logic.
* The chance to contribute to the foundational processes of a growing, principal led firm.
Blue Oak Consulting stays through the execution phase of our projects because decisions that look sound in theory often fail when they face real world friction. We apply this same level of scrutiny to our internal tools. By joining us as an AI Testing Assistant, you will help us maintain the high standard of financial discipline our clients expect. We value people who are more interested in getting the right answer than being right, and who understand that the most important part of any financial model is the data that goes into it.

apply