CLM Analyst
HSBCDubai, Dubai, UAESome careers grow faster than others.If youre looking for further opportunities to develop your career take the next step in fulfilling your potential right here at HSBC.Our Client Lifecycle Manage... أظهر المزيد
LLM Evaluation AssistantBlue Oak Consulting • Dubai, Dubai, AE
LLM Evaluation Assistant
Blue Oak Consulting • Dubai, Dubai, AE
10 منذ ساعات
الوصف الوظيفي
We are seeking an LLM Evaluation Assistant to help our team verify the logic and accuracy of model generated financial insights. This role focuses on the careful review of automated outputs to ensure they meet our standards for factual discipline and economic reasoning.
About Blue Oak Consulting
Blue Oak Consulting provides independent advisory on pricing, portfolio economics, capital allocation, and acquisition assumptions. We are not a traditional consulting firm focused on broad transformation programs or high level strategy decks. Instead, we interrogate specific commercial decisions where the financial stakes are high and the existing narrative is not sufficient. Our team looks past corporate language and P&L complexity to identify where value is leaking or capital is trapped. We work across sectors like software, manufacturing, and healthcare to test whether the assumptions behind a growth plan or an acquisition actually hold under pressure. We are a small, principal led firm where the people who do the work are the ones accountable for the results. We do not take transaction contingent fees, which allows us to be completely honest about whether the economics of a decision make sense. Our goal is to provide clarity through financial discipline and a healthy amount of skepticism. We stay through the execution phase because decisions that look sound in theory often fail when they meet real world friction.
The Role
As an LLM Evaluation Assistant, you will work in a fully remote capacity to test the outputs of large language models against real world financial data and logic. While many organizations are quick to adopt automated tools, we approach them with a disciplined eye, looking for errors, hallucinations, or flawed economic logic. You will be part of a small team dedicated to finding the friction points where theory meets reality. This is a part time contract position designed for someone who enjoys investigation and has a high attention to detail.
What You Will Be Doing
About Blue Oak Consulting
Blue Oak Consulting provides independent advisory on pricing, portfolio economics, capital allocation, and acquisition assumptions. We are not a traditional consulting firm focused on broad transformation programs or high level strategy decks. Instead, we interrogate specific commercial decisions where the financial stakes are high and the existing narrative is not sufficient. Our team looks past corporate language and P&L complexity to identify where value is leaking or capital is trapped. We work across sectors like software, manufacturing, and healthcare to test whether the assumptions behind a growth plan or an acquisition actually hold under pressure. We are a small, principal led firm where the people who do the work are the ones accountable for the results. We do not take transaction contingent fees, which allows us to be completely honest about whether the economics of a decision make sense. Our goal is to provide clarity through financial discipline and a healthy amount of skepticism. We stay through the execution phase because decisions that look sound in theory often fail when they meet real world friction.
The Role
As an LLM Evaluation Assistant, you will work in a fully remote capacity to test the outputs of large language models against real world financial data and logic. While many organizations are quick to adopt automated tools, we approach them with a disciplined eye, looking for errors, hallucinations, or flawed economic logic. You will be part of a small team dedicated to finding the friction points where theory meets reality. This is a part time contract position designed for someone who enjoys investigation and has a high attention to detail.
What You Will Be Doing
- Reviewing model outputs for factual accuracy regarding financial metrics and corporate filings.
- Testing the logical consistency of arguments presented by AI tools during the analysis of investment cases.
- Flagging instances where models use vague language instead of concrete data points.
- Comparing model generated summaries against source documents to identify omissions or distortions of risk factors.
- Recording and categorizing errors in reasoning to help refine the firm's internal workflows.
- Assisting principals in verifying the math behind automated projections to ensure no basic arithmetic errors exist.
- Documenting the specific prompts used to generate outputs and noting which variations lead to more reliable results.
- Collaborating with the team through digital channels to discuss cases where a model's interpretation of a contract is questionable.
- A current pursuit of or recent degree in finance, economics, or a related analytical field.
- A skeptical mindset that does not take automated or provided data at face value.
- Strong reading comprehension skills and the ability to spot subtle contradictions in a text.
- Basic familiarity with financial statements such as balance sheets and income statements.
- Comfort working in a fully remote setting where communication is largely written and focused on results.
- Proficiency in Excel and an interest in how data flows through different analytical systems.
- Willingness to perform repetitive tasks with a high degree of precision and focus.
- An organized approach to notes and documentation to help others review your findings easily.
- A fully remote work schedule that provides flexibility for those with other commitments or studies.
- Attractive pay that is competitive for the role and reflecting the specialized nature of these evaluation tasks.
- Direct exposure to the work of senior principals who have extensive experience in corporate finance and advisory.
- A culture that values plain speaking, honesty, and analytical rigor over office politics.
- Practical experience in the emerging field of AI evaluation within a commercial context.
- Access to complex, real world financial cases that go beyond what is typically taught in a classroom.
- An environment where your findings directly contribute to the quality of advice provided to clients.
إنشاء تنبيه وظيفي لهذا البحث
LLM Evaluation Assistant • Dubai, Dubai, AE
الوظائف المماثلة
Conversational AI Analyst Fully Remote
MercorDubai, Dubai, UAEHeadquartered in San Francisco our investors include.Full-time or Part-time Contract Work.Geography restricted to Egypt Saudi Arabia UAE USA.Conduct fact-checking using trusted public sources and e... أظهر المزيد
Rough Diamond Evaluator - Mining Site
Apt ResourcesDubai, Dubai, UAEApt Resources is seeking an experienced Diamond Evaluator to join our clients mining operations team in Angola.The ideal candidate will bring deep expertise in evaluating grading and valuing rough ... أظهر المزيد
Learning Associate
AmazonDubai, Dubai, UAEThe AMZL Trans Learning Associate works with their Country L&D manager Operations Managers Area Managers Production Assistants Delivery Service Provider (DSP) Managers Dispatchers Drivers and S... أظهر المزيد
Assitant Evaluator 7698
CRIFDubai, Dubai, UAEField Associate Evaluators & Assistant Evaluators.The Associate is required to conduct verification interviews with subject companies and collate information as per the norms and guidelines pr... أظهر المزيد
Content Reviewer
MercorDubai, Dubai, UAEHeadquartered in San Francisco our investors include.Full-time or Part-time Contract Work.Geography restricted to Egypt Saudi Arabia UAE USA.Conduct fact-checking using trusted public sources and e... أظهر المزيد
Content Quality Reviewer
MercorDubai, Dubai, UAEHeadquartered in San Francisco our investors include.Full-time or Part-time Contract Work.Geography restricted to Egypt Saudi Arabia UAE USA.Conduct fact-checking using trusted public sources and e... أظهر المزيد
Assistant T&C and L&D Manager
AccorHotelDubai, Dubai, UAEThe Assistant Manager - T&C and L&D supports the overall HR and training functions ensuring the smooth execution of daily operations and strategic initiatives with the guidance of the Direc... أظهر المزيد
Bilingual LLM Evaluator Arabic Expert
MercorDubai, Dubai, UAEHeadquartered in San Francisco our investors include.Full-time or Part-time Contract Work.Geography restricted to Egypt Saudi Arabia UAE USA.Conduct fact-checking using trusted public sources and e... أظهر المزيد
Sr. Content Quality Reviewer
MercorDubai, Dubai, UAEHeadquartered in San Francisco our investors include.Full-time or Part-time Contract Work.Geography restricted to Egypt Saudi Arabia UAE USA.Conduct fact-checking using trusted public sources and e... أظهر المزيد
Quality & Training Officer (Learning & Development)
Marriott Hotels ResortsDubai, Dubai, UAECreate and maintain filing systems.Create and type office correspondence using a computer.Order and track Human Resources office supplies and forms.Answer phone calls and record messages.Create new... أظهر المزيد
Assistant Learning Manager
Minor InternationalDubai, Dubai, UAEThe Assistant Learning Manager plays a vital role in supporting the Learning and Development function by coordinating and delivering training programs that enhance team members performance and ensu... أظهر المزيد
Diamond Evaluator - Mining Site - 1
Apt ResourcesDubai, Dubai, UAEApt Resources is seeking an experienced Diamond Evaluator to join our clients mining operations team in Angola.The ideal candidate will bring deep expertise in evaluating grading and valuing rough ... أظهر المزيد
Bilingual LLM Assessment Specialist Arabic
MercorDubai, Dubai, UAEHeadquartered in San Francisco our investors include.Full-time or Part-time Contract Work.Geography restricted to Egypt Saudi Arabia UAE USA.Conduct fact-checking using trusted public sources and e... أظهر المزيد
Language Model Evaluator Fully Remote
MercorDubai, Dubai, UAEHeadquartered in San Francisco our investors include.Generalist - English & Urdu.Conduct fact-checking using trusted public sources and external.Generate high-quality human evaluation data by i... أظهر المزيد
Trainee – Compliance (Wealth Management) – 8 months
Mirabaud & Cie SADubai, Dubai, UAEAssist the Head of Compliance in an ad-hoc project:.Provide focused effort to review validate and remediate a defined set of items within agreed timelines;.Documents and data gathering file reviews... أظهر المزيد
Senior Content Reviewer
MercorDubai, Dubai, UAEHeadquartered in San Francisco our investors include.Full-time or Part-time Contract Work.Geography restricted to Egypt Saudi Arabia UAE USA.Conduct fact-checking using trusted public sources and e... أظهر المزيد
Rough Diamond Evaluator - Mining Site - 1
Apt ResourcesDubai, Dubai, UAEApt Resources is currently looking for a skilled Rough Diamond Evaluator to join our clients mining team in Angola.The successful candidate will specialize in assessing grading and valuing rough di... أظهر المزيد
Bilingual Evaluator - Telugu Expert
MercorDubai, Dubai, United Arab EmiratesQuick Apply
Headquartered in San Francisco, our investors include.Generalist - English & Telugu.Conduct fact-checking using trusted public sources and external.Generate high-quality human evaluation data b... أظهر المزيد
Bilingual Evaluator Telugu Expert
MercorDubai, Dubai, UAEHeadquartered in San Francisco our investors include.Generalist - English & Telugu.Conduct fact-checking using trusted public sources and external.Generate high-quality human evaluation data by... أظهر المزيد