Finance Domain Expert for AI Training and Evaluation
Drive how advanced generative AI models understand and perform real financial work by providing deep, practice-based finance judgment. In this hands-on role you will assess model outputs, author precise instruction specifications and golden solutions, and build rigorous benchmarks so research teams can measure real improvement. This position places you on-site with a leading AI research team as a W-2 employee of Cincinnatus LLC.
Key Responsibilities- Data quality reviews: Vet finance tasks and model outputs for missing behaviors, shallow or flawed reasoning, incorrect assumptions, and answers that look plausible but would fail professional review.
- Instruction specs and golden datasets: Write high-quality instruction specifications, create authoritative solutions to financial problems, and define new tasks that reflect real-world finance practice.
- Benchmark design: Design challenging finance evaluation sets and tasks that reveal domain depth, and collaborate with researchers to build finance-specific skills and tools.
- Calibration and standards: Work with researchers and adjacent specialists to translate tacit financial judgment into explicit, teachable evaluation criteria and keep standards consistent.
- Minimum 5 years of substantive, dedicated professional finance experience at a recognized institution such as an investment bank, asset manager, private equity or credit fund, Big Four firm, large corporate finance function, or financial regulator. Roles that only touch finance peripherally do not meet this requirement.
- Specialization in at least one core finance discipline, for example corporate finance and FP&A, investment banking and M&A, asset or wealth management, private equity or private credit, quantitative finance and risk management, treasury, or accounting and audit.
- Senior-level progression with clear ownership of analysis and decisions, such as titles like Vice President, Director, Principal, Managing Director, Portfolio Manager, Controller, or CFO.
- Advanced degree from a strong program (MBA, MS, or PhD in finance, economics, accounting, or a quantitative field) and/or a recognized credential such as CFA, CPA, FRM, or an actuarial designation, strongly preferred.
- Practical familiarity with large language models, including hands-on use in professional work, and the judgment to distinguish well-reasoned answers from plausible-sounding but incorrect outputs.
- Excellent written communication, including the ability to provide precise, well-structured written feedback.
- Availability to commit reliably to 40 hours per week for an initial engagement of 6 months.
- Employment type: Full-time W-2 employment through Cincinnatus LLC, serving as the employer of record for this placement.
- Onsite requirement: Hybrid role based in the Bay Area, California. You must live in the Bay Area and be able to work on-site with the client''s team multiple days each week when required. This is not a remote role.
- Relocation: Candidates not currently based in the Bay Area must be willing to relocate at their own expense; relocation assistance is not provided.
- Placement and tools: You will be placed as part of the client research team, provisioned with client-issued accounts and equipment, and will work inside the client’s tools and workflows alongside their researchers.
- Engagement character: These roles are structured, role-based positions rather than freelance or short project gigs, and involve close collaboration and integration into standard enterprise workflows.
- Pay rate: $60.00 to $100.00 per hour.
- Must be able to accept W-2 employment with Cincinnatus LLC.
- Must reside in the Bay Area, California or relocate there before the engagement begins, at the candidate''s expense.
- Cincinnatus LLC administers employment, onboarding, payroll, benefits, and compliance for this role as the employer of record.
- Cincinnatus is an Equal Employment Opportunity employer and will provide reasonable accommodations for qualified applicants with disabilities.
Submit your resume and a brief cover letter describing your relevant finance specialization and hands-on experience with large language models. Applications will be processed through the hiring organization, and if selected you will be onboarded as a W-2 employee of Cincinnatus LLC which manages payroll, benefits, and employment administration for this placement.
Recommended Jobs
Mechanic
JOIN OUR OLD TOWN TROLLEY FAMILY! Voted BEST EMPLOYER! Named one of the Top 3 Employers and Best Leadership in St. Augustine. Proud winner of the Chamber Member of the Year and Florida’s First Coast …
Assistant Manager
Job Description Job Description Description: Are you looking for a great place to work and build a long-lasting management career? You’ve found the right place! At ACGBBQ, LLC., a licensed …
Guest Services Event Staff - Sebring International Racway
SEBRING INTERNATIONAL RACEWAY This racetrack located in Sebring, Florida, is America’s oldest road racing track, with over six decades of storied history. It hosts the historic Twelve Hours of Seb…
Student Ministry Leader
The Student Ministry Leader helps people find, follow, and serve Jesus by providing God-honoring vision, leadership, and training to lead student ministry staff, volunteers, parents, and students. …
Physical Therapist
Job Description Job Description Will provide care for inpatient hospital and outpatient services. Experience with adult Neuro and Ortho Patients preferred. Licensure: Must possess a valid Flor…
Clinical Infusion Pharmacist
Job Description Job Description Clinical Infusion Pharmacist – Specialty Home Infusion Location: Tampa Overview Prosper Infusion is seeking a Clinical Infusion Pharmacist to help run ou…
Low Voltage Lead Technician
Amphenol Custom Cable is a leader in providing innovative connectivity solutions, products, and services from concept to connection. With over 35 years of experience, we pride ourselves on our speed,…
Operations Associate - Part Time
Job ID: 291265 Store Name/Number: FL-Brickell City Centre (0306) Address: 701 South Miami Ave, Suite 231B, Miami, FL 33131, United States (US) Hourly/Salaried: Hourly (Non-Exempt) Full Tim…
JOIN THE BLACK BEAN DELI FAMILY
We are seeking energetic and responsible individuals who want to be part of a growing company. Job Types: Full-time, Part-time, and Seasonal positions available What you will bring to the table:…
Registered Nurse
Job Description Job Description Description: The Renfrew Center offers an unmatched opportunity, in the field of eating disorders, for a Registered Nurse to work in an environment that change…