Examination Operations Specialist
: Job Details :


Examination Operations Specialist

Court of Master Sommeliers, Americas

Job Location : Napa,CA, USA

Posted on : 2025-01-10T18:12:00Z

Job Description :

Location: Remote with travel approximately 6x/year

Position Overview: The Court of Master Sommeliers, Americas (CMS-A) is hiring an Examination Operations Specialist to enhance the operational excellence of our certification exams. This role will report to the CMS-A Examination Director and is essential for ensuring attention to detail in exam planning, content management, data analysis, coordinator support, and examiner training across all certification levels. Working closely with coordinators, Master Sommeliers, and candidates, the Specialist will manage logistics, uphold quality standards, and support CMS-A's commitment to rigor and transparency in exam administration.

Key Responsibilities:1. Exam Preparation, Content Management, and Data Analysis

  • Proof and publish new Introductory and Certified exams, ensuring high-quality content aligned with standards.
  • Create and manage exams in Examsoft, Brillium, and Pearson Vue; manage the question bank for exams, including approvals.
  • Analyze data from ExamSoft, ZipGrade, and Brillium to inform exam development and review questions for content and improvement.
  • Manage content updates with Master Sommelier input, prepare Introductory and Certified content, and work with Subject Matter Experts on future exam content.
2. Pre, Post, and Onsite Operations for Advanced and Master Sommelier Examinations
  • Manage scheduling of candidates and examiners to avoid conflicts and ensure seamless operations.
  • Organize and set up digital platforms (e.g., Mosyle MDM iPad configuration), manage data entry, and support onsite exam operations.
  • Prepare “What to Expect” sessions for candidates, schedule candidate feedback calls using Calendly, prepare daily onsite presentations for examiners
3. Introductory Examination and Certified Coordinator Support
  • Train and support Certified coordinators and examiners, including creating and managing training manuals, document management, and templates.
  • Be “on call” during examinations for troubleshooting and support. Investigate and troubleshoot system issues.
  • Support candidates with technical issues on Proctor U
  • Research and recommend innovative and, where possible, automated approaches for system administration tasks.
4. Report and Template Management
  • Draft, proof, and manage templates for examination operations procedures
  • Develop and maintain reporting templates; assist in the execution of feedback reports to support transparency and continuous improvement.

Qualifications:

  • Bachelor's degree or equivalent work experience preferred.
  • Proficiency in digital exam platforms e.g. Brillium, Pearson Vue, Examsoft, Proctor U, and Mobile Device Management systems.
  • Strong technical aptitude with proficiency in reviewing software documentation and a demonstrated ability to learn new systems quickly.
  • Exceptional written and verbal communication skills, with the ability to work collaboratively.
  • Experience in test administration, or a related field is advantageous.
  • Ability to handle multiple priorities and deadlines with minimal supervision.
  • Ability to handle confidential information professionally.
  • Familiarity with the sommelier profession and CMS-A certifications is a plus.

How to Apply: Please submit your resume and a cover letter outlining your relevant experience to >/p>

CMS-A is committed to fostering an inclusive and diverse workplace and encourages individuals of all backgrounds to apply.

More detail about Court of Master Sommeliers, Americas, please visit
Apply Now!

Similar Jobs (0)