Director, AP Assessment Training & Learning

About the Team  

The AP Curriculum and Assessment (AP C&A) Team at College Board (50+ staff) collaborates with colleagues across all aspects of the AP Program to develop, manage, and deliver AP’s 40+ courses in a wide variety of subject areas. AP® is a rigorous academic program built on the commitment, passion, and hard work of students and educators from secondary schools and higher education. AP provides willing and academically prepared high school students with the opportunity to study and learn at the college level.  

About the Opportunity  

As the Director, AP Assessment Training and Learning Design, you are the primary person developing learning courses and training for the curriculum and assessment teams across all 40 AP exams, as well as the learning courses and training material for Readers who score at the AP Reading. You will apply the principles of learning design to develop a curriculum and series of learning courses in assessment best principles and practices. In addition, you will collaborate with key stakeholders to develop robust training for AP outside item writers, and you will plan and guide a community of practice in support of AP assessments and content teams. In support of this endeavor, you will strategize with the Executive Director of Assessment to plan, implement and maintain the assessment curriculum across these areas. You will collaborate with internals stakeholders, including, but not limited to, AP assessment production, AP editorial staff, AP Delivery, AP Psychometrics, and external vendors. In addition, you will be responsible for managing the relevant project schedules for the development of training assets, tracking progress, and reporting on metrics using the latest business tools, including dashboards and databases, as well as written documentation and guides. Specific responsibilities for this position include but are not limited to the following. 

In this role, you will:  

AP Assessment Training & Learning (50%) 

• Provision and develop the training and learning assets for AP content teams (Assessment Leads and Course Leads) in support of the principles and best practices in assessment, including, but not limited to, learning modules and courses in topics such as test form assembly, psychometrics in assessment, fairness in assessment, and best practices in item writing. 

• Design, implement, and maintain assessment learning course series to provide training and professional development for AP content teams, as well as other stakeholders internal and external to the AP division. 

• Create and launch a successful communications plan to guide the adoption and completion of AP learning courses and learning modules, provide feedback loops for course improvement, and highlight and profile AP Assessment training and learning within the AP division and across the organization. 

• Track progress and provide metrics for internal content team members success with the assessment curriculum and learning courses. 

• Identify knowledge gaps for the content teams and strategize with the ED of Assessment to develop and execute a plan for additional learning courses and training sessions. Lead internal training sessions and direct training activities for content teams across all AP subjects, as needed. 

• In collaboration with the ED of AP Assessment, AP Assessment Production and AP Psychometrics, coordinate and manage the AP Assessment Community of Practice workshop sessions and office hours, including identifying areas of need and interest, and managing the schedule for guest speakers and instructional sessions. 

• Collaborate with key stakeholders in AP Assessment Production to develop robust training for AP item writing and outside item writers to support and maintain AP content quality and validity in adherence with best practices, while meeting production milestones. 

• In collaboration with AP C&A Department Heads and Assessment Managers, guide a working group of select content team members to contribute to and review of assessment learning and training assets. 

• Ensure all AP activities and assets follow and advance assessment principles and best practices, and all training and learning course content adhere to industry and assessment standards for learning design and development. 

• Maintain an assessment dashboard (Smartsheet) to provide reports and status trackers, as well as a repository of resources for AP content team members. 

AP Assessment, AP Reader Training and Learning (50%) 

• In collaboration with the AP assessment senior PJM for scoring, AP Delivery, and external stakeholders, develop the assessment training and learning assets, including learning modules and courses for sample selection, scoring leader training, and reader training, as well as subject-specific rubric and task model training for free response questions, performance tasks, and projects across 40 AP exams and for all exam modes (digital/print). 

• Coordinate with all assessment and curriculum leads, as well as with external stakeholders –the Chief Readers and scoring leadership--across all AP subjects to ensure training and learning assets for Pre-Reading Planning, Pre-Reading, and Reading are developed, reviewed, and delivered on time, whether the assets are digital or print. 

• Provision the AP Pre-Reading and Reading training and learning content into the relevant learning management systems (LMS), as well as scoring systems and applications in preparation for the annual AP Reading activities. 

• Manage content team reviews and validations of assessment assets, especially prompt and scoring guideline information in all scoring systems and applications in preparation for the annual AP Reading activities. 

• Lead internal training sessions for AP C&A content teams (Course Lead and Assessment Lead) in preparation for AP Reading activities; and directing training activities and events for the Chief Readers, scoring leadership, and readers across all AP subjects. 

• Manage annual reviews and updates for training assets and learning courses across all AP subjects, including the review and preparation of draft scoring guidelines, and scoring notes in preparation for the Pre-Reading. 

• Ensuring all AP activities and assets in support of free response scoring follow assessment principles and best practices, and all training and learning course content adhere to industry and assessment standards for learning design and development. 

About You  

You have:  

• A minimum of 5+ years of progressively responsible full-time professional work experience assessment training, learning design and development 

• A master’s degree is required. 

• Extensive knowledge of the Advanced Placement program and assessment principles and best practices, design and process 

• Extensive knowledge in item writer training and learning, and the development of items and task models, both multiple choice and free response 

• Experience and success in planning learning courses and familiarity with the tools of learning design, including content authoring and storyboard platforms, learning management systems, video and recording software, webinars, graphics, and document storage  

• Knowledgeable in accessibility requirements for learning courses and training materials 

• Clear ability to identify learning needs and knowledge gaps, and develop a plan for improvement 

• Advanced verbal and written communication skills, as well as effective presentational and instructional skills  

• A strong organizational mindset, excellent prioritization skills, and a predisposition towards action and production of results 

• An ability to produce schedules, dashboards, and visualizations in programs such as Smartsheet or Power BI 

• A customer-centric, empathetic, service-oriented, and organization-first mindset  

• Proficiency with Microsoft Project and other Microsoft Office applications  

• Willingness to travel 4 to 5 times a year, including 1 to 2 weeks in early June (domestic) 

• You are eligible to work in the US for any employer 

 About Our Benefits and Compensation  

College Board offers a competitive benefits and compensation program that attracts top talent looking to make a difference in education. As a self-sustaining non-profit, we believe in compensating employees equitably in relation to each other, their qualifications, their impact, and the relevant market.  

The hiring range for a new employee in this position is $80,000 – 135,000. College Board differentiates salaries by location so where you live will narrow the portion of this range in which you can expect a salary.  

Your salary will be carefully determined based on your location, relevant experience, the external labor market, and the pay of College Board employees in similar roles. College Board strives to provide our best offer up front based on this criteria.  

Your salary is only one part of all that College Board offers, including but not limited to:  

• A comprehensive package designed to support the well-being of employees and their families and promote education. Our robust benefits package includes health, dental, and vision insurance, generous paid time off, paid parental leave, fertility benefits, pet insurance, tuition assistance, retirement benefits, and more.  

• Recognition of exceptional performance through annual bonuses, salary growth over time through market increases, and opportunities for merit raises and promotions based on increased scope of responsibility.  

• A job that matters, a team that cares, and a place to learn, innovate and thrive.  

• You can expect to have transparent conversations about benefits and compensation with our recruiters throughout your application process.  

About Our Culture  

Our community matters, and we strive to practice and improve our culture daily. Here are some headlines:  

• We are motivated to positively impact the educational and career trajectories of millions of students a year.   

• We prioritize building a diverse and inclusive team where every employee can thrive, and every voice is heard.  

• We welcome staff to join any or all six of our affinity groups: ARISE (Alliance for Asian Retention, Inclusion, Success, and Engagement; DIASPORA (Alliance for Pan-African Success and Achievement); Pride (alliance for LGBTQ+ staff and allies); Resilience (alliance for Native staff and advocates); SALSA (Staff Alliance for Latinx Success and Achievement); and WIN (Women’s Impact Network).  

• We value learning and growth; we offer formal and informal ways to lead through your superpowers, sharpen your strengths, and meet your development goals.  

• We know that our impact is strongest together. Our College Board Cares program offers all staff up to $1,000 annual match against partner non-profit organizations.  

• We offer a transparent approach to promotions and merit raises, annual performance-based bonuses, and how to grow your career here over time.  

#LI-REMOTE

#LI-GG1