Vice President, Psychometrics

College Board – Learning and Assessment – Psychometrics  

100% Remote (anticipated 25% travel, usually 2-3 days at a time) 

About the Team  

The Psychometrics Team supports College Board in serving more than seven million students a year as they prepare for a successful transition to college through programs and services in college readiness and college success. We provide our partners with measurement solutions that set the standard for quality, efficiency, and innovation through operational excellence and research leadership that advances the field of Psychometrics and supports College Board’s mission of access and equity in education. We are a 25+ person core team of Psychometricians and Research Statisticians that collaborate deeply with other departments and divisions including, but not limited to Assessment Design & Development, College Readiness Assessments, Advanced Placement & Instruction, State & District Partnerships, and Technology.  

About the Opportunity 

As our Vice President, Psychometrics, you are energized by our mission to enhance educational and career opportunities for millions of students. You bring innovative thinking and strong leadership skills, with a deep understanding of educational assessments and measurement. As a change agent, you are excited to develop new assessment analytic solutions in response to the evolving education landscape. You excel at leading teams, whether they report directly to you or are part of cross-functional groups. You will champion the advancement of psychometrics and measurement solutions through strategic planning, effective communications, and exceptional team leadership. You will serve as a national expert to ensure the influence and validity of College Board assessments in the field.

In this role, you will:  

Measurement Leadership (50%) 

• Provide strategic oversight of operational and quality management across assessment programs, including the SAT Suite of Assessments, AP, Pre-AP, ACCUPLACER®, and CLEP®, to ensure timely and accurate psychometric analyses  

• Obtain institutional support for psychometric suggestions and recommendations and proactively address obstacles to ensure seamless operational execution

• Set an internal psychometric research agenda to advance our research-based approach to digital testing and leverage advances in analytics including Artificial Intelligence (AI)

• Champion novel psychometric solutions for the design and implementation of current and new digital assessments to enhance the reach and relevance of our assessment programs

• Communicate key psychometric analysis, insights and recommendations to a wide range of internal stakeholders, including the CEO, President, and SVP Learning & Assessment, in user-friendly formats 

Team Leadership and Management (30%) 

• Lead and inspire a team to enhance culture and engagement, fostering a highly motivated and cohesive unit through strategic vision, effective communication, and innovative engagement initiatives

• Manage a team of 4 senior leaders to prioritize work and achieve goals  

• Ensure the highest levels of staff productivity, effectiveness, and engagement within a motivated and creative team 

• Collaborate with divisional leaders to drive the SVP’s vision and goals 

• Manage the Psychometrics’ budget of $4.5M

Collaboration and Communications (20%) 

• Represent the quality and credibility of our assessment programs within the measurement community and with educators, states, policymakers, and the press  

• Review technical and research reports involving psychometric analyses, test validity and reliability, mode comparability, and other areas relevant to College Board assessments  

• Collaborate with other College Board divisions on new products and enhancements that support increasing the reach and relevance of the College Board suite of assessments and other offerings  

 
About You  

You have:  

• 10+ years’ experience in a management or leadership role, with demonstrated success managing through layers

• Demonstrated senior level experience in an educational research or assessment organization

• Advanced knowledge and/or experience with digital assessments, and with item response theory (IRT) and other psychometric models

• Demonstrated expertise leveraging advanced technologies (e.g., ML, GenAI, and LLMs) for evaluating open-ended/free-response answers and developing psychometric applications to enhance assessment accuracy, analytic efficiency, and scalability, is preferred

• Proven ability to establish a clear vision and direction, and effectively manage teams to achieve aligned goals and performance metrics    

• Adept problem-solving and data analysis skills to interpret complex data sets and translate them into clear, actionable insights

• Excellent verbal and written communication skills, with experience facilitating meetings and delivering presentations both remotely and in-person to large groups  

• Proven ability to build relationships and influence others to action  

• Ability to travel up to 25%   

• Authorization to work in the U.S.

About Our Process  

• Application review will begin immediately and will continue until the position is filled.  

• While the hiring process may vary, it generally includes: resume and application submission, recruiter phone/video screen, hiring manager interview, performance exercise and/or panel interview, and reference checks.  This is an approximately 8-week process. 

About Our Benefits and Compensation 

College Board offers a competitive benefits and compensation program that attracts top talent looking to make a difference in education. As a self-sustaining non-profit, we believe in compensating employees equitably in relation to each other, their qualifications, their impact, and the relevant market.  

The hiring range for a new employee in this position is $215,000 to $265,000.  Your salary will be carefully determined based on your location, relevant experience, the external labor market, and the pay of College Board employees in similar roles. College Board strives to provide our best offer up front based on these criteria.  

Your salary is only one part of all that College Board offers, including but not limited to:    

• A comprehensive package designed to support the well-being of employees and their families and promote education. Our robust benefits package includes health, dental, and vision insurance, generous paid time off, paid parental leave, fertility benefits, pet insurance, tuition assistance, retirement benefits, and more 

• Recognition of exceptional performance through annual bonuses, salary growth over time through market increases, and opportunities for merit raises and promotions based on increased scope of responsibility 

• A job that matters, a team that cares, and a place to learn, innovate and thrive 

You can expect to have transparent conversations about benefits and compensation with our recruiters throughout your application process. 

About Our Culture  

Our community matters, and we strive to practice and improve our culture daily. Here are some headlines:  

• We are driven to positively impact the educational and career trajectories of millions of students a year.  

• We prioritize building a diverse and inclusive team where every employee can thrive, and every voice is heard.  

• We welcome staff to join any or all six of our affinity groups: ARISE (Alliance for Asian Retention, Inclusion, Success, and Engagement; DIASPORA (Alliance for Pan-African Success and Achievement); Pride (alliance for LGBTQ+ staff and allies); Resilience (alliance for Native staff and advocates); SALSA (Staff Alliance for Latinx Success and Achievement); and WIN (Women’s Impact Network).   

#LI-MS1

#LI-REMOTE