Pillar 10: Continuous Evaluation and Improvement Maturity Assessment

This maturity assessment tool is designed to help educational institutions evaluate their current state of AI governance in terms of continuous evaluation and improvement of AI initiatives. The assessment covers the key components of Pillar 10 of the SAGE-AI Framework.

Who Should Participate?

This assessment should be completed by a cross-functional team including:

  • Senior leadership (e.g., President, Provost, CIO)
  • AI Governance Review Board members
  • AI/IT leadership
  • Faculty representatives
  • Data analysis and performance measurement experts
  • Stakeholder feedback coordinators
  • Legal and compliance officers

How to Use This Assessment

Read each question carefully and select the answer that best describes your institution's current state. Be honest in your responses to get an accurate picture of your institution's maturity level. After completing the assessment, use the scoring guide to calculate your overall maturity level for Pillar 10. If you are completing multiple pillar assessments, transfer your score into the master score sheet.

Assessment Questions

  1. Do you have an AI Governance Review Board in place? (No, Partially Implemented, Fully Implemented)
  2. Have you developed an AI Performance Metrics Framework? (No, Partially Implemented, Fully Implemented)
  3. Is there an AI Impact Assessment Protocol established? (No, Partially Implemented, Fully Implemented)
  4. Have you implemented a Stakeholder Feedback Mechanism for AI initiatives? (No, Partially Implemented, Fully Implemented)
  5. Is there an AI Governance Policy Review Process in place? (No, Partially Implemented, Fully Implemented)
  6. Have you established an Emerging AI Trends Monitoring System? (No, Partially Implemented, Fully Implemented)
  7. Is there a Cross-Institutional Benchmarking Program for AI governance practices? (No, Partially Implemented, Fully Implemented)
  8. Have you developed strategies for continuous learning and adaptation in AI governance? (No, Partially Implemented, Fully Implemented)

Scoring

For each question:

  • No = 0 points
  • Partially Implemented = 1 point
  • Fully Implemented = 2 points

Interpretation of Results

Based on your total score, your institution's maturity level can be categorized as follows:

  • Nascent Stage (0-4 points): Your institution is in the very early stages of continuous evaluation and improvement of AI initiatives. There may be some initial efforts to review AI governance, but a comprehensive approach to ongoing evaluation and refinement is largely absent. Focus on establishing a basic AI Governance Review Board and developing initial metrics for AI performance.
  • Emerging Stage (5-9 points): Your institution has begun to address continuous evaluation and improvement of AI initiatives, but the approach is still developing. Some key components like an impact assessment protocol or stakeholder feedback mechanisms may be in place but not fully developed or consistently applied across the institution. Work on formalizing processes, expanding evaluation efforts, and developing more comprehensive strategies for AI governance improvement.
  • Established Stage (10-13 points): Your institution has a clear and consistent approach to continuous evaluation and improvement of AI initiatives. Most key components are in place and functioning effectively. Focus on refining these processes, ensuring they're fully integrated across all AI initiatives, and adapting them to address emerging challenges and opportunities in AI governance.
  • Transformative Stage (14-16 points): Your institution is at the forefront of continuous evaluation and improvement practices for AI governance. Evaluation and improvement processes are fully embedded in AI governance, driving responsive and adaptive AI innovation. Continue to refine and evolve your approach, potentially serving as a model for other institutions. Focus on pushing the boundaries of AI governance improvement and contributing to the broader discourse on AI best practices.

Next Steps

Based on your assessment results:

  • Identify the areas where your institution scored lowest and prioritize these for improvement.
  • Develop action plans to address gaps in your continuous evaluation and improvement practices.
  • Set goals to progress to the next maturity stage, focusing on the key components that will help you advance.
  • Regularly reassess your maturity level to track progress and identify new areas for improvement.
  • Share best practices and lessons learned within your institution to foster a culture of continuous learning and adaptation in AI governance.
  • Consider assessing other pillars of the SAGE-AI Framework to get a comprehensive view of your institution's AI governance maturity.
  • For institutions at the Transformative stage, explore opportunities to contribute to the broader education community's understanding of effective continuous evaluation and improvement practices for AI governance.
Maturity Assessments