Directing AI in Assessments: Level 4 of the AI Assessment Scale

Brett Christie, Ph.D.
VP, Educational Innovation & Inclusivity

As AI continues to play a significant role in education, the AI Assessment Scale (AIAS) of 2024 by Perkins et al. provides a framework for integrating AI into academic tasks. This framework consists of five levels, ranging from AI exploration to no AI use. In this second post of our five-part series, we’ll explore Level 4: Full AI. This level allows students to use AI extensively, directing the technology to achieve specific goals and demonstrating their critical thinking and problem-solving abilities.

What is Level 4: Full AI?

Level 4 of the AIAS emphasizes the use of AI throughout the assessment process, with students directing AI to complete various elements of their work. At this level, AI is a comprehensive tool that enhances productivity and innovation, but the student remains in control, guiding the AI’s contributions to ensure they align with the assignment’s objectives. This level is ideal for advanced undergraduate and graduate courses where students are expected to engage deeply with AI.

Example Snapshots of Level 4 in Action

Example 1: Financial Analysis (Finance, 400-level)

• Assignment: Perform a financial analysis of a company using AI tools to assist with data processing and reporting.
• AI Use: AI analyzes financial data, generates reports, and provides insights, with students directing the analysis and drawing conclusions.
• Constructive Use: AI enhances the efficiency and accuracy of financial analyses, allowing students to focus on strategic decision-making.
• Managing AI: Students submit AI-generated reports alongside their final analysis, including a reflection on how they directed AI to enhance their analysis and ensured the accuracy and relevance of AI outputs. See full assignment example here.

Example 2: Research Paper (Graduate-level, Environmental Science)

• Assignment: Write a research paper on the impact of climate change, using AI for data analysis and literature review.
• AI Use: AI handles data analysis and synthesizes literature, with students directing the research process and writing the paper.
• Constructive Use: AI accelerates the research process, enabling students to focus on interpreting findings and drawing meaningful conclusions.
• Managing AI: Students submit AI-generated data analysis and literature summaries alongside the final paper. A reflective piece discusses how they guided AI use and integrated it into their original research. See full assignment example here.
  

Example 3: Marketing Campaign (Marketing, 300-level)

• Assignment: Develop a comprehensive marketing campaign using AI tools to assist with content creation, market analysis, and strategy development.
• AI Use: AI generates content, analyzes market data, and suggests strategies, with students directing the process to achieve specific campaign goals.
• Constructive Use: AI enhances the strategic planning process, allowing students to develop more targeted and effective marketing campaigns.
• Managing AI: Students submit AI-generated content and market analysis reports with the final campaign, alongside a reflection detailing how they directed AI and critically assessed its contributions. See full assignment example here.
  

Conclusion: Demonstrating Leadership and Critical Thinking in AI Use

Level 4 of the AIAS allows students to use AI extensively while demonstrating leadership in directing AI tools to achieve specific outcomes. By requiring reflective documentation of their process, instructors can ensure that students are not only using AI effectively but also developing critical thinking and problem-solving skills.

In our next post, we’ll explore Level 3: AI Collaboration, where AI acts as a collaborator in the completion of academic tasks. Stay tuned for more insights into how to best integrate AI into your teaching and assessment practices.

In the meantime, feel free to watch our webinar from August 14, 2024, “Navigating AI and Assessments: Strategies for the New Academic Year” and learn more about Level 5: AI Exploration in the first part of this series: “Exploring New Frontiers: Level 5 of the AI Assessment Scale“. Explore our growing body of resources on the topic in our “Guide to AI Use in Student Assignments: Practical Strategies & Examples.”