PlumX Metrics
Embed PlumX Metrics

Few-shot is enough: exploring ChatGPT prompt engineering method for automatic question generation in english education

Education and Information Technologies, ISSN: 1573-7608, Vol: 29, Issue: 9, Page: 11483-11515
2024
  • 33
    Citations
  • 0
    Usage
  • 156
    Captures
  • 0
    Mentions
  • 0
    Social Media
Metric Options:   Counts1 Year3 Year

Metrics Details

  • Citations
    33
    • Citation Indexes
      32
    • Policy Citations
      1
      • Policy Citation
        1
  • Captures
    156

Article Description

Through design and development research (DDR), we aimed to create a validated automatic question generation (AQG) system using large language models (LLMs) like ChatGPT, enhanced by prompting engineering techniques. While AQG has become increasingly integral to online learning for its efficiency in generating questions, issues such as inconsistent question quality and the absence of transparent and validated evaluation methods persist. Our research focused on creating a prompt engineering protocol tailored for AQG. This protocol underwent several iterations of refinement and validation to improve its performance. By gathering validation scores and qualitative feedback on the produced questions and the system’s framework, we examined the effectiveness of the system. The study findings indicate that our combined use of LLMs and prompt engineering in AQG produces questions with statistically significant validity. Our research further illuminates academic and design considerations for AQG design in English education: (a) certain question types might not be optimal for generation via ChatGPT, (b) ChatGPT sheds light on the potential for collaborative AI-teacher efforts in question generation, especially within English education.

Bibliographic Details

Provide Feedback

Have ideas for a new metric? Would you like to see something else here?Let us know