Skip to main content

AI as an Accessiblity Assistant

Explore methods for leveraging AI to streamline accessibility remediation.

Artificial intelligence can serve as a helpful accessibility assistant to make your course materials accessible for all students. This guide will help you explore practical methods for leveraging AI to streamline accessibility remediation of your digital course content. By using widely available AI tools, you can efficiently remediate instructional materials, improve overall course accessibility, and make progress toward compliance with digital accessibility standards.

Key Considerations for Making Instructional Content Accessible

Instructional materials are presented within a given course, for a particular purpose, and to a particular audience. Considering these three things – intent, context, and audience – will ensure that remediation results in materials that are not only technically accessible but also helpful as learning aids.

  • Intent: Why is the material in the course, and what is the learning objective?
  • Context: What else is in the lesson or course? What is already explained elsewhere, and in what format?
  • Audience: What prior knowledge can students be expected to know?

Considering intent, context and audience helps ensure anything added or included for the sake of accessibility is relevant and pedagogically effective. These considerations prevent unnecessary duplication of content and help ensure all content aligns with the intended learning objective of the materials.

AI for Image and Visual Accessibility

AI can assist significantly with visual accessibility of many types of visual learning materials including images, diagrams, charts and slide graphics.

Features of Accessible Visual Material

  • Include comprehensive text descriptions (alt text or longer descriptions) so no instructional content is missed.
  • Have minimal to no blinking, strobing, or moving text and images.
  • Have adequate resolution and color contrast.
  • Do not rely on color alone to convey meaning.
  • Are not images of text.

Describing simple and complex images

Generative AI models can assist with generating image descriptions. Dense graphics and diagrams containing multiple flow paths or labels can be challenging to describe. When short alt text is insufficient, AI can assist with drafting comprehensive long descriptions in a variety of ways that can be further refined with an expert lens.

AI can draft alt text

Alt text is generally 125 characters or less that describes an image so that learners using screen readers can benefit from the content of the image the same way that those who can see the image do. AI can help with writing alt text, but needs guidance to make it effective.

Parking lot with trees
Photo credit: Anita B. Stone
  • Prompt: “Write a 125-character alt text for this image.”
  • Result: “Several cars are parked in an outdoor parking lot beneath three large green trees against a bright, lightly clouded blue sky.” (Generated by Gemini)

What makes this description lower quality is that it does not consider intent, context or audience. If a prompt includes these considerations, the output is greatly improved. When prompted with more information, Gemini suggested alt text that was tailored to the lesson focus:

  • For Urban Forestry & Shade Benefits: Three mature oak trees growing in parking lot medians, providing a dense shade canopy over parked cars on a sunny day.
  • For Species Identification (e.g., Willow Oak): Three fine-textured Willow Oaks (Quercus phellos) with dense, light-green canopies planted in an urban parking lot.
  • For Planting Environments & Root Space: A row of oak trees planted in narrow soil islands surrounded by asphalt parking spaces under a clear sky.
TIP: If you have multiple images within the same lesson or document, establishing a continuous conversational thread with your chosen AI tool means that you can provide lesson-wide context just once, further increasing your efficiency.

AI can help describe complex known and established processes depicted visually

When teaching established concepts using standard graphics, describing the literal visual appearance of the image may not be the best approach. Instead, a clear text description of the underlying process or concept, rather than a description of the graphic, may be better. Let’s take the example image below.

Complex diagram illustrating the Krebs cycle.
Photo credit: Wikipedia

For a complex diagram of the Krebs cycle like the one above, the brief alt text might state: “Complex diagram illustrating the Krebs cycle.” A link to a more detailed text description of the process provides an accessible equivalent if the steps are not covered in surrounding text or transcripts.

The prompt,  “Generate a detailed description of the Krebs cycle, including each step and key molecules,” might be a good starting point for an equivalent text description, and the next step would be to review the output for accuracy and instructional alignment. If desired, you might prompt further to home in on a specific focus area, add observations, or reframe the description from another perspective.

AI can help with describing unique complex images

Unique complex images that do not depict standard established processes or concepts require targeted prompting to translate instructional content into clear text equivalents.

Sample Prompt for complex images:

I am providing an image from a college course slide or document. Your job is not to describe the image visually, but rather to translate the instructional content and concepts in this graphic into standalone, fully realized text. A student reading the description should gain complete conceptual mastery without needing to know an image was used to present it.

Context:

  • [Enter course & topic]
  • [Enter lesson context]
  • [Enter learning objective] 

Instructions and guidelines:

  • Write direct instructional prose that teaches the underlying concepts shown in the graphic.
  • State the central theory, phenomenon, or mechanism directly. Name and define each variable, node, or element, explicitly stating what role it plays in the larger concept.
  • Explain how these components interact, influence one another, or flow from input to output in sequential, logical order.
  • Do not use visual meta-language like “In this diagram,” “The image shows,” “On the left side,” or “Represented by a red arrow.”
  • Convert all visual relationships (arrows, clusters, layers, colors) directly into logical or causal relationships.
  • Present any explicit formulas, conditional rules (e.g., “If X increases, Y decreases”), or critical takeaways embedded in the material.”

Longer descriptions can be refined by instructing the AI model to omit information covered in accompanying lecture text. Final descriptions can be integrated alongside the graphic, within lecture notes, or in an accessible document appendix.

Creating Alt Text for Quizzes & Assessments

Creating alternative text and image descriptions for quiz items requires balancing accessibility with assessment integrity. Descriptions must provide sufficient detail for students to answer questions without explicitly revealing correct answers.

TIP: Focus on observable features

One approach is to prompt AI to describe the general concept or features being tested rather than asking it to describe an exemplar image. Ask for key diagnostic traits to ensure the text description provides the necessary details without giving away answers:

  • Prompt: “How would a layperson describe a white oak leaf in enough detail for identification using 125 characters or less?”
  • Result: “A green tree leaf with 7–9 smooth, rounded, finger-like lobes, no sharp points, and a pale underside.” (generated by Gemini)

This approach ensures that students relying on text descriptions are evaluated on the same domain knowledge as those viewing the visual image. You must review the description to ensure it highlights the features you have discussed in your course, and that it is equivalent to the image you’re providing for sighted students.

TIP: Provide guidelines for descriptions

In some instances, prompts must explicitly restrict specific terms that reveal assessment answers. For example, this leaf shows a fungus called powdery mildew, but it’s challenging to describe the image without using the word “powder” or “powdery.”


Source: Wikimedia

  • Prompt: “Describe the visual appearance of powdery mildew on a leaf without using the word ‘powder'”
  • Result: A dull white or pale gray haze on plant surfaces, closely resembling a dusting of flour, fine chalk, or light wood ash.

Unique challenge: Static images depicting movement

Static images depicting movement are another example of a case where getting help describing the movement in words is better than asking for an image description. In the example below, asking for alt text generated descriptions that were not usable in a quiz:
image showing circumduction of an armImage source: Wikimedia

  • Prompt: “Write alt text for this image.”
  • Results from Gemini:
    • Image description: A black-and-white line drawing depicting a person’s upper body with their left arm extended diagonally downward from the shoulder. A thick black arrow loops in a circular path around the hand and wrist, illustrating circumduction—the conical movement of a limb around a joint.
    • Alt text: Line drawing of an extended arm with a circular arrow around the hand indicating circumduction movement.

Neither of these results from Gemini are good alt text. The first is a literal description of the image, which is not as aligned with the probably learning objective of knowing terms that describe a movement. The alt text Gemini offered gives away the term.

A better result came from the prompt, “Describe circumduction of the arm in 125 characters or less using layperson terminology.” This resulted in, “It’s swinging your arm in a big circle from the shoulder, making your hand trace a cone shape in the air,” which could be easily refined to create good alt text for a quiz.

Refining images for accessibility

Learners with low vision greatly outnumber those depending on screen-reading software, and low-quality images can be difficult for anyone to parse. AI can assist with improving image resolution, checking color contrast, and converting rasterized image text into accessible, selectable text.

AI can convert data tables presented as images

It’s not uncommon for screenshots of data tables to make their way into instructional materials. As image of text, these should be converted to true text for accessibility, but these are tedious to recreate manually. AI models can transcribe text from table images into structured formats which can even be copied into spreadsheets as CSV data. However, models may occasionally err or introduce unprompted edits, such as inserting extra header rows or symbols, making human verification necessary.

AI can help produce higher quality graphics

AI can also enhance image resolution and visual quality. One instructor described the time-consuming task of creating quality graphics himself, and found that AI could greatly reduce the time it took to do so:

  • Prompt: “Generate a cleaner version of this image.”
  • Result: New image generated by Gemini

AI can help ensuring adequate color contrast

AI can assist in establishing accessible color contrast and visual distinction.

  • Prompt: Please remediate the color on this graphic, applying high-contrast, WCAG 2.1AA – compliant palette, set a white background, and add distinct patterns or textures to data series so the chart does not rely solely on color for interpretation.
  • Result:

Careful verification of AI output remains critical. For example, in one instance an AI tool was prompted to improve color contrast on a grayscale line graph, and generated a visually polished result. Closer inspection revealed inadvertently swapped line color designations mid-series.

AI can extract graph data

When granular data analysis is required, AI tools can extract underlying data points from a chart image to generate an accessible data table. While dense or overlapping graphs may require manual adjustments, simple visual charts are easier for models to digest and represent as tables.

Key Takeaways for Image / Graphic Accessibility and AI

  • With appropriate contextual prompting, AI chatbots can generate accurate image descriptions for both general instructional materials and quiz items.
  • It can generate written descriptions of complex graphics, or at least provide a starting draft for further revision.
  • AI can enhance image contrast and resolution, provided outputs are carefully reviewed for accuracy.
  • Instructors must remediate materials directly rather than relying on students to resolve inaccessible content themselves using AI. Learners may not spot subtle inaccuracies in AI-generated output.

AI for Multimedia Accessibility

Making multimedia accessible requires ensuring that all audio and visual content are provided in text. Videos need accurate closed captioning as well as text-based descriptions for any visuals not described verbally. Audio-only resources require text-based transcripts.

AI can assist with providing accurate captions

Platforms like Zoom and Panopto use AI to auto-generate video captions. While generally reliable, auto-captioning systems often struggle with specialized technical vocabulary or non-standard accents, substituting everyday words for domain-specific terminology.

AI can help correct and refine auto-generated captions. A typical workflow involves downloading the initial caption file with timestamps, using AI to correct inaccuracies, and uploading the revised caption file back to the video platform.

When using AI for caption editing, providing clear context and instructions is essential.

  • Provide a list of technical terms: Supply key vocabulary and acronyms used in the video to prevent default substitutions.
  • Address common mis-transcriptions: Instruct the chatbot on recurring phonetic errors specific to your course or platform.
  • Decide how to handle filler words: Specify whether to retain or remove spoken filler words based on your editing needs.
  • Protect timestamps and sequence numbers: Explicitly instruct the model not to alter timestamps, line sequence numbers, or indexing formats, as changes will break file synchronization.

Sample prompt for correcting captions: “You are a copy editor specializing in accessibility and academic caption correction for an upper-level undergraduate course on [Subject]. Correct the attached caption file and use this list of key terms, acronyms, and proper nouns to resolve phonetically mistranslated jargon. Replace phonetically misheard words with the correct technical terminology based on the context in the glossary. Do not alter, add, delete, or reformat any timestamps or line sequence numbers. Maintain clean verbatim speech. Fix glaring grammatical errors caused by auto-captioning, but preserve the speaker’s natural tone and phrasing. Provide only the corrected caption file contents without introductory text, conversational remarks, or markdown wrappers.”

For recurring course remediation, creating a custom chatbot trained on a course glossary and precise formatting instructions saves time by avoiding the need to re-train generic models in each new chat session. Many paid AI tools provide the ability to create and save custom bots.

AI can help convert captions into readable transcripts

When converting caption files into polished, stand-alone transcripts for reading, consider the following parameters:

  • Strip metadata: Remove sequence numbers and timestamps to clean up visual clutter.
  • Smooth sentence structure: Adjust spoken phrasing into proper written sentence structure without summarizing or losing original wording.
  • Decide how to handle audio cues: Decide whether nonverbal descriptions (e.g., background music, laughter) are essential to context or should be omitted.
  • Decide how to handle speaker labels: Include speaker identification if dialogue involves multiple participants and tracking attribution is necessary for understanding.

AI can draft descriptions of visual-only content in multimedia

Instructional content presented solely through visual elements must be conveyed verbally during recording or captured through supplemental text. Proactively narrating screen text, diagrams, or animations during presentation recording minimizes the need for separate descriptions.

When existing videos lack adequate verbal narration, one approach is to create an annotated transcript that integrates screenshots and descriptive text or links to extended descriptions.

AI can help with generating these descriptions in much the same way it helps with static images. Supply AI with the video screenshots as well as the surrounding presentation script. An example of this approach is viewable in this example annotated transcript.

The resulting comprehensive transcripts that benefit all learners, including students who are blind or have low vision.

Key Takeaways for Multimedia Accessibility and AI

  • Supply AI models with specialized domain glossaries to correct technical auto-captions accurately.
  • Establish highly explicit instructions upfront or build custom chatbots to prevent model drift over long conversations.
  • Start fresh conversation threads periodically to maintain strict adherence to editing guidelines.
  • Treat visual descriptions in multimedia with the same rigor as alt text for static graphics.

AI for Math Accessibility

To be accessible, mathematical notation must

  • be formatted as readable, structured text rather than static images with alt text
  • be navigable with screen readers, allowing users to move fluidly across math expressions.
  • have precise mathematical encoding to eliminate the ambiguity of spoken phrasing (e.g., distinguishing between different written interpretations of “A plus B over C”).
  • be encoded in standard formats such as MathML or LaTeX.

Learn more about accessible math: Teaching Resources: STEM Accessibility.

General-use AI models may help with math remediation

AI models allow instructors to convert screenshots, handwritten notes, or legacy documents into accessible math formats. Proceed with caution, however!

  • AI can produce outputs that appear visually correct while lacking underlying accessibility structure.
  • Models may attempt to solve equations, alter expressions, or reformat surrounding text unless explicitly restricted by prompt guidelines.

When prompting AI for math remediation, specify precise requirements, such as adhering to WCAG 2.1 AA standards or outputting MathJax-compatible LaTeX or MathML.

Specialized tools may be more appropriate for math remediation

Specialized tools designed for math accessibility include:

  • Bulk Remediation Tools: Platforms like MathPix, JamA11y, and Grind EQ process entire documents to extract and render accessible math.
  • Spot-Fixing Tools: Equatio directly converts selected math images or text into clean MathML or LaTeX.
  • Conversion Tools: Pandoc serves as an open-source tool for converting LaTeX source files into accessible web or document formats.

Key Takeaways for Accessible Math and AI

  • Specify required output formats (e.g., MathML or MathJax) directly in prompts.
  • Set strict guardrails to prevent AI from altering mathematical meaning or solving equations.
  • Manually inspect generated math expressions to ensure valid structural encoding.

AI for Text & Document Formatting

Creating accessible documents requires establishing logical reading orders, proper heading hierarchies, formatted list structures, descriptive link anchor text, and avoiding visual-only formatting (such as using color or bold styling alone to convey emphasis or meaning).

For standard accessibility checks, native accessibility checkers built into word processors and learning management systems are faster and more reliable than AI tools. However, AI excels at structural and instructional enhancements, such as:

  • Structural analysis: AI can evaluate large content blocks and recommend appropriate places to insert logical section headings or break text into bulleted lists.
  • Descriptive link optimization: AI can convert uninformative link text (such as “click here” or raw URL links) into natural sentences containing descriptive anchor text.

AI for Cognitive Accessibility & Universal Design

AI can support cognitive accessibility and general usability. Enhancing cognitive accessibility and designing for a neurodiverse learner population involves applying Universal Design for Learning (UDL) principles to make materials more user-friendly, offer clear options and flexibility, and provide embedded support for students who need it.

AI can assist with:

  • Editing text to use plain language that communicates even the most complex concepts clearly.
  • Drafting scaffolding tools such as summaries, job aids, graphic organizers, and guided notes.
  • Creating assessment evaluation tools, such as rubrics.
  • Converting materials into multiple formats or brainstorming alternative pathways for assignment completion based on UDL strategies.

One particular way for AI to help with cognitive accessibility is to help with creating a course glossary.

Creating course glossaries with AI

Creating course glossaries manually can be time-consuming, making it an ideal task for AI assistance. For example, in a horticulture course covering numerous plants, an instructor might provide a plant list and prompt AI to generate detailed, precise, pedagogically descriptions of each plant.

  • Prompt: Write a 2-sentence visual glossary entry for a tomato for an introductory undergraduate home horticulture class. Use accessible layperson terms focused purely on visual identification. Keep the total entry under 50 words and avoid botanical taxonomy.
    • Sentence 1 (Exterior): Describe key outer features, including shape range, skin/surface texture, color variations, and distinctive physical markers.
    • Sentence 2 (Interior): Describe the cross-section when sliced open, detailing the flesh, core, seeds/pit, and internal layout.
  • Result: A smooth, glossy fruit with a star-shaped green stem cap, ranging from tiny cherries to large, ribbed globes in red, yellow, orange, or dark purple. Slicing it reveals a fleshy central core surrounded by juicy, gel-filled pockets packed with small, edible seeds.

The prompt and learning objectives for the course will determine the specific guidelines in the prompt. Key things to note about this prompt, which may be broadly applicable include

  • Asking for a certain type of vocabulary. In this case, a person seeing a tomato would not need to know botanical terms to identify the vegetable. Layperson terminology makes an equitable textual experience. Other contexts (like higher-level courses) may rely on more advanced terminology.
  • Asking for a specific structural breakdown of sentence 1 and 2. This ensures standardization across the glossary.
  • Noting visual identification as the key learning objective. Other learning objectives would require a different prompt (cultural habit, harvesting processes, plant physiology)
  • Requiring a strict word count cap ensures a manageable glossary

Once you have a glossary, you can refer to terms within the glossary in your alt text which may help simplify description, Standardized glossary descriptions can also be reused as baseline alt text across course materials, ensuring consistent terminology throughout the curriculum. 

Conclusion

Artificial intelligence tools can assist instructors in addressing course accessibility needs. Across visual materials, multimedia assets, mathematical notation, text formatting, and cognitive scaffolding, AI tools can streamline several routine remediation tasks. When used thoughtfully, AI can support tasks such as drafting initial alt text, editing video captions, converting equations to MathML or LaTeX, and generating supplementary learning materials.

AI models have clear limitations and cannot guarantee pedagogical accuracy or full accessibility compliance on their own. Effective remediation requires clear, contextual prompting to yield useful results, and AI-generated content frequently contains errors or omissions. Continuous human oversight remains essential: instructors must carefully review, verify, and refine AI outputs to ensure that all course materials are accurate, reliable, and genuinely accessible to students.

Workshop Resources

Watch a recording of a recent presentation on this topic: Using AI as Your Accessibility Assistant (Video, 54 min).