Grouping responses

BETA
Info Alert Icon
Info

Crowdmark’s Answer grouping feature is in active development, and both Manual and Automated grouping are available to users with Instructor and Facilitator permissions. For more information, or if you have questions or concerns, please email support@crowdmark.com. We look forward to hearing your feedback!

 

Answer grouping is a tool that can help streamline grading by organizing similar responses to be graded in sequence, reducing the need for context switching and improving consistency. It also offers the ability to apply points to an entire group of responses, boosting speed and allowing more time for responses that require a closer look.

Crowdmark offers two options, available to users with Instructor or Facilitator permissions:

  • Automated grouping, which extracts the responses and uses AI to place them in groups for you. Once the groups are created, you’ll be able to edit and confirm them.
  • Manual grouping, which allows you to create groups based on your impressions of student responses. Groups can be created, removed and changed throughout this process.

Once your groups are created, points can be applied in bulk , or graded individually as a group using filters by an Instructor or Facilitator.

Automated grouping


Begin by ensuring the question you'd like to group is the one selected for grading.

1

Toggle to Groups in the top toolbar.

2

Use the box tool to highlight the area on the page where the final response should live. This is the area Crowdmark will extract for grouping.

3

Once the responses are extracted, the groups will be displayed for your review, to be edited, deleted or merged.

 

 

 

 

Click into a group and use the slider to zoom in or out.

4

If a response doesn’t belong, you can click to select it, then click to move it to another existing group, or a new group.

 

 

5

Once you’ve reviewed the groups, click Confirm group to move on to the grading options.

Manual grouping


Begin by ensuring the question you'd like to group is the one selected for grading.

1

Toggle to Groups in the top toolbar.

2

Use the box tool to highlight the area on the page where the final response should live. This is the area Crowdmark will extract for grouping.

3

Select Manual grouping in the right hand toolbar. Crowdmark will begin the work to extract student responses.

4

Once the responses are available, they’ll be displayed for you to review. Click into the Ungrouped responses and use the slider to zoom in or out.

 

 

 

5

Click to select responses, then click to move them into a group. You’ll be given the option to select an existing group, or create a new one.

 

 

 

 

 

6

Once you’ve reviewed the groups, click Confirm group to move on to the grading options.

Automated grouping FAQ


How does Automated grouping use AI?

Crowdmark’s Automated grouping uses a three-step process to create groups:

  1. Responses are cropped to the answer region selected by the instructor
  2. What’s written in the answer region is extracted and analyzed by a Language learning model (LLM)
  3. The LLM places the extracted responses in groups based on similarity

 

Is the LLM involved in any grading?

No. Crowdmark’s goal is to keep grading human, while making it quicker and easier for users. Instructors and Facilitators who have used the Automated grouping have the option of applying grades in bulk, grading groups individually using filters, or not using the groups at all.

What happens to my assessment data if I use Automated grouping?

Automated grouping meets all current privacy requirements. LLM grouping data is completely contained within the Crowdmark infrastructure and is never shared externally, or used for training or learning.

 

For any further questions please email support@crowdmark.com .

In this article

Can't find the answer to your question?