Difference between revisions of "Creating Assignments (assign IPC members to submissions)"
| Line 9: | Line 9: | ||
Requirements and steps: | Requirements and steps: | ||
# There are IPC members with status "accepted" (https://srmv2.eg.org/COMFy/Ipc/event/manageIPC). | # There are IPC members with status "accepted" (https://srmv2.eg.org/COMFy/Ipc/event/manageIPC). | ||
# Different reviewer types exist (usually Primary, Secondary, Tertiary) | |||
# Different reviewer types exist (usually Primary, Secondary, Tertiary) | |||
# IPCuploader and bidding are completed. | # IPCuploader and bidding are completed. | ||
# SARA score calculation should be started. | |||
# SARA score calculation should be started | |||
As chair you now have the possibility to either use the built-in solution or to use an external script for creating assignments. This script is owned and maintained by Prof. M. Wimmer. (https://gitlab.com/salzrat/eg-sig-sort) | As chair you now have the possibility to either use the built-in solution or to use an external script for creating assignments. This script is owned and maintained by Prof. M. Wimmer. (https://gitlab.com/salzrat/eg-sig-sort) | ||
Revision as of 16:22, 29 May 2024
SRMV2 provides an automatic reviewer assignment process. There are two entry points:
(for the correct links, replace "event" by your event.
https://srmv2.eg.org/COMFy/Conference/event/showSuggestionsForPaperAssignment
and https://srmv2.eg.org/COMFy/Conference/event/showSuggestionsForPaperAssignmentBySubmission
Requirements and steps:
- There are IPC members with status "accepted" (https://srmv2.eg.org/COMFy/Ipc/event/manageIPC).
- Different reviewer types exist (usually Primary, Secondary, Tertiary)
- IPCuploader and bidding are completed.
- SARA score calculation should be started.
As chair you now have the possibility to either use the built-in solution or to use an external script for creating assignments. This script is owned and maintained by Prof. M. Wimmer. (https://gitlab.com/salzrat/eg-sig-sort)
- A) Build-in
5 A1)) Now a new suggestion can be created: https://srmv2.eg.org/COMFy/Conference/event/createNewSuggestionForIPC This suggestion can be edited, exported (then edited offline, if comfortable), and imported again.
5 B) External Script
5 B1) Initialize Ratings
Initializes Rating and RatingOrg for Sort. For this purpose, the score (=affinity score, from the IPCuploader) is combined with the bidding. For “want review” the score is multiplied with 10, and for “could review” with 5.
5 B2) IPC members can help with sorting. Use "Manage Sorter" to invite them and assign them to submissions.
The goal is to set the ratings so that the order determined by the ratings corresponds to the preferences of a submission for IPC members.
This type of sorting is not about assigning reviewers, but rather about whether the rating, which is formed from bidding and affinity scores, is in line with the wishes and preferences of the IPC members. The sorters can change the rating for this purpose (initially, rating = RatingORG). This new order can then be used to generate the assignment.
5 B3) After the sorting, export the ratings https://srmv2.eg.org/COMFy/Review/event/ExportSuggestions and use the external script, the result can then be imported: https://srmv2.eg.org/COMFy/Review/event/ImportSuggestions
6) Last step (for both alternatives) when everything is set: "take Suggestion Live": the assignments are now active, IPC member should be informed. Use this button only once.
There is no way to change active assignments through this menu.