Creating Assignments (assign IPC members to submissions) - Revision history

Sbehnke: /* External Script */

2025-09-29T05:22:01Z

External Script

← Older revision		Revision as of 05:22, 29 September 2025
Line 38:		Line 38:
	*:Initializes Rating and RatingOrg for Sort. For this purpose, the score (=affinity score, from the IPCuploader) is combined with the bidding.		*:Initializes Rating and RatingOrg for Sort. For this purpose, the score (=affinity score, from the IPCuploader) is combined with the bidding.
	*:For “want review” the score is multiplied with 10, and for “could review” with 5.		*:For “want review” the score is multiplied with 10, and for “could review” with 5.
	* IPC members can help with sorting. Use "Manage Sorter" to invite them and assign them to submissions.		* IPC members can help with sorting. Use "Manage Sorter" to invite them and assign them to submissions. Sorters are IPC members, they cannot see the authors.
	[[Image:ManageSorter.png]]		[[Image:ManageSorter.png]]
	:The goal is to set the ratings so that the order determined by the ratings corresponds to the preferences of a submission for IPC members.		:The goal is to set the ratings so that the order determined by the ratings corresponds to the preferences of a submission for IPC members.
	:This type of sorting is not about assigning reviewers, but rather about whether the rating, which is formed from bidding and affinity scores, is in line with the wishes and preferences of the IPC members. The sorters can change the rating for this purpose (initially, rating = RatingORG). This new order can then be used to generate the assignment.		:This type of sorting is not about assigning reviewers, but rather about whether the rating, which is formed from bidding and affinity scores, is in line with the wishes and preferences of the IPC members. The sorters can change the rating for this purpose (initially, rating = RatingORG). This new order can then be used to generate the assignment.
	* After the sorting, export the ratings https://srmv2.eg.org/COMFy/Review/event/ExportSuggestions and use the external script, the result can then be imported: https://srmv2.eg.org/COMFy/Review/event/ImportSuggestions		* After the sorting, export the ratings https://srmv2.eg.org/COMFy/Review/event/ExportSuggestions and use the external script, the result can then be imported: https://srmv2.eg.org/COMFy/Review/event/ImportSuggestions

	=== Last step (for both alternatives)===		=== Last step (for both alternatives)===

Sbehnke at 09:36, 7 June 2024

2024-06-07T09:36:58Z

← Older revision		Revision as of 09:36, 7 June 2024
Line 30:		Line 30:
	There you can specify who is assigned as which review type. (One person cannot be in multiple review types in one submission!)		There you can specify who is assigned as which review type. (One person cannot be in multiple review types in one submission!)
	There you can access the submission, see every review type, who is currently assigned in this review type, a checkbox for every review type, the internally generated rating, the person's bid, his global expertise list. And how much expertise the person has that matches the paper.		There you can access the submission, see every review type, who is currently assigned in this review type, a checkbox for every review type, the internally generated rating, the person's bid, his global expertise list. And how much expertise the person has that matches the paper.
			In this table:
			Score: value from IPCUploader (SARA TFIDF),
			RatingOrg: value, generated through "Initialize Rating", calculated from SARA TFIDF combined with bidding. (5 could review, 10 want review)

	=== External Script===		=== External Script===
Line 35:		Line 38:
	*:Initializes Rating and RatingOrg for Sort. For this purpose, the score (=affinity score, from the IPCuploader) is combined with the bidding.		*:Initializes Rating and RatingOrg for Sort. For this purpose, the score (=affinity score, from the IPCuploader) is combined with the bidding.
	*:For “want review” the score is multiplied with 10, and for “could review” with 5.		*:For “want review” the score is multiplied with 10, and for “could review” with 5.
	~~In this table:~~
	~~Score: value from IPCUploader (SARA TFIDF),~~
	~~RatingOrg: value, generated through "Initialize Rating", calculated from SARA TFIDF combined with bidding. (5 could review, 10 want review)~~
	* IPC members can help with sorting. Use "Manage Sorter" to invite them and assign them to submissions.		* IPC members can help with sorting. Use "Manage Sorter" to invite them and assign them to submissions.
	[[Image:ManageSorter.png]]		[[Image:ManageSorter.png]]

Sbehnke at 09:35, 7 June 2024

2024-06-07T09:35:53Z

← Older revision		Revision as of 09:35, 7 June 2024
Line 35:		Line 35:
	*:Initializes Rating and RatingOrg for Sort. For this purpose, the score (=affinity score, from the IPCuploader) is combined with the bidding.		*:Initializes Rating and RatingOrg for Sort. For this purpose, the score (=affinity score, from the IPCuploader) is combined with the bidding.
	*:For “want review” the score is multiplied with 10, and for “could review” with 5.		*:For “want review” the score is multiplied with 10, and for “could review” with 5.
			In this table:
			Score: value from IPCUploader (SARA TFIDF),
			RatingOrg: value, generated through "Initialize Rating", calculated from SARA TFIDF combined with bidding. (5 could review, 10 want review)
	* IPC members can help with sorting. Use "Manage Sorter" to invite them and assign them to submissions.		* IPC members can help with sorting. Use "Manage Sorter" to invite them and assign them to submissions.
	[[Image:ManageSorter.png]]		[[Image:ManageSorter.png]]

Sbehnke at 18:14, 29 May 2024

2024-05-29T18:14:18Z

← Older revision		Revision as of 18:14, 29 May 2024
Line 29:		Line 29:

	There you can specify who is assigned as which review type. (One person cannot be in multiple review types in one submission!)		There you can specify who is assigned as which review type. (One person cannot be in multiple review types in one submission!)
	There you can access the submission, see every ~~reviewtype~~, who is currently assigned in this review type, a checkbox for every ~~Reviewtype~~, the internally generated rating, the person's bid, his global expertise list. And how much expertise the person has that matches the paper.		There you can access the submission, see every review type, who is currently assigned in this review type, a checkbox for every review type, the internally generated rating, the person's bid, his global expertise list. And how much expertise the person has that matches the paper.

	=== External Script===		=== External Script===

Sbehnke at 18:12, 29 May 2024

2024-05-29T18:12:17Z

← Older revision		Revision as of 18:12, 29 May 2024
Line 16:		Line 16:
	# SARA score calculation should be started.		# SARA score calculation should be started.

	As chair you now have the ~~possibility to~~ either ~~use~~ the built-in solution or ~~to use~~ an external script ~~for creating~~ assignments. This script is owned and maintained by Prof. M. Wimmer. (https://gitlab.com/salzrat/eg-sig-sort)		As chair, you now have the option of either using the built-in solution or using an external script to create assignments. This script is owned and maintained by Prof. M. Wimmer. (https://gitlab.com/salzrat/eg-sig-sort)

	=== Built-in ===		=== Built-in ===
	* Now a new suggestion can be created: https://srmv2.eg.org/COMFy/Conference/event/createNewSuggestionForIPC		* Now a new suggestion can be created: https://srmv2.eg.org/COMFy/Conference/event/createNewSuggestionForIPC
	::This suggestion can be edited, exported (then edited offline, if ~~comfortable~~), and imported again.		::This suggestion can be edited, exported (and then edited offline if necessary) and imported again..
	[[Image:CreatenewSuggestion.png]]		[[Image:CreatenewSuggestion.png]]

	When you press create New Suggestion you set the preferences for the new matching. If you are interested how the matching is created: [[calculate Suggestion]]		When you press create New Suggestion you set the preferences for the new matching. If you are interested how the matching is created: [[calculate Suggestion]]
	==== Modify the matching ====		==== Modify the matching ====
	If you ~~aren't~~ satisfied with the current ~~matching it is possible to~~ start ~~again~~ to get a better ~~matching~~ (~~there~~ is ~~a random shuffle in the matching~~) or to adjust ~~the matching of~~ the system. ~~Therefore~~ click on the ~~paper~~ you want to ~~fix~~. You will ~~get~~ to the following page:		If you are not satisfied with the current mapping, you can start over to get a better mapping (the mapping is randomly shuffled) or adjust the system's mapping. To do this, click on the document you want to correct. You will be taken to the following page:
	[[Image:EditSuggestion.png\|thumb\|350px\|none\|Edit Suggestion]]		[[Image:EditSuggestion.png\|thumb\|350px\|none\|Edit Suggestion]]

	There you can ~~customize~~ who ~~will be~~ assigned as which review type. (One person ~~can't~~ be in multiple review types in one ~~paper~~!)		There you can specify who is assigned as which review type. (One person cannot be in multiple review types in one submission!)
	There you can access the submission, see every reviewtype, who is currently assigned in this review type, for every Reviewtype ~~a checkbox~~, the ~~internal~~ generated rating, ~~the bidding of~~ the person, his global expertise list. And how much the person has ~~expertise matching with~~ the paper.		There you can access the submission, see every reviewtype, who is currently assigned in this review type, a checkbox for every Reviewtype, the internally generated rating, the person's bid, his global expertise list. And how much expertise the person has that matches the paper.


	=== External Script===		=== External Script===

Sbehnke at 17:55, 29 May 2024

2024-05-29T17:55:53Z

← Older revision		Revision as of 17:55, 29 May 2024
Line 39:		Line 39:
	[[Image:ManageSorter.png]]		[[Image:ManageSorter.png]]
	:The goal is to set the ratings so that the order determined by the ratings corresponds to the preferences of a submission for IPC members.		:The goal is to set the ratings so that the order determined by the ratings corresponds to the preferences of a submission for IPC members.
	*:This type of sorting is not about assigning reviewers, but rather about whether the rating, which is formed from bidding and affinity scores, is in line with the wishes and preferences of the IPC members. The sorters can change the rating for this purpose (initially, rating = RatingORG). This new order can then be used to generate the assignment.		:This type of sorting is not about assigning reviewers, but rather about whether the rating, which is formed from bidding and affinity scores, is in line with the wishes and preferences of the IPC members. The sorters can change the rating for this purpose (initially, rating = RatingORG). This new order can then be used to generate the assignment.
	* After the sorting, export the ratings https://srmv2.eg.org/COMFy/Review/event/ExportSuggestions and use the external script, the result can then be imported: https://srmv2.eg.org/COMFy/Review/event/ImportSuggestions		* After the sorting, export the ratings https://srmv2.eg.org/COMFy/Review/event/ExportSuggestions and use the external script, the result can then be imported: https://srmv2.eg.org/COMFy/Review/event/ImportSuggestions

Sbehnke at 17:55, 29 May 2024

2024-05-29T17:55:31Z

← Older revision		Revision as of 17:55, 29 May 2024
Line 38:		Line 38:
	* IPC members can help with sorting. Use "Manage Sorter" to invite them and assign them to submissions.		* IPC members can help with sorting. Use "Manage Sorter" to invite them and assign them to submissions.
	[[Image:ManageSorter.png]]		[[Image:ManageSorter.png]]
	*:The goal is to set the ratings so that the order determined by the ratings corresponds to the preferences of a submission for IPC members.		:The goal is to set the ratings so that the order determined by the ratings corresponds to the preferences of a submission for IPC members.
	*:This type of sorting is not about assigning reviewers, but rather about whether the rating, which is formed from bidding and affinity scores, is in line with the wishes and preferences of the IPC members. The sorters can change the rating for this purpose (initially, rating = RatingORG). This new order can then be used to generate the assignment.		*:This type of sorting is not about assigning reviewers, but rather about whether the rating, which is formed from bidding and affinity scores, is in line with the wishes and preferences of the IPC members. The sorters can change the rating for this purpose (initially, rating = RatingORG). This new order can then be used to generate the assignment.
	* After the sorting, export the ratings https://srmv2.eg.org/COMFy/Review/event/ExportSuggestions and use the external script, the result can then be imported: https://srmv2.eg.org/COMFy/Review/event/ImportSuggestions		* After the sorting, export the ratings https://srmv2.eg.org/COMFy/Review/event/ExportSuggestions and use the external script, the result can then be imported: https://srmv2.eg.org/COMFy/Review/event/ImportSuggestions

Sbehnke at 17:54, 29 May 2024

2024-05-29T17:54:45Z

← Older revision		Revision as of 17:54, 29 May 2024
Line 42:		Line 42:
	* After the sorting, export the ratings https://srmv2.eg.org/COMFy/Review/event/ExportSuggestions and use the external script, the result can then be imported: https://srmv2.eg.org/COMFy/Review/event/ImportSuggestions		* After the sorting, export the ratings https://srmv2.eg.org/COMFy/Review/event/ExportSuggestions and use the external script, the result can then be imported: https://srmv2.eg.org/COMFy/Review/event/ImportSuggestions

	=== Last step (for both alternatives) === when everything is set: "take Suggestion Live": the assignments are now active, IPC member should be informed.		=== Last step (for both alternatives)===
			when everything is set: "take Suggestion Live": the assignments are now active, IPC member should be informed.
	:Use this button only once.		:Use this button only once.
	:There is no way to change active assignments through this menu.		:There is no way to change active assignments through this menu.

Sbehnke at 17:54, 29 May 2024

2024-05-29T17:54:14Z

← Older revision		Revision as of 17:54, 29 May 2024
Line 42:		Line 42:
	* After the sorting, export the ratings https://srmv2.eg.org/COMFy/Review/event/ExportSuggestions and use the external script, the result can then be imported: https://srmv2.eg.org/COMFy/Review/event/ImportSuggestions		* After the sorting, export the ratings https://srmv2.eg.org/COMFy/Review/event/ExportSuggestions and use the external script, the result can then be imported: https://srmv2.eg.org/COMFy/Review/event/ImportSuggestions

	=== Last step (for both alternatives) === when everything is set:~~==0~~ "take Suggestion Live": the assignments are now active, IPC member should be informed.		=== Last step (for both alternatives) === when everything is set: "take Suggestion Live": the assignments are now active, IPC member should be informed.
	:Use this button only once.		:Use this button only once.
	:There is no way to change active assignments through this menu.		:There is no way to change active assignments through this menu.

Sbehnke at 17:53, 29 May 2024

2024-05-29T17:53:47Z

← Older revision		Revision as of 17:53, 29 May 2024
Line 42:		Line 42:
	* After the sorting, export the ratings https://srmv2.eg.org/COMFy/Review/event/ExportSuggestions and use the external script, the result can then be imported: https://srmv2.eg.org/COMFy/Review/event/ImportSuggestions		* After the sorting, export the ratings https://srmv2.eg.org/COMFy/Review/event/ExportSuggestions and use the external script, the result can then be imported: https://srmv2.eg.org/COMFy/Review/event/ImportSuggestions

	=== Last step (for both alternatives) when everything is set:==0 "take Suggestion Live": the assignments are now active, IPC member should be informed.		=== Last step (for both alternatives) === when everything is set:==0 "take Suggestion Live": the assignments are now active, IPC member should be informed.
	:Use this button only once.		:Use this button only once.
	:There is no way to change active assignments through this menu.		:There is no way to change active assignments through this menu.