... | ... | @@ -2,7 +2,11 @@ |
|
|
|
|
|
[[_TOC_]]
|
|
|
|
|
|
The following stories were prioritised for the Baseline version.
|
|
|
The HHMI team has confirmed that the Baseline version can be reduced in scope, and should focus development on the public-facing features as the highest priority in order to achieve a live release by early June 2022.
|
|
|
|
|
|
### Baseline version user stories prioritisation
|
|
|
|
|
|
The following stories were prioritised for the revised Baseline version.
|
|
|
|
|
|
#### Workflow step: Creating and submitting questions
|
|
|
|
... | ... | @@ -20,92 +24,35 @@ The following stories were prioritised for the Baseline version. |
|
|
* Complex Item Sets (question with sub-questions)
|
|
|
* Essay.
|
|
|
|
|
|
![Author_Dashboard](uploads/50c78aa1b66ad52721488f78e1d2fb1a/Author_Dashboard.jpg)
|
|
|
|
|
|
![Author_create_question](uploads/525caede92468566715801b9ee7d9485/Author_create_question.jpg)
|
|
|
|
|
|
#### Workflow step: Editors’ assessment of questions prior to review
|
|
|
|
|
|
1. Managing Editor assigns a submitted question (individually) to Handing Editors who check the question.
|
|
|
2. Managing Editor and Handling editors can chat with the question's Author to resolve any queries.
|
|
|
3. When a question is not accepted by an Editor, the Author gets boilerplate feedback via email notification.
|
|
|
4. Managing Editor and Handling Editors can invite multiple Reviewers to review questions.
|
|
|
5. Managing Editor and Handling Editors choose Reviewers to invite based on their expertise.
|
|
|
6. When an Editor invites a Reviewer, this notifies an HHMI finance person by email. The email includes the Author’s details and some question metadata (the Bloom’s level will determine the amount the author gets paid).
|
|
|
|
|
|
![Editor_dashboard-V2](uploads/7aa92aaa74c833fe833139b4c8be40c5/Editor_dashboard-V2.jpeg)
|
|
|
|
|
|
![Editor_question](uploads/21ca66e2942afe56993d548fed401cb5/Editor_question.jpeg)
|
|
|
|
|
|
|
|
|
![Editor_chat_to_author](uploads/33f9858e29e17767c6dc3ffa8248769a/Editor_chat_to_author.jpeg)
|
|
|
|
|
|
|
|
|
![Editor_invite_reviewers](uploads/748518dbd0a878b53384693efa2ca946/Editor_invite_reviewers.jpeg)
|
|
|
|
|
|
|
|
|
|
|
|
#### Workflow step: Reviewing questions
|
|
|
|
|
|
1. Reviewers can accept or reject an invitation to review a question.
|
|
|
2. Reviewers see a question without metadata and take the question as a student would.
|
|
|
3. Reviewers complete the reviewer's survey based on their answer, and submit their feedback.
|
|
|
4. Managing Editor and Handling Editors can chat with the question’s Reviewers to resolve any queries.
|
|
|
|
|
|
![Reviewers_dashboards](uploads/3a25ac9a3f7d21c0371cd96f60c64833/Reviewers_dashboards.jpeg)
|
|
|
|
|
|
![Reviewer_reject_or_accept](uploads/9e079ca6d6626cd24bc2c32ee173a0df/Reviewer_reject_or_accept.jpeg)
|
|
|
#### External workflow step: Editors’ assessment of questions prior to review
|
|
|
|
|
|
![Reviewer_checks_question](uploads/eb3b8ff566fd0b4a7c2f2c926843add4/Reviewer_checks_question.jpeg)
|
|
|
HHMI will continue to review authored questions externally to the Assessment Builder. This external workflow will require:
|
|
|
|
|
|
1. Managing and Handling Editors can export individual questions to Word format. *(Already planned for the Curate and use workflow step.)*
|
|
|
|
|
|
![Reviewer_provide_feedback_and_submit](uploads/573fa6a23ccef6bc82b81561b3fb0aaf/Reviewer_provide_feedback_and_submit.jpeg)
|
|
|
#### External workflow step: Reviewing questions
|
|
|
|
|
|
#### Workflow step: Editors’ assessment of questions after review
|
|
|
HHMI will continue to manage the question review process with content specialists externally to the Assessment Builder. Reviewer feedback must be recorded with tracked changes in Word for future reference.
|
|
|
|
|
|
1. Managing Editor and Handling Editors can reject a submitted question based on the Reviewers’ feedback.
|
|
|
2. When a question is not accepted by the Editor, the Author gets boilerplate feedback via email notification.
|
|
|
3. Managing Editor and Handling Editors can accept a reviewed question which moves the question into production.
|
|
|
#### External workflow step: Editors’ assessment of questions after review
|
|
|
|
|
|
As above, HHMI will complete the question review process externally to the Assessment Builder. Editor feedback must be recorded with tracked changes for future reference.
|
|
|
|
|
|
![Editor_check_reviews](uploads/aedd2af63aebcda942dede57c29a7012/Editor_check_reviews.jpeg)
|
|
|
|
|
|
#### Workflow step: Producing and publishing questions
|
|
|
|
|
|
1. Managing Editor and Handling Editors can assign production tasks.
|
|
|
2. Production team can see all production assignments on one question.
|
|
|
3. Production team can edit questions and its metadata to complete their tasks.
|
|
|
4. Production team can mark a production assignment complete.
|
|
|
5. Managing Editor and Handling Editors can delete a production task.
|
|
|
6. Managing Editor, Handling Editors and Production team can chat to each other.
|
|
|
7. Managing Editor and Handling Editors can publish a question when all production assignments are complete.
|
|
|
8. The System Admin can edit all published questions (e.g. to fix a typo).
|
|
|
|
|
|
![Production_dashboard](uploads/466447b392c732d53f0adc2536ff1c81/Production_dashboard.jpeg)
|
|
|
|
|
|
![Editor_production_assignment](uploads/f00cb9cdcc2cde36418bb107995b9507/Editor_production_assignment.jpeg)
|
|
|
|
|
|
#### Workflow step: Curating and using questions
|
|
|
The production step is simplified by managing task assignment and communication externally. The Managing or Handling Editor would implement the feedback from the review phase by following the tracked changes in the Word documents.
|
|
|
|
|
|
1. Managing Editor and Handling Editors can publish a question ~~when all production assignments are complete.~~
|
|
|
2. The System Admin can edit all published questions (e.g. to fix a typo).
|
|
|
Workflow step: Curating and using questions
|
|
|
1. All users can discover questions by searching learning objectives, question text and other metadata fields.
|
|
|
2. Non-signed up users see a question in a 'student view' (take question, then see answer with feedback).
|
|
|
3. Signed up users see a question in a 'faculty view' (with metadata) and 'student view'.
|
|
|
4. All users can export **individual** questions to Word format.
|
|
|
5. Signed up users can export **individual** questions to SCORM format.
|
|
|
4. All users can export individual questions to Word format.
|
|
|
5. Signed up users can export individual questions to SCORM format.
|
|
|
6. The exported questions meet HHMI's accessibility requirements.
|
|
|
|
|
|
![Logged_in_Discover_-_add_to_list](uploads/7424e3358c9ed67ea8b77505eb03eca8/Logged_in_Discover_-_add_to_list.jpeg)
|
|
|
|
|
|
![Faculty_view](uploads/699bf1d855df1445382fdf22bb7927af/Faculty_view.jpeg)
|
|
|
|
|
|
![Student_view](uploads/042116c2329e7d41d257c5a6a3ab3178/Student_view.jpeg)
|
|
|
|
|
|
**Not logged in view**
|
|
|
|
|
|
![Not_logged_in](uploads/2b0d5f5927290fb2837187e0cc758408/Not_logged_in.jpeg)
|
|
|
|
|
|
![Question_and_metadata_for_public_use](uploads/c892a1c8d1fbbcda9d1345c2e5cb8414/Question_and_metadata_for_public_use.jpeg)
|
|
|
|
|
|
#### Supporting functionality
|
|
|
|
|
|
1. Users sign up with local accounts.
|
... | ... | @@ -113,30 +60,14 @@ The following stories were prioritised for the Baseline version. |
|
|
* verify their email address
|
|
|
* accept HHMI legal terms
|
|
|
* complete a questionnaire on their academic knowledge and teaching experience
|
|
|
* can opt-in to be reviewers.
|
|
|
* can opt-in to be a Reviewer (this is necessary for HHMI gather users they can approach to be Reviewers, even though the Reviewer role won’t exist in this Baseline version)
|
|
|
3. After sign up, users can:
|
|
|
* change email and password
|
|
|
* opt-in or out as a Reviewer.
|
|
|
4. Admins can
|
|
|
* disable a user's account
|
|
|
* add and remove users to teams: Managing Editors; Handling Editors; Reviewers; and Production team.
|
|
|
* add and remove users to teams: Managing Editors; Handling Editors; ~~Reviewers; and Production team.~~
|
|
|
* see all users in the system (with basic information about them).
|
|
|
5. The site includes information pages created by HHMI, using the Drupal CMS, with text styles provided by Coko.
|
|
|
* a Home/landing page that links to the Discover page
|
|
|
* an About page.
|
|
|
|
|
|
**Login and sign up**
|
|
|
![login](uploads/0e5e3fe5965f537b08bbdf798801d6e0/login.jpeg)
|
|
|
|
|
|
![signup](uploads/4aa616c539bface03f2e81714686b039/signup.jpeg)
|
|
|
|
|
|
![Sign_up_questionnaire](uploads/c7a264971963e9c5ad496e42d91ce311/Sign_up_questionnaire.jpeg)
|
|
|
|
|
|
**User profile**
|
|
|
|
|
|
![Profile](uploads/b5ad7c6dbdf6ff049b5b029612a3389f/Profile.jpeg)
|
|
|
|
|
|
**Admin**
|
|
|
![Manage_teams](uploads/8f537096783c913b1472e3e0bcf1b9b8/Manage_teams.jpeg)
|
|
|
|
|
|
![Manage_users](uploads/a1a35edc5ea80f1c3128124759a80795/Manage_users.jpeg) |
|
|
\ No newline at end of file |
|
|
* a Professional Learning page that links to assessment courses and other pages on the BioInteractive website. |