QA: Testing list
Progress on tests is being tracked in this sheet
Automated testing overview:
A – Organization management
Priority: Check the functionalities necessary to make be able to work on different workflows
- Organization creation (publisher)
- Book creation
- Collection creation
- Collection settings update
- Adding books to collections
- Custom collection templates
- Collection Metadata modal updates
- Collection with custom groups: Move books into groups
- Collection order
- Publish TOC for collections.
- Organization Templates
- User management
B – Workflows
I. Word Workflow
a) Bulk upload (Confirm filename requirements and uploads)
b) Metadata modal updates
c) Settings modal updates
For each setting update we should confirm that it is applied correctly on the book. (Some settings can only be tested in one workflow, no need to add to all of them)
- – Parts:
- Check parts existing only when the setting is checked;
- Create parts & DND;
- Parts styling from editor;
- Nested parts;
- Add editors for parts;
- Delete part;
- Check ordering of chapters
- d) Team modal updates (to do this you will need to add users in editor role)
- e) Bulk modal actions
- Bulk actions
- Submit files in bulk
- Reload preview in bulk
- Publish single & multiple files in bulk
- Move to part button
Book component level
Files tab
- Upload check for all the sections;
Source: Check that it matches the criteria for filenames
Converted: Confirm that it matches the filename criteria’s
Supplementary: Single/multiple upload, new version update, file delete - File downloads:
Download all & download selected - Reload Preview & Submit button
Click submit & check the other buttons/actions are active/inactive as for the spreadsheet.
Click Reload Preview & check the other buttons/actions are active/inactive as for the spreadsheet.
Metadata tab
- Check that fields are not-editable despite the grants section.
- Upload a converted file and confirm the metadata appears correctly in the tab
Team tab
- Add and remove an editor – this can be done with user permissions
Errors tab
- Check the Show Help panel & comment
- View errors, but to do so, we need to have conversion which will take time
Preview tab
- Show review button Comments; Upload files and check that is added at the review section of files tab.
II- XML Workflow
Chapters
Repeat the same test cases as word workflow.
Add extra tests for the files tab related to Bookshelf Display PDFs & Images upload.
Wholebooks
- Create book
- Update book settings
- Update book team
- Files tab uploads:
• Source (Source file should have a tag main_xml for user to be able to submit)
• Converted
• Bookshelf Display PDFs (If there are pdf uploaded, it’s necessary for one of them to have the tag main_pdf, to be able to submit)
• Supplementary
• Images
- Preview tab: Show Review chatbox
- Errors tab: Check the Show Help panel & comment
III- PDF Workflow
Chapters
Repeat the same test cases as for word workflow.
Difference is, on submit, status is changed to tagging not converting.
Also more sections to upload files in the files tab. (Bookshelf, Images & Support)
- On support section check the creation of vendor-meta.xml which is added when a new book component is uploaded.
Wholebooks
- Create book
- Update book settings
- Update book team
- Files tab uploads:
- Source
- Converted
- Bookshelf Display PDFs
- Supplementary
- Images
- Support (vendor-meta.xml is added at the point of creation).
- Preview tab: Show Review chatbox
- Errors tab: Check the Show Help panel & comment
All workflows, should be checked the statuses as for: https://docs.google.com/spreadsheets/d/1M4ZdBbzr2s4-PUXqEblfsKoPBUuk4aG343u9ZAUn_Tk/edit#gid=0
Testing files required:
Files for automated testing:
-
Converted xml chapter file that includes all chapter metadata currently shown in the chapter metadata tab - see PB-0016.bxml -
Converted xml wholebook file that includes all book metadata currently shown in the book metadata modal. - see ukhta2501.bxml -
Full package with files for the xml wholebook above (source, images, suppl, bookshelfpdfs). - see: https://nextcloud.coko.foundation/s/zp26xmB3eP6Px3w?path=%2FXML%20workflow%2FXML-wholebook%2FClean -
Source & corresponding Converted files for Word WF which would cause a loading errors. For each file also respectively a list of expected errors. - see: https://nextcloud.coko.foundation/s/zp26xmB3eP6Px3w?path=%2FWord%20Workflow%2FWORD-chapters%2Fdirty%2Fpmc_loading_error -
Source & Converted files which will cause previewing status for Word WF. Converted xml of the chapter should have all the metadata included that would updated the metadata tab (with date history, contributors etc). - bgd-biotin.docx bgd-biotin.xml bgd-biotin-NoAbHead.docx bgd-biotin-NoAbHead.xml -
Converted xmls for Word workflow case which have hideTOC included.- see chapters with hideTOC icons in this book - https://ncbi.cloud68.co/organizations/32d78686-4b9a-46af-b52a-f5d0c4052177/bookmanager/b69258e0-272d-4cad-99eb-bded47be6915/ -
Converted file for Complete books word workflow which would result on loading errors (and the errors) -
Converted file for Complete books word workflow which would result on previewing status. - blocked by #1178 -
Converted xml chapter for 'PDF workflow' that included all metadata. - Example here -
PDF Wholebook workflow source & a converted xml output. Source file: wt606048.pdf For converted file: bookwt606034.xml Example on ncbidev here