icgc-argo/e2e-test

End to end testing of The ICGC ARGO platform

e2e-test's Issues

e2e-test: Migrate from Dockerhub to Github Packages

🐛 Join Program test failing

Describe the bug

Join Program test is failing because user does not exist in Ego
Fails on clicking "Join Now" after invite

{timestamp: "2020-08-25T23:43:11.690+0000", status: 404, error: "Not Found",…}
error: "Not Found"
message: "The 'User' entity with id '9f1f8350-7cf6-44b9-aa55-fc89ab0d6f16' does not exist"
path: "/oauth/update-ego-token"
status: 404
timestamp: "2020-08-25T23:43:11.690+0000"

Steps To Reproduce

Run the test

Expected behaviour

The user should exist from being invited

All data is hardcoded

Detailed Description

All data is hardcoded causing tests to break:

• UI will throw errors when there isn't specified elements in forms
• UI will have a different DOM (visible elements) if a data file upload is incorrect

Possible Implementation

Update existing, failing Sample Registration test

The file format changed so the test is failing.
Update the test so that it passes successfully.

Exit Criteria

• Write the test
• If UI changes are required (anchors etc) make the changes
• Make sure the test passes and get it to QA

Implement Link Test

Add tests for broken links and checking where links are being directed to, and if they are going to the right pages. I.e. making sure links are redirecting to the proper pages.

Implement Edit Program Test

Wiki test specs:
https://wiki.oicr.on.ca/display/icgcargotech/Automated+Testing+Plan

Test is 2.0- Edit/Update a Program.

Exit Criteria

• Write the test
• If UI changes are required (anchors etc) make the changes
• Make sure the test passes and get it to QA

Implement Clinical Data Validate test

Convert to TS: 5 tests

Convert to typescript:

• create program
• edit program
• clinical submission
• login
• user profile

🐛 Login tests fail because of insecure browser

Describe the bug

Chrome driven programmatically from nightwatch is flagged as insecure and wont allow login to the platform bc google wont allow login

• cant test login thru an automated system so chrome flags you as a robot

🐛 join program final action

The test for the final action of join program is not yet working, we have disabled this test in the meantime but this is something we want to re-enable

Implement test for Clinical Data upload for each file type

Wiki test specs:
https://wiki.oicr.on.ca/display/icgcargotech/Automated+Testing+Plan

Test number 6.0

Note: you cannot upload files through selelnium. Use the sample_registration example to use the API to submit the data to get around this.

Exit Criteria

• Write the test to upload clinical files
• If UI changes are required (anchors etc) make the changes
• Make sure the test passes and get it to QA

User token generation https://platform-ui.qa.argo.cancercollaboratory.org/user

Login as any user, and go to access token page
be able to generate an access token

• Access Token (test 8.0)
• Program Membership (test 8.1)

specs: https://wiki.oicr.on.ca/display/icgcargotech/Automated+Testing+Plan

Platform Selenium Testing

We have some selenium testing set up - we need to implement more selenium tests for the platform.
https://wiki.oicr.on.ca/display/icgcargotech/Automated+Testing+Plan

• Edit Program *
  -- list the fields that you want edited

• Sample Registration update the current test *

• Clinical Data upload for each file type *
  -- link files on wiki page

• Clinical Data Validate *

• Clinical Data Sign-off and Approval

• User token generation https://platform-ui.qa.argo.cancercollaboratory.org/user

Expected behavior on all state

Interactive prompt broke

Fix interactive prompt selecting environments

There is no mapping between passed in env and test settings

🐛 Firefox tests are failing

geckodriver (the driver for running headless FF) isn't able to fill out forms properly. This is happening on both local run and Browserstack (which we do not know what they use for automation).

For now we will disable testing on FF for the nightly run, but this is an issue we can revisit at a later time once teh driver is fixed itself in firefox.

Implement Clinical Data Sign-off and Approval

https://wiki.oicr.on.ca/display/icgcargotech/Automated+Testing+Plan
test 7.0

• there are 2 flows : updates vs no updates
• summary modal should have correct update vs new summary
• when update, get the approval message
• in the update case also add in as the DCC and and approve the submission
• when no update signoff and succeed thru to dashboard/toast