I was doing chores today and noticed 6 failures from our Popups-daily-beta-tests:
13:51:06 > selenium-daily 13:51:06 > npm run selenium-test 13:51:06 13:51:07 13:51:07 > selenium-test 13:51:07 > wdio tests/selenium/wdio.conf.js 13:51:07 13:51:08 13:51:08 Execution of 2 spec files started at 2022-06-09T19:51:08.417Z 13:51:08 13:51:09 [0-0] RUNNING in chrome - /tests/selenium/specs/page_previews.js 13:51:24 [0-0] Error in "Dwelling on a valid page link I should see a page preview" 13:51:24 Error: element (".mwe-popups") still not existing after 5000ms 13:51:24 at processTicksAndRejections (internal/process/task_queues.js:95:5) 13:51:24 at PopupsPage.dwellLink (/src/tests/selenium/pageobjects/popups.page.js:71:24) 13:51:24 at PopupsPage.dwellPageLink (/src/tests/selenium/pageobjects/popups.page.js:75:8) 13:51:24 at Context.<anonymous> (/src/tests/selenium/specs/page_previews.js:17:8) 13:51:30 [0-0] Error in "Dwelling on a valid page link Abandoning link hides page preview" 13:51:30 Error: element (".mwe-popups") still not existing after 5000ms 13:51:30 at processTicksAndRejections (internal/process/task_queues.js:95:5) 13:51:30 at PopupsPage.dwellLink (/src/tests/selenium/pageobjects/popups.page.js:71:24) 13:51:30 at PopupsPage.dwellPageLink (/src/tests/selenium/pageobjects/popups.page.js:75:8) 13:51:30 at Context.<anonymous> (/src/tests/selenium/specs/page_previews.js:22:8) 13:51:36 [0-0] Error in "Dwelling on a valid page link Quickly hovering, abandoning and re-hovering a link shows page preview" 13:51:36 Error: element (".mwe-popups") still not existing after 5000ms 13:51:36 at processTicksAndRejections (internal/process/task_queues.js:95:5) 13:51:36 at PopupsPage.dwellLink (/src/tests/selenium/pageobjects/popups.page.js:71:24) 13:51:36 at PopupsPage.dwellPageLink (/src/tests/selenium/pageobjects/popups.page.js:75:8) 13:51:36 at Context.<anonymous> (/src/tests/selenium/specs/page_previews.js:30:8) 13:51:37 [0-0] RETRYING in chrome - /tests/selenium/specs/page_previews.js 13:51:39 [0-0] RUNNING in chrome - /tests/selenium/specs/page_previews.js 13:51:50 [0-0] Error in "Dwelling on a valid page link I should see a page preview" 13:51:50 Error: element (".mwe-popups") still not existing after 5000ms 13:51:50 at processTicksAndRejections (internal/process/task_queues.js:95:5) 13:51:50 at PopupsPage.dwellLink (/src/tests/selenium/pageobjects/popups.page.js:71:24) 13:51:50 at PopupsPage.dwellPageLink (/src/tests/selenium/pageobjects/popups.page.js:75:8) 13:51:50 at Context.<anonymous> (/src/tests/selenium/specs/page_previews.js:17:8) 13:51:56 [0-0] Error in "Dwelling on a valid page link Abandoning link hides page preview" 13:51:56 Error: element (".mwe-popups") still not existing after 5000ms 13:51:56 at processTicksAndRejections (internal/process/task_queues.js:95:5) 13:51:56 at PopupsPage.dwellLink (/src/tests/selenium/pageobjects/popups.page.js:71:24) 13:51:56 at PopupsPage.dwellPageLink (/src/tests/selenium/pageobjects/popups.page.js:75:8) 13:51:56 at Context.<anonymous> (/src/tests/selenium/specs/page_previews.js:22:8) 13:52:03 [0-0] Error in "Dwelling on a valid page link Quickly hovering, abandoning and re-hovering a link shows page preview" 13:52:03 Error: element (".mwe-popups") still not existing after 5000ms 13:52:03 at processTicksAndRejections (internal/process/task_queues.js:95:5) 13:52:03 at PopupsPage.dwellLink (/src/tests/selenium/pageobjects/popups.page.js:71:24) 13:52:03 at PopupsPage.dwellPageLink (/src/tests/selenium/pageobjects/popups.page.js:75:8) 13:52:03 at Context.<anonymous> (/src/tests/selenium/specs/page_previews.js:30:8) 13:52:03 [0-0] FAILED in chrome - /tests/selenium/specs/page_previews.js (1 retries) 13:52:04 [0-1] RUNNING in chrome - /tests/selenium/specs/reference_previews.js 13:52:24 [0-1] PASSED in chrome - /tests/selenium/specs/reference_previews.js
https://integration.wikimedia.org/ci/view/Reading-Web/job/selenium-daily-beta-Popups/1461/console
I cannot reproduce any failure on https://en.wikipedia.beta.wmflabs.org/wiki/Popups_test_page so this might be due to the test itself.
Acceptance Criteria
- Popups tests pass