WIP - e2e tests, add a dedicated workflow for v2 webrtc not in eu #663
unit-tests.yml
on: pull_request
Matrix: Run unit and stack tests
Matrix: Browser SDK production / Run E2E tests
Matrix: Browser SDK staging / Run E2E tests
Matrix: RealtimeAPI SDK production / Run E2E tests
Matrix: RealtimeAPI SDK staging / Run E2E tests
Annotations
26 errors, 19 warnings, and 11 notices
[demote] › roomSessionDemote.spec.ts:15:7 › RoomSession demote participant › should demote participant:
internal/e2e-js/utils.ts#L375
1) [demote] › roomSessionDemote.spec.ts:15:7 › RoomSession demote participant › should demote participant
Error: page.evaluate: Object
at ../utils.ts:375
373 | options: *** invokeJoin: boolean *** = *** invokeJoin: true ***
374 | ) => ***
> 375 | return page.evaluate((*** invokeJoin ***) => ***
| ^
376 | return new Promise<any>(async (resolve, reject) => ***
377 | // @ts-expect-error
378 | const roomObj: Video.RoomSession = window._roomObj
at expectRoomJoined (/home/runner/work/signalwire-js/signalwire-js/internal/e2e-js/utils.ts:375:15)
at /home/runner/work/signalwire-js/signalwire-js/internal/e2e-js/tests/roomSessionDemote.spec.ts:46:27
|
[demote] › roomSessionDemoteAudience.spec.ts:14:7 › RoomSession demote method › should not be able to demote audience:
internal/e2e-js/utils.ts#L375
2) [demote] › roomSessionDemoteAudience.spec.ts:14:7 › RoomSession demote method › should not be able to demote audience
Error: page.evaluate: Object
at ../utils.ts:375
373 | options: *** invokeJoin: boolean *** = *** invokeJoin: true ***
374 | ) => ***
> 375 | return page.evaluate((*** invokeJoin ***) => ***
| ^
376 | return new Promise<any>(async (resolve, reject) => ***
377 | // @ts-expect-error
378 | const roomObj: Video.RoomSession = window._roomObj
at expectRoomJoined (/home/runner/work/signalwire-js/signalwire-js/internal/e2e-js/utils.ts:375:15)
at /home/runner/work/signalwire-js/signalwire-js/internal/e2e-js/tests/roomSessionDemoteAudience.spec.ts:49:27
|
Browser SDK staging / Run E2E tests (18.x, demote)
Process completed with exit code 1.
|
Browser SDK staging / Run E2E tests (18.x, slow)
The job was canceled because "_18_x_demote" failed.
|
[slow] › roomSessionAudienceCount.spec.ts:12:7 › RoomSession Audience Count › should receive correct audience_count in events:
internal/e2e-js/utils.ts#L375
1) [slow] › roomSessionAudienceCount.spec.ts:12:7 › RoomSession Audience Count › should receive correct audience_count in events
Error: page.evaluate: Object
at ../utils.ts:375
373 | options: *** invokeJoin: boolean *** = *** invokeJoin: true ***
374 | ) => ***
> 375 | return page.evaluate((*** invokeJoin ***) => ***
| ^
376 | return new Promise<any>(async (resolve, reject) => ***
377 | // @ts-expect-error
378 | const roomObj: Video.RoomSession = window._roomObj
at expectRoomJoined (/home/runner/work/signalwire-js/signalwire-js/internal/e2e-js/utils.ts:375:15)
at /home/runner/work/signalwire-js/signalwire-js/internal/e2e-js/tests/roomSessionAudienceCount.spec.ts:97:27
|
[slow] › roomSessionBadNetwork.spec.ts:29:9 › roomSessionBadNetwork › should survive to a network switch for member:
internal/e2e-js/utils.ts#L375
2) [slow] › roomSessionBadNetwork.spec.ts:29:9 › roomSessionBadNetwork › should survive to a network switch for member
Error: page.evaluate: Object
at ../utils.ts:375
373 | options: *** invokeJoin: boolean *** = *** invokeJoin: true ***
374 | ) => ***
> 375 | return page.evaluate((*** invokeJoin ***) => ***
| ^
376 | return new Promise<any>(async (resolve, reject) => ***
377 | // @ts-expect-error
378 | const roomObj: Video.RoomSession = window._roomObj
at expectRoomJoined (/home/runner/work/signalwire-js/signalwire-js/internal/e2e-js/utils.ts:375:15)
at /home/runner/work/signalwire-js/signalwire-js/internal/e2e-js/tests/roomSessionBadNetwork.spec.ts:57:53
|
Browser SDK staging / Run E2E tests (18.x, slow)
Process completed with exit code 1.
|
Browser SDK staging / Run E2E tests (18.x, reattach)
The job was canceled because "_18_x_demote" failed.
|
Browser SDK staging / Run E2E tests (18.x, reattach)
The operation was canceled.
|
Browser SDK staging / Run E2E tests (18.x, default)
The job was canceled because "_18_x_demote" failed.
|
Browser SDK staging / Run E2E tests (18.x, default)
The operation was canceled.
|
Browser SDK staging / Run E2E tests (18.x, v2WebRTC)
The job was canceled because "_18_x_demote" failed.
|
Browser SDK staging / Run E2E tests (18.x, streaming)
The job was canceled because "_18_x_demote" failed.
|
Browser SDK staging / Run E2E tests (18.x, v2WebRTC)
The operation was canceled.
|
Browser SDK staging / Run E2E tests (18.x, streaming)
The operation was canceled.
|
Browser SDK staging / Run E2E tests (18.x, callfabric)
The job was canceled because "_18_x_demote" failed.
|
Browser SDK staging / Run E2E tests (18.x, callfabric)
The operation was canceled.
|
Browser SDK staging / Run E2E tests (18.x, promote)
The job was canceled because "_18_x_demote" failed.
|
Browser SDK staging / Run E2E tests (18.x, promote)
The operation was canceled.
|
RealtimeAPI SDK staging / Run E2E tests (18.x)
Process completed with exit code 1.
|
[default] › video.test.ts:14:7 › Video › should join the room and listen for events:
internal/e2e-realtime-api/src/playwright/video.test.ts#L1
1) [default] › video.test.ts:14:7 › Video › should join the room and listen for events ───────────
Test timeout of 60000ms exceeded.
|
RealtimeAPI SDK production / Run E2E tests (18.x)
Process completed with exit code 1.
|
[default] › roomSession.spec.ts:598:7 › RoomSession › should allow retrieving the room session recordings and playbacks:
internal/e2e-js/tests/roomSession.spec.ts#L1
1) [default] › roomSession.spec.ts:598:7 › RoomSession › should allow retrieving the room session recordings and playbacks
Test timeout of 120000ms exceeded.
|
[default] › roomSession.spec.ts:598:7 › RoomSession › should allow retrieving the room session recordings and playbacks:
internal/e2e-js/tests/roomSession.spec.ts#L678
1) [default] › roomSession.spec.ts:598:7 › RoomSession › should allow retrieving the room session recordings and playbacks
Error: page.evaluate: Target closed
676 |
677 | // --------------- Getting the recordings from the 2nd room ---------------
> 678 | const recordings: any = await pageTwo.evaluate(async () => ***
| ^
679 | // @ts-expect-error
680 | const roomObj: Video.RoomSession = window._roomObj
681 | const payload = await roomObj.getRecordings()
at /home/runner/work/signalwire-js/signalwire-js/internal/e2e-js/tests/roomSession.spec.ts:678:43
|
[default] › roomSession.spec.ts:598:7 › RoomSession › should allow retrieving the room session recordings and playbacks:
internal/e2e-js/tests/roomSession.spec.ts#L1
1) [default] › roomSession.spec.ts:598:7 › RoomSession › should allow retrieving the room session recordings and playbacks
Pending operations:
- page.evaluate at tests/roomSession.spec.ts:678:43
|
Browser SDK production / Run E2E tests (18.x, default)
Process completed with exit code 1.
|
Slow Test:
internal/e2e-js/[demote] › roomSessionDemote.spec.ts#L1
internal/e2e-js/[demote] › roomSessionDemote.spec.ts took 38.6s
|
Slow Test:
internal/e2e-js/[callfabric] › callfabric/videoRoom.spec.ts#L1
internal/e2e-js/[callfabric] › callfabric/videoRoom.spec.ts took 16.2s
|
Slow Test:
internal/e2e-js/[callfabric] › callfabric/relayApp.spec.ts#L1
internal/e2e-js/[callfabric] › callfabric/relayApp.spec.ts took 15.6s
|
Slow Test:
internal/e2e-js/[callfabric] › callfabric/swml.spec.ts#L1
internal/e2e-js/[callfabric] › callfabric/swml.spec.ts took 15.4s
|
Slow Test:
internal/e2e-js/[promote] › roomSessionPromoteReattachDemote.spec.ts#L1
internal/e2e-js/[promote] › roomSessionPromoteReattachDemote.spec.ts took 33.9s
|
Slow Test:
internal/e2e-js/[promote] › roomSessionPromoteDemote.spec.ts#L1
internal/e2e-js/[promote] › roomSessionPromoteDemote.spec.ts took 33.7s
|
Slow Test:
internal/e2e-js/[slow] › roomSessionBadNetwork.spec.ts#L1
internal/e2e-js/[slow] › roomSessionBadNetwork.spec.ts took 58.6s
|
Slow Test:
internal/e2e-js/[slow] › roomSessionAudienceCount.spec.ts#L1
internal/e2e-js/[slow] › roomSessionAudienceCount.spec.ts took 17.6s
|
Slow Test:
internal/e2e-js/[reattach] › roomSessionReattachMultiple.spec.ts#L1
internal/e2e-js/[reattach] › roomSessionReattachMultiple.spec.ts took 27.8s
|
Slow Test:
internal/e2e-js/[reattach] › roomSessionReattach.spec.ts#L1
internal/e2e-js/[reattach] › roomSessionReattach.spec.ts took 23.8s
|
Slow Test:
internal/e2e-js/[reattach] › roomSessionReattachScreenshare.spec.ts#L1
internal/e2e-js/[reattach] › roomSessionReattachScreenshare.spec.ts took 18.5s
|
Slow Test:
internal/e2e-js/[reattach] › roomSessionReattachWrongProtocol.spec.ts#L1
internal/e2e-js/[reattach] › roomSessionReattachWrongProtocol.spec.ts took 16.1s
|
Slow Test:
internal/e2e-js/[v2WebRTC] › v2Webrtc/v2WebrtcFromRest.spec.ts#L1
internal/e2e-js/[v2WebRTC] › v2Webrtc/v2WebrtcFromRest.spec.ts took 1.7m
|
Slow Test:
internal/e2e-js/[v2WebRTC] › v2Webrtc/webrtcCalling.spec.ts#L1
internal/e2e-js/[v2WebRTC] › v2Webrtc/webrtcCalling.spec.ts took 26.7s
|
Slow Test:
internal/e2e-js/[default] › roomSession.spec.ts#L1
internal/e2e-js/[default] › roomSession.spec.ts took 2.4m
|
Slow Test:
internal/e2e-js/[default] › roomSessionJoinFrom.spec.ts#L1
internal/e2e-js/[default] › roomSessionJoinFrom.spec.ts took 41.7s
|
Slow Test:
internal/e2e-js/[default] › roomSessionDemoteReattachPromote.spec.ts#L1
internal/e2e-js/[default] › roomSessionDemoteReattachPromote.spec.ts took 32.6s
|
Slow Test:
internal/e2e-js/[default] › roomSessionRemoveAllMembers.spec.ts#L1
internal/e2e-js/[default] › roomSessionRemoveAllMembers.spec.ts took 30.4s
|
Slow Test:
internal/e2e-js/[default] › roomSessionRemoveAt.spec.ts#L1
internal/e2e-js/[default] › roomSessionRemoveAt.spec.ts took 29.6s
|
🎭 Playwright Run Summary
2 failed
[demote] › roomSessionDemote.spec.ts:15:7 › RoomSession demote participant › should demote participant
[demote] › roomSessionDemoteAudience.spec.ts:14:7 › RoomSession demote method › should not be able to demote audience
|
🎭 Playwright Run Summary
2 failed
[slow] › roomSessionAudienceCount.spec.ts:12:7 › RoomSession Audience Count › should receive correct audience_count in events
[slow] › roomSessionBadNetwork.spec.ts:29:9 › roomSessionBadNetwork › should survive to a network switch for member
|
🎭 Playwright Run Summary
5 passed (37.9s)
|
🎭 Playwright Run Summary
2 passed (50.3s)
|
🎭 Playwright Run Summary
1 skipped
6 passed (47.9s)
|
🎭 Playwright Run Summary
4 passed (1.5m)
|
🎭 Playwright Run Summary
2 passed (1.3m)
|
🎭 Playwright Run Summary
8 passed (1.7m)
|
🎭 Playwright Run Summary
6 passed (2.2m)
|
🎭 Playwright Run Summary
1 failed
[default] › video.test.ts:14:7 › Video › should join the room and listen for events ────────────
5 passed (1.4m)
|
🎭 Playwright Run Summary
1 failed
[default] › roomSession.spec.ts:598:7 › RoomSession › should allow retrieving the room session recordings and playbacks
37 passed (8.8m)
|