Tuwunel Complement Test Results
Tuwunel runs the Complement Matrix homeserver acceptance suite. Raw results are committed to tests/complement/results.jsonl; full server and test logs to tests/complement/logs.jsonl.
Counts
-
Test groups: 201. Passing: 68.7%
- ✅
pass: 138 - 🟨
some: 27 - ❌
fail: 34 - ⬛
skip: 2
- ✅
-
Subtests: 590. Passing: 67.8%
- ✅
pass: 400 - ❌
fail: 177 - ⬛
skip: 13
- ✅
All Top-Level Tests
| Test | Status | Subtests |
|---|---|---|
TestACLs | ✅ | – |
TestAddAccountData | ✅ | 2/0/0 |
TestArchivedRoomsHistory | 🟨 | 3/2/1 |
TestAsyncUpload | ✅ | 6/0/0 |
TestAvatarUrlUpdate | ✅ | – |
TestBannedUserCannotSendJoin | ✅ | – |
TestCanRegisterAdmin | ⬛ | – |
TestCannotKickLeftUser | ✅ | – |
TestCannotKickNonPresentUser | ❌ | – |
TestCannotSendKnockViaSendKnockInMSC3787Room | ✅ | 6/0/0 |
TestCannotSendNonJoinViaSendJoinV2 | ✅ | 6/0/0 |
TestCannotSendNonKnockViaSendKnock | ✅ | 6/0/0 |
TestCannotSendNonLeaveViaSendLeaveV2 | ✅ | 6/0/0 |
TestChangePassword | ✅ | 5/0/0 |
TestChangePasswordPushers | ✅ | 2/0/0 |
TestClientSpacesSummary | 🟨 | 1/4/0 |
TestClientSpacesSummaryJoinRules | ✅ | – |
TestComplementCanCreateValidV12Rooms | ✅ | – |
TestContent | ✅ | – |
TestContentCSAPIMediaV1 | ✅ | – |
TestContentMediaV1 | ✅ | – |
TestCorruptedAuthChain | ❌ | – |
TestCumulativeJoinLeaveJoinSync | ✅ | – |
TestDeactivateAccount | ✅ | 4/0/0 |
TestDelayedEvents | 🟨 | 6/7/1 |
TestDeletingDeviceRemovesDeviceLocalNotificationSettings | ❌ | 0/1/0 |
TestDemotingUsersViaUsersDefault | ✅ | – |
TestDeviceListUpdates | 🟨 | 4/6/0 |
TestDeviceListsUpdateOverFederation | ❌ | 0/3/0 |
TestDeviceListsUpdateOverFederationOnRoomJoin | ❌ | – |
TestDeviceManagement | 🟨 | 6/1/0 |
TestDisplayNameUpdate | ✅ | – |
TestE2EKeyBackupReplaceRoomKeyRules | ✅ | 3/0/0 |
TestEvent | ✅ | 3/0/0 |
TestEventAuth | ✅ | 2/0/0 |
TestEventRelationships | ❌ | – |
TestFederatedClientSpaces | ✅ | – |
TestFederatedEventRelationships | ❌ | – |
TestFederationKeyUploadQuery | ❌ | 0/2/0 |
TestFederationRedactSendsWithoutEvent | ✅ | – |
TestFederationRejectInvite | ✅ | – |
TestFederationRoomsInvite | 🟨 | 8/2/0 |
TestFederationThumbnail | ✅ | – |
TestFetchEvent | ✅ | – |
TestFetchEventNonWorldReadable | ❌ | – |
TestFetchEventWorldReadable | ✅ | – |
TestFetchHistoricalInvitedEventFromBeforeInvite | ❌ | – |
TestFetchHistoricalInvitedEventFromBetweenInvite | ✅ | – |
TestFetchHistoricalJoinedEventDenied | ❌ | – |
TestFetchHistoricalSharedEvent | ✅ | – |
TestFetchMessagesFromNonExistentRoom | ✅ | – |
TestFilter | ✅ | – |
TestFilterMessagesByRelType | ❌ | – |
TestGappedSyncLeaveSection | ✅ | – |
TestGetFilteredRoomMembers | ✅ | 3/0/0 |
TestGetMissingEventsGapFilling | ❌ | – |
TestGetRoomMembers | ✅ | – |
TestGetRoomMembersAtPoint | ❌ | – |
TestInboundCanReturnMissingEvents | ❌ | 0/4/0 |
TestInboundFederationKeys | ✅ | – |
TestInboundFederationProfile | ✅ | 2/0/0 |
TestInboundFederationRejectsEventsWithRejectedAuthEvents | ❌ | – |
TestInviteFiltering | 🟨 | 3/8/0 |
TestInviteFromIgnoredUsersDoesNotAppearInSync | ✅ | – |
TestIsDirectFlagFederation | ✅ | – |
TestIsDirectFlagLocal | ✅ | – |
TestJoinFederatedRoomFailOver | ✅ | – |
TestJoinFederatedRoomFromApplicationServiceBridgeUser | ❌ | 0/1/0 |
TestJoinFederatedRoomWithUnverifiableEvents | ✅ | 4/0/0 |
TestJoinViaRoomIDAndServerName | ✅ | – |
TestJson | ✅ | 3/0/0 |
TestJumpToDateEndpoint | 🟨 | 6/8/0 |
TestKeyChangesLocal | ✅ | 1/0/0 |
TestKeyClaimOrdering | ❌ | – |
TestKeysQueryWithDeviceIDAsObjectFails | ✅ | – |
TestKnockRestrictedRoomsLocalJoinNoCreatorsUsesPowerLevelsV11 | ✅ | – |
TestKnockRestrictedRoomsLocalJoinNoCreatorsUsesPowerLevelsV12 | ✅ | – |
TestKnockRoomsInPublicRoomsDirectory | ✅ | – |
TestKnockRoomsInPublicRoomsDirectoryInMSC3787Room | ✅ | – |
TestKnocking | 🟨 | 16/9/0 |
TestKnockingInMSC3787Room | 🟨 | 16/9/0 |
TestLeakyTyping | ✅ | – |
TestLeaveEventInviteRejection | ✅ | – |
TestLeaveEventVisibility | ❌ | – |
TestLeftRoomFixture | 🟨 | 2/3/0 |
TestLocalPngThumbnail | ✅ | 2/0/0 |
TestLogin | ✅ | 8/0/0 |
TestLogout | ✅ | 4/0/0 |
TestMSC3757OwnedState | ❌ | – |
TestMSC3967 | ✅ | – |
TestMSC4289PrivilegedRoomCreators | ✅ | 11/0/0 |
TestMSC4289PrivilegedRoomCreators_Additional | ✅ | – |
TestMSC4289PrivilegedRoomCreators_AdditionalCreatorsAndInvited | ✅ | – |
TestMSC4289PrivilegedRoomCreators_AdditionalValidation | ✅ | 5/0/0 |
TestMSC4289PrivilegedRoomCreators_InvitedAreCreators | ✅ | – |
TestMSC4289PrivilegedRoomCreators_Upgrades | ✅ | – |
TestMSC4291RoomIDAsHashOfCreateEvent | ✅ | – |
TestMSC4291RoomIDAsHashOfCreateEvent_AuthEventsOmitsCreateEvent | ✅ | – |
TestMSC4291RoomIDAsHashOfCreateEvent_CannotSendCreateEvent | ✅ | – |
TestMSC4291RoomIDAsHashOfCreateEvent_RoomIDIsOnCreateEvent | ✅ | – |
TestMSC4291RoomIDAsHashOfCreateEvent_UpgradedRooms | ❌ | – |
TestMSC4297StateResolutionV2_1_includes_conflicted_subgraph | ✅ | – |
TestMSC4297StateResolutionV2_1_starts_from_empty_set | ✅ | – |
TestMSC4308ThreadSubscriptionsSlidingSync | ❌ | 0/2/0 |
TestMSC4311FullCreateEventOnStrippedState | ❌ | – |
TestMediaConfig | ✅ | – |
TestMediaFilenames | ✅ | 25/0/0 |
TestMediaWithoutFileName | ✅ | 4/0/0 |
TestMediaWithoutFileNameCSMediaV1 | ✅ | 4/0/0 |
TestMembersLocal | 🟨 | 3/2/0 |
TestMembershipOnEvents | ❌ | – |
TestMessagesOverFederation | 🟨 | 3/2/0 |
TestNetworkPartitionOrdering | ✅ | – |
TestNotPresentUserCannotBanOthers | ✅ | – |
TestOlderLeftRoomsNotInLeaveSection | ✅ | – |
TestOutboundFederationEventSizeGetMissingEvents | ❌ | – |
TestOutboundFederationIgnoresMissingEventWithBadJSONForRoomVersion6 | ❌ | – |
TestOutboundFederationProfile | ✅ | 1/0/0 |
TestOutboundFederationSend | ✅ | – |
TestPartialStateJoin | ❌ | 0/58/7 |
TestPollsLocalPushRules | ❌ | 0/1/0 |
TestPowerLevels | ✅ | 3/0/0 |
TestPresence | 🟨 | 4/1/0 |
TestPresenceSyncDifferentRooms | ✅ | – |
TestProfileAvatarURL | ✅ | 2/0/0 |
TestProfileDisplayName | ✅ | 2/0/0 |
TestPublicRooms | ✅ | 9/0/0 |
TestPushRuleCacheHealth | ✅ | – |
TestPushRuleRoomUpgrade | ❌ | 0/5/0 |
TestPushSync | ✅ | 5/0/0 |
TestRedact | ✅ | 1/0/0 |
TestRegistration | ✅ | 19/0/4 |
TestRelations | ✅ | – |
TestRelationsPagination | ✅ | – |
TestRelationsPaginationSync | ✅ | – |
TestRemoteAliasRequestsUnderstandUnicode | ✅ | – |
TestRemotePngThumbnail | ✅ | 2/0/0 |
TestRemotePresence | ❌ | 0/2/0 |
TestRemoteTyping | ✅ | – |
TestRemovingAccountData | ✅ | 4/0/0 |
TestRequestEncodingFails | ❌ | 0/1/0 |
TestRestrictedRoomsLocalJoin | 🟨 | 4/1/0 |
TestRestrictedRoomsLocalJoinInMSC3787Room | 🟨 | 4/1/0 |
TestRestrictedRoomsLocalJoinNoCreatorsUsesPowerLevelsV11 | ✅ | – |
TestRestrictedRoomsLocalJoinNoCreatorsUsesPowerLevelsV12 | ✅ | – |
TestRestrictedRoomsRemoteJoin | 🟨 | 4/1/0 |
TestRestrictedRoomsRemoteJoinInMSC3787Room | 🟨 | 4/1/0 |
TestRestrictedRoomsRemoteJoinLocalUser | ✅ | – |
TestRestrictedRoomsRemoteJoinLocalUserInMSC3787Room | ✅ | – |
TestRestrictedRoomsSpacesSummaryFederation | ✅ | – |
TestRestrictedRoomsSpacesSummaryLocal | ✅ | – |
TestRoomAlias | ✅ | 5/0/0 |
TestRoomCanonicalAlias | ✅ | 10/0/0 |
TestRoomCreate | ✅ | 15/0/0 |
TestRoomCreationReportsEventsToMyself | 🟨 | 3/3/0 |
TestRoomDeleteAlias | 🟨 | 7/2/0 |
TestRoomForget | 🟨 | 5/3/0 |
TestRoomImageRoundtrip | ✅ | – |
TestRoomMembers | 🟨 | 7/3/0 |
TestRoomMessagesLazyLoading | ✅ | – |
TestRoomMessagesLazyLoadingLocalUser | ✅ | – |
TestRoomReadMarkers | ✅ | – |
TestRoomReceipts | ✅ | 1/0/0 |
TestRoomSpecificUsernameAtJoin | ✅ | 5/0/0 |
TestRoomSpecificUsernameChange | ✅ | 5/0/0 |
TestRoomState | ✅ | 15/0/0 |
TestRoomSummary | ✅ | – |
TestRoomsInvite | ✅ | 9/0/0 |
TestSearch | 🟨 | 4/3/0 |
TestSendAndFetchMessage | ✅ | – |
TestSendJoinPartialStateResponse | ✅ | – |
TestSendMessageWithTxn | ✅ | – |
TestServerCapabilities | ✅ | – |
TestServerNotices | ⬛ | – |
TestSync | 🟨 | 7/5/0 |
TestSyncFilter | ✅ | 2/0/0 |
TestSyncLeaveSection | ✅ | 3/0/0 |
TestSyncOmitsStateChangeOnFilteredEvents | ✅ | – |
TestSyncTimelineGap | ✅ | 2/0/0 |
TestTentativeEventualJoiningAfterRejecting | ✅ | – |
TestThreadSubscriptions | 🟨 | 1/7/0 |
TestThreadedReceipts | ❌ | – |
TestThreadsEndpoint | ❌ | – |
TestToDeviceMessages | ✅ | – |
TestToDeviceMessagesOverFederation | ✅ | 1/0/0 |
TestTxnIdWithRefreshToken | ✅ | – |
TestTxnIdempotency | ❌ | – |
TestTxnIdempotencyScopedToDevice | ✅ | – |
TestTxnInEvent | ✅ | – |
TestTxnScopeOnLocalEcho | ✅ | – |
TestTyping | ✅ | 3/0/0 |
TestUnknownEndpoints | 🟨 | 4/1/0 |
TestUnrejectRejectedEvents | ✅ | – |
TestUploadKey | 🟨 | 6/2/0 |
TestUploadKeyIdempotency | ✅ | – |
TestUploadKeyIdempotencyOverlap | ✅ | – |
TestUrlPreview | ✅ | – |
TestUserAppearsInChangedDeviceListOnJoinOverFederation | ✅ | – |
TestVersionStructure | ✅ | 1/0/0 |
TestWithoutOwnedState | ✅ | 7/0/0 |
TestWriteMDirectAccountData | ✅ | – |