Keyboard shortcuts

Press ← or → to navigate between chapters

Press S or / to search in the book

Press ? to show this help

Press Esc to hide this help

Tuwunel Complement Test Results

Tuwunel runs the Complement Matrix homeserver acceptance suite. Raw results are committed to tests/complement/results.jsonl; full server and test logs to tests/complement/logs.jsonl.

Counts

  • Test groups: 207. Passing: 84.1%

    • ✅ pass: 174
    • 🟨 some: 15
    • ❌ fail: 18
    • ⬛ skip: 0

  • Subtests: 595. Passing: 78.8%

    • ✅ pass: 469
    • ❌ fail: 118
    • ⬛ skip: 8

All Top-Level Tests

StatusSubtestsTest
✅–ACLs
✅–ACLsForEDUs
✅2/0/0AddAccountData
🟨3/2/1ArchivedRoomsHistory
✅6/0/0AsyncUpload
✅–AvatarUrlUpdate
✅–BannedUserCannotSendJoin
✅–CanRegisterAdmin
✅–CannotKickLeftUser
✅–CannotKickNonPresentUser
✅6/0/0CannotSendKnockViaSendKnockInMSC3787Room
✅6/0/0CannotSendNonJoinViaSendJoinV2
✅6/0/0CannotSendNonKnockViaSendKnock
✅6/0/0CannotSendNonLeaveViaSendLeaveV2
✅5/0/0ChangePassword
✅2/0/0ChangePasswordPushers
🟨1/4/0ClientSpacesSummary
✅–ClientSpacesSummaryJoinRules
✅–ComplementCanCreateValidV12Rooms
✅–Content
✅–ContentCSAPIMediaV1
✅–ContentMediaV1
❌–CorruptedAuthChain
✅–CumulativeJoinLeaveJoinSync
✅4/0/0DeactivateAccount
🟨6/7/1DelayedEvents
✅1/0/0DeletingDeviceRemovesDeviceLocalNotificationSettings
✅–DemotingUsersViaUsersDefault
🟨8/2/0DeviceListUpdates
✅2/0/0DeviceListsUpdateOverFederation
❌–DeviceListsUpdateOverFederationOnRoomJoin
✅7/0/0DeviceManagement
✅–DisplayNameUpdate
✅3/0/0E2EKeyBackupReplaceRoomKeyRules
✅3/0/0Event
✅2/0/0EventAuth
❌–EventRelationships
✅–FederatedClientSpaces
❌–FederatedEventRelationships
🟨1/1/0FederationKeyUploadQuery
✅–FederationRedactSendsWithoutEvent
✅–FederationRejectInvite
✅10/0/0FederationRoomsInvite
✅2/0/0FederationSlidingSyncReInviteAfterLeave
✅–FederationThumbnail
✅–FetchEvent
✅–FetchEventNonWorldReadable
✅–FetchEventWorldReadable
✅–FetchHistoricalInvitedEventFromBeforeInvite
✅–FetchHistoricalInvitedEventFromBetweenInvite
✅–FetchHistoricalJoinedEventDenied
✅–FetchHistoricalSharedEvent
✅–FetchMessagesFromNonExistentRoom
✅–Filter
❌–FilterMessagesByRelType
✅–GappedSyncLeaveSection
✅3/0/0GetFilteredRoomMembers
✅–GetMissingEventsGapFilling
✅–GetRoomMembers
❌–GetRoomMembersAtPoint
✅4/0/0InboundCanReturnMissingEvents
✅–InboundFederationKeys
✅2/0/0InboundFederationProfile
❌–InboundFederationRejectsEventsWithRejectedAuthEvents
🟨3/8/0InviteFiltering
✅–InviteFromIgnoredUsersDoesNotAppearInSync
✅–IsDirectFlagFederation
✅–IsDirectFlagLocal
✅–JoinFederatedRoomFailOver
✅1/0/0JoinFederatedRoomFromApplicationServiceBridgeUser
✅4/0/0JoinFederatedRoomWithUnverifiableEvents
✅–JoinViaRoomIDAndServerName
✅3/0/0Json
✅7/0/0JumpToDateEndpoint
✅1/0/0KeyChangesLocal
✅–KeyClaimOrdering
✅–KeysQueryWithDeviceIDAsObjectFails
✅–KnockRestrictedRoomsLocalJoinNoCreatorsUsesPowerLevelsV11
✅–KnockRestrictedRoomsLocalJoinNoCreatorsUsesPowerLevelsV12
✅–KnockRoomsInPublicRoomsDirectory
✅–KnockRoomsInPublicRoomsDirectoryInMSC3787Room
✅25/0/0Knocking
✅25/0/0KnockingInMSC3787Room
✅–LeakyTyping
✅–LeaveEventInviteRejection
❌–LeaveEventVisibility
🟨2/3/0LeftRoomFixture
✅2/0/0LocalPngThumbnail
✅8/0/0Login
✅4/0/0Logout
❌–MSC3757OwnedState
✅–MSC3967
✅11/0/0MSC4289PrivilegedRoomCreators
✅–MSC4289PrivilegedRoomCreators_Additional
✅–MSC4289PrivilegedRoomCreators_AdditionalCreatorsAndInvited
✅5/0/0MSC4289PrivilegedRoomCreators_AdditionalValidation
✅–MSC4289PrivilegedRoomCreators_InvitedAreCreators
✅–MSC4289PrivilegedRoomCreators_Upgrades
✅–MSC4291RoomIDAsHashOfCreateEvent
✅–MSC4291RoomIDAsHashOfCreateEvent_AuthEventsOmitsCreateEvent
✅–MSC4291RoomIDAsHashOfCreateEvent_CannotSendCreateEvent
✅–MSC4291RoomIDAsHashOfCreateEvent_RoomIDIsOnCreateEvent
✅–MSC4291RoomIDAsHashOfCreateEvent_UpgradedRooms
✅–MSC4297StateResolutionV2_1_includes_conflicted_subgraph
✅–MSC4297StateResolutionV2_1_starts_from_empty_set
❌0/2/0MSC4308ThreadSubscriptionsSlidingSync
✅–MSC4311FullCreateEventOnStrippedState
✅–MediaConfig
✅25/0/0MediaFilenames
✅4/0/0MediaWithoutFileName
✅4/0/0MediaWithoutFileNameCSMediaV1
🟨3/2/0MembersLocal
❌–MembershipOnEvents
🟨3/2/0MessagesOverFederation
✅–NetworkPartitionOrdering
✅–NotPresentUserCannotBanOthers
✅–OlderLeftRoomsNotInLeaveSection
❌–OutboundFederationEventSizeGetMissingEvents
❌–OutboundFederationIgnoresMissingEventWithBadJSONForRoomVersion6
✅1/0/0OutboundFederationProfile
✅–OutboundFederationSend
❌0/59/6PartialStateJoin
✅1/0/0PollsLocalPushRules
✅3/0/0PowerLevels
🟨4/1/0Presence
✅–PresenceSyncDifferentRooms
✅2/0/0ProfileAvatarURL
✅2/0/0ProfileDisplayName
✅9/0/0PublicRooms
✅–PushRuleCacheHealth
✅5/0/0PushRuleRoomUpgrade
✅5/0/0PushSync
✅1/0/0Redact
✅23/0/0Registration
✅–Relations
✅–RelationsPagination
✅–RelationsPaginationSync
✅–RemoteAliasRequestsUnderstandUnicode
✅2/0/0RemotePngThumbnail
❌0/2/0RemotePresence
✅–RemoteTyping
✅4/0/0RemovingAccountData
✅1/0/0RequestEncodingFails
✅5/0/0RestrictedRoomsLocalJoin
✅5/0/0RestrictedRoomsLocalJoinInMSC3787Room
✅–RestrictedRoomsLocalJoinNoCreatorsUsesPowerLevelsV11
✅–RestrictedRoomsLocalJoinNoCreatorsUsesPowerLevelsV12
✅5/0/0RestrictedRoomsRemoteJoin
✅5/0/0RestrictedRoomsRemoteJoinInMSC3787Room
✅–RestrictedRoomsRemoteJoinLocalUser
✅–RestrictedRoomsRemoteJoinLocalUserInMSC3787Room
✅–RestrictedRoomsSpacesSummaryFederation
✅–RestrictedRoomsSpacesSummaryLocal
✅5/0/0RoomAlias
✅10/0/0RoomCanonicalAlias
✅15/0/0RoomCreate
✅6/0/0RoomCreationReportsEventsToMyself
🟨7/2/0RoomDeleteAlias
🟨6/2/0RoomForget
✅–RoomImageRoundtrip
✅10/0/0RoomMembers
✅–RoomMessagesLazyLoading
✅–RoomMessagesLazyLoadingLocalUser
✅–RoomReadMarkers
✅1/0/0RoomReceipts
✅5/0/0RoomSpecificUsernameAtJoin
✅5/0/0RoomSpecificUsernameChange
✅15/0/0RoomState
✅–RoomSummary
✅2/0/0RoomSummaryAllowedRoomIDs
✅9/0/0RoomsInvite
✅7/0/0Search
✅–SendAndFetchMessage
✅–SendJoinPartialStateResponse
✅–SendMessageWithTxn
✅–ServerCapabilities
❌0/8/0ServerNotices
✅–SharedHistoryAfterLeaving
✅–StateDedupRequiresJoinedSender
🟨10/3/0Sync
✅2/0/0SyncFilter
✅3/0/0SyncLeaveSection
✅–SyncOmitsStateChangeOnFilteredEvents
✅2/0/0SyncTimelineGap
✅–TentativeEventualJoiningAfterRejecting
🟨1/7/0ThreadSubscriptions
❌–ThreadedReceipts
✅–ThreadsEndpoint
✅–ToDeviceMessages
✅1/0/0ToDeviceMessagesOverFederation
✅–TxnIdWithRefreshToken
❌–TxnIdempotency
✅–TxnIdempotencyScopedToDevice
✅–TxnInEvent
✅–TxnScopeOnLocalEcho
✅3/0/0Typing
✅–UnbanViaInvite
🟨4/1/0UnknownEndpoints
✅–UnrejectRejectedEvents
✅8/0/0UploadKey
✅–UploadKeyIdempotency
✅–UploadKeyIdempotencyOverlap
✅–UrlPreview
✅–UserAppearsInChangedDeviceListOnJoinOverFederation
✅1/0/0VersionStructure
✅7/0/0WithoutOwnedState
✅–WriteMDirectAccountData