How far each capability has been proved

Two questions are asked of every capability and neither answers the other. Live validation asks whether it reads and represents Microsoft 365 correctly. Product path assurance, below, asks whether evidence from it travelled the whole product path without gaining certainty on the way.

Operator

  • 4End-to-end verified
  • 20Partially verified
  • 0Not yet verified
End-to-end verified
Evidence from this capability travelled the whole product path and an identified consumer opened the artefact it produced.
Partially verified
A real tenant was read and the evidence was produced. The rest of the path has not been verified for this capability.
Not yet verified
An acquisition was attempted and did not establish a positive read. What it did establish is recorded rather than rounded up.

Auditor

Every capability and the five stages of the product path
Capabilityacquisitionevidenceassessmentbundleconsumer
activityprovenprovenprovennot-attemptednot-attempted
agentsprovenprovennot-applicablenot-attemptednot-attempted
applicationsprovenprovennot-applicablenot-attemptednot-attempted
brand-centerprovenprovennot-applicableprovenproven
classificationprovenprovenprovennot-attemptednot-attempted
conditional-accessprovenprovenprovenprovenproven
customizationprovenprovenprovenprovennot-attempted
forwardingprovenprovenprovennot-attemptednot-attempted
groupsprovenprovennot-applicablenot-attemptednot-attempted
guestsprovenprovennot-applicablenot-attemptednot-attempted
hubsprovenprovennot-applicablenot-attemptednot-attempted
licensingprovenprovennot-applicablenot-attemptednot-attempted
modernityprovenprovenprovennot-attemptednot-attempted
ownersprovenprovenprovennot-attemptednot-attempted
permissionsprovenprovenprovennot-attemptednot-attempted
service-principalsprovenprovennot-applicablenot-attemptednot-attempted
sharingprovenprovenprovennot-attemptednot-attempted
sitesprovenprovenprovenprovennot-attempted
sites-guestsprovenprovennot-applicablenot-attemptednot-attempted
sites-ownersprovenprovennot-attemptednot-attemptednot-attempted
sites-sharingprovenprovennot-attemptednot-attemptednot-attempted
spfxprovenprovenprovenprovennot-attempted
tenant-governanceprovenprovenprovenprovenproven
tenant-sharingprovenprovenprovenprovenproven

Engineering

  • activity · when a person last changed something on one site

    Product path
    positive-acquisition-observed
    Live validation
    full
    Permissions
    not-established
    Reads
    Get-PnPWeb · Get-PnPTenantSite
  • agents · the Copilot agents in one site, and the sources each declares

    Product path
    positive-acquisition-observed
    Live validation
    full
    Permissions
    Sites.Read.All
    Reads
    Get-PnPWeb · Get-PnPCopilotAgent
  • applications · the application registrations in the directory, when each credential ends, and what each asks for

    Product path
    positive-acquisition-observed
    Live validation
    full
    Permissions
    Application.Read.All
    Reads
    GET /v1.0/applications ($select of eight properties; a credential's hint and a certificate's bytes are never kept)
  • brand-center · the organisation asset libraries a brand centre is built on, and the boundary its assets are published across

    Product path
    vertical-path-proven
    Live validation
    full
    Permissions
    Sites.FullControl.All
    Reads
    Get-PnPOrgAssetsLibrary · Get-PnPTenantCdnEnabled -CdnType Public|Private · Get-PnPTenantCdnOrigin -CdnType Public|Private · Get-PnPTenantCdnPolicies -CdnType Public
  • classification · what a site records about the kind of content it holds

    Product path
    positive-acquisition-observed
    Live validation
    full
    Permissions
    Sites.Read.All
    Reads
    Get-PnPWeb · Get-PnPSite
  • conditional-access · the Conditional Access policies, named locations and Security Defaults state of one tenant

    Product path
    vertical-path-proven
    Live validation
    full
    Permissions
    Policy.Read.All
    Reads
    GET /v1.0/identity/conditionalAccess/policies · GET /v1.0/identity/conditionalAccess/namedLocations · GET /v1.0/policies/identitySecurityDefaultsEnforcementPolicy
  • customization · the surfaces by which executable content or customization can reach a page on one site

    Product path
    positive-acquisition-observed
    Live validation
    full
    Permissions
    Sites.Read.All
    Reads
    Get-PnPWeb -Includes EffectiveBasePermissions · Get-PnPFeature -Scope Web · Get-PnPList -Identity SitePages
  • forwarding · whether mail can leave this organisation automatically, and which of the three controls that govern it are in which position

    Product path
    positive-acquisition-observed
    Live validation
    full
    Permissions
    Exchange.ManageAsApp
    Reads
    Get-HostedOutboundSpamFilterPolicy · Get-RemoteDomain
  • groups · the Microsoft 365 groups in the directory, and how many owners and members each has, by kind and never by name

    Product path
    positive-acquisition-observed
    Live validation
    full
    Permissions
    GroupMember.Read.All
    Reads
    GET /v1.0/groups ($filter to Microsoft 365 groups) · GET /v1.0/groups/{id}/owners ($select=id) · GET /v1.0/groups/{id}/members ($select=id)
  • guests · the guest accounts in the directory, by object id and never by name

    Product path
    positive-acquisition-observed
    Live validation
    full
    Permissions
    User.Read.All
    Reads
    GET /v1.0/users?$filter=userType eq 'Guest' ($select of six properties, none of which names a person)
  • hubs · the sites registered as hubs, and how each is set

    Product path
    positive-acquisition-observed
    Live validation
    full
    Permissions
    not-established
    Reads
    Get-PnPHubSite
  • licensing · what is assigned in one tenant, and whether the usage reports are permitted to name the people who hold it

    Product path
    positive-acquisition-observed
    Live validation
    partial
    Permissions
    Organization.Read.All, User.Read.All, Reports.Read.All, ReportSettings.Read.All
    Reads
    Get-MgSubscribedSku · Get-MgUser -Property assignedLicenses · GET /v1.0/admin/reportSettings · GET /v1.0/reports/getOffice365ActiveUserDetail
  • modernity · how one site is built: template, branding, publishing

    Product path
    positive-acquisition-observed
    Live validation
    full
    Permissions
    Sites.Read.All
    Reads
    Get-PnPWeb · Get-PnPList · Get-PnPFeature · Get-PnPPage
  • owners · who administers one site

    Product path
    positive-acquisition-observed
    Live validation
    full
    Permissions
    Sites.Read.All
    Reads
    Get-PnPWeb · Get-PnPSiteCollectionAdmin
  • permissions · every visible list on a site, and its inheritance

    Product path
    positive-acquisition-observed
    Live validation
    full
    Permissions
    Sites.Read.All
    Reads
    Get-PnPList · Get-PnPListItem
  • service-principals · the service principals in the directory: whether each is enabled, whose application it is, and when its own credentials end

    Product path
    positive-acquisition-observed
    Live validation
    full
    Permissions
    Application.Read.All
    Reads
    GET /v1.0/servicePrincipals ($select of eight properties; a credential's hint and a certificate's bytes are never kept)
  • sharing · what one site permits, and its default link

    Product path
    positive-acquisition-observed
    Live validation
    full
    Permissions
    not-established
    Reads
    Get-PnPWeb · Get-PnPSite · Get-PnPTenantSite
  • sites · every site this identity can enumerate

    Product path
    positive-acquisition-observed
    Live validation
    full
    Permissions
    not-established
    Reads
    Get-PnPTenantSite
  • sites-guests · which guest accounts each enumerated site has met, by object id and never by name

    Product path
    positive-acquisition-observed
    Live validation
    full
    Permissions
    not-established
    Reads
    Get-PnPTenantSite · Get-PnPUser
  • sites-owners · who administers every enumerated site, read site by site

    Product path
    positive-acquisition-observed
    Live validation
    full
    Permissions
    not-established
    Reads
    Get-PnPTenantSite · Get-PnPSiteCollectionAdmin
  • sites-sharing · what every enumerated site permits, read site by site

    Product path
    positive-acquisition-observed
    Live validation
    full
    Permissions
    not-established
    Reads
    Get-PnPTenantSite · Get-PnPTenantSite -Identity
  • spfx · a site's app catalog: which solutions lag their version

    Product path
    positive-acquisition-observed
    Live validation
    partial
    Permissions
    Sites.Read.All
    Reads
    Get-PnPApp
  • tenant-governance · what every user in a tenant may do without asking, and how many accounts hold the role that may do anything

    Product path
    vertical-path-proven
    Live validation
    full
    Permissions
    Policy.Read.All, RoleManagement.Read.Directory, Policy.Read.AuthenticationMethod
    Reads
    GET /v1.0/policies/authorizationPolicy · GET /v1.0/policies/authenticationMethodsPolicy (the method configurations are expanded by the service, so this is one read and not one per method) · GET /v1.0/roleManagement/directory/roleAssignments ($filter on the Global Administrator template, $select only) · GET /v1.0/users/{id}?$select=id,onPremisesSyncEnabled (once per principal, so that no display name is ever received)
  • tenant-sharing · what the organisation permits, which every site inherits by default

    Product path
    vertical-path-proven
    Live validation
    full
    Permissions
    not-established
    Reads
    Get-PnPTenant

In scope today

A question is counted here only when the capability that supplies its evidence has read a real tenant. Implemented is not established: a collector proved only by offline tests has been proved to behave as somebody believed the API behaves, and a collector proved only by being refused has proved nothing about what it returns when it is permitted.

Governance questions established per workload
WorkloadQuestions established
sharepoint20
entra16
exchange2

38 questions currently satisfy the publication criteria at 1.0.0b10@0c269e9d29d0.

The number never appears without the criterion. A count detached from what it counts becomes a score, and a score is the one thing this product does not publish.

The publication criteria

A question appears above only when all of these hold. The page is derived from the evidence chain, so it is not possible to publish a question that does not satisfy them: this page is a check on the product, not a description of it.

  1. the rule declares its criteria, and the basis type is published;
  2. the evidence it requires is declared;
  3. the capability supplying that evidence has a positive live read against a real tenant;
  4. a denial, an unsupported surface or an absent licence does not collapse into an empty estate;
  5. the answer is reproducible from the evidence;
  6. the limitations are published, including what a pass leaves unresolved;
  7. a third party can verify the assessment without pH7x Systems;
  8. the sources the rule rests on are identified.

Criteria 1, 2, 3, 6 and 8 are read from the manifest for every question on this page. Criteria 4, 5 and 7 hold by construction and are proved by the Engine's own gates rather than re-checked here: stated so that nobody reads this list as eight independent measurements.

Implemented, and not counted

These exist in the product and are excluded from the number above. The reason is the Engine's own sentence, not ours.

  • licensing: partially live-validated, assignment, report identifiability and one usage report were observed against a real directory; the report returned rows and named nobody, and dependency evidence is collected by nothing
  • spfx: partially live-validated, both scopes observed: a tenant catalog of ten solutions and a site catalog of one. No solution in either was behind its catalog version, so the finding branch has not been produced by a real catalog
  • SPO-SPFX-001: no capability with a proven live read supplies its evidence

Not covered

We publish no governance questions for these, and nothing here is a commitment to add them.

Exchange · Teams · Intune · Purview · Defender

How outcomes are worded

The Engine's contract values are the authority. This site translates them for reading and never redefines one; the table is published so a reader can always recover the value behind the wording.

Contract value to public wording
Contract valuePublic wording
passestablished
faildeparture from the stated criteria
unknowncould not be established
not-applicablenot applicable
invalid-evidenceevidence not usable

Reading "could not be established"

This is not a failure. It means the available evidence does not support a conclusion.

A tool that answers it is refusing to invent an answer. On some collectors it is the most common outcome, and that is the product working: a run that returned green everywhere would be the result worth distrusting. It is also the answer with the most information in it, because it names what would have to be read to decide.

What is not established about continuity

Individual assessments are tamper-evident. Complete continuity across multiple assessments is not established.

A digest detects alteration. It does not detect omission: it proves a document was not changed, and it cannot prove that none was removed. Those are different guarantees, and the difference is stated here rather than left for somebody to discover.

Generated from capability-manifest/1.0.0 at 1.0.0b10@0c269e9d29d0, contract 1.0.0b10. Every fact on this page is the Engine's; this site publishes it and does not maintain it.