You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
What does arocapi 5 beta (5.0.0-beta.10 installed; check the latest beta and the main branch too) offer, or plan, that an indexer should build on? Specifically:
Its storage backends (storage/ocfl, storage/entity-meta, storage/s3, storage/directory): what each reads and whether any of them derive entities or file meta that ldacapi currently builds itself.
What arocapi reads from Entity and File rows (columns, meta keys) and from search documents, so we know the minimum an indexer must write.
Whether arocapi has or plans any indexer, ingest or deposit code, a deposit extension, or roCrateIds (an entity belonging to several crates).
The SearchBackend / OpenSearchBackend surface: bulk writes, per-call refresh, index settings and mappings.
Anything on its roadmap or open issues that would change the arocapi boundary (Indexer: redesign storage, indexing and index state #47's candidates: deriveUniqueEntityIds, pickSingleMemberOf, entityAsCrate, file storage meta, shared-entity upserts, a meta.crateId index).
Checked arocapi 5.0.0-beta.10 (installed). The latest beta and main have the same code: main is beta.10 plus one docs commit. Also checked arocapi's issues, PRs and ADRs, the docs site, and the RO-Crate API spec's deposit page.
None of them derives entities or file meta. OcflStorage, DirectoryStorage and S3Storage read a location the indexer wrote into meta (ocflObject+ocflPath, storagePath, storageKey), or a consumer locate function. EntityMetaMetadata serves whatever object is in Entity.meta.rocrate. None lists objects or parses crates (src/storage/*, arocapi ADR 0004).
The storage contract has no writes. A future deposit API would add a write key and locate files through locate (ADR 0004).
What arocapi reads
Entity: the eight Record columns (id, name, description, entityType, memberOf, rootCollection, two licence ids). memberOf and rootCollection are resolved to {id,name}, and a missing parent comes back as null. /entities sorts on createdAt/updatedAt too. The model has indexes on memberOf, rootCollection and entityType only, none on meta.
File: filename, mediaType, size and meta (storage keys). /files?memberOf= filters on the file entity'smemberOf.
arocapi itself reads only the storage keys from meta. The whole row goes to the consumer's access function and transformers.
Search: arocapi uses only hit ids, then loads Entity rows, dropping hits without a visible row. arocapi never derives a search document from an entity (ADR 0003). Fields used by searchVisibilityFilter must be in every document.
Indexer, deposit, roCrateIds
None of these exists or is planned in arocapi. Its Prisma surface is read-only (findMany/findFirst/count), and /capabilities hard-codes deposit: { supported: false }. The docs say deposit is "coming soon", but there is no issue, branch or design. The old "crate exploder" (Write a "crate exploder" that can split a bundled crate into nice small parts crate-works/arocapi#1) was closed in March 2026, deferring to ldacapi.
roCrateIds comes from the RO-Crate API spec's deposit section, not arocapi. Materialisation is implementation-defined and may be many-to-one (one entity, several crates). The field is optional. arocapi's models have no such column.
SearchBackend / OpenSearchBackend
The contract is index(docs, {tx?}) (upsert) and remove(ids) (idempotent). It has no count or clear: a rebuild is the consumer looping index.
OpenSearchBackend.index validates the whole batch, then sends oneclient.bulk (no chunking). It throws on the first failed item, and the bulk isn't atomic. It doesn't check that entity rows exist.
refresh (boolean | 'wait_for') is a factory option applied to every write. There is no per-call refresh.
createIndex() sets strict mappings from the field declarations and throws on a differing mapping. It sets no index settings.
Activity
johnf commentedon Nov 17, 2026
Resolution
Checked arocapi
5.0.0-beta.10(installed). The latest beta andmainhave the same code:mainis beta.10 plus one docs commit. Also checked arocapi's issues, PRs and ADRs, the docs site, and the RO-Crate API spec's deposit page.Findings:
docs/research/arocapi-5-beta-indexer.mdon branchresearch/arocapi-5-beta-indexer.Storage backends
OcflStorage,DirectoryStorageandS3Storageread a location the indexer wrote intometa(ocflObject+ocflPath,storagePath,storageKey), or a consumerlocatefunction.EntityMetaMetadataserves whatever object is inEntity.meta.rocrate. None lists objects or parses crates (src/storage/*, arocapi ADR 0004).OcflStorageopens one object per request and serves its head version. Size, ETag and last-modified come from OCFL, and Content-Type fromFile.mediaType.ocflPathis the decoded logical path (OCFL backend: object mapping, versions and delivery crate-works/arocapi#114).locate(ADR 0004).What arocapi reads
Entity: the eight Record columns (id,name,description,entityType,memberOf,rootCollection, two licence ids).memberOfandrootCollectionare resolved to{id,name}, and a missing parent comes back asnull./entitiessorts oncreatedAt/updatedAttoo. The model has indexes onmemberOf,rootCollectionandentityTypeonly, none onmeta.File:filename,mediaType,sizeandmeta(storage keys)./files?memberOf=filters on the file entity'smemberOf.meta. The whole row goes to the consumer'saccessfunction and transformers.Entityrows, dropping hits without a visible row. arocapi never derives a search document from an entity (ADR 0003). Fields used bysearchVisibilityFiltermust be in every document.Indexer, deposit,
roCrateIdsfindMany/findFirst/count), and/capabilitieshard-codesdeposit: { supported: false }. The docs say deposit is "coming soon", but there is no issue, branch or design. The old "crate exploder" (Write a "crate exploder" that can split a bundled crate into nice small parts crate-works/arocapi#1) was closed in March 2026, deferring to ldacapi.roCrateIdscomes from the RO-Crate API spec's deposit section, not arocapi. Materialisation is implementation-defined and may be many-to-one (one entity, several crates). The field is optional. arocapi's models have no such column.SearchBackend/OpenSearchBackendindex(docs, {tx?})(upsert) andremove(ids)(idempotent). It has no count or clear: a rebuild is the consumer loopingindex.OpenSearchBackend.indexvalidates the whole batch, then sends oneclient.bulk(no chunking). It throws on the first failed item, and the bulk isn't atomic. It doesn't check that entity rows exist.refresh(boolean | 'wait_for') is a factory option applied to every write. There is no per-call refresh.createIndex()sets strict mappings from the field declarations and throws on a differing mapping. It sets no index settings.Roadmap against #47's candidates
settingsoption for the index it creates crate-works/arocapi#143 (open) proposes a pass-throughsettingsoption.deriveUniqueEntityIds,pickSingleMemberOf,entityAsCrate, file storage meta, shared-entity upserts and ameta.crateIdindex aren't mentioned anywhere upstream.countsbelongs to the consumer, and asks whether table and column names become stable for raw SQL.entityVisibilityFiltercan't reach consumer-owned tables, because Prisma can't do one-sided relations. So arocapi's queries can't join to an ldacapi-owned crate↔entity table today.