
* feat: only allow metadata to be edited with PATCH request & only allow metadata files to be edited when a resource is available * fix: remove unnecesary log at POST * feat: PUT resets metadata contents + not possible to add metadata with PUT to container * feat: add metadataStrategy (auxiliaryStrategy) + use that strategy in operationhandlers * feat: PUT request on existing LDPC is not allowed as it would be possible to edit (read reset) metadata * test: add unit tests to operationhandlers to handle metadata editing * test: add unit tests to representationPatchHandler to handle metadata editing * fix: update dependency of meta.json to version 3.0.0 * fix: lint and dependency still v2 * fix: replaced file references to resource references + moved Patch check to new patchhandler which is more generic * fix: moved checking metadata resources checking from DELETE and POST handler down to DABS * fix: remove PATCH message about metadata extension * fix: move PATCH message about metadata extension * WIP: adding writeMetadata + getMetadata in DABS and add writeMetadata to DataAccessors (part 1) * WIP: implement writeMetadata in memorybackend + change resourceExists * WIP: implement writeMetadata in SparqlDataAccessor.ts * test: fix test interfaces * test: InMemoryDataAccessor.ts resulted into changing identifier for writeMetadata in DataAccessor.ts (now taking subject identifier instead of metadata resource identifier) * test: accessor tests implemented for metadata * test: add RdfImmutableCheckPatcher.test.ts * test: add tests in DataAccessorBasedStore.test.ts * test: fix template config for DynamicPods test * test: add integration tests for metadata * fix: change metaStrategy to metadataStrategy * refactor: comments updated to new location CSS on github + some alphabetical edits * refactor: remove getMetadata function in DABS as it is only used once * refactor: add DataAccessorBasedStoreArgs to DataAccessorBasedStore.ts * docs: modify documentation for writeMetadata function in DataAccessor.ts * feat: ldp:contains is also part of the metadata resource of a container * refactor: change function name and move check to DataAccessorBasedStore * fix: fix tests for DABS and PutOperationHandler * feat: avoid cloneRepresentation by introducing RdfPatcher, RdfStorePatcher and modifying ImmutableMetadataPatcher, N3Patcher, patching.json and SparqlUpdatePatcher * test: fix patcher tests * feat: create sparqlInsertMetadata in SparqlDataAccessor.ts * fix: move check during put on container if it exists already back to PutOperationHandler.ts after discussion in PR * test: update tests PutOperationHandler.ts and DataAccessorBasedStore.ts regarding previous commit * test: add converter to DABS and replace rejection on data during container creation to warning * test: implemented RdfPatcher test * feat: remove ContainerPatcher * fix: fix lint * fix: fix integration tests * refactor: fix minor issues mentioned in the PR * WIP: problem with removeResponseMetadata * refactor: remove responseMetadata in QuadToRdfConverter.ts * feat: handle ResponeMetadata when writing to the store via a patch * refactor: refactor based on comments in PR * feat: make ImmutableMetadataPatcher.ts instantiation more clear * test: achieve 100% coverage again * fix: fix lint * refactor: return to explicit arguments for the DABS * fix: return to explicit arguments for the DABS (missed one) * feat: optimise immutable checker * fix: fix, enhance docs + optimise config files * fix: DABS + QuadToRdfConverter feedback implemented * fix: patching feedback implemented * test: update operationhandler tests * test: update integration tests after feedback * test: update DABS tests after feedback * test: update ImmutableMetadataPatcher.test.ts after feedback * test: update patch tests after feedback * docs: add documentation about editing metadata * fix: config: intendation + name change + extra filters | filter pattern * docs: tsdoc added to RdfStorePatcher.ts * fix: DABS split implemented for getRepresentation + comment refactoring * docs: further documentation on removing response data on serialization * fix: DABS getRepresentation method * docs: apply feedback from Joachim on the documentation of metadata-editing.md * fix: indentation fix + fix metadata-editing.md documentation after feedback from Joachim * docs: small fix in metadata-editing.md documentation after feedback from Joachim * fix: fix metadata-editing.md documentation after feedback from Joachim * fix: fix tests meta-editing after feedback Joachim * feat: first attempt at RELEASE_NOTES.md * docs: update release notes based on feedback * docs: fix newline * fix: patching config changes after feedback * docs: metadata editing documentation changes after feedback * docs: metadata editing documentation changes after feedback * docs: metadata editing documentation changes after feedback * feat: optimisation on ImmutableMetadataPatcher.ts algorithm * feat: remove converter from DABS and add conversion for metadata resources in the RCS * fix: Fix documentation RepresentationPatchHandler.ts + fix response graph not being stored due to convertingstore * feat: make RepresentationPatcher generic * test: generic RepresentationPatcher tests * test: 100% coverage for patchers again * feat: containers can be created with POST with no content-type * feat: Immutable checks always with subject identifier * feat: create AuxiliaryLinkMetadataWriter for adding description resources Link Header * test: add tests for AuxiliaryLinkMetadataWriter and update them for ImmutableMetadataPatcher * feat: remove metadataGenerator from acl.json and fix tests accordingly * WIP: preserve metadata on PUT * feat: preserve metadata on PUT * fix: keep metadata on PATCHes * test: add unit tests for preserving metadata on PUT * fix: remove inConverter from sparql endpoint as that is already the default in the (converting.json) * fix: add metadatastrategy to RepresentationConvertingStore in regex.json * test: add integration tests for preserving metadata on PUT * docs: update release notes and adding documentation about preserving metadata on PUT * WIP: Template create setRepresentation * fix: Move container exists and not allowed check to setRepresentation * test: fix lint * fix: update configs and documentation * refactor: update and add documentation + small refactoring * refactor: update and add documentation + small refactoring + fix tests * fix: Dynamic pod config + tests * fix: TemplatedResourcesGenerator does not create containers when they already exist * fix: metadata preservation now deals with complex content types * docs: explain the case when there is no content-type * fix: minor comments
15 KiB
Community Solid Server release notes
v5.0.0
New features
- Support for Node v12 was dropped.
- Components.js was upgraded to v5. If you have created an external component you should also upgrade to prevent warnings and conflicts.
- A new FileSystemResourceLocker has been added. It allows for true threadsafe locking without external dependencies.
- The CSS can now run multithreaded with multiple workers, this is done with the
--workers
or-w
flag. - When starting the server through code, it is now possible to provide CLI value bindings as well in
AppRunner
. - The user can choose to "Log in with a different account" on the consent page
- Metadata of resources can now be edited by PATCHing its description resource. See the documentation for more information.
Data migration
The following actions are required if you are upgrading from a v4 server and want to retain your data.
...
Configuration changes
You might need to make changes to your v4 configuration if you use a custom config.
The @context
needs to be updated to
https://linkedsoftwaredependencies.org/bundles/npm/@solid/community-server/^5.0.0/components/context.jsonld
.
The following changes pertain to the imports in the default configs:
- The prefix of all imports was changed from
files-scs
tocss
. - All default configurations with a file-based backend now use a file-based locker instead of a memory-based one, making them threadsafe.
- 2 new options have been added for the
/http/server-factory/
imports:https-websockets.json
andhttps-no-websockets.json
, which allow starting the server with HTTPS by adding 2 new CLI parametershttpsKey
andhttpsCert
.
The following changes are relevant for v4 custom configs that replaced certain features.
/app/variables/*
was changed to support the newYargsCliExtractor
format andSettingsResolver
rename./util/resource-locker/memory.json
had the locker @type changed fromSingleThreadedResourceLocker
toMemoryResourceLocker
.- The content-length parser has been moved from the default configuration to the quota configurations.
/ldp/metadata-parser/default.json
/storage/backend/*-quota-file.json
/storage/backend/quota/quota-file.json
- The structure of the init configs has changed significantly to support worker threads.
/app/init/*
- RegexPathRouting has changed from a map datastructure to an array datastructure, allowing for fallthrough regex parsing. The change is reflected in the following default configs:
/storage/backend/regex.json
/sparql-file-storage.json
- The
IdentityProviderFactory
inputs have been extended./identity/handler/provider-factory/identity.json
- LDP components have slightly changed so the preference parser is in a separate config file.
/ldp/handler/*
- Restructured the init configs.
/app/init/base/init.json
/app/main/default.json
- Added lock cleanup on server start (and updated existing finalization).
/util/resource-locker/file.json
/util/resource-locker/redis.json
- Updated finalizers.
/app/identity/handler/account-store/default.json
/identity/ownership/token.json
/ldp/authorization/readers/access-checkers/agent-group.json
/ldp/handler/*
IntermediateModesExtractor
has been added to theModesExtractors
/ldp/modes/default.json
- The
PermissionReader
structure has changed to be more consistent./ldp/authorization/*
- The
PutOperationHandler
constructor now has an extra argument:metadataStrategy
, resulting in a change in/ldp/handler/components/operation-handler.json
.acl
and.meta
are now generated for every non-auxiliary byAuxiliaryLinkMetadataWriter
through an update in/util/auxiliary/strategies/acl.json
and the creation of/ldp/metadata-writer/writers/link-rel-metadata.json
- As a result the key-value for
acl
resources was removed from/ldp/metadata-writer/writers/link-rel.json
- As a result the key-value for
- The
DataAccessorBasedStore
constructor now has two new arguments:metadataStrategy
. As a result following configuration files are changed:/sparql-file-storage.json
/storage/backend/*
/storage/middleware/stores/patching.json
has changed significantly to allow description resources to be patched.- The metadata auxiliary strategy was added to the default list of auxiliary strategies.
/util/auxiliary/*
- Parsing link headers is updated in
/ldp/metadata-parser/parsers/link.json
as it now uses aLinkRelObject
as a value
Interface changes
These changes are relevant if you wrote custom modules for the server that depend on existing interfaces.
YargsCliExtractor
was changed to now take as input an array of parameter objects.RedirectAllHttpHandler
was removed and fully replaced byRedirectingHttpHandler
.SingleThreadedResourceLocker
has been renamed toMemoryResourceLocker
.- Both
TemplateEngine
implementations now take abaseUrl
parameter as input. - The
IdentityProviderFactory
andConvertingErrorHandler
now additionally take aPreferenceParser
as input. - Error handlers now take the incoming HttpRequest as input instead of just the preferences.
- Extended the initialization/finalization system:
- Introduced
Initializable
interface andInitializableHandler
wrapper class. - Introduced
Finalizer
abstract class andFinalizableHandler
wrapper class. - Changed type for
finalizer
attribute inApp
fromFinalizable
toFinalizer
and updated the calling code inApp.stop()
. - Removed the now obsolete
ParallelFinalizer
util class.
- Introduced
- Added a lock cleanup on initialize for lock implementations
RedisLocker
andFileSystemResourceLocker
. ResourceStore
functions that change a resource now return metadata for every changed resource.- All permission related interfaces have changed to support permissions over multiple identifiers.
IdentifierStrategy
has a newcontains
method.SettingsResolver
was renamed toShorthandResolver
, together with all related classes and parameters.DataAccessor
interface is changed. There is now a new method calledwriteMetadata
.
A new interface SingleThreaded
has been added. This empty interface can be implemented to mark a component as not-threadsafe. When the CSS starts in multithreaded mode, it will error and halt if any SingleThreaded components are instantiated.
v4.0.1
Freezes the oidc-provider
dependency to prevent a potential issue with the solid authn client
as described in https://github.com/inrupt/solid-client-authn-js/issues/2103.
v4.0.0
New features
- The server can be started with a new parameter to automatically generate accounts and pods, for more info see here.
- It is now possible to automate authentication requests using Client Credentials, for more info see here.
- A new
RedirectingHttpHandler
class has been added which can be used to redirect certain URLs. - A new default configuration
config/https-file-cli.json
that can set the HTTPS parameters through the CLI has been added. This is also an example of how to add CLI parameters through a custom configuration. - A new RedisLocker has been added to replace the old RedisResourceLocker class. It allows for true threadsafe read/write locking.
Configuration changes
You might need to make changes to your v3 configuration if you use a custom config.
The @context
needs to be updated to
https://linkedsoftwaredependencies.org/bundles/npm/@solid/community-server/^4.0.0/components/context.jsonld
.
The following changes pertain to the imports in the default configs:
- ...
The following changes are relevant for v3 custom configs that replaced certain features.
- The key/value storage configs in
config/storage/key-value/*
have been changed to reduce config duplication. All storages there that were only relevant for 1 class have been moved to the config of that class. - Due to a parameter rename in
CombinedSettingsResolver
,config/app/variables/resolver/resolver.json
has been updated. - The OIDC provider setup was changed to add client_credentials support.
/identity/handler/adapter-factory/webid.json
/identity/handler/provider-factory/identity.json
Interface changes
These changes are relevant if you wrote custom modules for the server that depend on existing interfaces.
- The output of
parseContentType
inHeaderUtil
was changed to include parameters. PermissionReader
s take an additionalmodes
parameter as input.- The
ResourceStore
functionresourceExists
has been renamed tohasResource
and has been moved to a separateResourceSet
interface. - Several
ModesExtractor
sPermissionBasedAuthorizer
now take aResourceSet
as constructor parameter. RepresentationMetadata
no longer accepts strings for predicates in any of its functions.CombinedSettingsResolver
parametercomputers
has been renamed toresolvers
.IdentityProviderFactory
requires an additionalcredentialStorage
parameter.- The
RedisResourceLocker
class has been removed and theRedisLocker
class was added instead.RedisLocker
implements both theResourceLocker
andReadWriteLocker
interface.
v3.0.0
New features
- The Identity Provider now uses the
webid
scope as required for Solid-OIDC. - The
VoidLocker
can be used to disable locking for development/testing purposes. This can be enabled by changing the/config/util/resource-locker/
import todebug-void.json
- Added support for setting a quota on the server. See the
config/quota-file.json
config for an example. - An official docker image is now built on each version tag and published at https://hub.docker.com/r/solidproject/community-server.
- Added support for N3 Patch.
- It is now possible to customize arguments to the
community-solid-server
command, which enables passing custom variables to configurations and setting new default values. - The AppRunner functions have changed to require Components.js variables. This is important for anyone who starts the server from code.
- When logging in, a consent screen will now provide information about the client.
Data migration
The following actions are required if you are upgrading from a v2 server and want to retain your data.
Due to changes in the keys used by the IDP, you will need to delete the stored keys and sessions.
If you are using a file backend, delete the .internal/idp/
folder in your data folder and restart the server.
This will not delete the user accounts, but users will have to log in again.
Configuration changes
You might need to make changes to your v2 configuration if you use a custom config.
The @context
needs to be updated to
https://linkedsoftwaredependencies.org/bundles/npm/@solid/community-server/^3.0.0/components/context.jsonld
.
The following changes pertain to the imports in the default configs:
- A new configuration option needs to be imported:
/app/variables/default.json
contains everything related to parsing CLI arguments and assigning values to variables.
The following changes are relevant for v2 custom configs that replaced certain features.
- Conversion has been simplified so most converters are part of the conversion chain:
/util/representation-conversion/default.json
- The IDP settings have changed to support the latest Solid-OIDC draft.
/identity/handler/provider-factory/identity.json
- Requests targeting the OIDC library now use a separate handler.
/http/handler/default.json
/identity/handler/default.json
- The architecture of IDP interaction handlers has completely changed to improve modularity
/identity/handler/interaction/*
/identity/registration/*
Interface changes
These changes are relevant if you wrote custom modules for the server that depend on existing interfaces.
TypedRepresentationConverter
function signatures changed and base functionality moved toBaseTypedRepresentationConverter
.- Many changes to several components related to the IDP. This includes the HTML templates.
v2.0.0
New features
- Pod owners always have Control access to resources stored in their Pod.
- The server now offers a one-time setup upon first boot.
This can be accessed by going to
/setup
. Configurations with a persistent backend enforce setup before the server can be used, preventing unintended modifications in the backend. These have corresponding*-no-setup.json
files where setup is disabled, so the pre-v2.0 behavior is still available. ETag
,Last-Modified
,If-None-Match
, and related conditional headers are supported.PATCH
ing containers is now supported.PUT
/POST
requests with empty bodies are supported.- WebACL authorization supports groups.
- IDP components (registration, login, etc.) fully support JSON input and output.
- There is a new configuration
sparql-file-storage.json
to have a SPARQL backend with file storage.sparql-file-storage.json
. - A server can be set up to restrict access to IDP components using WebACL.
A consequence of this is that IDP components are only accessible using a trailing slash.
E.g.,
/idp/register/
works,/idp/register
will error.
Configuration changes
You might need to make changes to your v1 configuration if you use a custom config.
The following changes pertain to the imports in the default configs:
- There are 2 new configuration options that for which a valid option needs to be imported:
/app/setup
determines how and if setup should be enabled./identity/access
determines if IDP access (e.g., registration) should be restricted
- The
/app/init/default.json
configuration no longer initializes the root container. This behaviour has been moved to the other options for/app/init
. /ldp/permissions
changed to/ldp/modes
and only has a default option now.
The following changes are relevant for v1 custom configs that replaced certain features. The path indicates which JSON-LD files were impacted by the change.
IdentityProviderHttpHandler
andInteractionRoute
arguments have changed substantially./identity/handler/default.json
/identity/handler/interaction/*
/identity/registration/*
.
- All internal storage is now stored in the
/.internal/
container./storage/key-value/resource-store.json
.
- Patching related classes have changed.
/storage/middleware/stores/patching.json
.
BasicRequestParser
now needs aconditionsParser
argument./ldp/handler/components/request-parser.json
.
LinkTypeParser
has been renamed toLinkRelParser
and now takes mappings as input./ldp/metadata-parser/*
ComposedAuxiliaryStrategy
isRootRequired
has been renamed torequiredInRoot
./util/auxiliary/strategies/acl.json
.
- Many changes to authentication and authorization structure.
- Config
/ldp/authentication/*
and/ldp/authorization/*
.
- Config
- All
HttpHandler
s have been changed./app/setup/handlers/setup.json
/http/handler/default.json
/identity/handler/default.json
/ldp/handler/default.json
.
v1.1.0
New features
- The
ConstantConverter
can now filter on media type using theenabledMediaRanges
anddisabledMediaRanges
options. That way, the server can be configured to bypass a default UI when accessing images or PDF documents. (https://github.com/solid/community-server/discussions/895, https://github.com/solid/community-server/pull/925)
v1.0.0
First release of the Community Solid Server.