57 Commits

Author SHA1 Message Date
Ruben Verborgh
17d774fc18 chore: Add SPARQL endpoint logging. 2020-11-04 10:31:54 +01:00
Joachim Van Herwegen
ef6f01a82c refactor: Change PreferenceSupport constructor to work with Components.js 2020-11-03 10:38:22 +01:00
Joachim Van Herwegen
50dfea1a27 refactor: Change routing constructors to work with Components.js 2020-11-02 15:41:32 +01:00
Joachim Van Herwegen
5287cd1e41 feat: Create a RoutingResourceStore that takes routing rules 2020-11-02 15:41:32 +01:00
Joachim Van Herwegen
dee4eef131 refactor: Change constructor so it is supported by Components.js 2020-11-02 15:04:05 +01:00
Joachim Van Herwegen
712a690904 feat: Update RepresentationConvertingStore to convert incoming data 2020-11-02 15:04:05 +01:00
Joachim Van Herwegen
9f7c246104 feat: Support SPARQL store backends 2020-11-02 15:04:05 +01:00
iesmessa
dff4ba8efe fix: Write tests and fix related bugs, refactor code 2020-11-02 15:04:05 +01:00
Ruben Verborgh
4b4f737013 chore: Use Jest recommended linting. 2020-11-02 10:03:18 +01:00
Ruben Verborgh
0476ba8069
chore(deps): update all dependencies (#293) 2020-11-02 09:08:14 +01:00
smessie
99464d9a95
feat: Add logging
* feat: Add logging

* refactor: Configure the logger for the tests once globally

* feat: Add logging

* fix: Fix ESLint errors due to merge conflicts

* Review log and error messages.

* refactor: Cleanup a bit

* refactor: Change to logger info calls

Co-authored-by: Ruben Verborgh <ruben@verborgh.org>
2020-10-26 10:31:01 +01:00
Joachim Van Herwegen
4df26454d4 refactor: Make ExtensionBasedMapper only expose what is needed 2020-10-16 09:35:48 +02:00
Joachim Van Herwegen
03c64e5617 refactor: Remove file and in memory stores 2020-10-16 09:35:48 +02:00
Joachim Van Herwegen
63f891c0f1 fix: Remove metadata file if no new metadata is stored 2020-10-14 15:35:22 +02:00
Joachim Van Herwegen
e861b080c2 feat: Fully support storing content-type in file extensions 2020-10-14 15:20:26 +02:00
Joachim Van Herwegen
626b3114f4 refactor: Rename instances of data resource to document 2020-10-14 15:20:26 +02:00
Joachim Van Herwegen
b896004bac feat: Create InMemoryDataAccessor 2020-10-14 11:32:27 +02:00
Joachim Van Herwegen
9a857b7581 feat: Create file-based DataAccessor 2020-10-14 11:32:27 +02:00
Joachim Van Herwegen
6ad40763f9 feat: Create DataAccessorBasedStore to have a standard store implementation 2020-10-14 11:32:27 +02:00
Joachim Van Herwegen
b47dc3f7f6 feat: Have ExtensionBasedMapper handle extensions correctly 2020-10-07 09:31:08 +02:00
smessie
d8e6c08859 refactor: Remove Turtle to Quad and Quad to Turtle converters 2020-09-30 09:12:42 +02:00
Joachim Van Herwegen
9657fbafb1 refactor: Update eslint related dependencies 2020-09-17 11:55:49 +02:00
Joachim Van Herwegen
85df2e5d7f refactor: Make URI constants consistent 2020-09-16 13:18:58 +02:00
Joachim Van Herwegen
8d3979372b refactor: Streamline RepresentationMetadata interface 2020-09-16 12:10:42 +02:00
Joachim Van Herwegen
76319ba360 feat: Update RepresentationMetadata to store triples 2020-09-16 12:10:42 +02:00
Ruben Taelman
1dd140ab61 refactor: Remove RuntimeConfig in favor of config variables, Closes #106 2020-09-15 08:52:23 +02:00
Joachim Van Herwegen
b1991cb08a
feat: More integration tests and test configs (#154)
* add todo

* Added configurations folder

* Added config to index

* changed /bin/server to use configfiles

* initiate acl with Setup component

* add last changes

* reset serverconfig

* move authenticatedLdpHandler configs to config files

* failed to read testss

* failed to read testss

* removed import part

* Fix merge conflicts

* add first FileResTests

* fix: fix fileresourcestore metadata error

* fix unit tests

* remove test files

* Added test and changed callFile

* Fix: metadata file error in FileResourceStore

* fix: ensure full test coverage

* added tests

* Fix get tests

* added testfiles

* changed config to use PasstrueStore

* to continue work on

* refactor fileresourcestore config

* refactor tests

* fix content-types, update tests

* replace sync methods with async methods

* move acl function to util

* added testfiles for Fileserver with acl

* update tests

* add first acl filestore test

* refactor

* add resource mapper

* refactor config files

* add more fileresourcestore acl tests

* add locking resource store test files

* move file mapping logic to resourcemapper

* added beforeAll for a permanent file in Auht tests

* make filestore dependent of resource mapper

* moved configs to test/configs

* set default contenttype

* refactor fileresourcemapper

* fix map function

* refactor

* fixed foldercreationtest

* changed some tests so the files are cleaned up when done testing

* add normalized parser

* Auhtenticationtests clean up acl file

* refactor unit test

* lost changes added again

* fix metadata problem

* refactor names

* reverse change

* add getters

* configs and start util

* add comments

* add comments, move code

* added acl helper and changed tests

* linter 7.7.0 -> 7.0.0

* moved test/tesfiles -> test/assets

* removed configs/**/*.ts from tsconfig.json

* Temporary changed threshold so cli test is ignored and commiting goes easier, will revert later

* added FileResourceStore to index

* Changed imports

* Changed imports for all configs

* Removed comment

* Changed names of configs

* added 'Config' to name and removed comment

* removed unused testfile and added testfile 0

* changed beforeAll to just copy permanent file

* change text/turtle to constant

* fix converter issue

* getHandler -> getHttpHandler, and updates to config

* removed ','

* removed trailing /

* changed imports for index.d.js problem

* removed duplicate file and added line that got removed in mergeconflicts

* add jest global teardown

* add ignore for CliRunner

* add changes

* fix copyfile error

* remove unused testfiles

* adding test with image

* add first util functions

* relative paths to absolute paths

* added 3 FileStoreTests

* more refactoring

* more absolute paths

* fix mkdir path

* added test

* add util for easy configs

* add comments

* added some testhelpers and refactor first test

* fix converter test error

* refactor FileResTests

* solved failing test because new converters

* removed afterAll()

* removed setAcl from util

* removed config from Authorization.test.ts

* changed strange linting

* refactored AuthenticatedFileResourceStore tests

* fixed unclear root variable

* fix: Use absolute test paths

* Mock fs correctly and remove teardown

* Clean up after tests

Co-authored-by: freyavs <freyavanspeybroeck@outlook.com>
Co-authored-by: thdossch <dossche.thor@gmail.com>
Co-authored-by: Freya <56410697+freyavs@users.noreply.github.com>
Co-authored-by: thdossch <49074469+thdossch@users.noreply.github.com>
Co-authored-by: Ruben Verborgh <ruben@verborgh.org>
2020-09-14 16:06:27 +02:00
Freya
383da24601
feat: Implement resource mapper for the file resource store (#142)
* move file mapping logic to resourcemapper

* make filestore dependent of resource mapper

* set default contenttype

* refactor fileresourcemapper

* fix map function

* refactor

* add normalized parser

* refactor unit test

* fix metadata problem

* refactor names

* reverse change

* add getters

* add comments

* add comments, move code

* change text/turtle to constant

* add changes

* add requested changes

* add more requested changes

* add more requested changes

* more changes
2020-09-11 17:08:53 +02:00
Ruben Taelman
0ed1ae539d lint: enable no-extraneous-dependencies rule
This also uses the new `import type` syntax for importing rdf-js types,
as it is required for making this new linter rule pass.

Closes #132
2020-09-07 08:46:08 +02:00
Joachim Van Herwegen
c808dfeff0
fix: metadata file error in FileResourceStore
* Fix: metadata file error in FileResourceStore

* fix: ensure full test coverage

* add stream piping function in util

* Fix typing in util function

* Add requested changes

* add suggested changes

* add suggested change

Co-authored-by: freyavs <freyavanspeybroeck@outlook.com>
2020-09-04 09:12:35 +02:00
Joachim Van Herwegen
785ec1ee07 fix: Don't buffer data before sending response with InMemoryResourceStore 2020-09-03 11:13:08 +02:00
Ruben Verborgh
85e3117efe refactor: Drop CONTENT_TYPE prefix 2020-09-03 09:52:48 +02:00
Ruben Verborgh
c5c5d13570 refactor: Replace dataType by binary flag 2020-09-03 09:52:48 +02:00
Joachim Van Herwegen
199d657097 refactor: Remove overused "Simple" prefix 2020-09-02 15:42:13 +02:00
Joachim Van Herwegen
af4a82f4c1 feat: Dynamically determine matching types in ChainedConverter 2020-09-01 15:39:10 +02:00
Joachim Van Herwegen
734f7e7f0f feat: Create RepresentationConverter that chains other converters 2020-09-01 15:39:10 +02:00
Ruben Taelman
2c3ae4eded Add generic QuadToRdfConverter 2020-09-01 11:49:49 +02:00
Ruben Taelman
f08e97b80c fix: failing conversion test due to N3 update 2020-09-01 09:00:15 +02:00
Ruben Taelman
e88e680ed7 feat: add support for parsing more RDF formats using rdf-parse 2020-08-31 12:01:47 +02:00
Ruben Taelman
48740e5cba style: improve linting of imports
A new plugin is used that offers autofixing capabilities.
2020-08-26 13:20:19 +02:00
Ruben Taelman
5126356c94
feat: Move runtime config into dedicated component, Closes #67
* Move runtime config into dedicated component, Closes #67

* Migrate FileResourceStore to RuntimeConfig
2020-08-26 10:25:47 +02:00
smessie
aa510bc6b8
fix: Release lock only when stream ends or is abandoned (#60)
* fix: Release lock only when stream has ended reading or an error occurs

* refactor: Refactor code and tests

* refactor: Move function mock to onBefore and remove unnecessary data drain

* fix: Make functions protected, add extra listener and add extra tests

* fix: Add extra TSDoc comment

* fix: Adjust tests to expect both end and close event

* refactor: Move test to other file

* refactor: make lockedRun method-independent

* fix: ensure lock release happens only once

* fix: make locked resources time out

* fix: destroy readable on error

Co-authored-by: Ruben Verborgh <ruben@verborgh.org>
2020-08-20 10:51:19 +02:00
Joachim Van Herwegen
b489d69bad fix: Use posix path library to be OS independent 2020-08-18 14:34:32 +02:00
smessie
381dae42f6
feat: Add file based ResourceStore (#52)
* feat: Add file resource store

* test: Write some tests for FileResourceStore

* fix: Reformat code and fix various small things from reviews

* fix: Change constants to just be the corresponding URL

* fix: Remove extra unnecessary wrap in a Promise

* fix: Write some more tests and fix related bugs

* fix: Use old way to import fs promises to support older Node versions

* refactor: Refactor code and tests

* refactor: Refactor and better document code

* fix: Change comparison with undefined by typeof check

* fix: Invert typeof check
2020-08-18 14:19:25 +02:00
Joachim Van Herwegen
0545ca121e feat: Add acl support 2020-08-18 10:32:07 +02:00
Joachim Van Herwegen
4403421c49 feat: Integrate data conversion with rest of server 2020-08-17 15:38:26 +02:00
Joachim Van Herwegen
5e1bb10f81 feat: Convert data from ResourceStore based on preferences 2020-08-17 15:38:26 +02:00
Joachim Van Herwegen
d6a35f9954 fix: Make Patch more consistent with other Representations 2020-08-17 15:38:26 +02:00
Joachim Van Herwegen
14db5fed91 feat: Specifiy constants in separate file 2020-07-28 12:00:17 +02:00
Joachim Van Herwegen
aaba113563 fix: Set max-len to 120 2020-07-24 15:10:34 +02:00