Commit Graph

283 Commits (46c6ee9be7cf7cac68bc060e937eb9e65b6197b7)

Author SHA1 Message Date
HFO4 0e5683bc3b test: search file with limited parent ids 2022-04-30 10:02:57 +08:00
HFO4 8ab0fe0e2f feat: search file under current folder 2022-04-29 20:03:52 +08:00
HFO4 94507fe609 feat: create aria2 task in batch 2022-04-29 20:01:43 +08:00
HFO4 1038bae238 feat: get file source link in batch 2022-04-29 19:59:25 +08:00
AaronLiu 7bdbf3e754
Merge pull request #1239 from vvisionnn/master
Keep updated at column when rename
2022-04-26 19:38:34 +08:00
HFO4 a523fc4e2c test: Folder.Create 2022-04-26 19:22:37 +08:00
HFO4 853bd4c280 fix: duplicate entry in insert transaction 2022-04-26 19:07:42 +08:00
HFO4 ae33e077a3 fix: text too long for some option field 2022-04-26 19:06:51 +08:00
vvisionnn 2dcf1664a6 fix: keep update at column when rename 2022-04-25 20:23:53 +08:00
HFO4 0fb31f4523 fix: deadlock while creating default user in SQLite 2022-04-24 15:16:25 +08:00
HFO4 f8b7e086ba fix: `database is locked` when using sqlite 2022-04-22 15:56:45 +08:00
HFO4 aaf8a793ee test: new changes related to `filesystem.CreateDirectory` 2022-04-21 14:29:10 +08:00
HFO4 71df067a76 fix: create directory now ignore conflict error, it will return the existed folder 2022-04-21 13:58:22 +08:00
HFO4 4f65d0e859 fix: use default chunk size if it is set as 0 2022-04-19 19:41:03 +08:00
HFO4 3804efd792 enhance: use transaction to update site settings 2022-04-19 15:36:29 +08:00
HFO4 13d36c25d4 test: fix failed test in model/file/deleteFile 2022-04-15 16:03:00 +08:00
HFO4 febbd0c5a0 Feat: batch download in streamming paradism
Fix: add cache-controler header in API call responses
2022-04-13 17:53:46 +08:00
HFO4 ace398d87b Fix: file size is ready dirty when clean upload sessions
After listing to be deleted files, before delete is committed to database, file size might be changed by ongoing upload, causing inconsistent user storage.
2022-04-03 20:39:50 +08:00
HFO4 d117080991 Test: new changes pkg filesystem 2022-03-30 20:38:02 +08:00
HFO4 31315c86ee Feat: support option for cache streamed chunk data into temp file for potential retry. 2022-03-26 15:33:31 +08:00
HFO4 1821923b74 Test: new changes in model pkg 2022-03-24 20:07:56 +08:00
HFO4 5a3ea89866 Feat: support `{ext}` and `{uuid}` magic variable 2022-03-23 19:26:25 +08:00
HFO4 eaa8c9e12d Refactor: move thumbnail config from ini file to database 2022-03-23 19:02:39 +08:00
HFO4 7eb8173101 Feat: adapt new uploader for s3 like policy
This commit also fix #730, #713, #756, #5
2022-03-20 11:29:50 +08:00
HFO4 9e5713b139 Feat: adapt new uploader for COS policy 2022-03-20 11:27:17 +08:00
HFO4 07f13cc350 Refactor: factory method for OSS client
Fix: use HTTPS schema by default in OSS client
Feat: new handler for Qiniu policy
2022-03-20 11:26:26 +08:00
HFO4 0df9529b32 Feat: generating token and callback url for OSS muiltpart upload, support resume upload in sever-side uploading for OSS 2022-03-20 11:23:55 +08:00
HFO4 b6efca1878 Feat: uploading OneDrive files in client side 2022-03-20 11:16:25 +08:00
HFO4 5bda037d74 Fix: cannot list multiple pages in async task page 2022-03-13 16:21:09 +08:00
HFO4 b96019be7c Feat: client method to upload file from master node to slave node 2022-03-13 16:16:58 +08:00
HFO4 081e75146c Fix: add optimism lock when updating file size 2022-03-13 16:15:19 +08:00
HFO4 e0714fdd53 Feat: process upload callback sent from slave node 2022-03-03 19:17:25 +08:00
HFO4 521c5c8dc4 Feat: use transactions to manipulate user's used storage 2022-02-27 14:24:17 +08:00
HFO4 285e80ba76 Feat: use database transactions to delete / update file size 2022-02-27 14:23:26 +08:00
HFO4 2811ee3285 Feat: slave policy creating upload session API 2022-02-27 14:22:09 +08:00
HFO4 7dd636da74 Feat: upload session recycle crontab job / API for cleanup all upload session 2022-02-27 14:16:36 +08:00
HFO4 3444b4a75e Feat: chunk upload handling for local policy 2022-02-27 14:13:39 +08:00
HFO4 72173bf894 Refactor: create placeholder file and record upload session id in it 2022-02-27 14:07:12 +08:00
HFO4 868a88e5fc Refactor: use universal FileHeader when handling file upload, remove usage of global ctx with FileHeader, SavePath, DisableOverwrite 2022-02-27 14:03:07 +08:00
HFO4 8443a30fb1 Feat: support chunk size option in policy 2022-02-10 19:31:06 +08:00
vvisionnn c84d0114ae
Fix: trigger err when move folder into itself (#1128) 2022-02-04 12:07:56 +08:00
HFO4 3948ee7f3a Fix: use `X-Cr-` as custom header prefix 2021-11-23 21:22:23 +08:00
HFO4 4dbe867020 Fix: failed unit test due to import cycle 2021-11-22 20:38:03 +08:00
HFO4 7fd984f95d Feat: support custom office preview service (Fix #1050) 2021-11-22 20:16:24 +08:00
HFO4 9fc08292a0 Feat: migration DB support custom upgrade scripts 2021-11-22 19:53:42 +08:00
HFO4 eeee43d569 Test: newly added sb models 2021-11-09 19:29:56 +08:00
HFO4 3064ed60f3 Test: new database models and middlewares 2021-11-08 20:49:07 +08:00
HFO4 e41ec9defa Refactor: move slave pkg inside of cluster
Test: middleware for node communication
2021-11-08 19:54:26 +08:00
HFO4 5db476634a Fix: deadlock and sync issue in node pool 2021-11-03 21:27:53 +08:00
AaronLiu 056de22edb
Feat: aria2 download and transfer in slave node (#1040)
* Feat: retrieve nodes from data table

* Feat: master node ping slave node in REST API

* Feat: master send scheduled ping request

* Feat: inactive nodes recover loop

* Modify: remove database operations from aria2 RPC caller implementation

* Feat: init aria2 client in master node

* Feat: Round Robin load balancer

* Feat: create and monitor aria2 task in master node

* Feat: salve receive and handle heartbeat

* Fix: Node ID will be 0 in download record generated in older version

* Feat: sign request headers with all `X-` prefix

* Feat: API call to slave node will carry meta data in headers

* Feat: call slave aria2 rpc method from master

* Feat: get slave aria2 task status
Feat: encode slave response data using gob

* Feat: aria2 callback to master node / cancel or select task to slave node

* Fix: use dummy aria2 client when caller initialize failed in master node

* Feat: slave aria2 status event callback / salve RPC auth

* Feat: prototype for slave driven filesystem

* Feat: retry for init aria2 client in master node

* Feat: init request client with global options

* Feat: slave receive async task from master

* Fix: competition write in request header

* Refactor: dependency initialize order

* Feat: generic message queue implementation

* Feat: message queue implementation

* Feat: master waiting slave transfer result

* Feat: slave transfer file in stateless policy

* Feat: slave transfer file in slave policy

* Feat: slave transfer file in local policy

* Feat: slave transfer file in OneDrive policy

* Fix: failed to initialize update checker http client

* Feat: list slave nodes for dashboard

* Feat: test aria2 rpc connection in slave

* Feat: add and save node

* Feat: add and delete node in node pool

* Fix: temp file cannot be removed when aria2 task fails

* Fix: delete node in admin panel

* Feat: edit node and get node info

* Modify: delete unused settings
2021-10-31 09:41:56 +08:00