Commit Graph

602 Commits (update-checksum)

Author SHA1 Message Date
HFO4 7bd5a8e3cd dep: update webautn client for better compatibility 2022-05-09 14:51:11 +08:00
XYenon 5bd711afc6
fix: catch s3 presign err (#1277) 2022-05-05 14:24:35 +08:00
HFO4 46c6ee9be7 i18n: add error codes related to sign up 2022-05-02 10:27:51 +08:00
HFO4 c9eefcb946 i18n: captcha, reset password 2022-04-30 16:51:24 +08:00
HFO4 4fe79859a9 enhance: generate error message for parameter error
i18n: use explicit error code for login controlelr
2022-04-30 16:50:59 +08:00
HFO4 0e5683bc3b test: search file with limited parent ids 2022-04-30 10:02:57 +08:00
HFO4 a31ac2299a update version number 2022-04-29 20:15:20 +08:00
HFO4 3b16d7d77c fix: error code overlap 2022-04-29 20:04:26 +08:00
HFO4 8ab0fe0e2f feat: search file under current folder 2022-04-29 20:03:52 +08:00
HFO4 d51351eebd fix: cannot generate thumbnail for COS policy 2022-04-29 20:02:55 +08:00
HFO4 94507fe609 feat: create aria2 task in batch 2022-04-29 20:01:43 +08:00
HFO4 1038bae238 feat: get file source link in batch 2022-04-29 19:59:25 +08:00
AaronLiu 7bdbf3e754
Merge pull request #1239 from vvisionnn/master
Keep updated at column when rename
2022-04-26 19:38:34 +08:00
HFO4 23642d7597 test: fix failed test related to Folder.Create 2022-04-26 19:34:19 +08:00
HFO4 70b30f8d5f release: 3.5.2 2022-04-26 19:10:03 +08:00
HFO4 7c8e9054ce fix: OneDrive chunk upload time should be `0`, avoiding upload timeouts when chunk size is large 2022-04-26 19:08:30 +08:00
HFO4 d845824bd8 fix: overwrite should be disabled when copy on write 2022-04-26 19:07:23 +08:00
HFO4 c62e355345 fix: cannot use LAN OSS endpoint for uploading 2022-04-26 19:05:54 +08:00
Weidi Deng 024f09f666 修复webdav上传的根目录 2022-04-26 14:37:03 +08:00
vvisionnn 2dcf1664a6 fix: keep update at column when rename 2022-04-25 20:23:53 +08:00
AaronLiu dc69a63217
Merge pull request #1232 from cloudreve/archiver-decompress
Archiver decompress
2022-04-25 18:11:23 +08:00
HFO4 86876a1c11 feat: select encoding for decompressing zip file 2022-04-25 18:07:47 +08:00
HFO4 cb51046305 test: new changes in decompress method 2022-04-25 17:23:42 +08:00
HFO4 d10639fd19 release: 3.5.1 2022-04-24 15:33:29 +08:00
HFO4 ba0e3278e3 fix: signature error when finishing oss upload 2022-04-24 15:16:47 +08:00
HFO4 d0779f564e release: 3.5.0 2022-04-22 20:29:53 +08:00
HFO4 b8bc5bed13 test: new `overwrite` param in CreateUploadSession 2022-04-22 16:05:57 +08:00
HFO4 91377f4676 fix: cached folder props should ignore date and policy 2022-04-22 15:58:39 +08:00
HFO4 b1803fa51f fix: cannot overwrite file to slave policy / fix: remove lock system for webdav to resolve Windows Explorer issue. 2022-04-22 15:57:21 +08:00
HFO4 f8b7e086ba fix: `database is locked` when using sqlite 2022-04-22 15:56:45 +08:00
Weidi Deng 23bd1389bc 使用archiver对压缩文件进行解压 2022-04-21 16:33:10 +08:00
HFO4 aaf8a793ee test: new changes related to `filesystem.CreateDirectory` 2022-04-21 14:29:10 +08:00
HFO4 2ab2662fcd fix: cannot upload file to onedrive because file info not match (fix #1215)
Path in onedrive is not case-sensitive while Cloudreve cares, thus file size is not matching when finishing upload.
2022-04-21 13:58:54 +08:00
HFO4 71df067a76 fix: create directory now ignore conflict error, it will return the existed folder 2022-04-21 13:58:22 +08:00
HFO4 86877aef4b fix: failed ut 2022-04-20 18:59:09 +08:00
HFO4 8741c3cc78 feat: return create date while list files 2022-04-20 18:51:43 +08:00
HFO4 6c93e37777 Update version number 2022-04-20 18:50:46 +08:00
HFO4 841a2e258d fix: ignore folder name conflict while creating upload session 2022-04-20 18:50:07 +08:00
HFO4 a26183875f fix: in decompress, file stream should be closed after copy it to temp file. 2022-04-20 11:49:01 +08:00
HFO4 fcc29e31eb Update version number 2022-04-19 20:17:37 +08:00
HFO4 00e2b26294 fix: remove filesystem upload log 2022-04-19 20:05:01 +08:00
HFO4 4f65d0e859 fix: use default chunk size if it is set as 0 2022-04-19 19:41:03 +08:00
HFO4 18f5bffed1 test: fix failed test 2022-04-15 15:53:10 +08:00
HFO4 478d390867 Fix: show modified date instead of creating date in file list 2022-04-13 17:54:10 +08:00
HFO4 febbd0c5a0 Feat: batch download in streamming paradism
Fix: add cache-controler header in API call responses
2022-04-13 17:53:46 +08:00
HFO4 6451e4c903 Merge branch 'master' of https://github.com/cloudreve/Cloudreve 2022-04-12 16:39:09 +08:00
Ink33 84807be1ca
use go:embed for static resources (#1107)
* feat: use go:embed to embed static files

* ci: fix broken test

* docs: update readme.md

* chore: remove statik

* feat: simplify code

Co-authored-by: AaronLiu <abslant@126.com>
2022-04-09 20:58:07 +08:00
HFO4 20e90e3963 Improve error message when uploading is conflicted 2022-04-09 09:57:22 +08:00
HFO4 ec776ac837 Test: new changes in pkg request, serializer, task, xml, router 2022-03-31 20:17:01 +08:00
HFO4 d117080991 Test: new changes pkg filesystem 2022-03-30 20:38:02 +08:00
HFO4 1c0a735df8 Test: new changes pkg remote, fsctx, part of filesystem 2022-03-29 20:13:05 +08:00
HFO4 c6130ab078 Feat: new changes in pkg: chunk, backoff, local, onedrive 2022-03-27 11:14:30 +08:00
HFO4 31315c86ee Feat: support option for cache streamed chunk data into temp file for potential retry. 2022-03-26 15:33:31 +08:00
HFO4 636ac52a3f Test: new changes in pkg: cache, cluster, conf 2022-03-26 15:32:57 +08:00
HFO4 e51c5cd70d Fix: root folder should not be deleted 2022-03-23 19:32:31 +08:00
HFO4 eaa8c9e12d Refactor: move thumbnail config from ini file to database 2022-03-23 19:02:39 +08:00
HFO4 d54ca151b2 Feat: overwrite database settings in conf.ini for slave node. 2022-03-23 18:58:18 +08:00
HFO4 7eb8173101 Feat: adapt new uploader for s3 like policy
This commit also fix #730, #713, #756, #5
2022-03-20 11:29:50 +08:00
HFO4 d3016b60af Feat: adapt new uploader for upyun policy 2022-03-20 11:27:43 +08:00
HFO4 9e5713b139 Feat: adapt new uploader for COS policy 2022-03-20 11:27:17 +08:00
HFO4 07f13cc350 Refactor: factory method for OSS client
Fix: use HTTPS schema by default in OSS client
Feat: new handler for Qiniu policy
2022-03-20 11:26:26 +08:00
HFO4 0df9529b32 Feat: generating token and callback url for OSS muiltpart upload, support resume upload in sever-side uploading for OSS 2022-03-20 11:23:55 +08:00
HFO4 015ccd5026 Feat: use new ChunkManager for OneDrive API client 2022-03-20 11:20:09 +08:00
HFO4 b6efca1878 Feat: uploading OneDrive files in client side 2022-03-20 11:16:25 +08:00
HFO4 24dfb2c24e Fix: undefined method in transfer task 2022-03-13 19:27:33 +08:00
HFO4 c89327631e Fix: panics inside of task was not correctly logged into DB
Feat: slave node use new API to upload file to master
2022-03-13 16:20:50 +08:00
HFO4 9136f3caec Fix: while placeholder file got conflict, original file might be deleted 2022-03-13 16:19:05 +08:00
HFO4 0650684dd9 Feat: cancel upload session in slave node 2022-03-13 16:18:39 +08:00
HFO4 effbc8607e Refactor: use chunk manager to manage resume upload in server side 2022-03-13 16:17:20 +08:00
HFO4 b96019be7c Feat: client method to upload file from master node to slave node 2022-03-13 16:16:58 +08:00
HFO4 e0714fdd53 Feat: process upload callback sent from slave node 2022-03-03 19:17:25 +08:00
HFO4 4925a356e3 Enable overwrite for non-first chunk uploading request 2022-03-03 19:15:25 +08:00
HFO4 7214e59c25 Feat: creating upload session and credential from master server 2022-02-28 17:52:59 +08:00
HFO4 118d738797 Feat: support apply append mode and overwrite mode for FileStream 2022-02-28 17:49:00 +08:00
HFO4 285611baf7 Feat: truncate file if uploaded chunk is overlapped 2022-02-28 17:47:57 +08:00
HFO4 521c5c8dc4 Feat: use transactions to manipulate user's used storage 2022-02-27 14:24:17 +08:00
HFO4 285e80ba76 Feat: use database transactions to delete / update file size 2022-02-27 14:23:26 +08:00
HFO4 2811ee3285 Feat: slave policy creating upload session API 2022-02-27 14:22:09 +08:00
HFO4 7dd636da74 Feat: upload session recycle crontab job / API for cleanup all upload session 2022-02-27 14:16:36 +08:00
HFO4 3444b4a75e Feat: chunk upload handling for local policy 2022-02-27 14:13:39 +08:00
HFO4 c301bd6045 Feat: API for receiviing chunk data 2022-02-27 14:11:01 +08:00
HFO4 72173bf894 Refactor: create placeholder file and record upload session id in it 2022-02-27 14:07:12 +08:00
HFO4 6fdf77e00e Feat: support setting "last modified" props when creating upload session 2022-02-27 14:05:21 +08:00
HFO4 e37e93a7b6 Feat: create hidden file when creating upload session 2022-02-27 14:04:30 +08:00
HFO4 868a88e5fc Refactor: use universal FileHeader when handling file upload, remove usage of global ctx with FileHeader, SavePath, DisableOverwrite 2022-02-27 14:03:07 +08:00
KAAAsS 8a222e7df4
fix: nil pointer in qiniu and upyun driver (#1146) 2022-02-26 08:39:47 +08:00
HFO4 8443a30fb1 Feat: support chunk size option in policy 2022-02-10 19:31:06 +08:00
HFO4 de9c41082c Feat: create upload session and pre-upload check 2022-02-10 19:30:08 +08:00
HFO4 855c9d92c4 Feat: get policy from directory props / Feat: return source enabled flag in file list 2022-02-10 19:25:38 +08:00
HFO4 6b15cae0b5 Update version number 2021-11-30 19:27:09 +08:00
HFO4 84d81f201f Fix: refresh interval not working 2021-11-30 19:26:35 +08:00
HFO4 af4d9767c2 Fix: slave node cannot transfer files to other slave node 2021-11-30 19:26:07 +08:00
HFO4 7ea72cf364 Fix: default CORS setting header should be applied with new change 2021-11-26 11:05:12 +08:00
HFO4 4eb7525c51 Fix: cannot transfer tasks with multiple files in slave node 2021-11-26 10:58:01 +08:00
HFO4 3948ee7f3a Fix: use `X-Cr-` as custom header prefix 2021-11-23 21:22:23 +08:00
HFO4 865a801fa8 Update version number 2021-11-22 21:08:35 +08:00
WeidiDeng 8c8ad3e149
Fix: WebDAV cannot move and rename at the same time (#1056) 2021-11-22 20:29:45 +08:00
HFO4 700e13384e Fix: using url escape instead of unescape in remote handler (#1051) 2021-11-22 20:23:34 +08:00
HFO4 96b84bb5e5 Test: tasks pkg 2021-11-20 17:14:45 +08:00
HFO4 9056ef9171 Test: new changes in 3.4.0 2021-11-20 16:59:29 +08:00
HFO4 532bff820a Test: new modifications in filesystem pkg 2021-11-16 20:54:21 +08:00
HFO4 fcd9eddc54 Test: pkg/cluster 2021-11-16 20:14:27 +08:00
HFO4 6c9967b120 Test: cluster/node.go and controller.go 2021-11-15 20:30:25 +08:00
HFO4 416f4c1dd2 Test: balancer / auth / controller in pkg 2021-11-11 20:56:16 +08:00
HFO4 f0089045d7 Test: aria2 task monitor 100% cover 2021-11-11 19:49:02 +08:00
kikoqiu 54ed7e43ca
Feat: improve thumbnails proformance and GC for local policy (#1044)
* thumb generating improvement

Replace "github.com/nfnt/resize" with "golang.org/x/image/draw". Add thumb task queue to avoid oom when batch thumb operation

* thumb improvement

* Add some tests for thumbnail generation
2021-11-11 17:45:22 +08:00
HFO4 4d7b8685b9 Test: aria2 task monitor
Fix: tmp file not deleted after transfer task failed to create
2021-11-09 20:53:42 +08:00
HFO4 e41ec9defa Refactor: move slave pkg inside of cluster
Test: middleware for node communication
2021-11-08 19:54:26 +08:00
HFO4 eaa0f6be91 Update version number 2021-11-07 10:14:30 +08:00
HFO4 5db476634a Fix: deadlock and sync issue in node pool 2021-11-03 21:27:53 +08:00
HFO4 1f06ee3af6 Fix: node cannot be reloaded when db model changes 2021-11-01 19:23:19 +08:00
AaronLiu 056de22edb
Feat: aria2 download and transfer in slave node (#1040)
* Feat: retrieve nodes from data table

* Feat: master node ping slave node in REST API

* Feat: master send scheduled ping request

* Feat: inactive nodes recover loop

* Modify: remove database operations from aria2 RPC caller implementation

* Feat: init aria2 client in master node

* Feat: Round Robin load balancer

* Feat: create and monitor aria2 task in master node

* Feat: salve receive and handle heartbeat

* Fix: Node ID will be 0 in download record generated in older version

* Feat: sign request headers with all `X-` prefix

* Feat: API call to slave node will carry meta data in headers

* Feat: call slave aria2 rpc method from master

* Feat: get slave aria2 task status
Feat: encode slave response data using gob

* Feat: aria2 callback to master node / cancel or select task to slave node

* Fix: use dummy aria2 client when caller initialize failed in master node

* Feat: slave aria2 status event callback / salve RPC auth

* Feat: prototype for slave driven filesystem

* Feat: retry for init aria2 client in master node

* Feat: init request client with global options

* Feat: slave receive async task from master

* Fix: competition write in request header

* Refactor: dependency initialize order

* Feat: generic message queue implementation

* Feat: message queue implementation

* Feat: master waiting slave transfer result

* Feat: slave transfer file in stateless policy

* Feat: slave transfer file in slave policy

* Feat: slave transfer file in local policy

* Feat: slave transfer file in OneDrive policy

* Fix: failed to initialize update checker http client

* Feat: list slave nodes for dashboard

* Feat: test aria2 rpc connection in slave

* Feat: add and save node

* Feat: add and delete node in node pool

* Fix: temp file cannot be removed when aria2 task fails

* Fix: delete node in admin panel

* Feat: edit node and get node info

* Modify: delete unused settings
2021-10-31 09:41:56 +08:00
WeidiDeng 9ff1b47646
fix webdav prop get (#1023)
修复了displayname为空,potplayer可以正常使用webdav功能
2021-09-27 22:28:36 +08:00
AaronLiu 65c4367689
Revert "delete $name policy (#831)" (#961)
This reverts commit e6959a5026.
2021-07-30 11:22:18 +08:00
HFO4 db7489fb61 Update version number 2021-07-11 20:10:51 +08:00
HFO4 622b928a90 Feat: support database charset option and more DMBS driver 2021-07-11 14:46:01 +08:00
Songtao e6959a5026
delete $name policy (#831) 2021-07-11 14:32:47 +08:00
kleinsea c85c2da523
feat: append config parameter: registerEnabled (#911) 2021-05-29 09:58:11 +08:00
HFO4 8659bdcf77 Fix: unable to read file from UPYUN (#472, #472, #836) 2021-05-11 21:52:55 +08:00
HFO4 641fe352da Fix: user encryption setting will now overwrite the default one in gomail (#869 #857 #723 #545) 2021-04-25 16:06:22 +08:00
HFO4 96712fb066 Feat: use RFC3339 time format in returned results (#811) 2021-04-03 16:57:13 +08:00
HFO4 a1252c810b Update version number to 3.3.1 2021-03-23 10:46:17 +08:00
topjohncian 233648b956
Refactor: captcha (#796) 2021-03-22 02:28:12 -08:00
HFO4 c0f7214cdb Revert "Fix: OSS SDK will encode all object key (#694)"
This reverts commit 270f617b and fix #802
2021-03-22 16:22:21 +08:00
HFO4 ccaefdab33 Fix: unable to upload file in WebDAV (#803) 2021-03-22 13:50:43 +08:00
HFO4 595f4a1350 Test: get parament source in OneDrive handler 2021-03-21 14:32:10 +08:00
HFO4 a5f80a4431 Feat: get permanent URL for OneDrive policy 2021-03-20 12:33:39 +08:00
HFO4 8431906b94 Update version number 2021-03-17 14:21:32 +08:00
ihipop 270f617b9d
Fix: OSS SDK will encode all object key (#694)
(cherry picked from commit b9cd82b849065f0d1ad093708f09c8722339bf2a)
2021-03-16 21:56:14 -08:00
HFO4 170f2279c1 Fix: failed to get thumbnails under global OneDrive policy 2021-03-14 11:03:10 +08:00
HFO4 4e2f243436 Feat: support using SharePoint site to store files 2021-03-12 17:05:13 +08:00
HFO4 fec2fe14f8 Modify: json tag for QueryDate 2021-03-11 14:50:32 +08:00
HFO4 1f1bc056e3 Feat: API for getting object property 2021-03-11 14:50:02 +08:00
HFO4 a93b964d8b Modify: OneDrive file URL cache will refreshed after file is updated 2021-03-03 17:07:26 +08:00
HFO4 4cf6c81534 Fix: failed unit test 2021-03-02 12:32:34 +08:00
HFO4 5a66af3105 Fix: failed unit test 2021-03-02 12:21:43 +08:00
HFO4 fc5c67cc20 Feat: disable overwrite for OneDrive policy 2021-03-01 13:27:18 +08:00
HFO4 5e226efea1 Feat: disable overwrite for non-updating put request, only works under local,slave,OneDrive,OSS policy. (#764) 2021-03-01 13:03:49 +08:00
HFO4 e699287ffd Modify: mark as success when deleting a file that does not exist;
Fix: minio is not usable in S3 policy
Modify: use batch request to delete S3 files
2021-02-28 16:48:51 +08:00
HFO4 3b22b4fd25 Update version number 2021-01-06 18:18:24 +08:00
Breeze Chen 488e62f762
Fix qiniu last modify time. (#691) 2021-01-06 17:01:24 +08:00
HFO4 61e6d9b591 Update version number 2020-12-10 17:26:39 +08:00
HFO4 055ed0e075 Fix: standardize the use of error codes related to login credentials 2020-12-08 20:13:42 +08:00
HFO4 5b44606276 Test: replace cdn proxy url for OneDrive policy 2020-12-08 17:31:37 +08:00
HFO4 bd2bdf253b Feat: using custom reverse proxying in OneDrive file downloading 2020-12-08 17:30:22 +08:00
HFO4 7279be2924 Fix: user storage might be returned twice when OneDrive uploading canceled in WebDAV requests 2020-12-01 19:22:52 +08:00
HFO4 a5805b022a Feat: enable using LAN endpoint in serverside request of OSS policy (#399) 2020-11-29 19:15:35 +08:00
HFO4 f0a68236a8 Feat: delete aria2 record in client side (#335) 2020-11-23 19:24:56 +08:00
HFO4 c6110e9e75 Feat: keep folder structure in aria2 transferring 2020-11-23 18:44:13 +08:00
HFO4 d97bc26042 Fix: add recycleLock preventing recycle FileSystem used by another goroutine 2020-11-21 19:32:25 +08:00