github
/
Cloudreve
mirror of https://github.com/cloudreve/Cloudreve
1
0
Fork 0
Code Issues Releases Wiki Activity
913 Commits
11 Branches
65 Tags
20 MiB
Commit Graph

376 Commits (redirect-status)

Author SHA1 Message Date
HFO4 521c5c8dc4 Feat: use transactions to manipulate user's used storage 2022-02-27 14:24:17 +08:00
HFO4 285e80ba76 Feat: use database transactions to delete / update file size 2022-02-27 14:23:26 +08:00
HFO4 2811ee3285 Feat: slave policy creating upload session API 2022-02-27 14:22:09 +08:00
HFO4 7dd636da74 Feat: upload session recycle crontab job / API for cleanup all upload session 2022-02-27 14:16:36 +08:00
HFO4 3444b4a75e Feat: chunk upload handling for local policy 2022-02-27 14:13:39 +08:00
HFO4 c301bd6045 Feat: API for receiviing chunk data 2022-02-27 14:11:01 +08:00
HFO4 72173bf894 Refactor: create placeholder file and record upload session id in it 2022-02-27 14:07:12 +08:00
HFO4 6fdf77e00e Feat: support setting "last modified" props when creating upload session 2022-02-27 14:05:21 +08:00
HFO4 e37e93a7b6 Feat: create hidden file when creating upload session 2022-02-27 14:04:30 +08:00
HFO4 868a88e5fc Refactor: use universal FileHeader when handling file upload, remove usage of global ctx with FileHeader, SavePath, DisableOverwrite 2022-02-27 14:03:07 +08:00
KAAAsS 8a222e7df4
fix: nil pointer in qiniu and upyun driver (#1146) 2022-02-26 08:39:47 +08:00
HFO4 8443a30fb1 Feat: support chunk size option in policy 2022-02-10 19:31:06 +08:00
HFO4 de9c41082c Feat: create upload session and pre-upload check 2022-02-10 19:30:08 +08:00
HFO4 855c9d92c4 Feat: get policy from directory props / Feat: return source enabled flag in file list 2022-02-10 19:25:38 +08:00
HFO4 af4d9767c2 Fix: slave node cannot transfer files to other slave node 2021-11-30 19:26:07 +08:00
HFO4 3948ee7f3a Fix: use `X-Cr-` as custom header prefix 2021-11-23 21:22:23 +08:00
HFO4 700e13384e Fix: using url escape instead of unescape in remote handler (#1051) 2021-11-22 20:23:34 +08:00
HFO4 9056ef9171 Test: new changes in 3.4.0 2021-11-20 16:59:29 +08:00
HFO4 532bff820a Test: new modifications in filesystem pkg 2021-11-16 20:54:21 +08:00
kikoqiu 54ed7e43ca
Feat: improve thumbnails proformance and GC for local policy (#1044) 
* thumb generating improvement

Replace "github.com/nfnt/resize" with "golang.org/x/image/draw". Add thumb task queue to avoid oom when batch thumb operation

* thumb improvement

* Add some tests for thumbnail generation
 2021-11-11 17:45:22 +08:00
HFO4 e41ec9defa Refactor: move slave pkg inside of cluster 
Test: middleware for node communication
 2021-11-08 19:54:26 +08:00
AaronLiu 056de22edb
Feat: aria2 download and transfer in slave node (#1040) 
* Feat: retrieve nodes from data table

* Feat: master node ping slave node in REST API

* Feat: master send scheduled ping request

* Feat: inactive nodes recover loop

* Modify: remove database operations from aria2 RPC caller implementation

* Feat: init aria2 client in master node

* Feat: Round Robin load balancer

* Feat: create and monitor aria2 task in master node

* Feat: salve receive and handle heartbeat

* Fix: Node ID will be 0 in download record generated in older version

* Feat: sign request headers with all `X-` prefix

* Feat: API call to slave node will carry meta data in headers

* Feat: call slave aria2 rpc method from master

* Feat: get slave aria2 task status
Feat: encode slave response data using gob

* Feat: aria2 callback to master node / cancel or select task to slave node

* Fix: use dummy aria2 client when caller initialize failed in master node

* Feat: slave aria2 status event callback / salve RPC auth

* Feat: prototype for slave driven filesystem

* Feat: retry for init aria2 client in master node

* Feat: init request client with global options

* Feat: slave receive async task from master

* Fix: competition write in request header

* Refactor: dependency initialize order

* Feat: generic message queue implementation

* Feat: message queue implementation

* Feat: master waiting slave transfer result

* Feat: slave transfer file in stateless policy

* Feat: slave transfer file in slave policy

* Feat: slave transfer file in local policy

* Feat: slave transfer file in OneDrive policy

* Fix: failed to initialize update checker http client

* Feat: list slave nodes for dashboard

* Feat: test aria2 rpc connection in slave

* Feat: add and save node

* Feat: add and delete node in node pool

* Fix: temp file cannot be removed when aria2 task fails

* Fix: delete node in admin panel

* Feat: edit node and get node info

* Modify: delete unused settings
 2021-10-31 09:41:56 +08:00
AaronLiu 65c4367689
Revert "delete $name policy (#831)" (#961) 
This reverts commit e6959a5026.
 2021-07-30 11:22:18 +08:00
Songtao e6959a5026
delete $name policy (#831) 2021-07-11 14:32:47 +08:00
HFO4 8659bdcf77 Fix: unable to read file from UPYUN (#472, #472, #836) 2021-05-11 21:52:55 +08:00
HFO4 96712fb066 Feat: use RFC3339 time format in returned results (#811) 2021-04-03 16:57:13 +08:00
HFO4 c0f7214cdb Revert "Fix: OSS SDK will encode all object key (#694)" 
This reverts commit 270f617b and fix #802
 2021-03-22 16:22:21 +08:00
HFO4 595f4a1350 Test: get parament source in OneDrive handler 2021-03-21 14:32:10 +08:00
HFO4 a5f80a4431 Feat: get permanent URL for OneDrive policy 2021-03-20 12:33:39 +08:00
ihipop 270f617b9d
Fix: OSS SDK will encode all object key (#694) 
(cherry picked from commit b9cd82b849065f0d1ad093708f09c8722339bf2a)
 2021-03-16 21:56:14 -08:00
HFO4 170f2279c1 Fix: failed to get thumbnails under global OneDrive policy 2021-03-14 11:03:10 +08:00
HFO4 4e2f243436 Feat: support using SharePoint site to store files 2021-03-12 17:05:13 +08:00
HFO4 a93b964d8b Modify: OneDrive file URL cache will refreshed after file is updated 2021-03-03 17:07:26 +08:00
HFO4 4cf6c81534 Fix: failed unit test 2021-03-02 12:32:34 +08:00
HFO4 5a66af3105 Fix: failed unit test 2021-03-02 12:21:43 +08:00
HFO4 fc5c67cc20 Feat: disable overwrite for OneDrive policy 2021-03-01 13:27:18 +08:00
HFO4 5e226efea1 Feat: disable overwrite for non-updating put request, only works under local,slave,OneDrive,OSS policy. (#764) 2021-03-01 13:03:49 +08:00
HFO4 e699287ffd Modify: mark as success when deleting a file that does not exist; 
Fix: minio is not usable in S3 policy
Modify: use batch request to delete S3 files
 2021-02-28 16:48:51 +08:00
Breeze Chen 488e62f762
Fix qiniu last modify time. (#691) 2021-01-06 17:01:24 +08:00
HFO4 5b44606276 Test: replace cdn proxy url for OneDrive policy 2020-12-08 17:31:37 +08:00
HFO4 bd2bdf253b Feat: using custom reverse proxying in OneDrive file downloading 2020-12-08 17:30:22 +08:00
HFO4 7279be2924 Fix: user storage might be returned twice when OneDrive uploading canceled in WebDAV requests 2020-12-01 19:22:52 +08:00
HFO4 a5805b022a Feat: enable using LAN endpoint in serverside request of OSS policy (#399) 2020-11-29 19:15:35 +08:00
HFO4 d97bc26042 Fix: add recycleLock preventing recycle FileSystem used by another goroutine 2020-11-21 19:32:25 +08:00
Loyalsoldier 79b8784934
Comply with Golang semantic import versioning (#630) 
* Code: compatible with semantic import versioning

* Tools & Docs: compatible with semantic import versioning

* Clean go.mod & go.sum
 2020-11-21 17:34:55 +08:00
HFO4 746aa3e8ef Test: s3 policy 2020-10-26 15:33:28 +08:00
HFO4 95f318e069 Feat: adapt minio for S3 policy and fix listing files 2020-10-26 15:06:02 +08:00
HFO4 77394313aa Fix: S3 adaption for minio 2020-10-11 13:05:14 +08:00
ZZF dd50ef1c25
添加S3策略的支持 (#425) 
* 添加亚马逊S3策略的支持

* 添加CDN支持，公有目录删除无用参数

* 增加Region
 2020-06-05 14:45:24 +08:00
HFO4 a7ba357cb8 Fix: hash mark in file name lead to 404 error (#405) 2020-05-30 19:35:28 +08:00
HFO4 5af3c4e244 Fix: directory renaming should not be limited by file extensions (#395) 2020-05-19 11:25:01 +08:00
HFO4 280308bc05 Modify: increase OneDrive client uploading chunk size to 100MB 2020-05-13 09:09:11 +08:00
HFO4 e8a6df9a86 Feat: import file from existing outer folder 2020-05-02 10:22:28 +08:00
HFO4 79daf92896 Test: List files in OneDrive 2020-05-01 09:22:27 +08:00
HFO4 8a2be58ef3 Feat: List files in OneDrive 2020-04-30 11:45:35 +08:00
HFO4 ce7784090f Feat: List files in upyun bucket 2020-04-30 10:37:48 +08:00
HFO4 dfb663a6e0 Feat: List files in Qiniu bucket 2020-04-29 10:37:15 +08:00
HFO4 cfaf20926f Feat: List files in COS bucket 2020-04-29 10:36:52 +08:00
HFO4 305497e7cb Test: oss.List 2020-04-29 09:18:26 +08:00
HFO4 52c2422be9 Feat: list oss files 2020-04-28 11:43:32 +08:00
HFO4 1afc750dae Modify: create folder if not exist while importing files 2020-04-28 10:47:40 +08:00
HFO4 960c886496 Test: slave side list file 2020-04-28 10:16:04 +08:00
HFO4 5d579cdadc Feat: slave side list file 2020-04-28 10:02:53 +08:00
HFO4 36e5b31f73 Modify: add recursive options for list method 
Test: local.List
 2020-04-27 10:31:34 +08:00
HFO4 8c547a05fd Fix: mismatched pointer receiver in oss.Driver 2020-04-24 11:14:32 +08:00
HFO4 f7311f906b Feat: add List method to Handler interface / implement local.List 2020-04-24 11:08:07 +08:00
HFO4 6006ff4d22 Feat: regenerate when thumbnail files not exist 2020-04-24 10:18:01 +08:00
HFO4 8c3287d380 Test: Policy.IsThumbExist / filesystem.AddFile 2020-04-22 11:10:43 +08:00
HFO4 304e7b502c Feat: thumbnail support for COS policy 2020-04-22 11:09:33 +08:00
HFO4 514e069113 Refactor: decide if there is a thumbnail based on the file extension 2020-04-22 11:04:35 +08:00
HFO4 ab3b59e63d Feat: add option to force delete file record in database 2020-04-19 10:09:16 +08:00
HFO4 816b537787 Fix: permission error while creating folder recursively 2020-04-07 11:09:27 +08:00
HFO4 e07b09186d Modify: use 644 permission when creating a new physical directory (#274) 2020-04-07 10:56:02 +08:00
HFO4 8c7d075484 Fix: repeated return of capacity when OneDrive WebDAV upload canceled 2020-04-07 10:51:54 +08:00
HFO4 46743f3c1e Fix: unsupported GET parameters in public OSS bucket 2020-04-07 10:15:11 +08:00
yeungc 6285e45e34
Fix: filename and code typo (#260) 
* Rename handller.go to handler.go

* Rename handller.go to handler.go

* Rename handller_test.go to handler_test.go

* Rename handller.go to handler.go

* Rename handller.go to handler.go

* Rename handller.go to handler.go

* Rename handller.go to handler.go

* Fix typo
 2020-03-23 13:44:59 +08:00
HFO4 87fde687eb Fix: files with percent sign (%) cannot be deleted in OneDrive 2020-03-18 10:42:41 +08:00
HFO4 0eb04ed0ea Feat: cache for OneDrive META request 2020-03-18 09:35:00 +08:00
HFO4 ff2dae80f0 Fix: incorrect thumb path detect while deleting files 2020-03-17 16:11:11 +08:00
HFO4 d1ca65461c Fix: incorrect capacity unit for OSS traffic limit 2020-03-15 09:56:50 +08:00
HFO4 36cec067d9 Fix: OneDrive monitoring should continue when error occurs 2020-03-12 15:56:06 +08:00
HFO4 c74ed10dbd Test: aria2 / filesystem.image 2020-03-12 10:12:13 +08:00
HFO4 297fc8d5bb Fix: failed test due to relative path 2020-03-12 09:40:29 +08:00
HFO4 71876a79cd Fix: failed test due to relative path 2020-03-12 09:30:57 +08:00
HFO4 37de715541 Fix: failed test due to relative path 2020-03-12 09:15:30 +08:00
HFO4 439b5a2ce0 Modify: stop recycle filesystem when generate thumbnails 2020-03-11 16:34:19 +08:00
HFO4 4de0a2577a Fix: recycle error when handling upload task 2020-03-11 16:29:46 +08:00
HFO4 4d70f9fa3e Fix: get execute file path dynamically 2020-03-11 10:32:35 +08:00
HFO4 c30c19ca3e Feat: create SFC for oss callback 2020-03-01 16:25:56 +08:00
HFO4 e8c4660c38 Feat: check policy update before upload 2020-02-27 17:12:59 +08:00
HFO4 2f1f619f2f Fix: failed test due to modifications 2020-02-27 15:34:16 +08:00
HFO4 c4eada2723 Modify: oss handle sign URL 2020-02-27 15:12:15 +08:00
HFO4 bd643fa2d5 Feat: remote test ping and ping-back 2020-02-27 11:17:59 +08:00
HFO4 f1ef21e195 Feat: add local policy 2020-02-26 15:11:06 +08:00
HFO4 a8272a66b7 Modify: move aria2 into internal packages / migration version check 2020-02-22 12:18:49 +08:00
HFO4 11e45bc751 Fix: failed unit test due to update with callback 2020-02-21 12:47:32 +08:00
HFO4 7dcc7a4880 Test: Task list / file delete 2020-02-21 12:09:43 +08:00
HFO4 5363b90167 Test: options / WebDAV middleware 2020-02-21 11:16:25 +08:00
HFO4 58d8695c53 Fix: endless loop while creating nested folders 2020-02-20 08:59:11 +08:00
HFO4 86889e2fac Feat: WebDAV account management 2020-02-18 12:10:28 +08:00
HFO4 663b827a1d Test: pkg modifications 2020-02-17 14:17:06 +08:00
HFO4 faf46745bc Feat: cron / Fix: users status check 2020-02-15 14:02:21 +08:00
HFO4 44d6ca487c Feat: mount storage policy for folders in WebDAV 2020-02-13 15:27:40 +08:00
HFO4 bb63ea7142 Test: model.Tags / modifications 2020-02-12 13:19:25 +08:00
HFO4 127d0236f9 Feat: filter and search file 2020-02-11 11:13:20 +08:00
HFO4 8f28a9c346 Modify: change raw object ID to Hash ID in share service 2020-02-10 14:29:27 +08:00
HFO4 9be1b4366f Modify: change raw object ID to Hash ID in file service 2020-02-10 13:10:59 +08:00
HFO4 f235ad1def Fix: aria2 RPC retry / return NoT_FOUND error while listing not existed path 2020-02-10 10:33:39 +08:00
HFO4 14982f5e70 Fix: handle none-utf8 encoding in decompression 2020-02-07 14:01:53 +08:00
HFO4 16613a6113 Modify: return parent folder id while listing objects 2020-02-07 13:54:37 +08:00
HFO4 4c530a26a0 Test: pkg/task / Fix: failed test due to policy cache 2020-02-07 11:47:52 +08:00
HFO4 fc5b7d42c8 Test: pkg/task 2020-02-06 16:01:06 +08:00
HFO4 1a93c9a2b9 Feat: retry for Onedrive SimpleUpload 2020-02-05 15:17:49 +08:00
HFO4 491e4de9de Feat: download torrent / multiple file / select file 2020-02-05 15:11:34 +08:00
HFO4 3ed84ad5ec Feat: validate / cancel task while downloading file in aria2 2020-02-05 12:58:26 +08:00
HFO4 fe8f1b1ef5 Feat: creat uri aria2 download task 2020-02-04 15:29:52 +08:00
HFO4 7804b4efb1 Fix: Onedrive have batch requests limit for 20 per request 2020-02-04 10:48:26 +08:00
HFO4 91e202c7e6 Feat: decompression task 2020-02-03 13:23:33 +08:00
HFO4 e722c33cd5 Feat: task queue / compression task 2020-02-02 14:40:07 +08:00
HFO4 b1490a665c Fix: missing x-oss-process params in thumb url in public oss bucket 2020-02-01 14:36:57 +08:00
HFO4 8bb2c2b0c5 Test: share related operation in filesystem 2020-02-01 14:26:21 +08:00
HFO4 b49202e7e1 Test: Share model 2020-02-01 13:14:50 +08:00
HFO4 437bdf46d4 Feat: thumb for shared folder 2020-02-01 10:34:23 +08:00
HFO4 9fe451ad4b Fix: cache-control header in thumb redirect request 2020-02-01 10:08:34 +08:00
HFO4 cc2c3b3f0f Feat: archive download in shared folder 2020-01-31 13:18:32 +08:00
HFO4 f5d79b1f94 Feat: re-save shared folder to user's space 2020-01-31 11:27:52 +08:00
HFO4 b1a9943b0c Feat: download / preview files for shared folder 2020-01-30 14:22:03 +08:00
HFO4 0edbbfc9ea Feat: list files for shared folder 2020-01-30 13:21:21 +08:00
HFO4 e2f6dab70c Feat: save re-save single shared file 2020-01-29 13:45:27 +08:00
HFO4 68704f8646 Feat: options to disable preview in file sharing 2020-01-29 11:03:09 +08:00
HFO4 7f0feebf42 Feat: download file from single file share 2020-01-28 12:41:00 +08:00
HFO4 4abd5b2346 Feat: cos policy upload/download in server-side 2020-01-25 11:43:13 +08:00
HFO4 c34f211d7e Feat: get source url in COS 2020-01-25 11:20:31 +08:00
HFO4 dc32e85492 Fix: capacity should be returned back when put failed 2020-01-25 10:40:53 +08:00
HFO4 8d437a451c Feat: COS credential / upload callback 2020-01-23 12:38:32 +08:00
HFO4 e894450d5e Modify: cancel race test 2020-01-22 15:11:03 +08:00
HFO4 4baddecd8e Fix: ignore data-race detector in onedrive tests 2020-01-22 15:06:56 +08:00
HFO4 a70bc7b908 Fix: ignore data-race detector in onedrive tests 2020-01-22 14:52:05 +08:00
HFO4 588514b4e0 Test: get filesystem from callback context 2020-01-22 14:41:12 +08:00
HFO4 8672042d61 Test: onedrive related 2020-01-22 14:26:13 +08:00
HFO4 0d2e3cc717 Test: Onedrive.OAuth 2020-01-22 10:50:47 +08:00
HFO4 d3f132de6d Fix: thumbnails for 21Vianet OneDrive 2020-01-22 08:58:59 +08:00
HFO4 752ce5ce62 Feat: resume upload in server side 2020-01-21 15:36:04 +08:00
HFO4 06ff8b5a50 Feat: get OneDrive thumbnails 2020-01-21 13:27:20 +08:00
HFO4 6aee31341f Feat: async monitor OneDrive resume upload progress 2020-01-21 11:49:46 +08:00
HFO4 dd5f6e3d25 Feat: onedrive client upload / callback 2020-01-20 14:34:21 +08:00
HFO4 807aa5ac18 Feat: OneDrive OAuth / refresh token 2020-01-19 12:52:36 +08:00
HFO4 fa3b51096a Feat: upyun download / thumb / sign 2020-01-18 14:08:43 +08:00
HFO4 84a6218d3a Test: oss callback signature verification 2020-01-18 12:51:07 +08:00
HFO4 5befbc21d0 Feat: upyun callback & authentication 2020-01-18 10:40:03 +08:00