alist/drivers
Sean 3c21a9a520
feat: Crypt driver, improve http/webdav handling (#4884)
this PR has several enhancements, fixes, and features:
- [x] Crypt: a transparent encryption driver. Anyone can easily, and safely store encrypted data on the remote storage provider.  Consider your data is safely stored in the safe, and the storage provider can only see the safe, but not your data.
  - [x] Optional: compatible with [Rclone Crypt](https://rclone.org/crypt/). More ways to manipulate the encrypted data.
  - [x] directory and filename encryption
  - [x] server-side encryption mode (server encrypts & decrypts all data, all data flows thru the server)
- [x] obfuscate sensitive information internally
- [x] introduced a server memory-cached multi-thread downloader.
  - [x] Driver: **Quark** enabled this feature, faster load in any single thread scenario. e.g. media player directly playing from the link, now it's faster.
- [x] general improvement on HTTP/WebDAV stream processing & header handling & response handling
  - [x] Driver: **Mega** driver support ranged http header
  - [x] Driver: **Quark** fix bug of not closing HTTP request to Quark server while user end has closed connection to alist

## Crypt, a transparent Encrypt/Decrypt Driver. (Rclone Crypt compatible)

e.g.  
Crypt mount path ->  /vault 
Crypt remote path -> /ali/encrypted
Aliyun mount paht -> /ali

when the user uploads a.jpg to /vault, the data will be encrypted and saved to /ali/encrypted/xxxxx. And when the user wants to access a.jpg,  it's automatically decrypted, and the user can do anything with it.
Since it's Rclone Crypt compatible, users can download /ali/encrypted/xxxxx  and decrypt it with rclone crypt tool. Or the user can mount this folder using rclone, then mount the decrypted folder in Linux...

NB.  Some breaking changes is made to make it follow global standard, e.g. processing the HTTP header properly.

close #4679 
close #4827 

Co-authored-by: Sean He <866155+seanhe26@users.noreply.github.com>
Co-authored-by: Andy Hsu <i@nn.ci>
2023-08-02 14:40:36 +08:00
..
115 fix(115): `user-agent` lost on upload (close #4831) 2023-07-23 15:18:33 +08:00
123 fix(123): Use APP-side API (close #4834 in #4856) 2023-07-27 15:51:59 +08:00
139 fix(139): upload empty file (close #4711) 2023-07-27 19:26:22 +08:00
189 refactor: change hash function 2023-07-15 16:29:44 +08:00
189pc refactor: change hash function 2023-07-15 16:29:44 +08:00
alias fix(alias): add api prefix for proxy url (close #4392) 2023-05-19 00:12:57 +08:00
alist_v2 refactor: obj name mapping and internal path processing (#2733) 2022-12-17 19:49:05 +08:00
alist_v3 fix(alist_v3): missed `Content-Length` on upload (close #4457) 2023-05-27 20:23:36 +08:00
aliyundrive refactor: change hash function 2023-07-15 16:29:44 +08:00
aliyundrive_open feat(aliyundrive_open): support `livp` format file download (close #4890) 2023-08-01 21:50:25 +08:00
aliyundrive_share fix(aliyundrive_open): fail limit on concurrently call (#4851) 2023-07-28 15:55:39 +08:00
baidu_netdisk perf(baidu_netdisk): optimize memory allocate 2023-07-29 17:12:43 +08:00
baidu_photo feat: Crypt driver, improve http/webdav handling (#4884) 2023-08-02 14:40:36 +08:00
baidu_share fix(baidu_share): large file download (#3887 close #3876) 2023-03-20 17:46:15 +08:00
base feat: Crypt driver, improve http/webdav handling (#4884) 2023-08-02 14:40:36 +08:00
cloudreve feat(cloudreve): auto remove trailing slash in address (#4492) 2023-05-28 16:18:09 +08:00
crypt feat: Crypt driver, improve http/webdav handling (#4884) 2023-08-02 14:40:36 +08:00
dropbox fix(dropbox): failed get link in #4639 2023-06-25 17:07:31 +08:00
ftp feat: Crypt driver, improve http/webdav handling (#4884) 2023-08-02 14:40:36 +08:00
google_drive feat(google_drive): support sa (close #3132 in #4360) 2023-05-12 14:47:50 +08:00
google_photo feat: support cancel for some drivers (close #2717) 2022-12-21 15:03:09 +08:00
ipfs_api feat(drivers): ipfs api (#4265) 2023-05-05 17:42:22 +08:00
lanzou feat(lanzou): support login with account (close #4880 in #4885) 2023-08-01 19:44:57 +08:00
local feat: Crypt driver, improve http/webdav handling (#4884) 2023-08-02 14:40:36 +08:00
mediatrack feat: support cancel for some drivers (close #2717) 2022-12-21 15:03:09 +08:00
mega feat: Crypt driver, improve http/webdav handling (#4884) 2023-08-02 14:40:36 +08:00
mopan fix(mopan): size field type(close #4734 in #4736) 2023-07-10 14:25:27 +08:00
onedrive fix(onedrive): error check in `upBig` 2023-04-11 22:52:42 +08:00
onedrive_app fix(onedrive): error check in `upBig` 2023-04-11 22:52:42 +08:00
pikpak fix(pikpak): hash calculation and fast upload judgment (#4745 fix #1081) 2023-07-11 22:19:21 +08:00
pikpak_share fix(pikpak_share): change media url to content url (close #3273) (#3441) 2023-02-16 15:42:11 +08:00
quark_uc feat: Crypt driver, improve http/webdav handling (#4884) 2023-08-02 14:40:36 +08:00
s3 feat(s3): add `SessionToken` field (close #4761) 2023-07-13 15:58:19 +08:00
seafile fix(seafile): driver panic while downloading or uploading file (#4491) 2023-05-28 16:45:46 +08:00
sftp feat: Crypt driver, improve http/webdav handling (#4884) 2023-08-02 14:40:36 +08:00
smb feat: Crypt driver, improve http/webdav handling (#4884) 2023-08-02 14:40:36 +08:00
teambition feat(teambition): support s3 upload method (close #4365) 2023-05-13 23:06:25 +08:00
template feat(drivers): alias a new storage with multi path (close #3248) 2023-03-13 15:35:37 +08:00
terabox fix(terabox): slice out of range (close #4858 in #4860) 2023-07-28 15:52:20 +08:00
thunder refactor: change hash function 2023-07-15 16:29:44 +08:00
trainbit fix: make `TlsInsecureSkipVerify` enable for all request (#4386) 2023-05-14 17:05:47 +08:00
url_tree fix(url_tree): incorrect tree structure 2023-03-24 20:34:03 +08:00
uss refactor: change hash function 2023-07-15 16:29:44 +08:00
virtual feat: Crypt driver, improve http/webdav handling (#4884) 2023-08-02 14:40:36 +08:00
webdav fix: make `TlsInsecureSkipVerify` enable for all request (#4386) 2023-05-14 17:05:47 +08:00
wopan feat: add `WoPan` driver (close #4541) 2023-06-17 20:20:00 +08:00
yandex_disk feat: support cancel for some drivers (close #2717) 2022-12-21 15:03:09 +08:00
all.go feat: Crypt driver, improve http/webdav handling (#4884) 2023-08-02 14:40:36 +08:00