github
/
aria2
mirror of https://github.com/aria2/aria2
1
0
Fork 0
Code Issues Releases Wiki Activity
3,133 Commits
9 Branches
152 Tags
63 MiB
Commit Graph

2315 Commits (9b4855a5f01865371d95d6452f1d3f0700e6788f)

Author SHA1 Message Date
Tatsuhiro Tsujikawa e76dc28f7f Added libnettle and libgmp support. 
libnettle and libgmp is used by default. Old implementation uses
libgcrypt as default. If more and more Linux distributions offer
libnettle linked GnuTLS, then this change decrease library dependency
against libgcrypt and libgpg-error.  The current library detection for
libnettle and libgmp is very simple, just use AC_SEARCH_LIBS.
util::generateRandomData() was written using SimpleRandomizer, thus no
external library dependency from this function.
 2011-08-11 02:29:14 +09:00
Tatsuhiro Tsujikawa 11ac2c4a88 Added DHKeyExchange implementation using GMP. 2011-08-11 00:08:29 +09:00
Tatsuhiro Tsujikawa 6edfa4e430 Limit maximum length of ByteArrayWriter. 
aria2 downloads meta files such as .torrent and .metalink file in
memory using ByteArrayWriter. To prevent accidentally download big
file, we set the maximum length that ByteArrayWriter can hold.  The
default is 5MiB and it is reasonable because most .torrent and
.metalink file are much smaller than that.
 2011-08-10 23:58:49 +09:00
Tatsuhiro Tsujikawa 2d9323651b Don't use sorted std::deque for requestSlots_. 
Don't use sorted deque for requestSlots_. For the most time, first
data requested is sent back first. So using std::deque, we find
received RequestSlot by O(1), while sorted std::deque requires
O(logN).
 2011-08-10 23:18:23 +09:00
Tatsuhiro Tsujikawa 6ee913b0bc Simplified PieceStatMan and RarestPieceSelector. 
Simplified PieceStatMan and RarestPieceSelector, but computation order
 to select piece index is still O(N) and unchanged.  Updating piece
 stat is improved to O(N) for bitfield update and O(1) for single
 index update, while old implementation needs O(NlogN) and O(N)
 respectively.
 2011-08-10 21:29:01 +09:00
Tatsuhiro Tsujikawa 37016c6587 global cout and cerr is now retrieved using global::cout() and global::cerr() 
This is necessary to avoid global variable initialization order
problem.
 2011-08-10 01:28:20 +09:00
Tatsuhiro Tsujikawa e8e3a6f259 wallclock is now retrieved using global::wallclock() call. 
This is necessary to avoid global variable initialization order
problem.
 2011-08-10 01:17:28 +09:00
Tatsuhiro Tsujikawa 97f34ab668 Added global::cerr. windows.h now included from common.h 
We replaced most of std::cerr with global::cerr.  windows.h is now
included from common.h. Before including it, we define WINVER.  We
renamed some variable name because some macros in windows.h collide
with them.
 2011-08-10 00:38:48 +09:00
Tatsuhiro Tsujikawa a10cda2f17 Use global::cout to output string to stdout. 
In MinGW32 build, global::cout is WinConsoleFile. When outputing to
console, it uses WriteConsoleW, so Unicode characters are written.
Fixed memory leak in WChar<->MultiByte conversion functions.  The
portion of code which uses std::cout is rewritten to use global::cout.
 2011-08-09 23:33:55 +09:00
Tatsuhiro Tsujikawa 02307cee0a Removed utf8ToNative from log message and exception message. 2011-08-08 21:46:10 +09:00
Tatsuhiro Tsujikawa 7368c9c9d8 Percent-encode non-printable ASCII and non-ASCII chars in FileEntry. 
Percent-encode non-printable ASCII and non-ASCII chars in URI using
util::percentEncodeMini() when URI is added to FileEntry.  Removed
percent-encode from Request. Also do percent-encoding when setting
referer and redirected URI.
 2011-08-07 20:46:04 +09:00
Tatsuhiro Tsujikawa 491e8bc519 Call utf8ToNative to log filename and URI in Metalink2RequestGroup. 2011-08-07 18:48:40 +09:00
Tatsuhiro Tsujikawa e9d16306df Made getRedirectURI and getTransferEncoding return const reference. 
Made getRedirectURI and getTransferEncoding in HttpResponse return
const reference.
 2011-08-07 18:45:29 +09:00
Tatsuhiro Tsujikawa 272d81b7a1 Rewritten ExpatMetalinkProcessor using BufferedFile. 2011-08-07 18:08:16 +09:00
Tatsuhiro Tsujikawa 32d413c6de Use BufferedFile::printf in SessionSerializer 2011-08-07 17:30:21 +09:00
Tatsuhiro Tsujikawa fd5f9127cd Rewritten Logger using BufferedFile. 2011-08-07 17:06:07 +09:00
Tatsuhiro Tsujikawa b6b8cb005d Added printf and flush method to BufferedFile. 2011-08-07 17:05:50 +09:00
Tatsuhiro Tsujikawa e2d682e0c6 bencode2::decodeFromFile is now first read torrent metainfo file into 
memory before parsing it.
 2011-08-07 01:43:24 +09:00
Tatsuhiro Tsujikawa 4220c2aadc Read aria2.conf using BufferedFile 
Read aria2.conf using BufferedFile. Added BufferedFile::transfer().
 2011-08-07 01:43:02 +09:00
Tatsuhiro Tsujikawa b3b67f440b Removed unused function declaration. 2011-08-07 01:11:28 +09:00
Tatsuhiro Tsujikawa 0f349773f5 Rewritten saveAs using BufferedFile 2011-08-07 01:10:17 +09:00
Tatsuhiro Tsujikawa a6c2ad53bf Rewritten UriListParser using BufferedFile 2011-08-07 01:05:02 +09:00
Tatsuhiro Tsujikawa 945012a32f Removed unused header 2011-08-07 00:37:54 +09:00
Tatsuhiro Tsujikawa 1f710d29c1 Rewritten SessionSerializer using BufferedFile 2011-08-07 00:36:44 +09:00
Tatsuhiro Tsujikawa 6034474550 Don't allow copying BufferedFile 2011-08-07 00:36:31 +09:00
Tatsuhiro Tsujikawa 190d170076 Rewritten ServerStatMan using BufferedFile. 2011-08-07 00:10:53 +09:00
Tatsuhiro Tsujikawa 7f3d027b83 Removed feof from operator unspecified_bool_type. Added eof(). 
In BufferedFile, removed feof from operator unspecified_bool_type. EOF
can be queried separately using newly added eof().
 2011-08-07 00:06:32 +09:00
Tatsuhiro Tsujikawa f6472abae8 Compare 16bytes of header text. 2011-08-06 23:04:06 +09:00
Tatsuhiro Tsujikawa 8f93855bbd Rewritten ProtocolDetector using BufferedFile 2011-08-06 22:43:24 +09:00
Tatsuhiro Tsujikawa c553d92f45 Rewritten NsCookieParser using BufferedFile 2011-08-06 21:59:06 +09:00
Tatsuhiro Tsujikawa f38c2d2012 Rewritten Netrc using BufferedFile. 2011-08-06 21:57:38 +09:00
Tatsuhiro Tsujikawa c9f8cf75bf Rewritten CookieStorage using BufferedFile 2011-08-06 21:53:59 +09:00
Tatsuhiro Tsujikawa 410d88710b Rewritten DHTRoutingTable I/O using BufferedFile. 2011-08-06 21:35:39 +09:00
Tatsuhiro Tsujikawa ef27370243 Use BufferedFile in DefaultBtProgressInfoFile 2011-08-06 21:27:17 +09:00
Tatsuhiro Tsujikawa 6cb91cae88 Added fopen/fread/fwrite/fgets wrapper class. 2011-08-06 21:17:36 +09:00
Tatsuhiro Tsujikawa 733ff2c05a Rewritten NsCookieParser using stdio instead of stream. 2011-08-05 23:35:00 +09:00
Tatsuhiro Tsujikawa 07874696c5 Rewritten Netrc using stdio instead of stream. 2011-08-05 23:33:30 +09:00
Tatsuhiro Tsujikawa 13158de0d3 Removed unused header fstream from DHTSetup 2011-08-05 22:45:34 +09:00
Tatsuhiro Tsujikawa 168094560d Rewritten CookieStorage using stdio instead of stream 2011-08-05 22:44:54 +09:00
Tatsuhiro Tsujikawa 292bbb3679 Added log messages to DHTRoutingTable IO routines. 2011-08-05 22:23:53 +09:00
Tatsuhiro Tsujikawa dea7a7969c Rewritten DHTRoutingTableSerializer using stdio instead of stream. 2011-08-05 22:15:55 +09:00
Tatsuhiro Tsujikawa f141cd4228 Rewritten DHTRoutingTableDeserializer using stdio instead of stream. 2011-08-05 21:50:11 +09:00
Tatsuhiro Tsujikawa 5eb338ad87 Rewritten DefaultBtProgressInfoFile using stdio instead of stream. 2011-08-05 18:34:07 +09:00
Tatsuhiro Tsujikawa 3879da592d In MinGW32, open file with UNICODE filename and print them in ANSI. 2011-08-04 21:43:02 +09:00
Tatsuhiro Tsujikawa 6e1e481be5 Make --metalink-location option available with --disable-metalink 2011-07-31 21:46:07 +09:00
Tatsuhiro Tsujikawa afdbda8f10 Initialize libgcrypt. 
We relied initialization of libgcrypt on gnutls_global_init(), but
recent change in gnutls, which changes default crypto backend from
libgcrypt to libnettle, leaves libgcrypt uninitialized if it uses
libnettle as backend(and this is likely because libnettle is chosen by
default). To fix this issue, we simply initialize libgcrypt on our
own.
 2011-07-30 17:36:39 +09:00
Tatsuhiro Tsujikawa 70eeebfae9 Retry DHT get_peers task if the number of peers in PeerStorage is less 
than max peers.

Added virtual size_t countPeer() const to PeerStorage.
 2011-07-29 23:49:25 +09:00
Tatsuhiro Tsujikawa aa13ff5f51 Throw exception with error message if gnutls_global_init() failed. 2011-07-29 22:06:02 +09:00
Tatsuhiro Tsujikawa 932c258755 Added log message when checksum validation failed. 2011-07-28 00:00:01 +09:00
Tatsuhiro Tsujikawa 4ea28cb837 Don't send basic auth header to service operated on differenct port. 
When --http-auth-challenge=true, aria2 only sends basic auth header
when requested. Old implementation sends basic auth header to service
operated in different port in successive request. This change avoid
this bug.
 2011-07-27 23:28:31 +09:00
Tatsuhiro Tsujikawa 02292feaba Consistent naming scheme for hash type and digest for Piece. 2011-07-27 22:50:10 +09:00
Tatsuhiro Tsujikawa 03f0774482 Consistent naming scheme for hash type and digest for DownloadContext. 2011-07-27 22:44:30 +09:00
Tatsuhiro Tsujikawa 7b86b294c9 Consistent naming scheme for hash type and digest. 2011-07-27 21:44:54 +09:00
Tatsuhiro Tsujikawa ce101f5ad2 Use HttpHeader::getIterator() instead of HttpHeader::get() 2011-07-27 21:15:54 +09:00
Tatsuhiro Tsujikawa c536e460aa Merge branch 'rfc6249' 2011-07-27 21:02:53 +09:00
Tatsuhiro Tsujikawa a533437be6 Implemented Metalink/HTTP in HTTP download. 
Link header fields from first Metalink server is utilized as described
in rfc6249. We only set digest from Digest header field to
DownloadContext only when PieceStorage is not initialized(in other
words, before file size is known). After PieceStorage is initialized,
Digest header field is used to check the value is the same in digest
in DownloadContext.  Current implementation only handles
rel=duplicate.
 2011-07-27 20:54:21 +09:00
Tatsuhiro Tsujikawa 67e91c3431 HttpResponse::getDigest() now returns all Digest. 
In addition, HttpResponse::getMetalinkHttpEntries() does not check
validity of URI. It is checked when we add it to FileEntry.
 2011-07-27 19:32:35 +09:00
Tatsuhiro Tsujikawa 7c317de4e7 Added Metalink/HTTP Link and Digest header field parser. 2011-07-26 23:41:21 +09:00
Tatsuhiro Tsujikawa 9ff60ac477 Added struct for Metalink/HTTP 2011-07-26 23:19:54 +09:00
Tatsuhiro Tsujikawa 3b9a751757 Lowcase PREF_METALINK_LOCATION before split. 2011-07-25 23:58:38 +09:00
Tatsuhiro Tsujikawa 5a4a627d72 Remove Metalink content-type after first server response. 
We don't accept Metalink content-type after first server response.
 2011-07-25 00:03:13 +09:00
Tatsuhiro Tsujikawa a6b7ef5f07 Eliminated static variable from LpdReceiveMessageCommand. 
BtRegistry now holds LpdMessageReceiver.
 2011-07-22 00:41:45 +09:00
Tatsuhiro Tsujikawa 97f76b7cf4 Fixed the bug due to dangling pointers in RequestGroup. 
RequestGroup holds a poitner to btRuntime_ and peerStorage_. After
removing them from BtRegistry, we failed to set 0 to them.  When
program access them, it goes undefined world, such as random crash.
We found this bug when pasuing download and valgrind warned memory
corruption.
 2011-07-21 23:59:44 +09:00
Tatsuhiro Tsujikawa c58f736bb9 BtRegistry now holds BitTorrent TCP server port. 
Because BitTorrent TCP server port is global configuration, it is not
preferable that per download resource BtRuntime holds it.  We also
refactored and eliminated ugly static variable in PeerListenCommand.
If TCP port is necessary, we inject it to them directly.
 2011-07-21 23:42:41 +09:00
Tatsuhiro Tsujikawa f0cd83f809 Added log message to clarify error for BitTorrent server socket. 2011-07-21 21:59:26 +09:00
Tatsuhiro Tsujikawa e15f4edf8b Loosen the condition where maxOutstandingRequest_ is increased. 2011-07-18 23:31:25 +09:00
Tatsuhiro Tsujikawa a454a97c4e Set UB_MAX_OUTSTANDING_REQUEST 256 2011-07-16 16:19:38 +09:00
Tatsuhiro Tsujikawa af0daa3caa Set NO_DEFAULT_VALUE as the default value of --enable-direct-io. 2011-07-16 16:15:16 +09:00
Tatsuhiro Tsujikawa 0eda667605 Added #deprecated help tag. 2011-07-16 16:14:57 +09:00
Tatsuhiro Tsujikawa 4933428261 Removed ENABLE_DIRECT_IO macro. 2011-07-16 16:06:15 +09:00
Tatsuhiro Tsujikawa dbf4f553ca Deprecated --enable-direct-io option. 
Modified DeprecatedOptionHandler so that it can have replacing
OptionHandler.
 2011-07-16 16:03:28 +09:00
Tatsuhiro Tsujikawa b96df117d6 Removed deprecated options. 
Removed --enable-xml-rpc, --xml-rpc-listen-all, --xml-rpc-listen-port,
--xml-rpc-max-request-size, --xml-rpc-user, --xml-rpc-passwd.
 2011-07-16 15:52:35 +09:00
Tatsuhiro Tsujikawa 5bbfa742fc Removed use of O_DIRECT because it performs bad. 2011-07-16 13:57:31 +09:00
Tatsuhiro Tsujikawa 5c4a52ad74 Managed user cuid in Piece. 
Previous implementation does not store information which Command cuid
uses which Piece.  Mark Piece acquired by SegmentMan by setting
Piece::setUsedBySegment(true).
 2011-07-16 00:58:41 +09:00
Tatsuhiro Tsujikawa ba710a7cb4 Define SHUT_WR as SD_SEND for MinGW32 2011-07-16 00:58:13 +09:00
Tatsuhiro Tsujikawa ad4065ca12 Increased max # of in-flight request in BitTorrent. 2011-07-16 00:24:29 +09:00
Tatsuhiro Tsujikawa 44c379eaa8 Do nothing if block has already acquired. 
This happens in end-game mode.
 2011-07-16 00:23:45 +09:00
Tatsuhiro Tsujikawa 5703835784 Use GNUTLS_SHUT_WR instead of GNUTLS_SHUT_RDWR 
We don't read the response from peer about this.
 2011-07-06 22:52:15 +09:00
Tatsuhiro Tsujikawa 6f602e2809 Call shutdown() with SHUT_WR before close to avoid TCP RST. 2011-07-06 22:51:20 +09:00
Tatsuhiro Tsujikawa d2e76eca47 Don't search faster server using ServerStatMan if req_ is null or 
total length is unknown.
 2011-06-29 21:30:32 +09:00
Tatsuhiro Tsujikawa 45430983d8 Move URI to spendUris_ when it is selected in 
FileEntry::findFasterRequest().
 2011-06-28 22:38:31 +09:00
Tatsuhiro Tsujikawa bd4d3a27b3 Assign global::wallclock instead of calling Timer::reset(). 2011-06-28 22:30:40 +09:00
Tatsuhiro Tsujikawa 5d498cb1ab Take into account PREF_MAX_CONNECTION_PER_SERVER in 
findFasterRequest(...,serverStatMan).
 2011-06-28 21:27:31 +09:00
Tatsuhiro Tsujikawa 2906484345 Use ServerStat to find faster server. 2011-06-28 00:21:29 +09:00
Tatsuhiro Tsujikawa 0f0d4b9a48 Documented that falloc can be used against NTFS(MinGW build only). 2011-06-20 23:28:19 +09:00
Tatsuhiro Tsujikawa cc7bc0aad3 Added aria2.getGlobalStat RPC method. 
It returns overall download/upload speed and the number of
active/stopped/waiting downloads.
 2011-06-17 22:45:42 +09:00
Tatsuhiro Tsujikawa bb7e2e69db Call requestQueueCheck() even if reservedGroups_ is not empty. 2011-06-16 22:36:20 +09:00
Tatsuhiro Tsujikawa 58b9655ad4 Call requestQueueCheck() even if reservedGroups_ is not empty. 
This is because if all downloads in reservedGroups_ are in paused
state, we have to call requestQueueCheck() for each new added
download.
 2011-06-16 22:01:14 +09:00
Tatsuhiro Tsujikawa bea21e0afa Added --stream-piece-selector option to -i list option. 2011-06-16 21:45:47 +09:00
Tatsuhiro Tsujikawa d5c2ef4ce9 Added --pause option. 
This option pauses download after added. This option is effective only
when --enable-rpc=true is given.  When --save-session option is used
and there are paused downloads, they are saved with --pause=true so
that it will become paused state when the session is recovered.
 2011-06-16 21:37:15 +09:00
Tatsuhiro Tsujikawa c0d1e98133 Abort aria2 if it could not setup any RPC server. 2011-06-15 22:19:09 +09:00
Tatsuhiro Tsujikawa 561dafc942 Added --truncate-console-readout option. 
This option truncates console readout to fit in a single line.  This
is default. Give false value to this option to tell aria2 not to
truncate console readout.
 2011-06-15 20:27:14 +09:00
Tatsuhiro Tsujikawa e3e7a420de Cache and reuse RpcMethod objects. 2011-06-15 20:07:10 +09:00
Tatsuhiro Tsujikawa d1885a5874 Allowed missing params in system.multicall RPC method. 2011-06-15 00:42:50 +09:00
Tatsuhiro Tsujikawa 2d92571cf9 Moved jsonRpc flag from RpcMethod to RpcRequest. 
Now RpcMethod is stateless, so we can cache and reuse them.
 2011-06-15 00:19:07 +09:00
Tatsuhiro Tsujikawa ba9673be1d Initialized member variables of DownloadResult in its ctor. 2011-06-12 00:51:36 +09:00
Tatsuhiro Tsujikawa 65ec9e98df Replaced InOrder with Inorder. 2011-06-11 21:49:09 +09:00
Tatsuhiro Tsujikawa deaea9537b Added --stream-piece-selector option. 
This option specifies piece selection algorithm used in HTTP/FTP
download. Piece means fixed length segment which is downloaded in
parallel in segmented download. If 'default' is given, aria2 selects
piece so that it reduces the number of establishing connection. This
is reasonable default behaviour because establishing connection is an
expensive operation.  If 'inorder' is given, aria2 selects piece which
has minimum index. Index=0 means first of the file. This will be
useful to view movie while downloading it. --enable-http-pipelining
option may be useful to reduce reconnection overhead.  Please note
that aria2 honors --min-split-size option, so it will be necessary to
specify a reasonable value to --min-split-size option.
 2011-06-11 21:41:56 +09:00
Tatsuhiro Tsujikawa cc82da3bab Added StreamPieceSelector class. 
This class abstracts the piece selection algorithm for HTTP/FTP
download.
 2011-06-11 17:34:17 +09:00
Tatsuhiro Tsujikawa 533cdfa850 Removed unnecessary template parameter from std::make_pair call. 
The patch was contributed from Dan Fandrich.
 2011-06-10 21:11:03 +09:00