staging/pepe2k/scripts/download.pl, branch v21.02.3

download: remove broken mirrors

2021-02-24T19:24:09Z

These mirrors don't exist anymore. Remove them. Signed-off-by: David Bauer (cherry picked from commit f04e0074915f03249cdebb460d4dc92875091c63)

treewide: unify OpenWrt hosted source via @OPENWRT

2021-02-05T22:00:24Z

Multiple sources are hosted on OpenWrts source server only. The source URLs to point to the server vary based on different epochs in OpenWrts history. Replace all by @OPENWRT which is an "empty" mirror, therefore using the fallback servers sources.cdn.openwrt.org and sources.openwrt.org. Signed-off-by: Paul Spooren

scripts: sources CDN as fallback in download.pl

2021-01-28T08:46:08Z

In case the default sources for a package fail use the CDN rather than our own mirror. In case the CDN fails, fallback to our mirror. Also remove mirror1 which isn't available anymore. Signed-off-by: Paul Spooren

download.pl: properly cleanup intermediate .hash file

2020-11-27T21:27:08Z

It seems like after a build the /dl dir seems to now contain a .hash file for each source file due to inproper cleanup so fix it by removing those intermediate files before leaving the download action. Fixes: 4e19cbc55335 ("download: handle possibly invalid local tarballs") Reported-by: Hannu Nyman Signed-off-by: Petr Štetiar

download: handle possibly invalid local tarballs

2020-11-27T13:46:13Z

Currently it's assumed, that already downloaded tarballs are always fine, so no checksum checking is performed and the tarball is used even if it might be corrupted. From now on, we're going to always check the downloaded tarballs before considering them valid. Steps to reproduce: 1. Remove cached tarball rm dl/libubox-2020-08-06-9e52171d.tar.xz 2. Download valid tarball again make package/libubox/download 3. Invalidate the tarball sed -i 's/PKG_MIRROR_HASH:=../PKG_MIRROR_HASH:=ff/' package/libs/libubox/Makefile 4. Now compile with corrupt tarball source make package/libubox/{clean,compile} Signed-off-by: Petr Štetiar

scripts: download.pl: retry download using filename

2020-11-20T01:35:43Z

With this commit, the download script will try downloading source files using the filename instead of the url-filename in case the previous download attempt using the url-filename failed. This is required, as the OpenWrt sources mirrors serve files using the filename files might be renamed to after downloading. If the original mirror for a file where url-filename and filename do not match goes down, the download failed prior to this patch. Further improvement can be done by performing this only for the OpenWrt sources mirrors. Signed-off-by: David Bauer

scripts: download.pl: fix indentation

2020-09-11T15:35:19Z

Signed-off-by: David Bauer

Revert "scripts/download: add sources CDN as first mirror"

2020-08-24T13:55:14Z

This reverts commit c737a9ee6a9c47b6e553ac81bf293b1161e59799. The source CDN has been discontinued in its current form and will take a while to be reestablished. Even then it makes little sense to put a CDN before other CDNs such as kernel.org, apache.org, sourceforge etc. Signed-off-by: Jo-Philipp Wich

scripts/download: add sources CDN as first mirror

2020-04-14T22:16:55Z

OpenWrt now has a CDN for sources at sources.cdn.openwrt.org which mirrors sources.openwrt.org. Downloading sources outside Europe or US (mainland) could result in low throughput, extremely slowing down the first compilation of the build system. This patch adds sources.cdn.openwrt.org as the first mirror to offer worldwide fast download speeds by default. If the CDN goes down for whatever reason, the script jumps to the next available mirror and downloads requested files as before (in regional varying speed). Signed-off-by: Paul Spooren Acked-by: Eneas U de Queiroz

scripts/dowload.pl: add archive.apache.org to apache mirror list

2019-12-22T23:21:46Z

apache mirrors holds only latest releases, to download older releases, one must use archive.apache.org to get them. Signed-off-by: Jiri Kastner