Signed-off-by: NNiels Thykier <niels@thykier.net>

Signed-off-by: NNiels Thykier <niels@thykier.net>

Signed-off-by: NNiels Thykier <niels@thykier.net>

* waldi/byhash-dedup:
  Add tool to de-duplicate pool
  Don't use dsync to de-dup files
  Re-use old by-hash file if new file hash matches

The deduplication causes all files to get new mtimes in each round.
This forces rsync on each mirror to re-download the files and fix all
the hard-links.

Currently the archive shows about 4GiB of files in pool/ that have been
de-duplicated.  Most of the others are part of the installer or by-hash.

Force the file to have the same mtime if the checksum shows that it was
not changed.

If source-only uploads are enabled, accept also uploads not including
arch-indep packages by default.  An exception exists for a list of
suites that have no arch:all buildds in Debian.

 - remove squeeze
 - wheezy is oldoldstable
 - jessie is oldstable
 - stretch is stable
 - welcome buster as testing

When accepting an upload on the security archive, we need the
`.buildinfo` files to forward the upload to ftp-master.  For now,
store them along with the `.changes` in the queue directory.