38 dead packages

[jrfondren]

The following packages can't be dub-added:

aammm
ansi
bgfx-d
big-d
btreader
checkit
civge
clipboard
dfunkt
dich
discord-d
dwtlib
dzmq
gdub
hoekjed
interfacing
kisaragi
lhl
libco
libhell
liblzma
litecraft-bgfx
m3d
mogud-benchmark
murmurhash3
pa
pc
pterm
pushmealert
quantum-random
rdub
riffedit
sml
soapclient
stripe-d
tmarsteel-dpipe
wolfssl
yaml-d

All failing as the source as gone away, with errors such as

Fetching riffedit 0.0.0...
Getting a release version failed: Downloading https://code.dlang.org/packages/riffedit/0.0.0.zip failed
with 404 ().
Retry with ~master...
Package riffedit not found for registry at https://code.dlang.org/ (fallbacks registry at https://codemi
rror.dlang.org/, registry at https://dub.bytecraft.nl/, registry at https://code-mirror.dlang.io/): No package candidate found for riffedit ~master
No package riffedit was found matching the dependency ~master

[WebFreak001]

if you need any of them, feel free to ping me (I have archives of most packages and it could be possible I have them archived if they are not too old)

[mw66]

@WebFreak001 how about put the archive on the dub server?

And make dub fetch the archive when fetching from github fails?

[WebFreak001]

that would first require a bunch of registry adjustments, but if you make a PR to include some kind of archive storage, we could upload historical files from my archives as well.

Not sure if currently our servers and bandwidth are enough for that though.

[carblue]

Sorry, my comment doesn't fit perfectly here, but almost:
I'm carblue, author of some (binding) dub packages, none of the 38 dead ones currently: iup, pkcs11, sodium.
But possibly my packages might add to the dead ones in the future because I lost contact to my registry login at
https://code.dlang.org/login?redirect=/my_packages
My former email address (It's gone now) possibly was chilli@posteo.net, my user name probably: carblue

My current credentials are Username: carblue (see also https://github.com/carblue where my D packages are hosted),
my current eMail address: bluecars@posteo.eu.

Whoever can help me regaining access to managing my dub packeges via login, please do so: I would like to update and test a lot after some years of inactivity.
Thanks in advance

[s-ludwig]

@carblue: I've verified everything and changed the account e-mail address to bluecars@posteo.eu - the old one was actually a ...@online.de address.

[s-ludwig]

@WebFreak001: How large is your archive and do you have zip archives of individual snapshots/versions, or git clones? Space on the server is limited, but its a dedicated server (a Hetzner server that I'm renting), so in theory we could probably have them add another drive to it.

[carblue]

@s-ludwig
Thanks, I regained access! ;-) And now I know it was ka6613-496@online.de (gone too)

[WebFreak001]

yes I've got all repositories checked out as git repositories

the total size of the entire dub registry all packages 1 month ago is 22GB (no built artifacts)

[s-ludwig]

Okay, 22 GB would work for the existing SSD storage, so we could in principle implement this for the registry. Some additional gigabytes of zip file cache would be required, but that should be okay, too. The main questions I think would be how GitHub's/GitLab's request throttling works for git requests and if/how the registry mirror should handle code caching. Then there may also be some legal (copyright) issues that could arise and may need some additional preparation.

[WebFreak001]

there doesn't seem to be any throttling for cloning git repositories, I just fetch them all in sequence without any delays every few hours

[Geod24]

@s-ludwig : Could we prune dead packages ? I have posted a list here. I was looking at a Dub issue where the following code:

#!/usr/bin/env dub
/+ dub.sdl:
    name "fixed"
    dependency "decimal" version="0.9.0"
+/

import std.stdio;
import std.algorithm;
import std.random;
import std.math;
import std.conv;
import std.datetime;
import decimal;
import std.bigint;

void main()
{
    decimal128 f = "24.9";
}

Results in:

 % ./bin/dub fixed.d
Error HTTP request returned status code 404 ()

Because fixed no longer exists. I will look into improving the error message (and testing this scenario), but in terms of user-friendliness, pruning those entries will beat any error message.