winetricks icon indicating copy to clipboard operation
winetricks copied to clipboard

find somewhere to mirror old microsoft (and other) binaries?

Open austin987 opened this issue 3 years ago • 18 comments

Microsoft is removing a lot of stuff, and archive.org is slow. I don't want to maintain or pay for servers.

I debated hosting stuff on github or sourceforge, but I think that's likely an abuse, at least in spirit if not the letter of their guidelines.

Opening an issue, as maybe someone has other ideas.

austin987 avatar Feb 04 '21 02:02 austin987

What's the required whole size?

mozo78 avatar Feb 08 '21 16:02 mozo78

I have 80GB host so I'll be happy to help.

mozo78 avatar Feb 09 '21 10:02 mozo78

Non-exhaustive, but after running 'make test' with an empty cache, 4.1 GB are used:

austin@desktop ~/.cache/winetricks $ du -sh *
1.2M	7zip
2.3M	ahk
57M	art2k7min
33M	art2kmin
28M	baekmuk
132K	binkw32
5.2M	cabinet
44K	cinepak
5.3M	cmd
156K	cnc_ddraw
580K	comctl32
3.8M	corefonts
1.4M	d3dcompiler_46
36M	d3dcompiler_47
7.4M	d9vk
6.3M	d9vk010
6.5M	d9vk011
6.5M	d9vk012
6.6M	d9vk013
6.7M	d9vk013f
7.0M	d9vk020
7.2M	d9vk021
7.2M	d9vk022
7.4M	d9vk030
7.4M	d9vk040
252M	directx9
24M	dotnet11
11M	dotnet11sp1
23M	dotnet20
355M	dotnet20sdk
24M	dotnet20sp1
24M	dotnet20sp2
51M	dotnet30
198M	dotnet35
232M	dotnet35sp1
49M	dotnet40
19M	dotnet40_kb2468871
63M	dotnet46
65M	dotnet461
60M	dotnet462
66M	dotnet471
81M	dotnet472
22M	dotnetcore2
23M	dotnetcore3
47M	dotnetcoredesktop3
248K	dotnet_verifier
6.4M	droid
7.5M	dx8vb
7.6M	dxvk
2.5M	dxvk054
2.5M	dxvk060
2.5M	dxvk061
2.5M	dxvk062
2.5M	dxvk063
2.5M	dxvk064
2.5M	dxvk065
4.4M	dxvk070
4.4M	dxvk071
4.4M	dxvk072
4.5M	dxvk080
4.6M	dxvk081
4.6M	dxvk090
4.6M	dxvk091
4.6M	dxvk092
4.6M	dxvk093
4.6M	dxvk094
4.7M	dxvk095
4.7M	dxvk096
4.7M	dxvk100
4.7M	dxvk101
4.7M	dxvk102
4.7M	dxvk103
4.9M	dxvk111
5.0M	dxvk120
5.0M	dxvk121
5.0M	dxvk122
5.0M	dxvk123
5.0M	dxvk130
5.1M	dxvk131
5.1M	dxvk132
5.3M	dxvk133
5.4M	dxvk134
5.4M	dxvk140
5.4M	dxvk141
5.4M	dxvk142
5.5M	dxvk143
5.5M	dxvk144
5.5M	dxvk145
5.5M	dxvk146
7.4M	dxvk150
7.4M	dxvk151
7.4M	dxvk152
7.5M	dxvk153
7.5M	dxvk154
7.5M	dxvk155
7.4M	dxvk160
7.4M	dxvk161
7.4M	dxvk170
7.6M	dxvk171
7.6M	dxvk172
7.6M	dxvk173
1.7M	eufonts
14M	faudio1901
14M	faudio1902
14M	faudio1903
14M	faudio1904
14M	faudio1905
14M	faudio1906
244K	galliumnine
244K	galliumnine06
244K	galliumnine07
30M	gfw
256K	glidewrapper
124K	glut
3.4M	hhw
3.8M	icodecs
77M	ie6
15M	ie7
17M	ie8
9.3M	ie8_kb2936068
12M	ipamona
3.7M	jet40
12M	lavfilters
11M	lavfilters702
1.3M	liberation
1.9M	lucida
5.2M	mdac27
5.9M	mdac28
63M	mfc70
3.5M	msdxmocx
1.8M	msls31
1.1M	msxml3
2.4M	msxml4
1.8M	msxml6
1.7M	nuget
2.6M	ogg
272K	opensymbol
58M	physx
61M	PowerPointViewer
20M	quicktime72
1.7M	riched30
144K	sdl
24M	shockwave
118M	sourcehansans
68M	speechsdk
408K	tahoma
29M	takao
2.0M	uff
12M	unifont
220K	vb2run
248K	vb3run
864K	vb4run
976K	vb5run
2.1M	vb6run
9.9M	vb6sp6
868K	vcrun2003
2.6M	vcrun2005
4.3M	vcrun2008
4.9M	vcrun2010
6.3M	vcrun2012
6.3M	vcrun2013
14M	vcrun2015
14M	vcrun2017
14M	vcrun2019
3.5M	vcrun6
61M	vcrun6sp6
3.8M	vjrun20
2.2M	vlgothic
1.7M	vulkanrt
1.6M	vulkanrt121412
2.4M	wenquanyi
6.9M	wenquanyizenhei
130M	win2ksp4
538M	win7sp1
1.2M	windowscodecs
4.8M	winxpsp2_support_tools
317M	winxpsp3
1.2M	wm9codecs
13M	wmp10
25M	wmp11
14M	wmp9
1.0M	wmv9vcm
1.1M	wsh57
7.4M	xna31
6.8M	xna40
11M	xvid
austin@desktop ~/.cache/winetricks $ du -sh .
4.1G	.

That doesn't account for apps/games, but those are also much less important IMO.

austin987 avatar Feb 12 '21 08:02 austin987

I have 90GB in mail.ru and 30GB in pcloud.com. Unfortunately I realized the uploaded files can't be accessed directly. I get the direct link but it expires after certain amount of time. I'm very sorry :(

mozo78 avatar Feb 12 '21 08:02 mozo78

No worries, I wouldn't want to depend on unknowing third party hosts, anyway.

Ideally, some company/FOSS group with infrastructure (admins, servers, legal contacts, etc.) in place would mirror it. In the meantime, I think archive.org works. I prefer focusing on the code aspect ;).

austin987 avatar Feb 12 '21 09:02 austin987

@austin987 How about hosting them on GitHub? The folks over at PortingKit seem to have done this. They are mirrored here.

I'm not a lawyer, so I'm unsure about how great of a solution this is, but it at least seems Microsoft isn't taking them down (yet).

gverm avatar Mar 01 '21 11:03 gverm

The GitHub Acceptable Use Policy implies it's not allowed: (https://docs.github.com/en/github/site-policy/github-acceptable-use-policies)

"infringes any proprietary right of any party, including patent, trademark, trade secret, copyright, right of publicity, or other right."

Given that it's an open secret that there is leaked Microsoft source code on GitHub (which, for obvious reasons, I'm not linking here), I don't think Microsoft really monitors what's on GitHub..That said, since I'm located in the United States, I don't really want to spit in their eye ;).

austin987 avatar Mar 05 '21 09:03 austin987

how about using something like IPFS?

omichalek avatar Mar 22 '21 21:03 omichalek

I see there is a w_download_torrent implemented (but not used). I also like the IPFS idea, but the bar to host a torrent is likely a lot lower than running a IPFS node. (in the meantime - archive.org would surly appreciate a donation: https://archive.org/donate/ I threw some money their way after downloading like 1.5GB to (maybe :crossed_fingers: ) run an old game)

olejorgenb avatar Apr 17 '21 19:04 olejorgenb

~https://www.catalog.update.microsoft.com/Search.aspx?q=KB976932 contains links to identically files which is currently downloaded from archive.org: https://web.archive.org/web/20110608165548/http://download.microsoft.com/download/0/A/F/0AFB5316-3062-494A-AB78-7FB0D4461357/windows6.1-KB976932-X86.exe == http://download.windowsupdate.com/msdownload/update/software/svpk/2011/02/windows6.1-kb976932-x86_c3516bc5c9e69fee6d9ac4f981f5b95977a8a2fa.exe~

Sorry for the noise - fixed in the newest version: https://github.com/Winetricks/winetricks/commit/66f5122b39d50e0103b7a5d5852a199065e8c95d

olejorgenb avatar Apr 17 '21 19:04 olejorgenb

most fonts (not CJK) + all pre-2016 DLL section (except DirectX) are 2.3Gb (with 7zip+Cabinet+SDL+Python2.7 included):

pi@raspberrypi:~ $ ls ~/.cache/winetricks
7zip         dotnet35sp1         msxml3            vb6run
ahk          dotnet40            msxml4            vb6sp6
art2k7min    dotnetcore2         msxml6            vcrun2003
art2kmin     dotnetcore3         ogg               vcrun2005
baekmuk      dotnetcoredesktop3  physx             vcrun2008
binkw32      dx8vb               PowerPointViewer  vcrun2010
cabinet      faudio              python27          vcrun2012
cinepak      faudio190607        quicktime76       vcrun2013
cmd          ffdshow             riched30          vcrun2015
comctl32     gdiplus_winxp       sdl               vcrun6
corefonts    glidewrapper        shockwave         vcrun6sp6
dirac        glut                tahoma            vlgothic
directx9     icodecs             takao             win2ksp4
dotnet11     lucida              track_usage       win7sp1
dotnet20     mdac27              vb2run            winxpsp2_support_tools
dotnet20sp1  mfc70               vb3run            winxpsp3
dotnet20sp2  msdxmocx            vb4run            wsh57
dotnet35     msls31              vb5run            xvid
pi@raspberrypi:~ $ du -sh ~/.cache/winetricks
2.3G	/home/pi/.cache/winetricks

Note: mdac27/art2kmin/art2k7min wreck default icon/mime associations

paulwratt avatar May 16 '21 09:05 paulwratt

see #1752 for example of how to get (now broken) urls working

any url that is broken and points to a microsoft server url is available from web.archive.org which is how they have already fixed a lot of urls (the SHA checksums dont change)

It may be worth approching Archive.Org for a specific Wintricks url that they can then offload to a specific server/connection - they already do this for various other large and/or well used (retro) items.

you can't use GitHub because there are file size limits, which some of the binaries will excede (I think its 100Mb on the web upload, and 250Mb on the GIT urls)

EDIT: also see this comment

paulwratt avatar May 16 '21 09:05 paulwratt

winetricks already falls back to archive.org. The point of this issue is to avoid the need for that fallback.

austin987 avatar May 17 '21 16:05 austin987

maybe set up a nextcloud instance?

werdahias avatar Jun 29 '21 18:06 werdahias

Maybe you can think about store those achieves on AWS or other cloud-file share platform?

sakylian avatar Mar 22 '22 08:03 sakylian

There might still be a relatively fair number of http://download.microsoft.com/download/* links up. But alas with none of the entry/welcome/front pages available, it's anybody guess to come up with the right "GUID" and file name, if we weren't already relying on them in the past. (e.g. I tried for half a hour to figure out the original url for VS7.1sp1-KB9322981102-X86-Enu.exe, which could provide you with the last msvc(p|r)71 dlls, but with no luck).

Is there some way to increase the results limit for when you run queries on the wayback machine?

mirh avatar Nov 14 '22 16:11 mirh

cloudflare r2 might work? it does seem to have 10gb free storage... (and zero egress fees, ever)

somebody1234 avatar Feb 04 '23 10:02 somebody1234

winetricks already falls back to archive.org. The point of this issue is to avoid the need for that fallback.

It seems like the version it now falls back to is broken or at least results in invalid exe files (someone maybe saved the 404 page?)

MTRNord avatar Aug 14 '23 14:08 MTRNord