Re: [Mingw-cross-env-list] Installing in Offline Environment

Forgive my ignorance - I'm not sure what the difference is between `lcms` and `lcms2`. I have a package `lcms-1.19.tar.gz` that *does* have a checksum matching that expected by `src/lcms1.mk`. But if I understand this all correctly, when I try to build for qt5, it's looking for lcms2, specifically lcms2-2.9, which is what I have manually downloaded. My lcms2 tarball is not matching what is expected when I download manually from SourceForge, where the tarball is hosted. It sounds like it's an issue of lcms2 getting re-packaged on SourceForge.

> Do you mean `lcms2` or `lcms`? I can see mxe is downloading `lcms` from backup. There are two reasons we will fall through to a backup:

> - primary or secondary files/sites are unreachable
> - checksum has changed on primary or secondary site
>
>the latter case is usually a project reissuing a tarball with a packaging fix for the same version. In that case, we have checksum-suffixed tarballs as backups. If you are going to the trouble of an air-space build, you should verify anything from a backup and issue a pull request to update the checksum from the primary site.

It looks like the last modification date of the lcms2 tarball was on 25 November 2017, and the last update to lcms.mk that changed the package version and checksum was on 7 November 2017. Looks like the issue you pointed out, there was a re-packaging that just didn't get caught and the backup had the right checksum. I can try updating the checksum on my air-gapped system and see if that fixes the issue. If so, I can open a PR on GitHub to address it.

Thanks again everyone for your patience!

-Seth

On Wed, Sep 18, 2019 at 10:55 AM Tony Theodore <address@hidden> wrote:

> On 18 Sep 2019, at 22:33, Seth Raymond <address@hidden> wrote:
>
> @Mark - Yes, that was my mistake in my write-up, I did run "make download-qt5”.

See my results below from `make download-qt5`[1]

Note there are some pkgs (automake, patch,…) that are platform specific (darwin here)
and won’t be part of your deps.

> @Tony - Yes, I realized late last night that I could check the src/*.mk files to see what the accepted checksums were... not sure why I didn't think of that earlier. I have re-downloaded all of the packages and the only one that is having an issue now is lcms2. I grabbed it from the approved website (sourceforge), but it seems that the checksums still aren't matching.

Do you mean `lcms2` or `lcms`? I can see mxe is downloading `lcms` from backup. There
are two reasons we will fall through to a backup:
- primary or secondary files/sites are unreachable
- checksum has changed on primary or secondary site

the latter case is usually a project reissuing a tarball with a packaging fix for the
same version. In that case, we have checksum-suffixed tarballs as backups. If you are
going to the trouble of an air-space build, you should verify anything from a backup
and issue a pull request to update the checksum from the primary site.

Both `bzip2` and `lcms` will have mismatches from a manual download.

You can avoid backup downloads with[2]:

make download MXE_NO_BACKUP_DL=true

> To bring my files from the networked computer to the non-networked, I burn the packages to a CD and bring that over.

After [1], it should fit on a CD:
$ du -h -d1 pkg
515M pkg

> The burning process does encrypt the files, so that could be one potential point of failure, though I really hope that's not the case…

Most of these files have been encrypted in transit so I can’t see how that would be an issue.

> I have not yet confirmed a delta between the checksum pre-burned to CD and once it has been removed from the CD

Indeed, if you want to do this manually, verifying checksums is your first step.

Cheers,

Tony

[1] download qt5 and all deps

$ rm -rf pkg
$ make download-qt5 -j8
[download] ccache-3.6.tar.xz
[download] qt3d-everywhere-src-5.13.1.tar.xz
[download] pkgconf-da179fd.tar.gz
[download] libtool-2.4.4.tar.gz
[download] autoconf-2.69.tar.xz
[download] m4-1.4.18.tar.xz
[download] automake-1.16.1.tar.gz
[download] bison-3.0.4.tar.xz
[download] flex-2.6.0.tar.bz2
[download] patch-2.7.5.tar.gz
[download] gcc-5.5.0.tar.xz
[download] binutils-2.28.tar.bz2
[download] mingw-w64-v6.0.0.tar.bz2
[download] gmp-6.1.2.tar.xz
[download] isl-0.15.tar.bz2
[download] mpc-1.1.0.tar.gz
[download] mpfr-3.1.5.tar.xz
[download] qtbase-everywhere-src-5.13.1.tar.xz
MXE Warning! Downloading isl from second URL.
[download] dbus-1.13.12.tar.xz
[download] expat-2.2.8.tar.bz2
[download] fontconfig-2.13.1.tar.bz2
[download] freetype-2.10.1.tar.xz
[download] bzip2-1.0.6.tar.gz
[download] libpng-1.6.37.tar.xz
[download] zlib-1.2.11.tar.xz
[download] gettext-0.20.1.tar.xz
MXE Warning! Downloading bzip2 from backup.
[download] libiconv-1.16.tar.gz
[download] freetds-1.1.15.tar.bz2
[download] openssl-1.1.1d.tar.gz
[download] harfbuzz-2.6.1.tar.gz
[download] cairo-1.16.0.tar.xz
[download] glib-2.50.2.tar.xz
[download] libffi-3.2.1.tar.gz
[download] pcre-8.43.tar.bz2
MXE Warning! Downloading harfbuzz from second URL.
[download] lzo-2.10.tar.gz
[download] pixman-0.33.6.tar.gz
[download] icu4c-56_1-src.tgz
[download] jpegsrc.v9c.tar.gz
[download] mysql-connector-c-6.1.6-src.tar.gz
[download] cmake-3.10.0.tar.gz
[download] pcre2-10.33.tar.bz2
[download] postgresql-9.2.4.tar.bz2
[download] sqlite-autoconf-3290000.tar.gz
[download] zstd-v1.4.3.tar.gz
[download] qtdeclarative-everywhere-src-5.13.1.tar.xz
[download] qtimageformats-everywhere-src-5.13.1.tar.xz
[download] jasper-version-2.0.16.tar.gz
[download] libmng-2.0.3.tar.xz
[download] lcms2-2.9.tar.gz
[download] tiff-4.0.10.tar.gz
[download] libwebp-1.0.3.tar.gz
[download] xz-5.2.4.tar.gz
[download] qtsvg-everywhere-src-5.13.1.tar.xz
[download] qtxmlpatterns-everywhere-src-5.13.1.tar.xz
[download] qtgamepad-everywhere-src-5.13.1.tar.xz
MXE Warning! Downloading lcms from backup.
[download] qtactiveqt-everywhere-src-5.13.1.tar.xz
[download] qtcharts-everywhere-src-5.13.1.tar.xz
[download] qtmultimedia-everywhere-src-5.13.1.tar.xz
[download] qtconnectivity-everywhere-src-5.13.1.tar.xz
[download] qtdatavis3d-everywhere-src-5.13.1.tar.xz
[download] qtgraphicaleffects-everywhere-src-5.13.1.tar.xz
[download] qtlocation-everywhere-src-5.13.1.tar.xz
[download] qtnetworkauth-everywhere-src-5.13.1.tar.xz
[download] qtpurchasing-everywhere-src-5.13.1.tar.xz
[download] qtquickcontrols-everywhere-src-5.13.1.tar.xz
[download] qtquickcontrols2-everywhere-src-5.13.1.tar.xz
[download] qtremoteobjects-everywhere-src-5.13.1.tar.xz
[download] qtscript-everywhere-src-5.13.1.tar.xz
[download] qtscxml-everywhere-src-5.13.1.tar.xz
[download] qtsensors-everywhere-src-5.13.1.tar.xz
[download] qtserialbus-everywhere-src-5.13.1.tar.xz
[download] qtserialport-everywhere-src-5.13.1.tar.xz
[download] qtspeech-everywhere-src-5.13.1.tar.xz
[download] qttools-everywhere-src-5.13.1.tar.xz
[download] qttranslations-everywhere-src-5.13.1.tar.xz
[download] qtvirtualkeyboard-everywhere-src-5.13.1.tar.xz
[download] qtwebchannel-everywhere-src-5.13.1.tar.xz
[download] qtwebsockets-everywhere-src-5.13.1.tar.xz
[download] qtwebview-everywhere-src-5.13.1.tar.xz
[download] qtwinextras-everywhere-src-5.13.1.tar.xz

[2] don’t use backup downloads

$ rm pkg/bzip2-1.0.6.tar.gz pkg/lcms2-2.9.tar.gz
$ make download-qt5 -k MXE_NO_BACKUP_DL=true
[download] bzip2-1.0.6.tar.gz

Download failed or wrong checksum of package bzip2!
------------------------------------------------------------
--2019-09-19 00:35:36-- https://ftp.osuosl.org/pub/clfs/conglomeration/bzip2/1.0.6/bzip2-1.0.6.tar.gz
Resolving ftp.osuosl.org (ftp.osuosl.org)... 64.50.233.100, 64.50.236.52, 140.211.166.134
Connecting to ftp.osuosl.org (ftp.osuosl.org)|64.50.233.100|:443... connected.
HTTP request sent, awaiting response... 404 Not Found
2019-09-19 00:35:37 ERROR 404: Not Found.
Download failed!
------------------------------------------------------------
[log] /Users/tonyt/dev/mxe/log/bzip2-download

make: *** [download-only-bzip2-1.0.6.tar.gz] Error 1
[download] lcms2-2.9.tar.gz

Download failed or wrong checksum of package lcms!
------------------------------------------------------------
10550K .......... .......... .......... .......... .......... 98% 3.35M 0s
10600K .......... .......... .......... .......... .......... 99% 3.11M 0s
10650K .......... .......... .......... .......... .......... 99% 6.22M 0s
10700K .......... ....... 100% 13.2M=8.2s
2019-09-19 00:35:49 (1.28 MB/s) - ‘/Users/tonyt/dev/mxe/pkg/.tmp-lcms2-2.9.tar.gz’ saved [10974649/10974649]
Download failed!
------------------------------------------------------------
[log] /Users/tonyt/dev/mxe/log/lcms-download

make: *** [download-only-lcms2-2.9.tar.gz] Error 1
make: Target `download-qt5' not remade because of errors.

From:	Seth Raymond
Subject:	Re: [Mingw-cross-env-list] Installing in Offline Environment
Date:	Wed, 18 Sep 2019 12:12:21 -0400