zlib: add ZIP archive support to zlib (ZipFile,ZipBuffer,ZipEntry)

[pipobscure]

Summary

Add ZIP archive support to the node:zlib module through three classes
and a set of helpers:

• ZipEntry: a single archive member, with buffered reads (content()),
  bounded-memory streaming reads (contentIterator()), and
  create()/createStream() for building members.
• ZipFile: random access to an archive backed by a file descriptor,
  reading members lazily without retaining their content and writing
  new members in place; opened with open()/openSync().
• ZipBuffer: a zero-copy, in-memory view over an archive already held
  in a Buffer.

createZipArchive() serializes a sequence of entries into an archive
byte stream, and setMaxZipContentSize() bounds the default in-memory
decompression size. Every operation has both an asynchronous and a
synchronous form.

P.S.: my CLA should be on file and I wrote this myself so COO is declared

[codecov]

Codecov Report

❌ Patch coverage is 98.48790% with 60 lines in your changes missing coverage. Please review.
✅ Project coverage is 90.27%. Comparing base (6572cf5) to head (4fdc3fe).
⚠️ Report is 73 commits behind head on main.

Files with missing lines	Patch %	Lines
lib/internal/zip/file.js	97.12%	20 Missing ⚠️
lib/internal/zip/entry.js	98.50%	12 Missing and 2 partials ⚠️
lib/internal/zip/headers.js	97.17%	14 Missing ⚠️
lib/internal/zip/fs-util.js	94.00%	4 Missing and 5 partials ⚠️
lib/internal/zip/compression.js	99.33%	2 Missing ⚠️
lib/internal/zip/archive.js	99.65%	1 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             main   #64339      +/-   ##
==========================================
+ Coverage   90.13%   90.27%   +0.14%     
==========================================
  Files         741      755      +14     
  Lines      242251   246219    +3968     
  Branches    45615    46413     +798     
==========================================
+ Hits       218355   222278    +3923     
- Misses      15396    15424      +28     
- Partials     8500     8517      +17     

Files with missing lines	Coverage Δ
lib/internal/errors.js	97.91% <100.00%> (+<0.01%)	⬆️
lib/internal/zip.js	100.00% <100.00%> (ø)
lib/internal/zip/binary.js	100.00% <100.00%> (ø)
lib/internal/zip/buffer.js	100.00% <100.00%> (ø)
lib/internal/zip/constants.js	100.00% <100.00%> (ø)
lib/internal/zip/content-size.js	100.00% <100.00%> (ø)
lib/internal/zip/dos.js	100.00% <100.00%> (ø)
lib/internal/zip/extra-fields.js	100.00% <100.00%> (ø)
lib/internal/zip/header-builders.js	100.00% <100.00%> (ø)
lib/zlib.js	98.13% <100.00%> (+0.06%)	⬆️
... and 6 more

... and 30 files with indirect coverage changes

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
• 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

[bakkot]

See also #45651

[pipobscure]

See also #45651

Thanks @bakkot !!!

I think the time has come for it on the one hand, and on the other I added some „motivation“ links earlier. Here some more detail:

Based on this, we can modify the loader to directly load from an archive. If we do that, we get application bundles. pipobscure#5 & pipobscure#6

Which can then in turn be used to easily create application bundles: https://github.com/pipobscure/experimental-sea

So the world had changed enough that it‘s worth proposing again.

[mcollina]

I like this a lot. It's likely better to split this into 2 PRs, one for Zip support and one for VFS-Zip, so the Zip support could theoretically be backportable on its own.

[pipobscure]

As per @mcollina I split this into two PRs.

I have the vfs-provider ready to go as follow up one (as it depends on this being merged)

I also made sure that the streaming side of things was actually as clean as I intended, and added a few more tests.

[bakkot]

Might be worth borrowing some tests from other projects: e.g. python, go, info-zip. There's a lot of edge cases with zip files. (Python's tests are larger than this whole PR put together.)

Not all directly applicable because this doesn't include the ability to extract to disk, fortunately.

[pipobscure]

Might be worth borrowing some tests from other projects

I've added a bunch more tests and compared to what go/python/info-zip do. (info-zip is cli exercise, so it's not entirely clear what gets tested).

I also gave zip.js an once over and concluded that it was too large a file (it originated from separate files that I've had for ages combined into one).

So I split it back out so it would be easier to review. And gave that another look.

[mcollina]

lgtm

[nodejs-github-bot]

CI: https://ci.nodejs.org/job/node-test-pull-request/74727/

[mcollina]

@jasnell @JakobJingleheimer ptal

[GeoffreyBooth]

My 2022 self thanks you for doing this 😀

[JakobJingleheimer]

Awesome!

I'm on holiday til next weekend. I'll take a look when I'm back 🙂 I tagged myself to review so I don't forget.

[pipobscure]

Rebased on latest main to resolve the conflict

[pipobscure]

The failing mac tests seem to be entirely unrelated

Failed tests:
out/Release/node /Users/runner/work/node/node/node/test/parallel/test-debugger-extract-function-name.mjs
out/Release/node --test-reporter=./test/common/test-error-reporter.js --test-reporter-destination=stdout /Users/runner/work/node/node/node/test/parallel/test-repl-user-error-handler.js

can someone verify my deduction please.

[mcollina]

lgtm

[nodejs-github-bot]

CI: https://ci.nodejs.org/job/node-test-pull-request/75288/

[nodejs-github-bot]

CI: https://ci.nodejs.org/job/node-test-pull-request/75295/

[mcollina]

Everything is green, CI is ok, we are missing another @nodejs/tsc approval as this a large PR.

[marco-ippolito]

We should use the newer experimental stages like 1.0, 1.1 etc...

[marco-ippolito]

LGTM

[targos]

I am reviewing. You can dismiss my request for changes if I don't answer by tomorrow.

[panva]

import { createGzip } from 'node:zlib'

This stable import emits ZIP experimental warning because of how our ESM facade evaluates the getters.