Add a FAQ entry on how to deal with long lists of allowed domains

Limit tests to Twisted < 21

Refactor curl_to_request_kwargs #5001

Close files in the PerYearXmlExportPipeline documentation example

Co-authored-by: alkazaz alkazaz@kth.se
Co-authored-by: swill swill@kth.se
Co-authored-by: lerjevik lerjevik@kth.se
Co-authored-by: aljica aljica@kth.se

Making sure we can run async def tests

negotiatedProtocol's type is Optional[bytes]

See https://github.com/twisted/twisted/blob/twisted-20.3.0/src/twisted/protocols/tls.py#L563-L587
and https://www.pyopenssl.org/en/20.0.1/api/ssl.html#OpenSSL.SSL.Connection.get_alpn_proto_negotiated

Note that OpenSSL.SSL.Connection.get_next_proto_negotiated is deprecated:
https://www.pyopenssl.org/en/20.0.0/changelog.html#backward-incompatible-changes

Skip uvloop 0.15.0+ on py36.

Refactor SpiderMiddlewareManager.scrape_response.

This reverts commit 7b11b74c.

Let’s see how test results change