This file contains the release notes for Twisted.
It only contains high-level changes that are of interest to Twisted library users. Users of Twisted should check the notes before planning an upgrade.
Ticket numbers in this file can be looked up by visiting https://twisted.org/trac/ticket/<number>
No changes since 23.10.0.rc1.
- twisted.python.filepath.FilePath and related classes (twisted.python.filepath.IFilepath, twisted.python.filepath.AbstractFilePath, twisted.python.zippath.ZipPath, and twisted.python.zippath.ZipArchive) now have type annotations. Additionally, FilePath is now generic, describing its mode, so you can annotate variables as FilePath[str] or FilePath[bytes] depending on the types that you wish to get back from the 'path' attribute and related methods like 'basename'. (#11822)
- When using CPython, functions wrapped by twisted.internet.defer.inlineCallbacks can have their arguments and return values freed immediately after completion (due to there no longer being circular references). (#11885)
- Fix TypeError on t.i.cfreactor due to 3.10 type annotation syntax (#11965)
- Fix the type annotations of DeferredLock.run, DeferredSemaphore.run, maybeDeferred, ensureDeferred, inlineCallbacks and fromCoroutine that used to return Deferred[Any] to return the result of the passed Coroutine/Coroutine function (#11985)
- Fixed significant performance overhead (CPU and bandwidth) when doing small writes to a TLS transport. Specifically, small writes to a TLS transport are now buffered until the next reactor iteration. (#11989)
- fix mypy due to hypothesis 6.85 (#11995)
- The search and version navigation for the documentation hosted on Read The Docs was fixed. This was a regression introduced with 23.8.0. (#12012)
- Drop support for Python 3.7. Remove twisted[contextvars] extra (contextvars are always available in Python 3.7+) (#11913)
- #5206, #11583, #11787, #11871, #11912, #11921, #11922, #11926, #11932, #11934, #11936, #11938, #11940, #11942, #11945, #11948, #11952, #11953, #11955, #11957, #11959, #11961, #11964, #11973, #11977, #11980, #11982, #11993, #11999, #12004, #12005, #12009
No significant changes.
- In Twisted 16.3.0, we changed twisted.web to stop dispatching HTTP/1.1 pipelined requests to application code. There was a bug in this change which still allowed clients which could send multiple full HTTP requests in a single TCP segment to trigger asynchronous processing of later requests, which could lead to out-of-order responses. This has now been corrected and twisted.web should never process a pipelined request over HTTP/1.1 until the previous request has fully completed. (CVE-2023-46137, GHSA-cq7q-gv5w-rwx2) (#11976)
- twisted.dom.microdom and twisted.web.domhelpers are now deprecated. (#3651)
No significant changes.
No significant changes.
No significant changes.
- #10115
This is the last release with support for Python 3.7.
No changes since 23.8.0.rc1.
- reactor.spawnProcess() now uses posix_spawnp when possible, making it much more efficient (#5710)
- Twisted now officially supports Python 3.11. (#10343)
- twisted.internet.defer.Deferred.fromFuture now has a more precise type annotation. (#11753)
- twisted.internet.defer._ConcurrencyPrimitive.__aexit__ now has a more precise type annotation. (#11795)
- twisted.internet.defer.race has been added as a way to get the first available result from a list of Deferreds. (#11817)
- The CI suite was updated to execute the tests using a Python 3.12 pre-release (#11857)
- twisted.conch.scripts.ckeygen now substitutes a default of "~/.ssh/id_rsa" if no keyfile is specified. (#6607)
- Correct type hints for IHostnameResolver.resolveHostName and IResolverSimple.getHostByName. (#10276)
- twist conch --auth=sshkey can now authenticate users without a traceback again, thanks to twisted.conch.unix.UnixConchUser no longer being incorrectly instantiated with bytes. In the course of this fix, some type hinting has also been applied to twisted.cred.portal. (#11626)
- twisted.internet.gireactor now works with Gtk4, and is tested and supported in CI again. (#11705)
- When interrupted with control-C, trial -j no longer obscures tracebacks for any errors caused by that interruption with an UnboundLocalError due to a bug in its own implementation. Note that there are still several internal tracebacks that will be emitted upon exiting, because tearing down the test runner mid-suite is still not an entirely clean operation, but it should at least be possible to see errors reported from, for example, a test that is hanging more clearly. (#11707)
- PortableGIReactor and PortableGtkReactor are no longer necessary and are now aliases of GIReactor and Gtk2Reactor respectively, improving the performance of any applications using them. (#11738)
- The Twisted package dependencies were updated to minimum versions that will work with latest Twisted codebase. (#11740)
- Deferred's type annotations have been made more comprehensive, precise, correct, and strict. You may notice new type errors in your applications; be sure to check on those because they may represent real type errors! (#11772)
- To prevent parsing errors and ensure validity when serializing HTML comments, twisted.web.template.flattenString has been updated to escape the --> sequence within comments. (#11804)
- BadZipfile (with a small f) has been deprecated since Python 3.2, use BadZipFile (big F) instead, added in 3.2. (#11821)
- twisted.web.template now avoids unnecessary copying and is faster, particularly for templates with deep nesting. (#11834)
- twisted.web.template now avoids some unecessary evaluation of type annotations and is faster. (#11835)
- utcfromtimestamp has been deprecated since Python 3.12, use fromtimestamp(x, timezone.utc).replace(tzinfo=None) instead. (#11908)
- Optional dependency "extras" names like conch_nacl now use hyphens rather than underscores to comply with PEP 685. The old names will be supported until the end of 2023. (#11655)
- twisted.internet.gtk2reactor, twisted.internet.gtk3reactor, and twisted.internet.glib2reactor are now deprecated in favor of twisted.internet.gireactor. (#11705)
- The minimum supported version of PyPy has been updated to 3.9. (#11836)
- #10149, #10310, #10345, #11708, #11723, #11742, #11746, #11748, #11751, #11764, #11766, #11768, #11776, #11788, #11799, #11806, #11824, #11828, #11830, #11856, #11859, #11877, #11894
PyAsn1 has been removed as a conch dependency.
twisted.conch.ssh.keys.Key no longer supports loading "alternate" OpenSSH private keys. These are some private keys that at some point were handled by OpenSSH but for which no specification exists. For more info about these OpenSSH keys see twisted#3008. (#11843)
Due to changes in the way raw private key byte serialization are handled in Cryptography, and widespread support for Ed25519 in current versions of OpenSSL, we no longer support PyNaCl as a fallback for Ed25519 keys in Conch. (#11871)
- #11815, #11879
No significant changes.
No significant changes.
No significant changes.
No significant changes.
This release contains a security fix for CVE-2022-39348. This is a low-severity security bug.
Twisted 22.10.0rc1 release candidate was released on 2022-10-26 and there are no changes between the release candidate and the final release.
- The
systemd:endpoint parser now supports "named" file descriptors. This is a more reliable mechanism for choosing among several inherited descriptors. (#8147)
- The
systemdendpoint parser'sindexparameter is now documented as leading to non-deterministic results in which descriptor is selected. The newnameparameter is now documented as preferred. (#8146) - The implementers of Zope interfaces are once more displayed in the documentations. (#11690)
- twisted.protocols.dict, which was deprecated in 17.9, has been removed. (#11725)
- #11573, #11599, #11616, #11628, #11631, #11640, #11645, #11647, #11652, #11664, #11674, #11679, #11686, #11692, #11694, #11696, #11700, #11702, #11713, #11715, #11721
- twisted.conch.manhole.ManholeInterpreter now captures tracebacks even if sys.excepthook has been modified. (#11638)
- The twisted.web.pages.errorPage, notFound, and forbidden each return an IResource that displays an HTML error pages safely rendered using twisted.web.template. (#11716)
- twisted.web.error.Error.__str__ no longer raises an exception when the error's message attribute is None. Additionally, it validates that code is a plausible 3-digit HTTP status code. (#10271)
- The typing of the twisted.web.http_headers.Headers methods addRawHeader() and setRawHeaders() now allow mixing str and bytes, matching the runtime behavior. (#11635)
- twisted.web.vhost.NameVirtualHost no longer echoes HTML received in the Host header without escaping it (CVE-2022-39348, GHSA-vg46-2rrj-3647). (#11716)
- twisted.web.resource.Resource.putChild now raises TypeError when the path argument is not bytes, rather than issuing a deprecation warning. (#8985)
- The twisted.web.resource.ErrorPage, NoResource, and ForbiddenResource classes have been deprecated in favor of new implementations twisted.web.pages module because they permit HTML injection. (#11716)
- emailserver.tac now runs under python3.x (#11634)
No significant changes.
No significant changes.
- twisted.trial.unittest.SynchronousTestCase.successResultOf is now annotated as accepting coroutines. (#11657)
- The implementation of
trial -jN ...now handles test errors and failures larger than 64 kB. It also handles other internal communication errors by logging them in the worker and attempting to send them to the parent process -- instead of crashing withUnknownRemoteErrorand no additional details. (#10314) - trial -jN --logfile path no longer hangs if path contains a directory separator. (#11580)
- #11649, #11661, #11677, #11710
Twisted 22.8.0rc1 release candidate was released on 2022-08-28 and there are no changes between the release candidate and the final release.
- twisted.internet.defer.maybeDeferred will now schedule a coroutine result as asynchronous operation and return a Deferred that fires with the result of the coroutine. (#10327)
- Twisted now works with Cryptography versions 37 and above, and as a result, its minimum TLS protocol version has been upgraded to TLSv1.2. (#10377)
twisted.internet.base.DelayedCall.__repr__will no longer raiseAttributeErrorif theDelayedCallwas created before debug mode was enabled. As a side-effect,twisted.internet.base.DelayedCall.creatoris now defined asNonein cases where previously it was undefined. (#8306)- twisted.internet.iocpreactor.udp now properly re-queues its listener when there is a failure condition on the read from the socket. (#10052)
- twisted.internet.defer.inlineCallbacks no longer causes confusing StopIteration tracebacks to be added to the top of tracebacks originating in triggered callbacks (#10260)
- The typing of twisted.internet.task.react no longer constrains the type of argv. (#10289)
- ContextVar.reset() now works correctly inside inlineCallbacks functions and coroutines. (#10301)
- Implement twisted.python.failure._Code.co_positions for compatibility with Python 3.11. (#10336)
- twisted.pair.tuntap._TUNSETIFF and ._TUNGETIFF values are now correct parisc, powerpc and sparc architectures. (#10339)
- The release process documentation was updated to include information about doing a security release. (#10324)
- The development and policy documentation pages were moved into the same directory that is now placed inside the documentation root directory. (#11575)
- Python 3.6 is no longer supported. Twisted 22.4.0 was the last version with support for Python 3.6. (#10304)
- #9437, #9495, #10066, #10275, #10318, #10325, #10328, #10329, #10331, #10349, #10350, #10352, #10353, #11561, #11564, #11567, #11569, #11585, #11592, #11600, #11606, #11610, #11612, #11614
- twisted.conch.checkers.UNIXAuthorizedKeysFiles now uses the filesystem encoding to decode usernames before looking them up in the password database, so it works on Python 3. (#10286)
- twisted.conch.ssh.SSHSession.request_env no longer gives a warning if the session does not implement ISessionSetEnv. (#10347)
- The cftp command line (and twisted.conch.scripts.cftp.SSHSession.extReceived) no longer raises an unhandled error when receiving data on stderr from the server. (#10351)
- #10330
- twisted.web.template.renderElement now combines consecutive, sychronously-available bytes up to a fixed size limit into a single string to pass to
IRequest.writeinstead of passing them all separately. This greatly reduces the number of chunks in the response. (#10348)
- #11604
- twisted.mail.maildir.MaildirMessage now use byte header to avoid incompatibility with the FileMessage which writes bytes not strings lines to a message file (#10244)
- twisted.words.protocols.irc.IRCClient now splits overly long NOTICEs and NOTICEs containing n before sending. (#10285)
- twisted.names.dns logs unparsable messages rather than generating a Failure instance (#9723)
trial --jobs=N --exitfirstis now supported. (#9654)
- trial --jobs=N --until-failure ... now reports the correct number of tests run after each iteration. (#10311)
trial -jN ...will now pass errors and failures toIReportermethods as instances ofWorkerExceptioninstead ofstr. (#10333)
- #10319, #10338, #11571
- twisted.python.failure.Failure tracebacks now capture module information, improving compatibility with the Raven Sentry client. (#7796)
- twisted.python.failure.Failure objects are now compatible with dis.distb, improving compatibility with post-mortem debuggers. (#9599)
- twisted.internet.interfaces.IReactorSSL.listenSSL now has correct type annotations. (#10274)
- twisted.internet.test.test_glibbase.GlibReactorBaseTests now passes. (#10317)
- twisted.conch.ssh now supports using RSA keys with SHA-2 signatures (RFC 8332) when acting as a server. The rsa-sha2-512 and rsa-sha2-256 public key signature algorithms are automatically preferred over ssh-rsa if the client advertises support for them; the actual public keys do not need to change. (#9765)
- twisted.conch.ssh now has an alternative Ed25519 implementation using PyNaCl, in order to support platforms that lack OpenSSL >= 1.1.1b. The new "conch_nacl" extra has the necessary dependency. (#10208)
- (#10313)
- Twisted is now compatible with h2 4.x.x. (#10182)
- twisted.web.http had several several defects in HTTP request parsing that could permit HTTP request smuggling. It now disallows signed Content-Length headers, forbids illegal characters in chunked extensions, forbids a
0xprefix to chunk lengths, and only strips spaces and horizontal tab characters from header values. These changes address CVE-2022-24801 and GHSA-c2jg-hw38-jrqq. (#10323)
- twisted.mail.pop3.APOPCredentials is now correctly marked as implementing twisted.cred.credentials.IUsernamHashedPassword, rather than IUsernamePassword. (#10305)
No significant changes.
No significant changes.
- trial --until-failure --jobs=N now reports the number of each test pass as it begins. (#10312)
- twisted.trial.unittest.TestCase now discards cleanup functions after running them. Notably, this prevents them from being run an ever growing number of times with trial -u .... (#10320)
- #10315, #10321, #10322
- twisted.internet.gireactor.PortableGIReactor.simulate and twisted.internet.gtk2reactor.PortableGtkReactor.simulate no longer raises TypeError when there are no delayed called. This was a regression introduced with the migration to Python 3 in which the builtin min function no longer accepts None as an argument. (#9660)
- twisted.conch.ssh.transport.SSHTransportBase now disconnects the remote peer if the SSH version string is not sent in the first 4096 bytes. (#10284, CVE-2022-21716, GHSA-rv6r-3f5q-9rgx)
- Add type annotations for twisted.web.http.Request.getHeader. (#10270)
- Support for Python 3.6, which is EoL as of 2021-09-04, has been deprecated. (#10303)
- #10216, #10299, #10300
- #10298
No significant changes.
No significant changes.
No significant changes.
No significant changes.
- _dist.test.test_workertrial now correctly compare strings via assertEqual() and pass on PyPy3 (#10302)
- Python 3.10 is now a supported platform (#10224)
- Type annotations have been added to the twisted.python.fakepwd module. (#10287)
- twisted.internet.defer.inlineCallbacks has an improved type annotation, to avoid typing errors when it is used on a function which returns a non-None result. (#10231)
twisted.internet.base.DelayedCall.__repr__andtwisted.internet.task.LoopingCall.__repr__had the changes from #10155 reverted to accept non-function callables. (#10235)- Revert the removal of .whl building that was done as part of #10177. (#10236)
- The type annotation of the host parameter to twisted.internet.interfaces.IReactorTCP.connectTCP has been corrected from bytes to str. (#10251)
- Deprecated
twisted.python.threading.ThreadPool.currentThread()in favor ofthreading.current_thread(). Switchedtwisted.python.threading.ThreadPool.currentThread()andtwisted.python.threadable.getThreadID()to use threading.current_thread()` to avoid the deprecation warnings introduced forthreading.currentThread()in Python 3.10. (#10273)
- twisted.internet.utils.runWithWarningsSupressed behavior of waiting on deferreds has been documented. (#10238)
- Sync API docs templates with pydoctor 21.9.0 release, using new theming capabilities. (#10267)
- #1681, #9944, #10198, #10218, #10219, #10228, #10229, #10234, #10239, #10240, #10245, #10246, #10248, #10250, #10255, #10277, #10288, #10292
- SSHTransportBase.ssh_KEXINIT now uses the remote peer preferred MAC list for negotiation. In previous versions it was only using the local preferred MAC list. (#10241)
- twisted.conch.ssh now supports SSH extension negotiation (RFC 8308). (#10266)
- twisted.conch now uses constant-time comparisons for MACs. (#8199)
- twisted.conch.ssh.filetransfer.FileTransferServer will now return an ENOENT error status if an SFTP client tries to close an unrecognized file handle. (#10293)
- twisted.web.client.RedirectAgent and twisted.web.client.BrowserLikeRedirectAgent now properly remove sensitive headers when redirecting to a different origin. (#10294)
- Add type annotations for twisted.web.client.readBody. (#10269)
- twisted.web.client.getPage, twisted.web.client.downladPage, and the associated implementation classes (HTTPPageGetter, HTTPPageDownloader, HTTPClientFactory, HTTPDownloader) have been removed because they do not segregate cookies by domain. They were deprecated in Twisted 16.7.0 in favor of twisted.web.client.Agent. GHSA-92x2-jw7w-xvvx. (#10295)
No significant changes.
No significant changes.
No significant changes.
- trial.runner.filenameToModule now sets the correct module.__name__ and sys.modules key (#10230)
- Python 3.10b3 is now supported (#10224)
- Type hinting was added to twisted.internet.defer, making this is the first release of Twisted where you might reasonably be able to use mypy without your own custom stub files (#10017)
- The changes to
DelayedCall.__repr__andLoopingCall.__repr__from 21.7.0.rc1 were reverted as the wrong assumption that__qualname__is available on all the supported Python versions. (#10235) - The automated release process was updated to generate and release wheel files to PyPI (#10236)
- twisted.internet.defer.inlineCallbacks has an improved type annotation, to avoid typing errors when it is used on a function which returns a non-None result. (#10231)
- trial.runner.filenameToModule now sets the correct
module.__name__andsys.moduleskey (#10230) - twisted.internet.process can now pause and resume producing in python 3 (#9933)
- When installing Twisted it now requires a minimum Python 3.6.7 version to match the version used with automated testing. This is the minimum Python version that we know that Twisted works with. (#10098)
- twisted.internet.asyncioreactor.AsyncioSelectorReactor will no longer raise a TypeError like "SelectorEventLoop required, instead got: <uvloop.Loop ...>" (broken since 21.2.0). (#10106)
- twisted.web.template.flatten and flattenString will no longer raise RecursionError if a large number of synchronous Deferreds are included in a document. (#10125)
- Fix type hint for http.Request.uri (from str to bytes). (#10139)
- twisted.web.http_headers.getRawHeaders and twisted.web.http_headers.getAllRawHeaders are now typed to return immutable sequences of header values instead of lists. twisted.web.http_headers.getRawHeaders is now typed to return a non-optional value if a non-None default value is given. (#10142)
- Fixed type hint for addr argument to twisted.internet.interfaces.buildProtocol. (#10147)
- twisted.trial._dist.worker.LocalWorker.connectionMade now always writes the log file using UTF-8 encoding. In previous versions it was using the system default encoding. This was causing encoding errors as the distributed trial workers are sending Unicode data and the system default encoding might not always be Unicode compatible. For example, it can be CP1252 on Windows. (#10157)
- twisted.words.protocols.irc.ctcpExtract was updated to work with PYPY 3.7.4. (#10189)
- twisted.conch.ssh.transport.SSHServerTransport and twisted.conch.ssh.transport.SSHClientTransport no longer use the hardcoded SHA1 digest for non-group key exchanges. (#10203)
- haproxy transport wrapper now returns hosts of type str for getPeer() and getHost(), as specified by IPv4Address and IPv6Address documentation. Previously it was returning bytes for the host. (#10211)
- Remove dead link in twisted.internet._dumbwin32proc module docstring (#9520)
- Sync API docs templates with pydoctor 21.2.2 release. (#10105)
- Twisted IRC channels are now hosted by Libera.Chat. (#10213)
- Python 3.5 is no longer supported. (#9958)
- #9816, #9915, #10068, #10085, #10094, #10102, #10107, #10108, #10109, #10110, #10112, #10119, #10120, #10121, #10122, #10123, #10140, #10143, #10145, #10150, #10151, #10155, #10159, #10168, #10169, #10171, #10172, #10173, #10174, #10179, #10194, #10201, #10212, #10215, #10217, #11017
- #10097
- twisted.web.template.renderElement() now accepts any IRequest implementer instead of only twisted.web.server.Request. Add type hints to twisted.web.template. (#10184)
- The server-side HTTP/1.1 chunking implementation no longer performs quadratic work when input arrives in small chunks, preventing CPU exhaustion. (#3795)
- twisted.web.http's chunked encoding support now rejects chunk sizes that are invalid because they look like negative hexadecimal integers. (#10130)
- The type hint of twisted.web.server.Request.postpath is now correctly listed as Optional[List[bytes]]. This was incorrect in Twisted v21.2.0. (#10136)
- The server-side HTTP/1.1 chunking implementation now rejects invalid chunk boundaries, preventing unbounded buffering. (#10137)
- The server-side HTTP/1.1 chunking implementation now limits the length of the chunk size line (which includes chunk extensions) to twisted.web.http.maxChunkSizeLineLength — 1 KiB — so that it may not consume an unbounded amount of memory. (#10144)
- Calling twisted.web.server.Site now registers its expiration timeout using the reactor associated with its twisted.web.server.Site. Site now a reactor attribute via its superclass, twisted.web.http.HTTPFactory. (#10177)
- #9659, #10100, #10154, #10186
No significant changes.
No significant changes.
No significant changes.
- The enableSessions argument to twisted.internet.ssl.CertificateOptions now actually enables/disables OpenSSL's session cache. Also, due to session-related bugs, it defaults to False. (#9583)
- twisted.internet.defer.inlineCallbacks and ensureDeferred will now associate a contextvars.Context with the coroutines they run, meaning that ContextVar objects will maintain their value within the same coroutine, similarly to asyncio Tasks. This functionality requires Python 3.7+, or the contextvars PyPI backport to be installed for Python 3.5-3.6. (#9719, #9826)
- twisted.internet.defer.Deferred.fromCoroutine has been added. This is similar to the existing ensureDeferred function, but is named more consistently inside Twisted and does not pass through Deferreds. (#9825)
- trial now allows the @unittest.skipIf decorator to specify that an entire test class should be skipped. (#9829)
- The twisted.python.deprecate.deprecatedKeywordParameter decorator can be used to mark a keyword paramater of a function or method as deprecated. (#9844)
- Projects using Twisted can now perform type checking against a Twisted installation, for example using mypy. (#9908)
- twisted.python.util.InsensitiveDict now fully implements MutableMapping. (#9919)
- Python 3.8 is now tested and supported. (#9955)
- Support a coroutine function in twisted.internet.task.react (#9974)
- PyPy 3.7 is now tested and supported. (#10093)
- twisted.web.twcgi.CGIProcessProtocol.processEnded(...) now handles an already-finished request, for example when request.connectionLost(...) was called previously. (#9468)
- Twisted's dependency on PyHamcrest has been moved from the base package to the new "test" extra. Consequently the test extra must be installed for Twisted's test suite to pass. (#9509)
- Fixed serialization of timedelta, date, and time objects in twisted.spread. (#9716)
- twisted.internet.asyncioreactor.AsyncioSelectorReactor now raises an exception if instantiated with an event loop which is not compatible with asyncio.SelectorEventLoop. This fixes the AsyncioSelectorReactor in Python 3.8+ on Windows, where in bp-34687 the default Windows asyncio event loop was changed to ProactorEventLoop. Applications that use AsyncioSelectorReactor on Windows with Python 3.8+ must call asyncio.set_event_loop_policy(asyncio.WindowsSelectorEventLoopPolicy()) before instantiating and running AsyncioSelectorReactor. (#9766)
- twisted.internet.process.registerReapProcessHandler and ._BaseProcess.reapProcess will no longer raise a TypeError when processing a None PID (#9775)
- INotify will close its file descriptor if a directory is automatically removed by twisted from the watchlist because it's deleted, avoiding orphaned filedescriptors. (#9777)
- DelayedCall.reset() is now working properly with asyncioreactor (#9780)
- AsyncioSelectorReactor.seconds() now correctly returns an epoch time. (#9787)
- The _connDone parameter has been removed from twisted.internet.abstract.FileDescriptor.loseConnection()'s signature in order to match the signature in the base class twisted.internet._newtls.ConnectionMixin loseConnection(). (#9849)
- The Gtk3 reactor now runs on Wayland-only sessions (#9904)
- Descriptive error messages from twisted.internet.error are now present when running with 'python -OO'. (#9918)
- Comparator methods such as __eq__() now always return NotImplemented for uncomparable types. (#9919)
- When installing Twisted it now requires a minimum Python 3.5.4 version to match the version used with automated testing. This is the minimum Python version that we know that Twisted works with. (#10098)
- The narrative docs now contains the associated Twisted version and the date when they were generated. (#3945)
- The "Writing a twistd plugin" howto now explains how to deploy twistd plugins using Python packaging and pip (#9243)
- (#9868, #9873, #9874)
- Fix a typo in "Introduction to Deferreds" document. (#9948)
- The Twisted Coding Standard has been changed to refer to The Black code style for guidelines regarding whitespace and line lengths. (#9957)
- Exempt
__repr__,__slots__and other@attrs.definerelated changes from compatibility policy. (#9982) - Fix many docstring mistakes flagged by new sanity checks in pydoctor. (#10021)
- Fix a few dozen broken links to API documentation pages. (#10057)
- twisted.cred.credentials.UsernameHashedPassword is now deprecated because it doesn't hash the password, causing it to return the wrong result. (#8368)
- twisted.news is now removed from the codebase. (This module was never installed on Python 3.) (#9782)
- Support for Python 2.7 has been removed. Twisted now supports only Python versions 3.5/3.6/3.7. (#9790)
- twisted.pair.ethernet.IEthernetProtocol.addProto()'s interface was changed to match the existing implementations in the Twisted source code. (#9877)
- twisted.python.filepath.FilePath.statinfo was deprecated in Twisted 15.0.0 and has now been removed. (#9881)
- The parameters to twisted.internet.base.ReactorBase.addSystemEventTrigger(), twisted.internet.base.ReactorBase.callWhenRunning(), twisted.internet.base.ReactorBase.callLater(), twisted.internet.task.Clock.callLater() have been renamed to match the parameters defined in the following interfaces: twisted.internet.interfaces.IReactorCore, twisted.internet.interfaces.IReactorTime. (#9897)
- Functions and types in twisted.python.compat that existed to support the transition from Python 2 to 3 have been deprecated. (#9922)
- twisted.logger.LoggingFile.softspace has been deprecated. (#10042)
- twisted.python.win32.WindowsError and FakeWindowsError have been deprecated. (#10053)
- twisted.mail.pop3client has been renamed to twisted.mail._pop3client, since it has always been a private implementation module. (#10054)
- #5356, #6460, #6903, #6986, #7945, #9306, #9512, #9531, #9622, #9652, #9718, #9744, #9768, #9773, #9776, #9778, #9781, #9784, #9785, #9788, #9789, #9791, #9793, #9795, #9796, #9797, #9798, #9800, #9802, #9803, #9808, #9809, #9810, #9811, #9812, #9820, #9823, #9827, #9833, #9837, #9840, #9842, #9846, #9847, #9848, #9850, #9851, #9852, #9854, #9855, #9856, #9857, #9858, #9861, #9862, #9863, #9864, #9865, #9866, #9867, #9869, #9870, #9871, #9872, #9876, #9878, #9879, #9880, #9882, #9883, #9884, #9886, #9889, #9890, #9891, #9892, #9895, #9896, #9898, #9899, #9902, #9903, #9916, #9917, #9921, #9924, #9927, #9928, #9936, #9953, #9954, #9956, #9959, #9960, #9969, #9970, #9971, #9975, #9976, #9977, #9978, #9979, #9980, #9981, #9983, #9985, #9986, #9987, #9988, #9989, #9991, #9992, #9995, #9999, #10000, #10002, #10009, #10010, #10011, #10014, #10015, #10018, #10025, #10027, #10029, #10032, #10033, #10034, #10036, #10038, #10043, #10044, #10046, #10054, #10059, #10060, #10061, #10063, #10064, #10065, #10069, #10080, #10090
- twisted.conch.ssh now supports Ed25519 keys (requires OpenSSL >= 1.1.1b). (#8966)
- twisted.conch.ssh.session.SSHSession can now accept environment variables sent by the client, if the SSH avatar implements the new ISessionSetEnv interface. (#9315)
- twisted.conch.ssh.keys.Key.fromString and twisted.conch.ssh.keys.Key.toString now normalize Unicode passphrases as required by NIST 800-63B. (#9736)
- twisted.conch.telnet now implements EOR (End of Record) command (RFC 885) (#9875)
- t.c.ssh.filetransfer.FileTransferClient now errbacks any outstanding requests if the connection is lost before a reply is received. (#9571)
- t.c.ssh.filetransfer.FileTransferClient immediately errbacks any attempt to send a request on a closed channel. (#9572)
- twisted.conch.ssh.session.SSHSession now accepts environment variables also for multiplexed SSH session. (#10016)
- construct and assign portal and checkers consistently in ssh server example (#9578)
- #6446, #9571, #9831, #9913
- twisted.web.http.Request.getRequestHostname now supports IPv6 literal hostnames in HTTP host headers. (#6014)
- Fixed unexpected exception by handling subclass of TaskFinished when FileBodyProducer's task stopped twice. (#6528)
- Importing twisted.web.client no longer has the side effect of initializing the reactor. (#9774)
- Ensure that all calls to connectionLost use a Failure instance in the HTTP 2 code. (#9817)
- twisted.web.util.ParentRedirect has been fixed and documented. It was broken by a security fix in Twisted 19.2.0. (#9835)
- xmlrpc's Proxy class now verifies HTTPS certificates against the system bundle. (#9836)
- twisted.web.twcgi can now handle url parameters in python 3 (#9887)
- defer reactor import in twisted.web.xmlrpc (#9931)
- twisted.web.RedirectAgent now supports 308 redirects (#9940)
- Fixed an error where twisted.web.http.requestReceived() tries to encode a NoneType returned by cgi.parse_multipart when a multipart body does not contain a "content-disposition" definition. (#10084)
- xmlrpc's QueryFactory class is now public, more explanation for xmlrpc's queryFactory, and new xmlrpc-debug.py example script for debugging raw XML-RPC traffic. (#9350)
- twisted.web.client.ContentDecoderAgent's documentation has been corrected and improved. (#9742)
- #6446, #9758, #9801, #9831, #9834, #9841
- twisted.mail.smtp.ESMTPSender no longer forces TLSv1.0 when used without explicit context factory. (#9740)
- #6446, #9831, #9832, #9900, #9910
- #9901
- twisted.names.hosts.Resolver and twisted.names.hosts.searchFileForAll() now ignore malformed lines in hosts files like /etc/hosts (#9752)
- New interface IEncodableRecord combines IEncodable and IRecord, which is useful when using type annotations. (#9920)
- twistd -n dns --pyzone example-domain.com will no longer throw an exception on startup with Python 3. (#9783)
- twist dns --pyzone example-domain.com now works on Python 3. (#9786)
- #9749
- twisted.protocols.amp.BoxDispatcher.callRemote and callRemoteString will no longer return failing Deferreds for requiresAnswer=False commands when the transport they're operating on has been disconnected. (#9756)
- Added a missing hyphen to a reference to the
--debugoption ofpdbin the Trial how-to. (#9690) - The documentation of the twisted.cred.checkers module has been extended and corrected. (#9724)
- twisted.news is deprecated. (#9405)
- #9634, #9701, #9707, #9710, #9715, #9726, #9727, #9728, #9729, #9735, #9737, #9757
- twisted.conch.ssh now supports the curve25519-sha256 key exchange algorithm (requires OpenSSL >= 1.1.0). (#6814)
- twisted.conch.ssh.keys can now write private keys in the new "openssh-key-v1" format, introduced in OpenSSH 6.5 and made the default in OpenSSH 7.8. ckeygen has a corresponding new --private-key-subtype=v1 option. (#9683)
- twisted.conch.keys.Key.privateBlob now returns the correct blob format for ECDSA (i.e. the same as that implemented by OpenSSH). (#9682)
- #9760
- Fixed return type of twisted.web.http.Request.getUser and twisted.web.http.Request.getPassword to binary if no authorization header was found or an exception was thrown (#9596)
- twisted.web.http.HTTPChannel now rejects requests (with status code 400 and a drop) that have malformed headers of the form "Foo : value" or ": value". (#9646)
- twisted.web.http.Request now correctly parses multipart-encoded form data submitted as a chunked request on Python 3.7+. (#9678)
- twisted.web.client.BrowserLikePolicyForHTTPS is now listed in __all__, since it's a user-facing class that anyone could import and extend. (#9769)
- twisted.web.http was subject to several request smuggling attacks. Requests with multiple Content-Length headers were allowed (CVE-2020-10108, thanks to Jake Miller from Bishop Fox and ZeddYu Lu for reporting this) and now fail with a 400; requests with a Content-Length header and a Transfer-Encoding header honored the first header (CVE-2020-10109, thanks to Jake Miller from Bishop Fox for reporting this) and now fail with a 400; requests whose Transfer-Encoding header had a value other than "chunked" and "identity" (thanks to ZeddYu Lu) were allowed and now fail with a 400. (#9770)
- #9733
- Fixed parsing of streams with Python 3.8 when there are spaces in namespaces or namespaced attributes in twisted.words.xish.domish.ExpatElementStream (#9730)
- twisted.names.secondary.SecondaryAuthority now accepts str for its domain parameter, so twist dns --secondary now functions on Python 3. (#9496)
- twisted.trial.successResultOf, twisted.trial.failureResultOf, and twisted.trial.assertNoResult accept coroutines as well as Deferreds. (#9006)
- Fixed circular import in twisted.trial.reporter, introduced in Twisted 16.0.0. (#8267)
- The POP3 server implemented by twisted.mail.pop3 now accepts passwords that contain spaces. (#9100)
- Incoming HTTP/2 connections will now not time out if they persist for longer than one minute. (#9653)
- The serial extra now requires pywin32 on Windows enabling use of twisted.internet.serialport without specifying the windows_platform extra. (#9700)
- #8506, #9677, #9684, #9687, #9688
- twisted.conch.ssh.keys now correctly writes the "iqmp" parameter in serialized RSA private keys as q^-1 mod p rather than p^-1 mod q. (#9681)
- #9689
- twisted.web.server.Request will now use twisted.web.server.Site.getContentFile, if it exists, to get a file into which to write request content. If getContentFile is not provided by the site, it will fall back to the previous behavior of using io.BytesIO for small requests and tempfile.TemporaryFile for large ones. (#9655)
- twisted.web.client.FileBodyProducer will now stop producing when the Deferred returned by FileBodyProducer.startProducing is cancelled. (#9547)
- The HTTP/2 server implementation now enforces TCP flow control on control frame messages and times out clients that send invalid data without reading responses. This closes CVE-2019-9512 (Ping Flood), CVE-2019-9514 (Reset Flood), and CVE-2019-9515 (Settings Flood). Thanks to Jonathan Looney and Piotr Sikora. (#9694)
No significant changes.
No significant changes.
No significant changes.
- The callable argument to twisted.internet.task.deferLater() is no longer required. (#9577)
- Twisted's minimum Cryptography requirement is now 2.5. (#9592)
- twisted.internet.utils.getProcessOutputAndValue now accepts stdinBytes to write to the child process's standard input. (#9607)
- Add new twisted.logger.capturedLogs context manager for capturing observed log events in tests. (#9617)
- twisted.internet.base.PluggableResolverMixin, which implements the pluggable resolver interfaces for easier re-use in other reactors, has been factored out of ReactorBase. (#9632)
- The PyPI page for Twisted has been enhanced to include more information and useful links. (#9648)
- twisted.internet.endpoints is now importable on Windows when pywin32 is not installed. (#6032)
- twisted.conch.ssh now generates correct keys when using hmac-sha2-512 with SHA1 based KEX algorithms. (#8258)
- twisted.internet.iocpreactor.abstract.FileHandle no longer duplicates/looses outgoing data when .write() is called in rapid succession with large payloads (#9446)
- twisted.application.backoffPolicy will not fail on connection attempts > 1750 with default settings. (#9476)
- Trial on Python 3 will now properly re-raise ImportErrors that occur during the import of a module, rather than saying the module doesn't exist. (#9628)
- twisted.internet.process does not fail on import when the process has more than 1024 file descriptors opened. (#9636)
- Add the stackLevel keyword argument to twisted.logger.STDLibLogObserver._findCaller to fix an incompatibility with Python 3.8. (#9668)
- Fix the incorrect docstring for twisted.python.components.Componentized.addComponent which stated that the function returned a list of interfaces, even though the function doesn't actually do so. (#9637)
- twisted.test.proto_helpers has moved to twisted.internet.testing. twisted.test.proto_helpers has been deprecated. (#6435)
- twisted.protocols.mice, deprecated since Twisted 16.0, has been removed. (#9602)
- twisted.conch.insults.client and twisted.conch.insults.colors, deprecated since Twisted 10.1, have been removed. (#9603)
- The __version__ attribute of Twisted submodules that were previously packaged separately, deprecated since Twisted 16.0, has been removed. (#9604)
- Python 3.4 is no longer supported. (#9613)
- twisted.python.compat.OrderedDict, an alias for collections.OrderedDict and deprecated since Twisted 15.5, has been removed. (#9639)
- #9217, #9445, #9454, #9605, #9614, #9615, #9619, #9625, #9633, #9640, #9674
- t.c.ssh.connection.SSHConnection now fails channels that are in the process of opening when the connection is lost. (#2782)
- #9610
- twisted.web.tap, the module that is run by twist web, now accepts --display-tracebacks to render tracebacks on uncaught exceptions. (#9656)
- twisted.web.http.Request.write after the channel is disconnected will no longer raise AttributeError. (#9410)
- twisted.web.client.Agent.request() and twisted.web.client.ProxyAgent.request() now produce TypeError when the method argument is not bytes, rather than failing to generate the request. (#9643)
- twisted.web.http.HTTPChannel no longer raises TypeError internally when receiving a line-folded HTTP header on Python 3. (#9644)
- All HTTP clients in twisted.web.client now raise a ValueError when called with a method and/or URL that contain invalid characters. This mitigates CVE-2019-12387. Thanks to Alex Brasetvik for reporting this vulnerability. (#9647)
- twisted.web.server.Site's instance variable displayTracebacks is now set to False by default. (#9656)
- twisted.web.iweb.IRequest's "prepath" and "postpath" attributes, which have existed for a long time, are now documented. (#5533)
- The documented type of t.w.iweb.IRequest's "method" and "uri" attributes on Python 3 has been corrected to match the implementation. (#9091)
- t.w.iweb.IRequest's "args" attribute is now correctly documented to be bytes. (#9458)
- The API documentation of twisted.web.iweb.IRequest and twisted.web.http.Request has been updated and extended to match the implementation. (#9593)
- Passing a path argument to twisted.web.resource.Resource.putChild which is not of type bytes is now deprecated. In the future, passing a non-bytes argument to putChild will return an error. (#9135)
- Passing --notracebacks/-n to twisted.web.tap, the module that is run by twist web, is now deprecated due to traceback rendering being disabled by default. (#9656)
- #9597
No significant changes.
- twisted.words.protocols.jabber.xmlstream.TLSInitiatingInitializer and twisted.words.protocols.jabber.client.XMPPClientFactory now take an optional configurationForTLS for customizing certificate options for StartTLS. (#9561)
- twisted.words.protocols.jabber.xmlstream.TLSInitiatingInitializer now properly verifies the server's certificate against platform CAs and the stream's domain, mitigating CVE-2019-12855. (#9561)
- twisted.names.client.Resolver will no longer infinite loop if it cannot bind a UDP port to use for resolving. (#9620)
This is the final release that will support Python 3.4.
- twisted.internet.ssl.CertificateOptions now uses 32 random bytes instead of an MD5 hash for the ssl session identifier context. (#9463)
- DeferredLock and DeferredSemaphore can be used as asynchronous context managers on Python 3.5+. (#9546)
- t.i.b.BaseConnector has custom __repr__ (#9548)
- twisted.internet.ssl.optionsForClientTLS now supports validating IP addresses from the certificate subjectAltName (#9585)
- Twisted's minimum Cryptography requirement is now 2.5. (#9592)
- twisted.web.proxy.ReverseProxyResource fixed documentation and example snippet (#9192)
- twisted.python.failure.Failure.getTracebackObject now returns traceback objects whose frames can be passed into traceback.print_stack for better debugging of where the exception came from. (#9305)
- twisted.internet.ssl.KeyPair.generate: No longer generate 1024-bit RSA keys by default. Anyone who generated a key with this method using the default value should move to replace it immediately. (#9453)
- The message of twisted.internet.error.ConnectionAborted is no longer truncated. (#9522)
- twisted.enterprise.adbapi.ConnectionPool.connect now logs only the dbapiName and not the connection arguments, which may contain credentials (#9544)
- twisted.python.runtime.Platform.supportsINotify no longer considers the result of isDocker for its own result. (#9579)
- The documentation for the the twisted.internet.interfaces.IConsumer, IProducer, and IPullProducer interfaces is more detailed. (#2546)
- The errback example in the docstring of twisted.logger.Logger.failure has been corrected. (#9334)
- The sample code in the "Twisted Web In 60 Seconds" tutorial runs on Python 3. (#9559)
- #8921, #9071, #9125, #9428, #9536, #9540, #9580
- twisted.conch.ssh.keys can now read private keys in the new "openssh-key-v1" format, introduced in OpenSSH 6.5 and made the default in OpenSSH 7.8. (#9515)
- Conch now uses pyca/cryptography for Diffie-Hellman key generation and agreement. (#8831)
- #9584
- twisted.web.client.HostnameCachingHTTPSPolicy was added as a new contextFactory option. The policy caches a specified number of twisted.internet.interfaces.IOpenSSLClientConnectionCreator instances to to avoid the cost of instantiating a connection creator for multiple requests to the same host. (#9138)
- twisted.web.http.Request.cookies, twisted.web.http.HTTPChannel.writeHeaders, and twisted.web.http_headers.Headers were all vulnerable to header injection attacks. They now replace linear whitespace ('r', 'n', and 'rn') with a single space. twisted.web.http.Reqeuest.cookies also replaces semicolons (';') with a single space. (#9420)
- twisted.web.client.Request and twisted.web.client.HTTPClient were both vulnerable to header injection attacks. They now replace linear whitespace ('r', 'n', and 'rn') with a single space. (#9421)
No significant changes.
No significant changes.
- twisted.names.dns now has IRecord implementations for the SSHFP and TSIG record types. (#9373)
- twisted.internet._sslverify.ClientTLSOptions no longer raises IDNAError when given an IPv6 address as a hostname in a HTTPS URL. (#9433)
- The repr() of a twisted.internet.base.DelayedCall now encodes the same information as its str(), exposing details of its scheduling and target callable. (#9481)
- Python 3.7 is now supported. (#9502)
- twisted.logger.LogBeginner's default critical observer now prints tracebacks for new and legacy log system events through the use of the new eventAsText API. This API also does not raise an error for non-ascii encoded data in Python2, it attempts as well as possible to format the traceback. (#7927)
- Syntax error under Python 3.7 fixed for twisted.conch.manhole and twisted.main.imap4. (#9384)
- trial -j reports tracebacks on test failures under Python 3. (#9436)
- Properly format multi-byte and non-ascii encoded data in a traceback. (#9456)
- twisted.python.rebuild now functions on Python 3.7. (#9492)
- HTTP/2 server connections will no longer time out active downloads that take too long. (#9529)
- Several minor formatting problems in the API documentation have been corrected. (#9461)
- The documentation of twisted.internet.defer.Deferred.fromFuture() has been updated to reflect upstream changes. (#9539)
- async keyword argument is deprecated in twisted.conch.manhole (ManholeInterpreter.write and Manhole.add) and in twisted.main.imap4.IMAP4Server.sendUntaggedResponse, isAsync keyword argument is introduced instead. (#9384)
- #9379, #9485, #9489, #9499, #9501, #9511, #9514, #9523, #9524, #9525, #9538
- twisted.conch.keys.Key.public returns the same twisted.conch.keys.Key instance when it is already a public key instead of failing with an exception. (#9441)
- RSA private keys are no longer corrupted during loading, allowing OpenSSL's fast-path to operate for RSA signing. (#9518)
- The documentation for IConchUser.gotGlobalRequest() is more accurate. (#9413)
- twisted.conch.ssh.filetransfer.ClientDirectory's use as an iterator has been deprecated. (#9527)
- twisted.web.server.Request.getSession now returns a new session if the previous session has expired. (#9288)
- #9479, #9480, #9482, #9491
No significant changes.
No significant changes.
No significant changes.
- Cancelling a Deferred returned by twisted.internet.defer.inlineCallbacks now cancels the Deferred it is waiting on. (#4632)
- twisted.application.internet.ClientService now accepts a function to initialize or validate a connection before it is returned by the whenConnected method as the prepareConnection argument. (#8375)
- Traceback generated for twisted.internet.defer.inlineCallbacks now includes the full stack of inlineCallbacks generators between catcher and raiser (before it only contained raiser's stack). (#9176)
- Add optional cwd argument to twisted.runner.procmon.ProcMon.addProcess (#9287)
- twisted.python.failure.Failure tracebacks generated by coroutines scheduled with twisted.internet.defer.ensureDeferred - i.e. any Deferred-awaiting coroutine - now contain fewer extraneous frames from the trampoline implementation, and correctly indicate the source of exceptions raised in other call stacks - i.e. the function that raised the exception. In other words: if you 'await' a function that raises an exception, you'll be able to see where the error came from. (#9459)
- On UNIX-like platforms, Twisted attempts to recover from EMFILE when accepting connections on TCP and UNIX ports by shedding incoming clients. (#5368)
- The documentation of IReactorTime.getDelayedCalls() has been corrected to indicate that the method returns a list, not a tuple. (#9418)
- "python -m twisted web --help" now refers to "--listen" instead of the non-existing "--http" (#9434)
- twisted.python.htmlizer.TokenPrinter now explicitly works on bytestrings. (#9442)
- twisted.enterprise.adbapi.ConnectionPool.runWithConnection and runInteraction now use the reactor that is passed to ConnectionPool's constructor. (#9467)
- The Twisted Coding Standard now contains examples of how to mark up a feature as added in the next Twisted release. (#9460)
- Deprecate direct introspection of ProcMon's processes: processes should not be directly accessed or pickled. (#9287)
- twisted.internet.address.IPv4Address._bwHack and twisted.internet.address.UNIXAddress._bwHack, as well as the parameters to the constructors, deprecated since Twisted 11.0, have been removed. (#9450)
- #7495, #9399, #9406, #9411, #9425, #9439, #9449, #9450, #9452
- twisted.conch.ssh.transport.SSHTransportBase now includes Twisted's version in the software version string it sends to the server, allowing servers to apply compatibility workarounds for bugs in particular client versions. (#9424)
- If the command run by twisted.conch.endpoints.SSHCommandClientEndpoint exits because of a delivered signal, the client protocol's connectionLost is now called with a ProcessTerminated exception instead of a ConnectionDone exception. (#9412)
- twisted.conch.ssh.transport.SSHTransportBase now correctly handles MSG_DEBUG with a false alwaysDisplay field on Python 2 (broken since 8.0.0). (#9422)
- twisted.conch.manhole.lastColorizedLine now does not throw a UnicodeDecodeError on non-ASCII input. (#9442)
- Added support for SameSite cookies in
http.Request.addCookie. (#9387)
- twisted.web.server.GzipEncoderFactory would sometimes fail to gzip requests if the Accept-Encoding header contained whitespace between the comma-separated acceptable encodings. It now trims whitespace before checking if gzip is an acceptable encoding. (#9086)
- twisted.web.static.File renders directory listings on Python 2, including those with text paths. (#9438)
- twisted.python.http.Request now correcly parses multipart bodies on Python 3.7. (#9448)
- twisted.web.http.combinedLogFormatter (used by t.w.http.Server and t.w.server.Site) no longer produces DeprecationWarning about Request.getClientIP. (#9470)
- #9432, #9466, #9479, #9480
No significant changes.
No significant changes.
- #9398
- The --port/--https arguments to web plugin are now deprecated, in favor of --listen. The --listen argument can be given multiple times to listen on multiple ports. (#6670)
- Twisted now requires zope.interface 4.4.2 or higher across all platforms and Python versions. (#8149)
- The osx_platform setuptools extra has been renamed to macos_platform, with the former name being a compatibility alias. (#8848)
- Zsh completions are now provided for the twist command. (#9338)
- twisted.internet.endpoints.HostnameEndpoint now has a __repr__ method which includes the host and port to which the endpoint connects. (#9341)
- twistd now uses the UID's default GID to initialize groups when --uid is given but --gid is not. This prevents an unhandled TypeError from being raised when os.initgroups() is called. (#4442)
- twisted.protocols.basic.LineReceiver checks received lines' lengths against its MAX_LENGTH only after receiving a complete delimiter. A line ending in a multi-byte delimiter like 'rn' might be split by the network, with the first part arriving before the rest; previously, LineReceiver erroneously disconnected if the first part, e.g. 'zzzz....r' exceeded MAX_LENGTH. LineReceiver now checks received data against MAX_LENGTH plus the delimiter's length, allowing short reads to complete a line. (#6556)
- twisted.protocols.basic.LineOnlyReceiver disconnects the transport after receiving a line that exceeds MAX_LENGTH, like LineReceiver. (#6557)
- twisted.web.http.Request.getClientIP now returns the host part of the client's address when connected over IPv6. (#7704)
- twisted.application.service.IService is now documented as requiring the 'running', 'name' and 'parent' attributes (the documentation previously implied they were required, but was unclear). (#7922)
- twisted.web.wsgi.WSGIResource no longer raises an exception when a client connects over IPv6. (#8241)
- When using TLS enable automatic ECDH curve selection on OpenSSL 1.0.2+ instead of only supporting P-256 (#9210)
- twisted.trial._dist.worker and twisted.trial._dist.workertrial consistently pass bytes, not unicode to AMP. This fixes "trial -j" on Python 3. (#9264)
- twisted.trial.runner now uses the 'importlib' module instead of the 'imp' module on Python 3+. This eliminates DeprecationWarnings caused by importing 'imp' on Python 3. (#9275)
- twisted.web.client.HTTP11ClientProtocol now closes the connection when the server is sending a header line which is longer than he line limit of twisted.protocols.basic.LineReceiver.MAX_LENGTH. (#9295)
- twisted.python.failure now handles long stacktraces better; in particular it will log tracebacks for stack overflow errors. (#9301)
- The "--_shell-completion" argument to twistd now works on Python 3. (#9303)
- twisted.python.failure.Failure now raises the wrapped exception in Python3, and self (Failure) n Python2 when trap() is called without a matching exception (#9307)
- Writing large amounts of data no longer implies repeated, expensive copying under Python 3. Python 3's write speeds are now as fast as Python 2's. (#9324)
- twisted.protocols.postfix now properly encodes errors which are unicode strings to bytes. (#9335)
- twisted.protocols.policies.ProtocolWrapper and twisted.protocols.tls.TLSMemoryBIOProtocol no longer create circular references that keep protocol instances in memory after connection is closed. (#9374)
- twisted.conch.ssh.transport.SSHTransportBase no longer strips trailing spaces from the SSH version string of the connected peer. (#9377)
- trial -j no longer crashes on Python 2 on test failure messages containing non-ASCII bytes. (#9378)
- RSA keys replaced with 2048bit ones in twisted.conch.test.keydata in order to be compatible with OpenSSH 7.6. (#9388)
- AsyncioSelectorReactor uses the global policy's event loop. asyncio libraries that retrieve the running event loop with get_event_loop() will now receive the one used by AsyncioSelectorReactor. (#9390)
- public attributes of twisted.logger.Logger are now documented as attributes. (#8157)
- List indentation formatting errors have been corrected throughout the documentation. (#9256)
- twisted.protocols.basic.LineOnlyReceiver.lineLengthExceeded no longer returns twisted.internet.error.ConnectionLost. It instead directly disconnects the transport and returns None. (#6557)
- twisted.python.win32.getProgramsMenuPath and twisted.python.win32.getProgramFilesPath were deprecated in Twisted 15.3.0 and have now been removed. (#9312)
- Python 3.3 is no longer supported. (#9352)
- #7033, #8887, #9204, #9289, #9291, #9292, #9293, #9302, #9336, #9355, #9356, #9364, #9375, #9381, #9382, #9389, #9391, #9393, #9394, #9396
- twisted.plugins.cred_unix now properly converts a username and password from bytes to str on Python 3. In addition, passwords which are encrypted with SHA512 and SH256 are properly verified. This fixes running a conch server with: "twistd -n conch -d /etc/ssh/ --auth=unix". (#9130)
- In twisted.conch.scripts.conch, on Python 3 do not write bytes directly to sys.stderr. On Python 3, this fixes remote SSH execution of a command which fails. (#9344)
- twisted.conch.ssh.filetransfer.FileTransferClient.wasAFile attribute has been removed as it serves no purpose. (#9362)
- Removed deprecated support for PyCrypto key objects in conch (#9368)
- The new twisted.iweb.IRequest.getClientAddress returns the IAddress provider representing the client's address. Callers should check the type of the returned value before using it. (#7707)
- Eliminate use of twisted.python.log in twisted.web modules. (#9280)
- Scripts ending with .rpy, .epy, and .cgi now execute properly in Twisted Web on Python 3. (#9271)
- twisted.web.http.Request and twisted.web.server.Request are once again hashable on Python 2, fixing a regression introduced in Twisted 17.5.0. (#9314)
- Correct reactor docstrings for twisted.web.client.Agent and twisted.web.client._StandardEndpointFactory to communicate interface requirements since 17.1. (#9274)
- The examples for the "Twisted Web in 60 Seconds" tutorial have been fixed to work on Python 3. (#9285)
- twisted.iweb.IRequest.getClientIP is deprecated. Use twisted.iweb.IRequest.getClientAddress instead (see #7707). (#7705)
- twisted.web.iweb.IRequest.getClient and its implementations (deprecated in #2552) have been removed. (#9395)
- twistd.mail.scripts.mailmail has been ported to Python 3. (#8487)
- twisted.mail.bounce now works on Python 3. (#9260)
- twisted.mail.pop3 and twisted.mail.pop3client now work on Python 3. (#9269)
- SMTP authentication in twisted.mail.smtp now works better on Python 3, due to improved improved bytes vs unicode handling. (#9299)
- #9310
No significant changes.
No significant changes.
This is the last Twisted release where Python 3.3 is supported, on any platform.
- twisted.python.failure.Failure is now a new-style class which subclasses BaseException. (#5519)
- twisted.internet.posixbase.PosixReactorBase.adoptStreamPort and twisted.internet.posixbase.PosixReactorBase.adoptStreamConnection now support AF_UNIX SOCK_STREAM sockets. (#5573)
- (#8940)
- t.protocol.policies.TimeoutMixin.setTimeout and t.protocol.policies.TimeoutProtocol.cancelTimeout (used in t.protocol.policies.TimeoutFactory) no longer raise a t.internet.error.AlreadyCancelled exception when calling them for an already cancelled timeout. (#9131)
- twisted.web.template.flatten now supports coroutines that yield Deferreds. (#9199)
- twisted.web.client.HTTPConnectionPool passes the repr() of the endpoint to the client protocol factory, and the protocol factory adds that to its own repr(). This makes logs more useful. (#9235)
- Python 3.6 is now supported (#9240)
- twisted.python.logfile.BaseLogFile and subclasses now always open the file in binary mode, and will process text as UTF-8. (#6938)
- The ssl: endpoint now accepts certKey PEM files without trailing newlines. (#7530)
- Logger.__init__ sets the namespace to "<unknown>" instead of raising KeyError when unable to determine the namespace from the calling context. (#7930)
- twisted.internet._win32serialport updated to support pySerial 3.x and dropped pySerial 2.x support. (#8159)
- twisted.python.rebuild now works on Python 3. (#8213)
- twisted.web.server.Request.notifyFinish will now once again promptly notify applications of client disconnection (assuming that the client doesn't send a large amount of pipelined request data) rather than waiting for the timeout; this fixes a bug introduced in Twisted 16.3.0. (#8692)
- twisted.web.guard.HTTPAuthSessionWrapper configured with DigestCredentialFactory now works on both Python 2 and 3. (#9127)
- Detect when we’re being run using “-m twisted” or “-m twisted.trial” and use it to build an accurate usage message. (#9133)
- twisted.protocols.tls.TLSMemoryBIOProtocol now allows unregisterProducer to be called when no producer is registered, bringing it in line with other transports. (#9156)
- twisted.web web servers no longer print tracebacks when they timeout clients that do not respond to TLS CLOSE_NOTIFY messages. (#9157)
- twisted.mail.imap4 now works on Python 3. (#9161)
- twisted.python.shortcut now works on Python 3 in Windows. (#9170)
- Fix traceback forwarding with inlineCallbacks on python 3. (#9175)
- twisted.mail.imap4.MessageSet now treats * as larger than every message ID, leading to more consistent and robust behavior. (#9177)
- The following plugins can now be used on Python 3 with twistd: dns, inetd, portforward, procmon, socks, and words. (#9184)
- twisted.internet._win32serialport now uses serial.serialutil.to_bytes() to provide bytes in Python 3. (#9186)
- twisted.internet.reactor.spawnProcess() now does not fail on Python 3 in Windows if passed a bytes-encoded path argument. (#9200)
- twisted.protocols.ident now works on Python 3. (#9221)
- Ignore PyPy's implementation differences in base object class. (#9225)
- twisted.python.test.test_setup now passes with setuptools 36.2.1 (#9231)
- twisted.internet._win32serialport SerialPort._clearCommError() no longer raises AttributeError (#9252)
- twisted.trial.unittest.SynchronousTestCase and twisted.trial.unittest.TestCase now always run their tearDown methods, even when a test method fails with an exception. They also flush all errors logged by a test method before running another, ensuring the logged errors are associated with their originating test method. (#9267)
- Trial's documentation now directly mentions the preferred way of running Trial, via "python -m twisted.trial". (#9052)
- twisted.internet.endpoints.HostnameEndpoint and twisted.internet.endpoints.TCP4Client endpoint documentation updated to correctly reflect that the timeout argument takes a float as well as an int. (#9151)
- Badges at top of README now correctly render as links to respective result pages on GitHub. (#9216)
- The example code for the trial tutorial is now compatible with Python3 and the current version of Twisted. (#9223)
- twisted.protocols.dict is deprecated. (#9141)
- gpsfix.py has been removed from the examples. It uses twisted.protocols.gps which was removed in Twisted 16.5.0. (#9253)
- oscardemo.py, which illustrates the use of twisted.words.protocols.oscar, as been removed. twisted.words.protocols.oscar was removed in Twisted 17.5.0. (#9255)
- #5949, #8566, #8650, #8944, #9159, #9160, #9162, #9196, #9219, #9228, #9229, #9230, #9247, #9248, #9249, #9251, #9254, #9262, #9276, #9308
- twisted.conch.ssh.userauth.SSHUserAuthServer now gracefully handles unsupported authentication key types. (#9139)
- twisted.conch.client.default verifyHostKey now opens /dev/tty with no buffer to be compatible with Python 3. This lets the conch cli work with Python 3. (#9265)
- twisted.conch.ssh._cryptography_backports has been removed in favor of using int_to_bytes() and int_from_bytes() from cryptography.utils. (#9263)
- #9158, #9272
- twisted.web.static.File.contentTypes is now documented. (#5739)
- twisted.web.server.Request and any Twisted web server using it now support automatic fast responses to HTTP/1.1 and HTTP/2 OPTIONS * requests, and reject any other verb using the * URL form. (#9190)
- --add-header "HeaderName: Value" can be passed to twist web in order to set extra headers on all responses (#9241)
- twisted.web.client.HTTPClientFactory(...).gotHeaders(...) now handles a wrong Set-Cookie header without a traceback. (#9136)
- twisted.python.web.http.HTTPFactory now always opens logFile in binary mode and writes access logs in UTF-8, to avoid encoding issues and newline differences on Windows. (#9143)
- The code examples in "Using the Twisted Web Client" now work on Python 3. (#9172)
- twisted.web.server.Request and all web servers that use it now no longer send a default Content-Type header on responses that do not have a body (i.e. that set Content-Length: 0 or that send a 204 status code). (#9191)
- twisted.web.http.Request and all subclasses now correctly fire Deferreds returned from notifyFinish with errbacks when errors are encountered in HTTP/2 streams. (#9208)
- twisted.web.microdom, twisted.web.domhelpers, and twisted.web.sux now work on Python 3. (#9222)
- Sending a list of recipients with twisted.smtp.SenderFactory has been fixed. This fixes a problem found when running buildbot. (#9180)
- twisted.mail.imap4.IMAP4Server parses empty string literals even when they are the last argument to a command, such as LOGIN. (#9207)
- twisted.words.tap has been ported to Python 3 (#9169)
- #9246
- Queries for unknown record types no longer incorrectly result in a server error. (#9095)
- Failed TCP connections for AFXR queries no longer raise an AttributeError. (#9174)
- spawnProcess no longer opens an unwanted console on Windows (#5726)
- The transition to the hyperlink package adds IPv6 support to twisted.python.url.URL. This is now deprecated and new code should use hyperlink directly (see #9126). (#8069)
- twisted.logger now buffers only 200 events by default (reduced from 65536) while waiting for observers to be configured. (#8164)
- The transition of twisted.python.url to using the hyperlink package enables a URL.click() with no arguments (or 0-length string argument) to resolve dot segments in the path. (#8184)
- twisted.protocols.finger now works on Python 3. (#8230)
- TLS-related tests now pass when run with OpenSSL 1.1.0. This makes tests pass again on macOS and Windows, as cryptography 1.8 and later include OpenSSL 1.1.0. (#8898)
- UNIX socket endpoints now process all messages from recvmsg's ancillary data via twisted.internet.unix.Server.doRead/twisted.internet.unix.Client.doRead, while discarding and logging ones that don't contain file descriptors. (#8912)
- twisted.internet.endpoints.HostnameEndpoint and twisted.web.client.Agent work again with reactors that do not provide IReactorPluggableNameResolver. This undoes the changes that broke downstream users such as treq.testing. Note that passing reactors that do not provide IReactorPluggableNameResolver to either is deprecated. (#9032)
- A Python 3 Perspective Broker server which receives a remote call with keyword arguments from a Python 2 client will now decode any keys which are binary to strings instead of crashing. This fixes interoperability between Python 2 Buildbot clients and Python 3 Buildbot servers. (#9047)
- twisted.internet._threadedselect now works on both Python 2 and 3. (#9053)
- twisted.internet.interfaces.IResolverSimple implementers will now always be passed bytes, properly IDNA encoded if required, on Python 2. On Python 3, they will now be passed correctly IDNA-encoded Unicode forms of the domain, taking advantage of the idna library from PyPI if possible. This is to avoid Python's standard library (which has an out of date idna module) from mis- encoding domain names when non-ASCII Unicode is passed to it. (#9137)
- The examples in Twisted howto "Using the Twisted Application Framework", section "Customizing twistd logging" have been updated to use latest logging modules and syntax (#9084)
- twisted.internet.defer.Deferred.asFuture and twisted.internet.defer.Deferred.fromFuture were added, allowing for easy transitions between asyncio coroutines (which await Futures) and twisted coroutines (which await Deferreds). (#8748)
- twisted.application.internet.ClientService.whenConnected now accepts an argument "failAfterFailures". If you set this to 1, the Deferred returned by whenConnected will errback when the connection attempt fails, rather than retrying forever. This lets you react (probably by stopping the ClientService) to connection errors that are likely to be persistent, such as using the wrong hostname, or not being connected to the internet at all. (#9116)
- twisted.protocols.tls.TLSMemoryBIOProtocol and anything that uses it indirectly including the TLS client and server endpoints now enables TLS 1.3 cipher suites. (#9128)
- #8133, #8995, #8997, #9003, #9015, #9021, #9026, #9027, #9049, #9057, #9062, #9065, #9069, #9070, #9072, #9074, #9075, #9111, #9117, #9140, #9144, #9145
- twisted.runner.inetdconf.InvalidRPCServicesConfError, twisted.runner.inetdconf.RPCServicesConf, twisted.runner.inetdtap.RPCServer, and twisted.runner.portmap, deprecated since 16.2.0, have been removed. (#8464)
- twisted.python.url and twisted.python._url were modified to rely on hyperlink, a new package based on the Twisted URL implementation. Hyperlink adds support for IPv6 (fixing #8069), correct username/password encoding, better scheme/netloc inference, improved URL.click() behavior (fixing #8184), and more. For full docs see hyperlink.readthedocs.io and the CHANGELOG in the hyperlink GitHub repo. (#9126)
- History-aware terminal protocols like twisted.conch.manhole.Manhole no longer raise a TypeError when a user visits a partial line they added to the command line history by pressing up arrow before return. (#9031)
- The telnet_echo.tac example had conflicting port callouts between runtime and documentation. File was altered to run on documented port, 6023. (#9055)
- Remove diffie-hellman-group1-sha1 from twisted.conch. See https://weakdh.org/ (#9019)
- Removed small and obscure elliptic curves from conch. The only curves conch supports now are the ones also supported by OpenSSH. (#9088)
- twisted.mail.smtp has been ported to Python 3. (#8770)
- RRHeader now converts its ttl argument to an integer, raising a TypeError if it cannot. (#8340)
- twisted.web.cgi now works on Python 3 (#8009)
- twisted.web.distrib now works on Python 3 (#8010)
- twisted.web.http.HTTPFactory now propagates its reactor's callLater method to the HTTPChannel object, rather than having callLater grab the global reactor. This prevents the possibility of HTTPFactory logging using one reactor, but HTTPChannel running timeouts on another. (#8904)
- twisted.web.template.flattenString docstring now correctly references io.BytesIO (rather than NativeStringIO). (#9028)
- twisted.web.client now exposes the RequestGenerationFailed exception type. (#5310)
- twisted.web.client.Agent will now parse responses that begin with a status line that is missing a phrase. (#7673)
- twisted.web.http.HTTPChannel and twisted.web._http2.H2Connection have been enhanced so that after they time out they wait a small amount of time to allow the connection to close gracefully and, if it does not, they forcibly close it to avoid allowing malicious clients to forcibly keep the connection open. (#8902)
- #8981, #9018, #9067, #9090, #9092, #9093, #9096
- twisted.words.protocols.oscar, which is client code for Oscar/ICQ, was deprecated in 16.2.0 and has now been removed. (#9024)
- Added a new interface, twisted.internet.interfaces.IHostnameResolver, which is an improvement to twisted.internet.interfaces.IResolverSimple that supports resolving multiple addresses as well as resolving IPv6 addresses. This is a native, asynchronous, Twisted analogue to getaddrinfo. (#4362)
- twisted.web.client.Agent now uses HostnameEndpoint internally; as a consequence, it now supports IPv6, as well as making connections faster and more reliably to hosts that have more than one DNS name. (#6712)
- twisted.internet.ssl.CertificateOptions now has the new constructor argument 'raiseMinimumTo', allowing you to increase the minimum TLS version to this version or Twisted's default, whichever is higher. The additional new constructor arguments 'lowerMaximumSecurityTo' and 'insecurelyLowerMinimumTo' allow finer grained control over negotiated versions that don't honour Twisted's defaults, for working around broken peers, at the cost of reducing the security of the TLS it will negotiate. (#6800)
- twisted.internet.ssl.CertificateOptions now sets the OpenSSL context's mode to MODE_RELEASE_BUFFERS, which will free the read/write buffers on idle TLS connections to save memory. (#8247)
- trial --help-reactors will only list reactors which can be imported. (#8745)
- twisted.internet.endpoints.HostnameEndpoint now uses the passed reactor's implementation of twisted.internet.interfaces.IReactorPluggableResolver to resolve hostnames rather than its own deferToThread/getaddrinfo wrapper; this makes its hostname resolution pluggable via a public API. (#8922)
- twisted.internet.reactor.spawnProcess now does not emit a deprecation warning on Unicode arguments. It will encode Unicode arguments down to bytes using the filesystem encoding on UNIX and Python 2 on Windows, and pass Unicode through unchanged on Python 3 on Windows. (#8941)
- twisted.trial._dist.test.test_distreporter now works on Python 3. (#8943)
- trial --help-reactors will now display iocp and win32er reactors with Python 3. (#8745)
- twisted.logger._flatten.flattenEvent now handles log_format being None instead of assuming the value is always a string. (#8860)
- twisted.protocol.ftp is now Python 3 compatible (#8865)
- twisted.names.client.Resolver can now resolve names with IPv6 DNS servers. (#8877)
- twisted.application.internet.ClientService now waits for existing connections to disconnect before trying to connect again when restarting. (#8899)
- twisted.internet.unix.Server.doRead and twisted.internet.unix.Client.doRead no longer fail if recvmsg's ancillary data contains more than one file descriptor. (#8911)
- twist on Python 3 now correctly prints the help text when given no plugin to run. (#8918)
- twisted.python.sendmsg.sendmsg no longer segfaults on Linux + Python 2. (#8969)
- IHandshakeListener providers connected via SSL4ClientEndpoint will now have their handshakeCompleted methods called. (#8973)
- The twist script now respects the --reactor option. (#8983)
- Fix crash when using SynchronousTestCase with Warning object which does not store a string as its first argument (like libmysqlclient). (#9005)
- twisted.python.compat.execfile() does not open files with the deprecated 'U' flag on Python 3. (#9012)
- twisted.internet.ssl.CertificateOption's 'method' constructor argument is now deprecated, in favour of the new 'raiseMinimumTo', 'lowerMaximumSecurityTo', and 'insecurelyLowerMinimumTo' arguments. (#6800)
- twisted.protocols.telnet (not to be confused with the supported twisted.conch.telnet), deprecated since Twisted 2.5, has been removed. (#8925)
- twisted.application.strports.parse, as well as the deprecated default arguments in strports.service/listen, deprecated since Twisted 10.2, has been removed. (#8926)
- twisted.web.client.getPage and twisted.web.client.downloadPage have been deprecated in favour of https://pypi.org/project/treq and twisted.web.client.Agent. (#8960)
- twisted.internet.defer.timeout is deprecated in favor of twisted.internet.defer.Deferred.addTimeout (#8971)
- #7879, #8583, #8764, #8809, #8859, #8906, #8910, #8913, #8916, #8934, #8945, #8949, #8950, #8952, #8953, #8959, #8962, #8963, #8967, #8975, #8976, #8993, #9013
- twisted.conch.manhole now works on Python 3. (#8327)
- Twisted Conch now supports ECDH key exchanges. (#8730)
- Add support in twisted.conch.ssh for hmac-sha2-384 (#8784)
- conch and cftp scripts now work on Python 3. (#8791)
- twisted.conch.ssh supports ECDH key exchange. (#8811)
- twisted.conch.ssh.keys.Key.fromString now supports OpenSSL private keys with Windows line endings (rn) again (broken since 16.6.0). (#8928)
- The documentation for twisted.conch.endpoints.SSHCommandClientEndpoint.existingConnection now describes where the value for the connection parameter might come from. (#8892)
- #8890, #8894, #8957, #8958, #8968
- twisted.mail.tap (the twist plugin for mail) no longer accepts the --pop3s option or implicit port numbers to --pop3 and --smtp. This functionality has been deprecated since 11.0. (#8920)
- twisted.names.authority.BindAuthority has been ported to Python 3. (#8880)
No significant changes have been made for this release.
No significant changes have been made for this release.
- On Python 3, procmon now handles process output without exceptions (#8919)
- twisted.web.client.Agent now sets
Content-Length: 0for PUT and POST requests made without a body producer. (#8984)
- twisted.web.http.HTTPFactory now times connections out after one minute of no data from the client being received, before the request is complete, rather than twelve hours. (#3746)
- twisted.web.http.HTTPChannel, the server class for Twisted's HTTP/1.1 server, now exerts backpressure against clients that do not read responses. This means that if a client stops reading from a socket for long enough, Twisted will stop reading further requests from that client until it consumes some responses. (#8868)
- twisted.web.http_headers.Headers.getRawHeaders no longer attempts to decode the default value when called with a unicode header name. (#8974)
- twisted.web.http.HTTPChannel is less likely to leak file descriptors when timing out clients using HTTPS connections. In some cases it is still possible to leak a file descriptor when timing out HTTP clients: further patches will address this issue. (#8992)
- #7744, #8909, #8935
No significant changes have been made for this release.
- The twist script can now be run by invoking python -m twisted. (#8657)
- twisted.protocols.sip has been ported to Python 3. (#8669)
- twisted.persisted.dirdbm has been ported to Python 3. (#8888)
- twisted.internet.defer.Deferred now implements send, not __send__, which means that it is now a conforming generator. (#8861)
- The IOCP reactor no longer transmits the contents of uninitialized memory when writing large amounts of data. (#8870)
- Deferreds awaited/yielded from in a twisted.internet.defer.ensureDeferred wrapped coroutine will now properly raise exceptions. Additionally, it more closely models asyncio.ensure_future and will pass through Deferreds. (#8878)
- Deferreds that are paused or chained on other Deferreds will now return a result when yielded/awaited in a twisted.internet.defer .ensureDeferred-wrapped coroutine, instead of returning the Deferred it was chained to. (#8890)
- twisted.test.proto_helpers is now explicitly covered by the compatibility policy. (#8857)
- #8281, #8823, #8862
- twisted.conch.ssh.keys supports ECDSA keys (#8798)
- scripts/ckeygen can now generate ecdsa keys. (#8828)
- ckeygen has been ported to Python 3 (#8855)
- twisted.conch.ssh no longer uses gmpy, if available. gmpy is unmaintained, does not have binary wheels for any platforms, and an alternative for higher performance is available in the form of PyPy. (#8079)
No significant changes have been made for this release.
No significant changes have been made for this release.
No significant changes have been made for this release.
No significant changes have been made for this release.
No significant changes have been made for this release.
- twisted.web.server.Site's HTTP/2 server support now emits vastly fewer WINDOW_UPDATE frames than previously. (#8681)
- twisted.web.Agent now tolerates receiving unexpected status codes in the 100 range by discarding them, which is what RFC 7231 recommends doing. (#8885)
- twisted.web._http.H2Stream's getHost and getPeer implementations now actually return the host and peer instead of None. (#8893)
- twisted.words.protocols.irc has been ported to Python 3 (#6320)
- Added twisted.internet.defer.Deferred.addTimeout method to enable timeouts of deferreds. (#5786)
- Perspective Broker (the twisted.spread package) has been ported to Python 3 (#7598)
- 'yield from' can now be used on Deferreds inside generators, when the generator is wrapped with twisted.internet.defer.ensureDeferred. (#8087)
- twisted.internet.asyncioreactor has been added, which is a Twisted reactor on top of Python 3.4+'s native asyncio reactor. It can be selected by passing "--reactor=asyncio" to Twisted tools (twistd, Trial, etc) on platforms that support it (Python 3.4+). (#8367)
- twisted.python.zippath now works on Windows with Python 3. (#8747)
- twisted.internet.cfreactor is ported to Python 3 and supported on 2.7 and 3.5+. (#8838)
- twisted.internet.test.test_iocp and twisted.internet.test.test_tcp have been fixed to work under Python 3 with the Windows IOCP reactor (#8631)
- Arguments to processes on Windows are now passed mbcs-encoded arguments. This prevents process-related tests from hanging on Windows with Python 3. (#8735)
- Client and server TLS connections made via the client TLS endpoint and the server SSL endpoint, as well as any other code that uses twisted.internet.ssl.CertificateOptions, no longer accept 3DES- based cipher suites by default, to defend against SWEET32. (#8781)
- twisted.logger.jsonFileLogObserver no longer emits non-JSON tracebacks into its file; additionally, twisted.logger.formatEventAsClassicLogText now includes traceback information for the log event it formats. (#8858)
- twisted.python.version now exports a version of Incremental that is 16.10.1 or higher, making t.p.v.Version package name comparisons case-insensitive. (#8863)
- twisted.python.reflect.safe_str encodes unicode as ascii with backslashreplace error handling on Python 2. (#8864)
- The twisted.internet.interfaces.IProtocol.dataReceived() method takes one parameter of type bytes. This has been clarified in the doc string. (#8763)
- twisted.python.constants is deprecated in preference to constantly on PyPI, which is the same code rolled into its own package. (#7351)
- twisted.python.dist3 has been made private API. (#8761)
- When the source code is checked out, bin/trial is no longer in the tree. Developers working on the Twisted source code itself should either (1) run all tests under tox, or (2) run 'python setup.py develop' to install trial before running any tests. (#8765)
- twisted.protocols.gps, deprecated since Twisted 15.2, has been removed. (#8787)
- #4926, #7868, #8209, #8214, #8271, #8308, #8324, #8348, #8367, #8377, #8378, #8379, #8380, #8381, #8383, #8385, #8387, #8388, #8389, #8391, #8392, #8393, #8394, #8397, #8406, #8410, #8412, #8413, #8414, #8421, #8425, #8426, #8430, #8432, #8434, #8435, #8437, #8438, #8439, #8444, #8451, #8452, #8453, #8454, #8456, #8457, #8459, #8462, #8463, #8465, #8468, #8469, #8479, #8482, #8483, #8486, #8490, #8493, #8494, #8496, #8497, #8498, #8499, #8501, #8503, #8504, #8507, #8508, #8510, #8513, #8514, #8515, #8516, #8517, #8520, #8521, #8522, #8523, #8524, #8527, #8528, #8529, #8531, #8532, #8534, #8536, #8537, #8538, #8543, #8544, #8548, #8552, #8553, #8554, #8555, #8557, #8560, #8563, #8565, #8568, #8569, #8572, #8573, #8574, #8580, #8581, #8582, #8586, #8589, #8590, #8592, #8593, #8598, #8603, #8604, #8606, #8609, #8615, #8616, #8617, #8618, #8619, #8621, #8622, #8624, #8627, #8628, #8630, #8632, #8634, #8640, #8644, #8645, #8646, #8647, #8662, #8664, #8666, #8668, #8671, #8672, #8677, #8678, #8684, #8691, #8702, #8705, #8706, #8716, #8719, #8724, #8725, #8727, #8734, #8741, #8749, #8752, #8754, #8755, #8756, #8757, #8758, #8767, #8773, #8776, #8779, #8780, #8785, #8788, #8789, #8790, #8792, #8793, #8799, #8808, #8817, #8839, #8845, #8852
- SSH key fingerprints can be generated using base64 encoded SHA256 hashes. (#8701)
- SSHUserAuthServer does not crash on keyboard interactive authentication when running on Python 3 (#8771)
- twisted.conch.insults.insults.ServerProtocol no longer corrupts a client's display when attempting to set the cursor position, and its ECMA-48 terminal manipulation works on Python 3. (#8803)
- #8495, #8511, #8715, #8851
- twisted.mail.protocols.DomainSMTP and DomainESMTP, deprecated since 2003, have been removed. (#8772)
- #6289, #8525, #8786, #8830
No significant changes have been made for this release.
- #8625, #8663
No significant changes have been made for this release.
- twisted.pair has been ported to Python 3 (#8744)
No significant changes have been made for this release.
- twisted.web.client.HTTPConnectionPool and anything that uses it, like twisted.web.client.Agent, have had their logic for resuming transports changed so that transports are resumed after state machine transitions are complete, rather than before. This change allows the HTTP client infrastructure to work with alternative HTTP implementations such as HTTP/2 which may be able to deliver a complete response synchronously when producing is resumed. (#8720)
- #8519, #8530, #8629, #8707, #8777, #8778, #8844
No significant changes have been made for this release.
- #8360, #8460
- Client and server TLS connections made via the client TLS endpoint and the server SSL endpoint, as well as any other code that uses twisted.internet.ssl.CertificateOptions, now support ChaCha20 ciphers when available from the OpenSSL on the system. (#8760)
- Client and server TLS connections made via the client TLS endpoint and the server SSL endpoint, as well as any other code that uses twisted.internet.ssl.CertificateOptions, no longer accept 3DES- based cipher suites by default, to defend against SWEET32. (#8781)
No significant changes have been made for this release.
No significant changes have been made for this release.
No significant changes have been made for this release.
No significant changes have been made for this release.
No significant changes have been made for this release.
No significant changes have been made for this release.
No significant changes have been made for this release.
No significant changes have been made for this release.
- Add twisted.application.twist, meant to eventually replace twistd with a simpler interface. Add twisted.application.runner API, currently private, which twist is built on. (#5705)
- The new interface IHandshakeListener that can be implemented by any Protocol provides a callback that is called when the TLS handshake has been completed, allowing Protocols to make decisions about the TLS configuration before application data is sent. (#6024)
- twisted.python.syslog has been ported to Python 3. (#7957)
- twisted.internet.defer.ensureDeferred has been added, similar to asyncio's ensure_future. Wrapping a coroutine (the result of a function defined using async def, available only on Python 3.5+) with it allows you to use the "await" keyword with Deferreds inside the coroutine, similar to "yield" when using inlineCallbacks. (#8088)
- twisted.internet.inotify have been ported to Python 3 (#8211)
- twisted.enterprise has been ported to Python 3. The third-party pysqlite2 package has not been ported to Python 3, so any database connector based on pysqlite2 cannot be used. Instead the sqlite3 module included with Python 3 should be used. (#8303)
- Scripts such as cftp, ckeygen, conch, mailmail, pyhtmlizer, tkconch, twistd and trial have been updated to be setuptools console scripts. (#8491)
- twisted.pair.raw and twisted.pair.rawudp have been ported to Python 3 (#8545)
- twisted.internet.baseprocess has been ported to Python 3. (#8546)
- twisted.python.dist has been ported to Python 3 (#8556)
- twisted.internet.interfaces.IOpenSSLContextFactory has been added, which defines the interface provided both by the old-style twisted.internet.ssl.ContextFactory class and the newer twisted.interface.ssl.CertificateOptions class. This is a precursor to formally deprecating the former class in favour of the latter. (#8597)
- twisted.python.zipstream has been ported to Python 3 (#8607)
- Zip file entries returned by ChunkingZipFile.readfile() are now context managers. (#8641)
- twisted.protocols.socks has been ported to Python 3 (#8665)
- twisted.spread.banana has been ported to Python 3 (#8667)
- Trial can now be invoked via "python -m twisted.trial". (#8712)
- twisted.protocols.postfix has been ported to Python 3 (#8713)
- twisted.protocols.wire and twisted.protocols.portforwarding have been ported to Python 3 (#8717)
- twisted.protocols.stateful has been ported to Python 3 (#8718)
- twisted.protocols.memcache is now compatible with Python 3. (#8726)
- twisted.protocols.dict has been ported to Python 3 (#8732)
- pip install -e ".[dev]" now works on Python 3, but it will not install twistedchecker or pydoctor, which have not yet been ported. (#7807)
- twistd can now properly daemonize on Linux/Unix when run under Python3 and will not hang indefinitely. (#8155)
- tox can now be used to run Twisted's tests on Windows (#8578)
- twisted.python.filepath.setContent() and twisted.python.filepath.moveTo() now work on Windows with Python 3 (#8610)
- twisted.internet.win32eventreactor works on Python 3 in Windows (#8626)
- The TLS payload buffer size was reduced in twisted.protocols.tls.TLSMemoryBIOProtocol. This fixes writing of very long strings using the TLSv1_1 method from the OpenSSL library. (#8693)
- twisted.logger._flatten.flattenEvent() now does not crash if passed a unicode string. (#8699)
- twisted.application.strports.service (and thus twistd) no longer swallow asynchronous exceptions from IStreamServerEndpoint.listen. (#8710)
- _twistd_unix now reports the name and encoded message of an exception raised during daemonization on Python 2 and 3. (#8731)
- twisted.protocols.amp now handles floats on Python 3. Previously, sending a float would raise a ValueError. (#8746)
- Some broken links to xprogramming in the unit test documentation have been fixed. (#8579)
- The Twisted Tutorial "The Evolution of Finger" has been updated to use endpoints throughout. (#8588)
- Updated the mail examples to use endpoints and better TLS. (#8595)
- Changed the Twisted Web howto to use endpoints and modern TLS. (#8596)
- Updated bug report URL in man pages. (#8600)
- In twisted.internet.udp.Port, write() takes a parameter of type bytes. This is clarified in the docstring. (#8635)
- twisted.internet.interfaces.ITransport.write() and twisted.internet.interfaces.ITransport.writeSequence() take bytes parameters. (#8636)
- twisted.python.filepath.AbstractFilePath.getContent() returns bytes. The docstring was updated to clarify this. (#8637)
- Updated release notes to reflect that 15.4 is the last version that supported Python 2.6, not 15.5. (#8651)
- A missing space in defer.rst resulted in badly rendered output. The space was added. (#8723)
- Dropped support for pyOpenSSL versions less than 16.0.0. (#8441)
- #4926, #7868, #8209, #8271, #8276, #8308, #8324, #8348, #8367, #8377, #8378, #8379, #8380, #8381, #8383, #8385, #8386, #8387, #8388, #8389, #8391, #8392, #8393, #8394, #8397, #8406, #8410, #8412, #8413, #8414, #8421, #8425, #8426, #8428, #8429, #8430, #8432, #8434, #8435, #8437, #8438, #8439, #8444, #8451, #8452, #8453, #8454, #8456, #8457, #8459, #8462, #8463, #8465, #8468, #8469, #8479, #8482, #8483, #8486, #8490, #8493, #8494, #8496, #8497, #8498, #8499, #8501, #8503, #8504, #8507, #8508, #8510, #8513, #8514, #8515, #8516, #8517, #8520, #8521, #8522, #8523, #8524, #8527, #8528, #8529, #8531, #8532, #8534, #8536, #8537, #8538, #8540, #8541, #8543, #8548, #8552, #8553, #8554, #8555, #8557, #8560, #8563, #8565, #8568, #8569, #8572, #8573, #8574, #8577, #8580, #8581, #8582, #8584, #8586, #8589, #8590, #8592, #8593, #8598, #8603, #8604, #8606, #8609, #8615, #8616, #8617, #8618, #8619, #8621, #8624, #8627, #8628, #8630, #8632, #8634, #8640, #8644, #8645, #8646, #8647, #8648, #8662, #8664, #8666, #8668, #8671, #8672, #8684, #8691, #8702, #8703, #8705, #8706, #8716, #8719, #8724, #8725, #8727, #8733, #8734, #8741
- twisted.conch.ssh.address is now ported to Python 3. (#8495)
- twisted.conch.ssh.transport is now ported to Python 3. (#8638)
- twisted.conch.ssh.channel is now ported to Python 3. (#8649)
- twisted.conch.ssh.userauth is now ported to Python 3. (#8654)
- twisted.conch.ssh.connection is now ported to Python 3. (#8660)
- twisted.conch.ssh.session is now ported to Python 3. (#8661)
- twisted.conch.ssh.filetransfer is now ported to Python 3. (#8675)
- twisted.conch.ssh.agent is now ported to Python 3. (#8686)
- twisted.conch.ssh is now ported to Python 3. (#8690)
- twisted.conch.openssh_compat.* is now ported to Python 3. (#8694)
- twisted.conch.client.knownhosts is now ported to Python 3. (#8697)
- twisted.conch.insults.insults has been ported to Python 3 (#8698)
- twisted.conch.client.default is now ported to Python 3. (#8700)
- twisted.conch.recvline has been ported to Python 3 (#8709)
- twisted.conch.endpoints is now ported to Python 3. (#8722)
- The SSHService is now a bytestring (#8653)
- The name field in SShChannel is now a bytestring (#8683)
- Fixed syntax errors in cftp man page. (#8601)
- #8495, #8511, #8715
- twisted.mail.mail.DomainWithDefaultDict.has_key is now deprecated in favor of the in keyword. (#8361)
- twisted.mail.protocols.SSLContextFactory, deprecated since Twisted 12.0, has been removed. (#8591)
- #8525
- twisted.names.srvconnect is now ported to Python 3. (#8262)
- twisted.names.resolve and twisted.names.tap have been ported to Python 3 (#8550)
- #8625, #8663
No significant changes have been made for this release.
No significant changes have been made for this release.
- twisted.runner has been ported to Python 3. (#8739)
- Twisted web HTTP/2 servers now time out HTTP/2 connections in the same manner as HTTP/1.1 connections. (#8480)
- A bug in twisted.web.server.Site.makeSession which may lead to predictable session IDs was fixed. Session IDs are now generated securely using os.urandom. (#3460)
- twisted.web.server.Request.getSession will now, for a request sent over HTTPS, set a "Secure" cookie, preventing the secure session from being sent over plain-text HTTP. (#3461)
- If called multiple times, twisted.web.http.Request.setLastModified now correctly observes the greatest supplied value. (#3807)
- The HTTP server now correctly times connections out. (broken in 16.2) (#8481)
- Twisted's HTTP/2 support no longer throws priority exceptions when WINDOW_UDPATE frames are received after a response has been completed. (#8558)
- twisted.web.twcgi.CGIScript will now not pass the "Proxy" header to CGI scripts, as a mitigation to CVE-2016-1000111. (#8623)
- Twisted Web's HTTP/2 server can now tolerate streams being reset by the client midway through a data upload without throwing exceptions. (#8682)
- twisted.web.http.Request now swallows header writes on reset HTTP/2 streams, rather than erroring out. (#8685)
- twisted.web's HTTP/2 server now tolerates receiving WINDOW_UPDATE frames for streams for which it has no outstanding data to send. (#8695)
- twisted.web.http.HTTPChannel now resumes producing on finished, non-persistent connections. This prevents HTTP/1 servers using TLS from leaking a CLOSE_WAIT socket per request. (#8766)
- #8519, #8530, #8629, #8707
- twisted.words.xish is now ported to Python 3 (#8337)
- twisted.words.protocols.jabber is now ported to Python 3 (#8423)
- twisted.words.protocols.irc.ERR_TOOMANYMATCHES was introduced according to the RFC 2812 errata. (#8585)
- twisted.words.protocols.irc.RPL_ADMINLOC was removed and replaced with twisted.words.protocols.irc.RPL_ADMINLOC1 and twisted.words.protocols.irc.RPL_ADMINLOC2 to match the admin commands defined in RFC 2812. (#8585)
- twisted.words.protocols.jabber.sasl_mechanisms has been fixed for Python 3.3 (#8738)
- The XMPP client example now works on Python 3. (#8509)
- #8360, #8460
- Defined a new interface, IProtocolNegotiationFactory, that can be implemented by IOpenSSLClientConnectionCreator or IOpenSSLServerConnectionCreator factories to allow them to offer protocols for negotiation using ALPN or NPN during the TLS handshake. (#8188)
- twisted.trial.unittest.SynchronousTestCase.assertRegex is now available to provide Python 2.7 and Python 3 compatibility. (#8372)
- Development documentation has been updated to refer to Git instead of SVN. (#8335)
- twisted.python.reflect's deprecated functions have been removed. This includes funcinfo (deprecated since Twisted 2.5), allYourBase and accumulateBases (deprecated since Twisted 11.0), getcurrent and isinst (deprecated since Twisted 14.0). (#8293)
- twisted.scripts.tap2deb and twisted.scripts.tap2rpm (along with the associated executables), deprecated since Twisted 15.2, have now been removed. (#8326)
- twisted.spread.ui has been removed. (#8329)
- twisted.manhole -- not to be confused with manhole in Conch -- has been removed. This includes the semi-functional Glade reactor, the manhole application, and the manhole-old twistd plugin. (#8330)
- twisted.protocols.sip.DigestAuthorizer, BasicAuthorizer, and related functions have been removed. (#8445)
- #7229, #7826, #8290, #8323, #8331, #8336, #8341, #8344, #8345, #8347, #8351, #8363, #8365, #8366, #8374, #8382, #8384, #8390, #8395, #8396, #8398, #8399, #8400, #8401, #8403, #8404, #8405, #8407, #8408, #8409, #8415, #8416, #8417, #8418, #8419, #8420, #8427, #8433, #8436, #8461
No significant changes have been made for this release.
No significant changes have been made for this release.
- twisted.names.client.Resolver as well as all resolvers inheriting from twisted.names.common.ResolverBase can now understand DNS answers that come back in a different case than the query. Example: querying for www.google.com and the answer comes back with an A record for www.google.COM will now work. (#8343)
No significant changes have been made for this release.
No significant changes have been made for this release.
No significant changes have been made for this release.
- twisted.web.http.HTTPChannel now implements ITransport. Along with this change, twisted.web.http.Request now directs all its writes to the HTTPChannel, rather than to the backing transport. This change is required for future HTTP/2 work. (#8191)
- twisted.web.http.HTTPChannel now has a HTTP/2 implementation which will be used if the transport has negotiated using it through ALPN/NPN (see #8188). (#8194)
- twisted.web.client.Agent and twisted.web.client.ProxyAgent now add brackets to IPv6 literal addresses in the host header they send. (#8369)
- The HTTP server now correctly times connections out. (broken in 16.2) (#8481)
- twisted.web would previously dispatch pipelined requests simultaneously and queue the responses. This behaviour did not enforce any of the guarantees required by RFC 7230 or make it possible for users to enforce those requirements. For this reason, the parallel dispatch of requests has been removed. Pipelined requests are now processed serially. (#8320)
No significant changes have been made for this release.
- twisted.protocols.haproxy.proxyEndpoint provides an endpoint that wraps any other stream server endpoint with the PROXY protocol that retains information about the original client connection handled by the proxy; this wrapper is also exposed via the string description prefix 'haproxy'; for example 'twistd web --port haproxy:tcp:8765'. (#8203)
- twisted.application.app.AppLogger (used by twistd) now uses the new logging system. (#8235)
- twisted.application-using applications (trial, twistd, etc) now work with the --reactor option on Python 3. (#8299)
- Failures are now logged by STDLibLogObserver. (#8316)
- Deprecation documentation was extended to include a quick check list for developers. (#5645)
- The Twisted Deprecation Policy is now documented in the Twisted Development Policy. (#8082)
- The documentation examples for UDP now work on Python 3. (#8280)
- Passing a factory that produces log observers that do not implement twisted.logger.ILogObserver or twisted.python.log.ILogObserver to twisted.application.app.AppLogger has been deprecated. This is primarily used by twistd's --logger option. Please use factories that produce log observers implementing twisted.logger.ILogObserver or the legacy twisted.python.log.ILogObserver. (#8235)
- twisted.internet.qtreactor, a stub that imported the external qtreactor, has been removed. (#8288)
- #6266, #8231, #8244, #8256, #8266, #8269, #8275, #8277, #8286, #8291, #8292, #8304, #8315
No significant changes have been made for this release.
- #8279
No significant changes have been made for this release.
- twisted.names.server is now ported to Python 3 (#8195)
- twisted.names.authority and twisted.names.secondary have been ported to Python 3 (#8259)
No significant changes have been made for this release.
No significant changes have been made for this release.
- twisted.runner.inetdtap and twisted.runner.inetdconf RPC support was deprecated as it was broken for a long time. (#8123)
- twisted.web.http.HTTPFactory's constructor now accepts a reactor argument, for explicit reactor selection. (#8246)
- twisted.web.http.HTTPChannel.headerReceived now respond with 400 and disconnect when a malformed header is received. (#8101)
- twisted.web.http.Request once again has a reference to the HTTPFactory which created it, the absence of which was preventing log messages from being created. (#8272)
- twisted.web.http.HTTPChannel no longer processes requests that have invalid headers as the final header in their header block. (#8317)
- twisted.web.client.HTTPClientFactory (and the getPage and downloadPage APIs) now timeouts correctly on TLS connections where the remote party is not responding on the connection. (#8318)
- #8300
- twisted.words.protocols.msn, deprecated since Twisted 15.1, has been removed. (#8253)
- twisted.words.protocols.oscar is deprecated. (#8260)
No significant changes have been made for this release.
No significant changes have been made for this release.
No significant changes have been made for this release.
No significant changes have been made for this release.
No significant changes have been made for this release.
No significant changes have been made for this release.
No significant changes have been made for this release.
- twisted.web.http.Request once again has a reference to the HTTPFactory which created it, the absence of which was preventing log messages from being created. (#8272)
No significant changes have been made for this release.
- twisted.application.internet.ClientService, a service that maintains a persistent outgoing endpoint-based connection; a replacement for ReconnectingClientFactory that uses modern APIs. (#4735)
- Twisted now uses setuptools' sdist to build tarballs. (#7985)
- Twisted is now compatible with OpenSSL 1.0.2f. (#8189)
- #4543, #8124, #8193, #8210, #8220, #8223, #8226, #8242
- twisted.conch.checkers is now ported to Python 3. (#8225)
- twisted.conch.telnet is now ported to Python 3. (#8228)
- twisted.conch.manhole_ssh.ConchFactory (used by twistd manhole) no longer uses a hardcoded SSH server key, and will generate a persistent one, saving it in your user appdir. If you use ConchFactory, you will now need to provide your own SSH server key. (#8229)
- #8237, #8240
No significant changes have been made for this release.
No significant changes have been made for this release.
No significant changes have been made for this release.
No significant changes have been made for this release.
No significant changes have been made for this release.
- twisted.web.http.Request.addCookie now supports both unicode and bytes arguments, with unicode arguments being encoded to UTF-8. (#8067)
- twisted.web.util.DeferredResource no longer causes spurious "Unhandled error in Deferred" log messages. (#8192)
- twisted.web.server.site.makeSession now generates an uid of type bytes on both Python 2 and 3. (#8215)
- #8238
No significant changes have been made for this release.
- todo parameter for IReporter.addExpectedSuccess and IReporter.addUnexpectedSuccess is no longer required. If not provided, a sensible default will be used instead. (#4811)
- A new string endpoint type, "tls:", allows for properly-verified TLS (unlike "ssl:", always matching hostname resolution with certificate hostname verification) with faster IPv4/IPv6 connections. This comes with an accompanying function, twisted.internet.endpoints.wrapClientTLS, which can wrap an arbitrary client endpoint with client TLS. (#5642)
- twisted.python.filepath.makedirs accepts an ignoreExistingDirectory flag which ignore the OSError raised by os.makedirs if requested directory already exists. (#5704)
- twisted.protocols.amp has been ported to Python 3. (#6833)
- twisted.internet.ssl.trustRootFromCertificates returns an object suitable for use as trustRoot= to twisted.internet.ssl.optionsForClientTLS that trusts multiple certificates. (#7671)
- twisted.python.roots is now ported to Python 3. (#8131)
- twisted.cred.strports has been ported to Python 3. (#8216)
- Expected failures from standard library unittest no longer fail with Trial reporters. (#4811)
- twisted.internet.endpoints.HostnameEndpoint.connect no longer fails with an AlreadyCalledError when the Deferred it returns is cancelled after all outgoing connection attempts have been made but none have yet succeeded or failed. (#8014)
- twisted.internet.task.LoopingCall.withCount when run with internal of 0, now calls the countCallable with 1, regardless of the time passed between calls. (#8125)
- twisted.internet.endpoints.serverFromString, when parsing a SSL strports definition, now gives the correct error message when an empty chain file is given. (#8222)
- The Twisted Project has adopted the Contributor Covenant as its Code of Conduct. (#8173)
- twisted.internet.task.LoopingCall.deferred is now deprecated. Use the deferred returned by twisted.internet.task.LoopingCall.start() (#8116)
- twisted.internet.gtkreactor, the GTK+ 1 reactor deprecated since Twisted 10.1, has been removed. This does not affect the GTK2, GLib, GTK3, or GObject-Introspection reactors. (#8145)
- twisted.protocols.mice, containing a Logitech MouseMan serial driver, has been deprecated. (#8148)
- The __version__ attribute of former subprojects (conch, mail, names, news, pair, runner, web, and words) is deprecated in preference to the central twisted.__version__. (#8219)
- #6842, #6978, #7668, #7791, #7881, #7943, #7944, #8050, #8104, #8115, #8119, #8122, #8139, #8144, #8154, #8162, #8180, #8187, #8220
- twisted.conch now uses cryptography instead of PyCrypto for its underlying crypto operations. (#7413)
- twisted.conch.ssh.keys is now ported to Python 3. (#7998)
- twisted.conch.ssh.channel.SSHChannel's getPeer and getHost methods now return an object which provides IAddress instead of an old- style tuple address. (#5999)
- twisted.conch.endpoint.SSHCommandClientEndpoint, when authentication is delegated to an SSH agent, no longer leaves the agent connection opened when connection to the server is lost. (#8138)
- #7037, #7715, #8200, #8208
No significant changes have been made for this release.
No significant changes have been made for this release.
No significant changes have been made for this release.
No significant changes have been made for this release.
No significant changes have been made for this release.
- twisted.web.http_headers._DictHeaders now correctly handles updating via keyword arguments in Python 3 (therefore twisted.web.http_headers is now fully ported to Python 3). (#6082)
- twisted.web.wsgi has been ported to Python 3. (#7993)
- twisted.web.http_headers.Headers now accepts both Unicode and bytestring keys and values, encoding to iso-8859-1 and utf8 respectively. (#8129)
- twisted.web.vhost ported to Python 3. (#8132)
- twisted.web.http.HTTPChannel now correctly handles non-ascii method name by returning 400. Previously non-ascii method name was causing unhandled exceptions. (#8102)
- twisted.web.static.File on Python 3 now redirects paths to directories without a trailing slash, to a path with a trailing slash, as on Python 2. (#8169)
- twisted.web.http.Request's headers and received_headers attributes, deprecated since Twisted 13.2, have been removed. (#8136)
- twisted.web.static.addSlash is deprecated. (#8169)
- #8140, #8182
No significant changes have been made for this release.
Python 3.5 (on POSIX) support has been added.
This release introduces changes that are required for Conch's SSH implementation to work with OpenSSH 6.9+ servers.
- twisted.python.url is a new abstraction for URLs, supporting RFC 3987 IRIs. (#5388)
- twisted.python.logfile is now ported to Python 3. (#6749)
- twisted.python.zippath has been ported to Python 3. (#6917)
- twisted.internet.ssl.CertificateOptions and twisted.internet.ssl.optionsForClientTLS now take a acceptableProtocols parameter that enables negotiation of the next protocol to speak after the TLS handshake has completed. This field advertises protocols over both NPN and ALPN. Also added new INegotiated interface for TLS interfaces that support protocol negotiation. This interface adds a negotiatedProtocol property that reports what protocol, if any, was negotiated in the TLS handshake. (#7860)
- twisted.python.urlpath.URLPath now operates correctly on Python 3, using bytes instead of strings, and introduces the fromBytes constructor to assist with creating them cross-version. (#7994)
- twisted.application.strports is now ported to Python 3. (#8011)
- twistd (the Twisted Daemon) is now ported to Python 3. (#8012)
- Python 3.5 is now supported on POSIX platforms. (#8042)
- twisted.internet.serialport is now ported on Python 3. (#8099)
- twisted.logger.formatEvent now can format an event if it was flattened (twisted.logger.eventAsJSON does this) and has text after the last replacement field. (#8003)
- twisted.cred.checkers.FilePasswordDB now logs an error if the credentials db file does not exist, no longer raises an unhandled error. (#8028)
- twisted.python.threadpool.ThreadPool now properly starts enough threads to do any work scheduled before ThreadPool.start() is called, such as when work is scheduled in the reactor via reactor.callInThread() before reactor.run(). (#8090)
- Twisted Development test standard documentation now contain information about avoiding test data files. (#6535)
- The documentation for twisted.internet.defer.DeferredSemaphore now describes the actual usage for limit and tokens instance attributes. (#8024)
- twisted.python._initgroups, a C extension, has been removed and stdlib support is now always used instead. (#5861)
- Python 2.6 is no longer supported. (#8017)
- twisted.python.util.OrderedDict is now deprecated, and uses of it in Twisted are replaced with collections.OrderedDict. (#8051)
- twisted.persisted.sob.load, twisted.persisted.sob.loadValueFromFile and twisted.persisted.sob.Persistent.save() are now deprecated when used with a passphrase. The encyption used by these methods are weak. (#8081)
- twisted.internet.interfaces.IStreamClientEndpointStringParser has been removed and Twisted will no longer use parsers implementing this interface. (#8094)
- #5976, #6628, #6894, #6980, #7228, #7693, #7731, #7997, #8046, #8054, #8056, #8060, #8063, #8064, #8068, #8072, #8091, #8095, #8096, #8098, #8106
- twisted.conch.ssh now supports the diffie-hellman-group-exchange- sha256 key exchange algorithm. (#7672)
- twisted.conch.ssh now supports the diffie-hellman-group14-sha1 key exchange algorithm. (#7717)
- twisted.conch.ssh.transport.SSHClientTransport now supports Diffie- Hellman key exchange using MSG_KEX_DH_GEX_REQUEST as described in RFC 4419. (#8100)
- twisted.conch.ssh now supports the hmac-sha2-256 and hmac-sha2-512 MAC algorithms. (#8108)
- twisted.conch.ssh.keys.objectType is now deprecated. Use twisted.conch.ssh.keys.Key.sshType. (#8080)
- twisted.conch.ssh.transport.SSHClientTransport no longer supports Diffie-Hellman key exchange using MSG_KEX_DH_GEX_REQUEST_OLD for pre RFC 4419 servers. (#8100)
No significant changes have been made for this release.
No significant changes have been made for this release.
No significant changes have been made for this release.
No significant changes have been made for this release.
No significant changes have been made for this release.
- twisted.web.http.Request.addCookie now supports the httpOnly attribute which when set on cookies prevents the browser exposing it through channels other than HTTP and HTTPS requests (i.e. they will not be accessible through JavaScript). (#5911)
- twisted.web.client.downloadPage is now ported to Python 3. (#6197)
- twisted.web.client.Agent is now ported to Python 3. (#7407)
- twisted.web.tap (ran when calling twistd web) has now been ported to Python 3. Not all features are enabled -- CGI, WSGI, and distributed web serving will be enabled in their respective tickets as they are ported. (#8008)
- twisted.web.client.URI now supports IPv6 addresses. Previously this would mistake the colons used as IPv6 address group separators as the start of a port specification. (#7650)
- twisted.web.util's failure template has been moved inline to work around Python 3 distribution issues. (#8047)
- twisted.web.http.Request on Python 3 now handles multipart/form- data requests correctly. (#8052)
- #8016, #8070
- twisted.words.protocol.irc.IRC now has a sendCommand() method which can send messages with tags. (#6667)
- #8015, #8097
This is the last Twisted release where Python 2.6 is supported, on any platform.
- Trial has been ported to Python 3. (#5965)
- Twisted now requires setuptools for installation. (#7177)
- twisted.internet.endpoints.clientFromString is now ported to Python 3. (#7973)
- twisted.internet._sslverify now uses SHA256 instead of MD5 for certificate request signing by default. (#7979)
- twisted.internet.endpoints.serverFromString is now ported to Python 3. (#7982)
- twisted.positioning is now ported to Python 3. (#7987)
- twisted.python.failure.Failure's __repr__ now includes the exception message. (#8004)
- fixed a bug which could lead to a hang at shutdown in twisted.python.threadpool. (#2673)
- twisted.internet.kqreactor on Python 3 now supports EINTR (Control-C) gracefully. (#7887)
- Fix a bug introduced in 15.3.0; pickling a lambda function after importing twisted.persisted.styles raises PicklingError rather than AttributeError. (#7989)
- #7902, #7980, #7990, #7992
No significant changes have been made for this release.
- #7977
No significant changes have been made for this release.
No significant changes have been made for this release.
No significant changes have been made for this release.
No significant changes have been made for this release.
No significant changes have been made for this release.
- twisted.web.proxy is now ported to Python 3. (#7939)
- twisted.web.guard is now ported to Python 3. (#7974)
- twisted.web.http.Request.setResponseCode now only allows bytes messages. (#7981)
- twisted.web.server.Request.processingFailed will now correctly write out the traceback on Python 3. (#7996)
No significant changes have been made for this release.
- twisted.application.app is now ported to Python 3 (#6914)
- twisted.plugin now supports Python 3 (#7182)
- twisted.cred.checkers is now ported to Python 3. (#7834)
- twisted.internet.unix is now ported to Python 3. (#7874)
- twisted.python.sendmsg has now been ported to Python 3, using the stdlib sendmsg/recvmsg functionality when available. (#7884)
- twisted.internet.protocol.Factory now uses the new logging system (twisted.logger) for all its logging statements. (#7897)
- twisted.internet.stdio is now ported to Python 3. (#7899)
- The isDocker method has been introduced on twisted.python.runtime.Platform to detect if the running Python is inside a Docker container. Additionally, Platform.supportsINotify() now returns False if isDocker() is True, because of many Docker storage layers having broken INotify. (#7968)
- twisted.logger.LogBeginner.beginLoggingTo now outputs the correct warning when it is called more than once. (#7916)
- twisted.cred.pamauth (providing PAM support) has been removed due to it being unusable in current supported Python versions. (#3728)
- twisted.application.app.HotshotRunner (twistd's hotshot profiler module) is removed and twistd now uses cProfile by default. (#5137)
- twisted.python.win32.getProgramsMenuPath and twisted.python.win32.getProgramFilesPath are now deprecated. (#7883)
- twisted.lore has now been removed, in preference to Sphinx. (#7892)
- Deprecated zsh tab-complete files are now removed in preference to twisted.python.usage's tab-complete functionality. (#7898)
- twisted.python.hashlib, deprecated since 13.1, has now been removed. (#7905)
- twisted.trial.runner.DryRunVisitor, deprecated in Twisted 13.0, has now been removed. (#7919)
- twisted.trial.util.getPythonContainers, deprecated since Twisted 12.3, is now removed. (#7920)
- Twisted no longer supports being packaged as subprojects. (#7964)
- #6136, #7035, #7803, #7817, #7827, #7844, #7876, #7906, #7908, #7915, #7931, #7940, #7967, #7983
- The Conch Unix server now sets the HOME environment variable when executing commands. (#7936)
- #7937
No significant changes have been made for this release.
No significant changes have been made for this release.
No significant changes have been made for this release.
No significant changes have been made for this release.
No significant changes have been made for this release.
- twisted.web.xmlrpc is now ported to Python 3. (#7795)
- twisted.web.template and twisted.web.util are now ported to Python 3. (#7811)
- twisted.web.error is now ported to Python 3. (#7845)
- twisted.web.html is now deprecated in favor of twisted.web.template. (#4948)
- #7895, #7942, #7949, #7952, #7975
No significant changes have been made for this release.
- twisted.logger now marks the isError key correctly on legacy events generated by writes to stderr. (#7903)
- twisted.logger's documentation is now correctly listed in the table of contents. (#7904)
No significant changes have been made for this release.
No significant changes have been made for this release.
No significant changes have been made for this release.
No significant changes have been made for this release.
No significant changes have been made for this release.
No significant changes have been made for this release.
No significant changes have been made for this release.
No significant changes have been made for this release.
No significant changes have been made for this release.
- twisted.internet.process has now been ported to Python 3. (#5987)
- twisted.cred.credentials is now ported to Python 3. (#6176)
- twisted.trial.unittest.TestCase's assertEqual, assertTrue, and assertFalse methods now pass through the standard library's more informative failure messages. (#6306)
- The new package twisted.logger provides a new, fully tested, and feature-rich logging framework. The old module twisted.python.log is now implemented using the new framework. The new logger HOWTO documents the new framework. (#6750)
- twisted.python.modules is now ported to Python 3. (#7804)
- twisted.python.filepath.FilePath now supports Unicode (text) paths. Like the os module, instantiating it with a Unicode path will return a Unicode-mode FilePath, instantiating with a bytes path will return a bytes-mode FilePath. (#7805)
- twisted.internet.kqreactor is now ported to Python 3 (#7823)
- twisted.internet.endpoints.ProcessEndpoint is now ported to Python 3. (#7824)
- twisted.python.filepath.FilePath now has asBytesMode and asTextMode methods which return a FilePath in the requested mode. (#7830)
- twisted.python.components.proxyForInterface now creates method proxies that can be used with functools.wraps. (#7832)
- The tls optional dependency will now also install the idna package to validate idna2008 names. (#7853)
- Don't raise an exception if DefaultLogObserver.emit() gets an event with a message that raises when repr() is called on it. Specifically: use textFromEventDict() instead of a separate (and inferior) message rendering implementation. (#6569)
- twisted.cred.credentials.DigestedCredentials incorrectly handled md5-sess hashing according to the RFC, which has now been fixed. (#7835)
- Fixed an issue with twisted.internet.task.LoopingCall.withCount where sometimes the passed callable would be invoked with "0" when we got close to tricky floating point boundary conditions. (#7836)
- twisted.internet.defer now properly works with the new logging system. (#7851)
- Change messages key to log_io for events generated by LoggingFile. (#7852)
- twisted.logger had literal characters in docstrings that are now quoted. (#7854)
- twisted.logger now correctly formats a log event with a key named message when passed to a legacy log observer. (#7855)
- twisted.internet.endpoints.HostnameEndpoint now uses getaddrinfo properly on Python 3.4 and above. (#7886)
- Fix a typo in narrative documentation for logger (#7875)
- tkunzip and tapconvert in twisted.scripts were deprecated in 11.0 and 12.1 respectively, and are now removed. (#6747)
- twisted.protocols.gps is deprecated in preference to twisted.positioning. (#6810)
- twisted.scripts.tap2deb and twisted.scripts.tap2rpm are now deprecated. (#7682)
- twisted.trial.reporter.TestResult and twisted.trial.reporter.Reporter contained deprecated methods (since 8.0) which have now been removed. (#7815)
- #6027, #7287, #7701, #7727, #7758, #7776, #7786, #7812, #7819, #7831, #7838, #7865, #7866, #7869, #7872, #7877, #7878, #7885
- twisted.conch.ssh.forwarding now supports local->remote forwarding of IPv6 (#7751)
No significant changes have been made for this release.
- twisted.mail.smtp.sendmail now uses ESMTP. It will opportunistically enable encryption and allow the use of authentication. (#7257)
No significant changes have been made for this release.
No significant changes have been made for this release.
No significant changes have been made for this release.
No significant changes have been made for this release.
- twisted.web.static is now ported to Python 3. (#6177)
- twisted.web.server.Site accepts requestFactory as constructor argument. (#7016)
- twisted.web.util had some HTML generation functions deprecated since 12.1 that have now been removed. (#7828)
- #6927, #7797, #7802, #7846
- The resumeOffset argument to twisted.words.protocol.irc.DccFileReceive now works as it is documented. (#7775)
- Optional dependencies can be installed using the extra_requires facility provided by setuptools. (#3696)
- Twisted Trial's basics documentation now has a link to the documentation about how Trial finds tests. (#4526)
- twisted.application.internet.UDPClient, deprecated since Twisted 13.1.0, has been removed. (#7702)
- #6988, #7005, #7006, #7007, #7008, #7044, #7335, #7666, #7723, #7724, #7725, #7748, #7763, #7765, #7766, #7768
No significant changes have been made for this release.
No significant changes have been made for this release.
- twisted.mail.smtp.ESMTPClient now does not fall back to plain SMTP if authentication or TLS is required and not able to occur. (#7258)
- #6705
No significant changes have been made for this release.
- #7728
No significant changes have been made for this release.
No significant changes have been made for this release.
No significant changes have been made for this release.
- #7726
- twisted.web.static.File allows defining a custom resource for rendering forbidden pages. (#6951)
- #7000, #7485, #7750, #7762
- twisted.words.protocols.msn is now deprecated (#6395)
- #6494
- twisted.internet.protocol.ClientFactory (and subclasses) may now return None from buildProtocol to immediately close the connection. (#710)
- twisted.trial.unittest.SynchronousTestCase.assertRaises can now return a context manager. (#5339)
- Implementations of twisted.internet.interfaces.IStreamClientEndpoint included in Twisted itself will now handle None being returned from the client factory's buildProtocol method by immediately closing the connection and firing the waiting Deferred with a Failure. (#6976)
- inlineCallbacks now supports using the return statement with a value on Python 3 (#7624)
- twisted.spread.banana.Banana.sendEncoded() now raises a more informative error message if the user tries to encode objects of unsupported type. (#7663)
- twisted.internet.interfaces.IReactorMulticast.listenMultiple works again RHEL 6's python 2.6. (#7159)
- Allow much more of the code within Twisted to use ProcessEndpoint by adding IPushProducer and IConsumer interfaces to its resulting transport. (#7436)
- twisted.internet.ssl.Certificate(...).getPublicKey().keyHash() now produces a stable value regardless of OpenSSL version. Unfortunately this means that it is different than the value produced by older Twisted versions. (#7651)
- twisted.python.reflect.safe_str on Python 3 converts utf-8 encoded bytes to clean str instead of "b'a'" (#7660)
- twisted.spread.banana.Banana now raises NotImplementedError when receiving pb messages without pb being the selected dialect (#7662)
- The SSL server string endpoint parser (twisted.internet.endpoints.serverFromString) now constructs endpoints which, by default, disable the insecure SSLv3 protocol. (#7684)
- The SSL client string endpoint parser (twisted.internet.endpoints.clientFromString) now constructs endpoints which, by default, disable the insecure SSLv3 protocol. (#7686)
- inlineCallbacks now has introductory documentation. (#1009)
- The echoclient example now uses twisted.internet.task.react. (#7083)
- Twisted Trial's how-to documentation now has a link to Twisted's contribution guidelines and has been reformatted. (#7475)
- Fixed a path error in the make.bat file for building Sphinx documentation, so that it is now possible to build the documentation using make.bat on Windows. (#7542)
- twisted.python.filepath.FilePath.statinfo was deprecated. (#4450)
- twisted.internet.defer.deferredGenerator is now deprecated. twisted.internet.defer.inlineCallbacks should be used instead. (#6044)
- Pickling twisted.internet.ssl.OptionSSLCertificationOptions and twisted.internet.ssl.Keypair is no longer supported. __getstate__ and __setstate__ methods of these classes have been deprecated. (#6166)
- twisted.spread.jelly's support for unjellying "instance" atoms is now deprecated. (#7653)
- #3404, #4711, #5730, #6042, #6626, #6947, #6953, #6989, #7032, #7038, #7039, #7097, #7098, #7142, #7143, #7154, #7155, #7156, #7157, #7158, #7160, #7161, #7162, #7164, #7165, #7176, #7234, #7252, #7329, #7333, #7355, #7369, #7370, #7419, #7529, #7531, #7534, #7537, #7538, #7620, #7621, #7633, #7636, #7637, #7638, #7640, #7641, #7642, #7643, #7665, #7667, #7713, #7719
- The new APIs: twisted.conch.checkers.IAuthorizedKeysDB, twisted.conch.checkers.InMemorySSHKeyDB, twisted.conch.checkers.UNIXAuthorizedKeyFiles, and twisted.conch.checkers.SSHPublicKeyChecker have been added to provide functionality to check the validity of SSH public keys and specify where authorized keys are to be found. (#7144)
- twisted.conch.checkers.SSHPublicKeyDatabase is now deprecated in favor of a twisted.conch.checkers.SSHPublicKeyChecker instantiated with a twisted.conch.checkers.UNIXAuthorizedKeyFiles. (#7144)
- #6626, #7002, #7526, #7532, #7698
No significant changes have been made for this release.
No significant changes have been made for this release.
- #6999, #7708
- twisted.names.secondary.SecondaryAuthority can now answer queries again (broken since 13.2.0). (#7408)
- #7352
No significant changes have been made for this release.
- #7703
No significant changes have been made for this release.
- #7722
No significant changes have been made for this release.
- twisted.web.client.Agent.usingEndpointFactory allows creating an Agent that connects in non-standard ways, e.g. via a proxy or a UNIX socket. (#6634)
- The Deferred returned by twisted.web.client.readBody can now be cancelled. (#6686)
- twisted.web.iweb.IRequest.getClient is now deprecated. Its implementation in Twisted, twisted.web.http.Request.getClient, is also deprecated and will no longer attempt to resolve the client IP address to a hostname. (#2252)
- #7247, #7302, #7680, #7689
No significant changes have been made for this release.
- #6994, #7163, #7622