forked from jhy/jsoup
-
Notifications
You must be signed in to change notification settings - Fork 1
/
Copy pathCHANGES
1797 lines (1241 loc) · 88.2 KB
/
CHANGES
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
jsoup changelog
Release 1.16.1 [PENDING]
* Improvement: in Jsoup.connect(url), natively support URLs with Unicode characters in the path or query string,
without having to be escaped by the caller.
<https://github.com/jhy/jsoup/issues/1914>
* Improvement: Calling Node.remove() on a node with no parent is now a no-op, vs a validation error.
<https://github.com/jhy/jsoup/issues/1898>
* Bugfix: aligned the HTML Tree Builder processing steps for AfterBody and AfterAfterBody to the updated WHATWG
standard, to not pop the stack to close <body> or <html> elements. This prevents an errant </html> closing preceding
structure. Also added appropriate error message outputs in this case.
<https://github.com/jhy/jsoup/issues/1851>
* Bugfix: Corrected support for ruby elements (<ruby>, <rp>, <rt>, and <rtc>) to current spec.
<https://github.com/jhy/jsoup/issues/1294>
* Bugfix: When using Node.before(node) or Node.after(node), if the incoming node was a sibling of the context node,
the incoming node may be inserted into the wrong relative location.
<https://github.com/jhy/jsoup/issues/1898>
* Bugfix: In Jsoup.connect(url), if the input URL had components that were already % escaped, they would be escaped
again, causing errors when fetched.
<https://github.com/jhy/jsoup/issues/1902>
* Bugfix: when tracking input source positions, text in tables that was fostered had invalid positions.
<https://github.com/jhy/jsoup/issues/1927>
* Bugfix: If the Document.OutputSettings class was initialized, and then Entities.escape(String) called, an NPE may be
thrown due to a class loading circular dependency.
<https://github.com/jhy/jsoup/issues/1910>
* Bugfix: when pretty-printing, the first inline Element or Comment in a block would not be wrap-indented if it were
preceded by a blank text node.
<https://github.com/jhy/jsoup/issues/1906>
* Bugfix: when pretty-printing a <pre> containing block tags, those tags were incorrectly indented.
<https://github.com/jhy/jsoup/issues/1891>
* Bugfix: <br> tags should be wrap-indented when in block tags (and not when in inline tags).
<https://github.com/jhy/jsoup/issues/1911>
Release 1.15.4 [18-Feb-2023]
* Improvement: added the ability to escape CSS selectors (tags, IDs, classes) to match elements that don't follow
regular CSS syntax. For example, to match by classname <p class="one.two">, use document.select("p.one\\.two");
<https://github.com/jhy/jsoup/issues/838>
* Improvement: when pretty-printing, wrap text that follows a <br> tag.
<https://github.com/jhy/jsoup/issues/1858>
* Improvement: when pretty-printing, normalize newlines that follow self-closing tags in custom tags.
<https://github.com/jhy/jsoup/issues/1852>
* Improvement: when pretty-printing, collapse non-significant whitespace between a block and an inline tag.
<https://github.com/jhy/jsoup/issues/1802>
* Improvement: in Element#forEach and Node#forEachNode, use java.util.function.Consumer instead of the previous
Android compatibility shim org.jsoup.helper.Consumer. Subsequently, the latter has been deprecated.
<https://github.com/jhy/jsoup/pull/1870>
* Improvement: added a new method Document#forms(), to conveniently retrieve a List<FormElement> containing the <form>
elements in a document.
* Improvement: added a new method Document#expectForm(query), to find the first matching FormElement, or blow up
trying.
* Bugfix: URLs containing characters such as [ and ] were not escaped correctly, and would throw a
MalformedURLException when fetched.
<https://github.com/jhy/jsoup/issues/1873>
* Bugfix: Element.cssSelector would create invalid selectors for elements where the tag name, ID, or classnames needed
to be escaped (e.g. if a class name contained a ':' or '.').
<https://github.com/jhy/jsoup/issues/1742>
* Bugfix: element.text() should have a space between a block and an inline element.
<https://github.com/jhy/jsoup/issues/1877>
* Bugfix: if a Node or an Element was replaced with itself, that node would incorrectly be orphaned.
<https://github.com/jhy/jsoup/issues/1843>
* Bugfix: form data on a previous request was copied to a new request in newRequest(), resulting in an accumulation of
form data when executing multi-step form submissions, or data sent to later requests incorrectly. Now, newRequest()
only copies session related settings (cookies, proxy settings, user-agent, etc) but not the request data nor the
body.
<https://github.com/jhy/jsoup/issues/1778>
* Bugfix: fixed an issue in Safelist.removeAttributes which could throw a ConcurrentModificationException when using
the ":all" pseudo-attribute.
* Bugfix: given extremely deeply nested HTML, a number of methods in Element could throw a StackOverflowError due
to excessive recursion. Namely: #data(), #hasText(), #parents(), and #wrap(html).
<https://github.com/jhy/jsoup/issues/1864>
* Change: deprecated the unused Document#normalise() method. Normalization occurs during the HTML tree construction,
and no longer as a distinct phase.
Release 1.15.3 [2022-Aug-24]
* Security: fixed an issue where the jsoup cleaner may incorrectly sanitize crafted XSS attempts if
SafeList.preserveRelativeLinks is enabled.
<https://github.com/jhy/jsoup/security/advisories/GHSA-gp7f-rwcx-9369>
* Improvement: the Cleaner will preserve the source position of cleaned elements, if source tracking is enabled in the
original parse.
* Improvement: the error messages output from Validate are more descriptive. Exceptions are now ValidationExceptions
(extending IllegalArgumentException). Stack traces do not include the Validate class, to make it simpler to see
where the exception originated. Common validation errors including malformed URLs and empty selector results have
more explicit error messages.
* Bugfix: the DataUtil would incorrectly read from InputStreams that emitted reads less than the requested size. This
lead to incorrect results when parsing from chunked server responses, for example.
<https://github.com/jhy/jsoup/issues/1807>
* Build Improvement: added implementation version and related fields to the jar manifest.
<https://github.com/jhy/jsoup/issues/1809>
*** Release 1.15.2 [2022-Jul-04]
* Improvement: added the ability to track the position (line, column, index) in the original input source from where
a given node was parsed. Accessible via Node.sourceRange() and Element.endSourceRange().
<https://github.com/jhy/jsoup/pull/1790>
* Improvement: added Element.firstElementChild(), Element.lastElementChild(), Node.firstChild(), Node.lastChild(),
as convenient accessors to those child nodes and elements.
* Improvement: added Element.expectFirst(cssQuery), which is just like Element.selectFirst(), but instead of returning
a null if there is no match, will throw an IllegalArgumentException. This is useful if you want to simply abort
processing if an expected match is not found.
* Improvement: when pretty-printing HTML, doctypes are emitted on a newline if there is a preceding comment.
<https://github.com/jhy/jsoup/pull/1664>
* Improvement: when pretty-printing, trim the leading and trailing spaces of textnodes in block tags when possible,
so that they are indented correctly.
<https://github.com/jhy/jsoup/issues/1798>
* Improvement: in Element#selectXpath(), disable namespace awareness. This makes it possible to always select elements
by their simple local name, regardless of whether an xmlns attribute was set.
<https://github.com/jhy/jsoup/issues/1801>
* Bugfix: when using the readToByteBuffer method, such as in Connection.Response.body(), if the document has not
already been parsed and must be read fully, and there is any maximum buffer size being applied, only the default
internal buffer size is read.
<https://github.com/jhy/jsoup/issues/1774>
* Bugfix: when serializing HTML, newlines in elements descending from a pre tag were incorrectly skipped. That caused
what should have been preformatted output to instead be a run of text.
<https://github.com/jhy/jsoup/issues/1776>
* Bugfix: when pretty-print serializing HTML, newlines separating phrasing content (e.g. a <span> tag within a <p> tag
would be incorrectly skipped, instead of normalized to a space. Additionally, improved space normalization between
other end of line occurrences, and whitespace handling after a closing </body>
<https://github.com/jhy/jsoup/issues/1787>
*** Release 1.15.1 [2022-May-15]
* Change: removed previously deprecated methods and classes (including org.jsoup.safety.Whitelist; use
org.jsoup.safety.Safelist instead).
* Improvement: when converting jsoup Documents to W3C Documents in W3CDom, preserve HTML valid attribute names if the
input document is using the HTML syntax. (Previously, would always coerce using the more restrictive XML syntax.)
<https://github.com/jhy/jsoup/pull/1648>
* Improvement: added the :containsWholeText(text) selector, to match against non-normalized Element text. That can be
useful when elements can only be distinguished by e.g. specific case, or leading whitespace, etc.
<https://github.com/jhy/jsoup/issues/1636>
* Improvement: added Element#wholeOwnText() to retrieve the original (non-normalized) ownText of an Element. Also
added the :containsWholeOwnText(text) selector, to match against that. BR elements are now treated as newlines
in the wholeText methods.
<https://github.com/jhy/jsoup/issues/1636>
* Improvement: added the :matchesWholeText(regex) and :matchesWholeOwnText(regex) selectors, to match against whole
(non-normalized, case sensitive) element text and own text, respectively.
<https://github.com/jhy/jsoup/issues/1636>
* Improvement: when evaluating an XPath query against a context element, the complete document is now visible to the
query, vs only the context element's sub-tree. This enables support for queries outside (parent or sibling) the
element, e.g. ancestor-or-self::*.
<https://github.com/jhy/jsoup/issues/1652>
* Improvement: allow a maxPaddingWidth on the indent level in OutputSettings when pretty printing. This defaults to
30 to limit the indent level for very deeply nested elements, and may be disabled by setting to -1.
<https://github.com/jhy/jsoup/pull/1655>
* Improvement: when cloning a Node or an Element, the clone gets a cloned OwnerDocument containing only that clone, so
as to preserve applicable settings, such as the Pretty Print settings.
<https://github.com/jhy/jsoup/issues/763>
* Improvement: added a convenience method Jsoup.parse(File).
<https://github.com/jhy/jsoup/issues/1693>
* Improvement: in the NodeTraversor, added default implementations for NodeVisitor.tail() and NodeFilter.tail(), so
that code using only head() methods can be written as lambdas.
* Improvement: in NodeTraversor, added support for removing nodes via Node.remove() during NodeVisitor.head().
<https://github.com/jhy/jsoup/issues/1699>
* Improvement: added Node.forEachNode(Consumer<Node>) and Element.forEach(Consumer<Element) methods, to efficiently
traverse the DOM with a functional interface.
<https://github.com/jhy/jsoup/issues/1700>
* Bugfix: boolean attribute names should be case-insensitive, but were not when the parser was configured to preserve
case.
<https://github.com/jhy/jsoup/issues/1656>
* Bugfix: when reading from SequenceInputStreams across the buffer, the input stream was closed too early, resulting
in missed content.
<https://github.com/jhy/jsoup/pull/1671>
* Bugfix: a comment with all dashes (<!----->) should not emit a parse error.
<https://github.com/jhy/jsoup/issues/1667>
* Bugfix: when throwing a SelectorParseException for an invalid selector, don't try to String.format the input, as
that could throw an IllegalFormatException.
<https://github.com/jhy/jsoup/issues/1691>
* Bugfix: when serializing HTML with Pretty Print enabled, extraneous whitespace may be added on closing tags, or
extra newlines may be added at the end of script blocks.
<https://github.com/jhy/jsoup/issues/1688>
<https://github.com/jhy/jsoup/issues/1689>
* Bugfix: when copy-creating a Safelist from another, perform a deep-copy of the original's settings, so that changes
to the original after creation do not affect the copy.
<https://github.com/jhy/jsoup/pull/1763>
* Bugfix [Fuzz]: speed improvement when parsing constructed HTML containing very deeply incorrectly stacked formatting
elements with many attributes.
<https://github.com/jhy/jsoup/issues/1695>
* Bugfix [Fuzz]: during parsing, a StackOverflowException was possible given crafted HTML with hundreds of nested
table elements followed by invalid formatting elements.
<https://github.com/jhy/jsoup/issues/1697>
*** Release 1.14.3 [2021-Sep-30]
* Improvement: added native XPath support in Element#selectXpath(String)
<https://github.com/jhy/jsoup/pull/1629>
* Improvement: added full support for the <template> tag to the HTML5 parser spec.
<https://github.com/jhy/jsoup/issues/1634>
* Improvement: added support in CharacterReader to track newlines, so that parse errors can be reported more
intuitively.
<https://github.com/jhy/jsoup/pull/1624>
* Improvement: tracked parse errors now have more details, including the erroneous token, to help clarify the errors.
* Improvement: speed and memory optimizations for the :has(subquery) selector.
* Improvement: the :contains(text) and :containsOwn(text) selectors are now whitespace normalized, aligning to the
document text that they are matching against.
<https://github.com/jhy/jsoup/issues/876>
* Improvement: in Element, speed optimized adopting all of an element's child nodes into a currently empty element.
Improves the HTML adoption agency algorithm when adopting elements with many children.
<https://github.com/jhy/jsoup/issues/1638>
* Improvement: increased the parse speed when in RCData (e.g. <title>) and unescaped <tag> tokens are found, by
memoizing the </title> scan and reducing GC.
<https://github.com/jhy/jsoup/issues/1644>
* Improvement: when parsing custom tags (in HTML or XML), added a flyweight cache on Tag.valueOf(name) to reduce
memory overhead when many tags are repeated. Also tuned other areas of the parser when many very deeply stacked
custom elements were present.
<https://github.com/jhy/jsoup/issues/1646>
* Bugfix: when tracking errors or checking for validity in the Cleaner, errors were incorrectly raised for missing
optional closing tags.
* Bugfix: the OSGi bundle meta-data incorrectly set a version on the import of javax.annotation (used as a build-time
dependency for nullability assertions).
<https://github.com/jhy/jsoup/issues/1616>
* Bugfix: the Attributes::equals() method was sensitive to the order of its contents, but it should not be.
<https://github.com/jhy/jsoup/issues/1492>
* Bugfix: when the HTML parser was configured to preserve case, Element text methods would miss adding whitespace for
"BR" tags.
* Bugfix: attribute names are now normalized & validated correctly for the specific output syntax (HTML or XML).
Previously, syntactically invalid attribute names could be output by the html() methods. Such attributes are still
available in the DOM, and will be normalized if possible on output.
<https://github.com/jhy/jsoup/issues/1474>
* Bugfix [Fuzz]: fixed an IOOB when an empty select tag was followed by a body tag that needed reparenting.
<https://github.com/jhy/jsoup/issues/1639>
* Build Improvement: fixed nullability annotations for Node.equals(other) and other equals methods.
<https://github.com/jhy/jsoup/issues/1628>
* Build Improvement: added JDK 17 to the CI builds.
<https://github.com/jhy/jsoup/pull/1641>
*** Release 1.14.2 [2021-Aug-15]
* Improvement: support Pattern.quote \Q and \E escapes in the selector regex matchers.
<https://github.com/jhy/jsoup/pull/1536>
* Improvement: Element.absUrl() now supports tel: URLs, and other URLs that are already absolute but that Java does
not have input stream handlers for.
<https://github.com/jhy/jsoup/issues/1610>
* Bugfix: when serializing output, escape characters that are in the < 0x20 range. This improves XML output
compatibility, and makes HTML output with these characters easier to read (as they're otherwise invisible).
<https://github.com/jhy/jsoup/issues/1556>
* Bugfix: the *|el wildcard namespace selector now also matches elements with no namespace.
<https://github.com/jhy/jsoup/issues/1565>
* Bugfix: corrected a potential case of the parser input stream not being closed immediately on a read exception.
* Bugfix: when making a HTTP POST, if the request write fails, make sure the connection is immediately cleaned up.
* Bugfix: in the XML parser, XML processing instructions without attributes would be serialized as if they did.
<https://github.com/jhy/jsoup/issues/770>
* Bugfix: updated the HtmlTreeParser resetInsertionMode to the current spec for supported elements.
<https://github.com/jhy/jsoup/issues/1491>
* Bugfix: fixed an NPE when parsing fragment HTML into a standalone table element.
<https://github.com/jhy/jsoup/issues/1603>
* Bugfix: fixed an NPE when parsing fragment heading HTML into a standalone p element.
<https://github.com/jhy/jsoup/issues/1601>
* Bugfix: fixed an IOOB when parsing a formatting fragment into a standalone p element.
<https://github.com/jhy/jsoup/issues/1602>
* Bugfix: tag names must start with an ascii-alpha character.
<https://github.com/jhy/jsoup/issues/1006>
* Bugfix [Fuzz]: fixed a slow parse when a tag or an attribute name has thousands of null characters in it.
<https://github.com/jhy/jsoup/issues/1580>
* Bugfix [Fuzz]: the adoption agency algorithm can have an incorrect bookmark position
<https://github.com/jhy/jsoup/issues/1576>
* Bugfix [Fuzz]: malformed HTML could result in null elements on stack
<https://github.com/jhy/jsoup/issues/1579>
* Bugfix [Fuzz]: malformed deeply nested table elements could create a stack overflow.
<https://github.com/jhy/jsoup/issues/1577>
* Bugfix [Fuzz]: Speed optimized malformed HTML creating elements with thousands of elements - limit the attribute
count per element when parsing to 512 (in real-world HTML, P99 is ~ 8).
<https://github.com/jhy/jsoup/issues/1578>
* Bugfix [Fuzz]: Speed improvement for the foster formatting elements algo, by limiting how far up a crafted stack
to scan.
<https://github.com/jhy/jsoup/issues/1593>
* Bugfix [Fuzz]: Speed improvement when parsing crafted HTML when transferring form attributes.
<https://github.com/jhy/jsoup/issues/1595>
* Bugfix [Fuzz]: Speed improvement when the stack was thousands of items deep, and non-matching close tags sent.
<https://github.com/jhy/jsoup/issues/1596>
* Bugfix [Fuzz]: Speed improvement when an attribute name is 600K of quote characters or otherwise needs accumulation
vs being able to read in one hit.
<https://github.com/jhy/jsoup/issues/1605>
* Bugfix [Fuzz]: Speed improvement when closing missing empty tags (in XML comment processed as HTML) when thousands
deep in stack.
<https://github.com/jhy/jsoup/issues/1606>
* Bugfix [Fuzz]: Fix a potential stack-overflow in the parser given crafted HTML, when the parser looped in the
InSelectInTable state.
* Bugfix [Fuzz]: Fix an IOOB when the HTML root was cleared from the stack and then attributes were merged onto it.
<https://github.com/jhy/jsoup/issues/1611>
* Bugfix [Fuzz]: Improved the speed of parsing when crafted HTML contains hundreds of active formatting elements
that were copied for all new elements (similar to an amplification attack). The number of considered active
formatting elements that will be cloned when mis-nested is now capped to 12.
<https://github.com/jhy/jsoup/issues/1613>
*** Release 1.14.1 [2021-Jul-10]
* Change: updated the minimum supported Java version from Java 7 to Java 8.
* Change: updated the minimum Android API level from 8 to 10.
* Change: although Node#childNodes() returns an UnmodifiableList as a view into its children, it was still
directly backed by the internal child list. That made some uses, such as looping and moving those children to
another element, throw a ConcurrentModificationException. Now this method returns its own list so that they are
separated and changes to the parent's contents will not impact the children view. This aligns with similar methods
such as Element#children(). If you have code that iterates this list and makes parenting changes to its contents,
you may need to make a code update.
<https://github.com/jhy/jsoup/issues/1431>
* Change: the org.jsoup.Connection interface has been modified to introduce new methods for sessions and the cookie
store. If you have a custom implementation of this interface, you will need to add implementations of these methods.
* Improvement: added HTTP request session management support with Jsoup.newSession(). This extends the Connection
implementation to support (optional) sessions, which allow request defaults (timeout, proxy, etc) to be set once and
then applied to all requests within that session.
Cookies are re-implemented to correctly support path and domain filtering when used within a session. A default
in-memory cookie store is used for the session, or a custom implementation (perhaps disk-persistent, or pre-set)
can be used instead.
Forms submitted using the FormElement#submit() use the same session that was used to fetch the document and so pass
cookies and other defaults appropriately.
The session is multi-thread safe and can execute multiple requests concurrently. If the user accidentally tries to
execute the same request object across multiple threads (vs calling Connection#newRequest()),
that is detected cleanly and a clear exception is thrown (vs weird blowups in input stream reading, or forcing
everything through a synchronized bottleneck.
<https://github.com/jhy/jsoup/pull/1476>
* Improvement: renamed the Whitelist class to Safelist, with the goal of more inclusive language. A shim is provided
for backwards compatibility (source and binary). This shim is marked as deprecated and will be removed in the
jsoup 1.15.1 release.
<https://github.com/jhy/jsoup/pull/1464>
* Improvement: added support for Internationalized Domain Names (IDNs) in Jsoup.Connect.
<https://github.com/jhy/jsoup/issues/1300>
* Improvement: added support for loading and parsing gzipped HTML files in Jsoup.parse(File in, charset, baseUri).
* Improvement: reduced thread contention in HttpConnection and Document.
<https://github.com/jhy/jsoup/pull/1455>
* Improvement: better parsing performance when under high thread concurrency
<https://github.com/jhy/jsoup/pull/1402>
* Improvement: added Element#id(String) ID attribute setter.
* Improvement: in Document, #body() and #head() accessors will now automatically create those elements, if they were
missing (e.g. if the Document was not parsed from HTML). Additionally, the #body() method returns the frameset
element (instead of null) for frameset documents.
* Improvement: when cleaning a document, the output settings of the original document are cloned into the cleaned
document.
<https://github.com/jhy/jsoup/issues/1417>
* Improvement: when parsing XML, disable pretty-printing by default.
<https://github.com/jhy/jsoup/issues/1168>
* Improvement: much better performance in Node#clone() for large and deeply nested documents. Complexity was O(n^2) or
worse, now O(n).
* Improvement: during traversal using the NodeTraversor, nodes may now be replaced with Node#replaceWith(Node).
<https://github.com/jhy/jsoup/issues/1289>
* Improvement: added Element#insertChildren and Element#prependChildren, as convenience methods in addition to
Element#insertChildren(index, children), for bulk moving nodes.
* Improvement: clean up relative URLs with too many .. segments better.
<https://github.com/jhy/jsoup/pull/1482>
* Build Improvement: integrated jsoup into the OSS Fuzz project, which semi-randomly generates millions of different
HTML and XML input files, searching for areas to improve in the parser for increased robustness and throughput.
<https://github.com/jhy/jsoup/issues/1502>
* Build Improvement: integrated with GitHub's CodeQL static code analyzer.
<https://github.com/jhy/jsoup/pull/1494>
* Build Improvement: moved to GitHub Workflows for build verification.
* Build Improvement: updated Jetty (used for integration tests; not bundled) to 9.4.42.
* Build Improvement: added nullability annotations and initial settings.
<https://github.com/jhy/jsoup/pull/1467>
* Bugfix: corrected the adoption agency algorithm, to handle cases where e.g. a <a> tag incorrectly nests further <a>
tags.
<https://github.com/jhy/jsoup/pull/1517> <https://github.com/jhy/jsoup/issues/845>
* Bugfix: when parsing HTML, could throw NPEs on some tags (isindex or table>input).
<https://github.com/jhy/jsoup/issues/1404>
* Bugfix: in HttpConnection.Request, headers beginning with "sec-" (e.g. Sec-Fetch-Mode) were silently discarded by
the underlying Java HttpURLConnection. These are now settable correctly.
<https://github.com/jhy/jsoup/issues/1461>
* Bugfix: when adding child Nodes to a Node, could incorrectly reparent all nodes if the first parent had the same
length of children as the incoming node list.
* Bugfix: when wrapping an orphaned element, would throw an NPE.
* Bugfix: when wrapping an element with HTML that included multiple sibling elements, those siblings were incorrectly
added as children of the wrapper instead of siblings.
* Bugfix: when setting the content of a script or style tag via the Element#html(String) method, the content is now
treated as a DataNode, not a TextNode. This means that characters like '<' will no longer be incorrectly escaped.
As a related ergonomic improvement, the same behavior applies for Element#text(String) (i.e. the content will be
treated as a DataNode, despite calling the text() method.
<https://github.com/jhy/jsoup/issues/1419>
* Bugfix: when wrapping HTML around an existing element with Element#wrap(String), will now take the content as
provided and ignore normal HTML tree-building rules. This allows for e.g. a div tag to be placed inside of p tags.
* Bugfix: the Elements#forms() method should return the selected immediate elements that are Forms, not children.
<https://github.com/jhy/jsoup/pull/1403>
* Bugfix: when creating a selector for an element with Element#cssSelector, if the element used a non-unique ID
attribute, the returned selector may not match the desired element.
<https://github.com/jhy/jsoup/issues/1085>
* Bugfix: corrected the toString() methods of the Evaluator classes.
* Bugfix: when converting a jsoup document to a W3C document (in W3CDom#convert), if a tag had XML illegal characters,
a DOMException would be thrown. Now instead, that tag is represented as a text node.
<https://github.com/jhy/jsoup/issues/1093>
* Bugfix: if a HTML file ended with an open noscript tag, an "EOF" string would appear in the HTML output.
* Bugfix: when parsing a document as XML, automatically set the output syntax to XML, and ensure that "<" characters
in attributes are escaped as "<" (which is not required in HTML as the quoted attribute contents are safe, but is
required in XML).
<https://github.com/jhy/jsoup/issues/1420>
* Bugfix: [Fuzz] when parsing an attribute key containing "abs:abs", a validation error would be incorrectly
thrown.
<https://github.com/jhy/jsoup/issues/1541>
* Bugfix: [Fuzz] could NPE while parsing in resetInsertionMode().
<https://github.com/jhy/jsoup/issues/1538>
* Bugfix: [Fuzz] when parsing XML, could Stack Overflow when parsing XML declarations.
<https://github.com/jhy/jsoup/issues/1539>
* Bugfix: [Fuzz] fixed a potential Stack Overflow when parsing mis-nested tfoot tags, and updated the tree parser for
this situation to match the updated HTML5 spec.
<https://github.com/jhy/jsoup/issues/1543>
* Bugfix: [Fuzz] fixed a potentially slow HTML parse when tags are nested extremely deep (e.g. 88K depth), by limiting
the formatting tag search depth to 256. In practice, it's generally between 4 - 8.
<https://github.com/jhy/jsoup/issues/1544>
* Bugfix: [Fuzz] when parsing an unterminated RCDATA token (e.g. a <title> tag), could throw an IO Exception "No
buffer left to unconsume" when trying to rewind the buffer.
<https://github.com/jhy/jsoup/issues/1542>
*** Release 1.13.1 [2020-Feb-29]
* Improvement: added Element#closest(selector), which walks up the tree to find the nearest element matching the
selector.
<https://github.com/jhy/jsoup/issues/1326>
* Improvement: memory optimizations, reducing the retained size of a Document by ~ 39%, and allocations by ~ 9%:
1. Attributes holder in Elements is only created if the element has attributes
2. Only track the baseUri in an element when it is set via DOM to a new value for a given tree
3. After parsing, do not retain the input character reader (and associated buffers) in the Document#parser
* Improvement: substantial parse speed improvements vs 1.12.x (bringing back to par with previous releases).
<https://github.com/jhy/jsoup/issues/1327>
* Improvement: when pretty-printing, comments in inline tags are not pushed to a newline
* Improvement: added Attributes#hasDeclaredValueForKey(key) and Attribute#hasDeclaredValueForKeyIgnoreCase(), to check
if an attribute is set but has no value. Useful in place of the deprecated and removed BooleanAttribute class and
instanceof test.
* Improvement: removed old methods and classes that were marked deprecated in previous releases.
* Improvement: added Element#select(Evaluator) and Element#selectFirst(Evaluator), to allow re-use of a parsed CSS
selector if using the same evaluator many times.
<https://github.com/jhy/jsoup/issues/1319>
* Improvement: added Elements#forms(), Elements#textNodes(), Elements#dataNodes(), and Elements#comments(), as a
convenient way to get access to these node types directly from an element selection.
* Improvement: preserve whitespace before html and head tag, if pretty-printing is off.
* Bugfix: in a <select> tag, a second <optgroup> would not automatically close an earlier open <optgroup>
<https://github.com/jhy/jsoup/issues/1313>
* Bugfix: in CharacterReader when parsing an input stream, could throw a Mark Invalid exception if the reader was
marked, a bufferUp occurred, and then the reader was rewound.
<https://github.com/jhy/jsoup/issues/1324>
* Bugfix: empty tags and form tags did not have their attributes normalized (lower-cased by default)
<https://github.com/jhy/jsoup/pull/1323>
* Bugfix: when preserve case was set to on, the HTML pretty-print formatter didn't indent capitalized tags correctly.
* Bugfix: ensure that script and style contents are parsed into DataNodes, not TextNodes, when in case-sensitive
parse mode.
**** Release 1.12.2 [2020-Feb-08]
* Improvement: the :has() selector now supports relative selectors. For example, the query
"div:has(> a)" will select all "div" elements that have at least one direct child "a" element.
<https://github.com/jhy/jsoup/pull/1214>
* Improvement: added Element chaining methods for various overridden methods on Node.
<https://github.com/jhy/jsoup/issues/1193>
* Improvement: ensure HTTP keepalives work when fetching content via body() and bodyAsBytes().
<https://github.com/jhy/jsoup/issues/1232>
* Improvement: set the default max body size in Jsoup.Connection to 2MB (up from 1MB) so fewer people get trimmed
content if they have not set it, but still in sensible bounds. Also updated the default user-agent to improve
default compatibility.
* Improvement: dramatic speed improvement when bulk inserting child nodes into an element (wrapping contents).
<https://github.com/jhy/jsoup/issues/1281>
* Improvement: added Element#childrenSize() as a convenience to get the size of an element's element children.
<https://github.com/jhy/jsoup/pull/1291>
* Improvement: in W3CDom.asString, allow the output mode to be specified as HTML or as XML. It will default to
checking the content, and automatically selecting.
* Improvement: added a Document#documentType() method, to get a doc's doctype.
* Improvement: To DocumentType, added #name(), #publicID(), and #systemId() methods to fetch those fields.
* Improvement: in W3CDom conversions from jsoup documents, retain the DocumentType, and be able to serialize it.
<https://github.com/jhy/jsoup/issues/1183>
* Bugfix: on pages fetch by Jsoup.Connection, a "Mark Invalid" exception might be incorrectly thrown, or the page may
miss some data. This occurred on larger pages when the file transfer was chunked, and an invalid HTML entity
happened to cross a chunk boundary.
<https://github.com/jhy/jsoup/issues/1218>
* Bugfix: if duplicate attributes in an element exist, retain the first vs the last attribute with the same name. Case
aware (HTML case-insensitive names, XML are case-sensitive).
<https://github.com/jhy/jsoup/issues/1219>
* Bugfix: don't submit input type=button form elements.
<https://github.com/jhy/jsoup/issues/1231>
* Bugfix: handle error position reporting correctly and don't blow up in some edge cases.
<https://github.com/jhy/jsoup/issues/1251>
<https://github.com/jhy/jsoup/pull/1253>
* Bugfix: handle the ^= (starts with) selector correctly when the prefix starts with a space.
<https://github.com/jhy/jsoup/pull/1280>
* Bugfix: don't strip out zero-width-joiners (or zero-width-non-joiners) when normalizing text. That breaks combined
emoji (and other text semantics). 🤦♂️
<https://github.com/jhy/jsoup/issues/1269>
* Bugfix: Evaluator.TagEndsWith (namespaced elements) and Tag disagreed in case-sensitivity. Now correctly matches
case-insensitively.
<https://github.com/jhy/jsoup/issues/1257>
* Bugfix: Don't throw an exception if a selector ends in a space, just trim it.
<https://github.com/jhy/jsoup/issues/1274>
* Bugfix: HTML parser adds redundant text when parsing self-closing textarea.
<https://github.com/jhy/jsoup/issues/1220>
* Bugfix: Don't add spurious whitespace or newlines to HTML or text for inline tags.
<https://github.com/jhy/jsoup/issues/1305>
<https://github.com/jhy/jsoup/issues/731>
* Bugfix: TextNode.outerHtml() wouldn't normalize correctly without a parent.
<https://github.com/jhy/jsoup/issues/1309>
* Bugfix: Removed binary input detection as it was causing too many false positives.
<https://github.com/jhy/jsoup/issues/1250>
* Bugfix: when cloning a TextNode, if .attributes() was hit before the clone() method, the text value would only be a
shallow clone.
<https://github.com/jhy/jsoup/issues/1176>
* Various code hygiene updates.
**** Release 1.12.1 [2019-May-12]
* Change: removed deprecated method to disable TLS cert checking Connection.validateTLSCertificates().
* Change: some internal methods have been rearranged; if you extended any of the Jsoup internals you may need to make
updates.
* Improvement: documents now remember their parser, so when later manipulating them, the correct HTML or XML tree
builder is reused, as are the parser settings like case preservation.
<https://github.com/jhy/jsoup/issues/769>
* Improvement: Jsoup now detects the character set of the input if specified in an XML Declaration, when using the
HTML parser. Previously that only happened when the XML parser was specified.
<https://github.com/jhy/jsoup/issues/1009>
* Improvement: if the document's input character set does not support encoding, flip it to one that does.
<https://github.com/jhy/jsoup/issues/1007>
* Improvement: if a start tag is missing a > and a new tag is seen with a <, treat that as a new tag. (This differs
from the HTML5 spec, which would make at attribute with a name beginning with <, but in practice this impacts too
many pages.
<https://github.com/jhy/jsoup/issues/797>
* Improvement: performance tweaks when parsing start tags, data, tables.
* Improvement: added Element.nextElementSiblings() and Element.previousElementSiblings()
<https://github.com/jhy/jsoup/pull/1054>
* Improvement: treat center tags as block tags.
<https://github.com/jhy/jsoup/pull/1113>
* Improvement: allow forms to be submitted with Content-Type=multipart/form-data without requiring a file upload;
automatically set the mime boundary.
<https://github.com/jhy/jsoup/pull/1058>
* Improvement: Jsoup will now detect if an input file or URL is binary, and will refuse to attempt to parse it, with
an IO exception. This prevents runaway processing time and wasted effort creating meaningless parsed DOM trees.
<https://github.com/jhy/jsoup/issues/1192>
* Bugfix: when using the tag case preserving parsing settings, certain HTML tree building rules where not followed
for upper case tags.
<https://github.com/jhy/jsoup/issues/1149>
* Bugfix: when converting a Jsoup document to a W3C DOM, if an element is namespaced but not in a defined namespace,
set it to the global namespace.
<https://github.com/jhy/jsoup/issues/848>
* Bugfix: attributes created with the Attribute constructor with just spaces for names would incorrectly pass
validation.
<https://github.com/jhy/jsoup/issues/1159>
* Bugfix: some pseudo XML Declarations were incorrectly handled when using the XML Parser, leading to an IOOB
exception when parsing.
<https://github.com/jhy/jsoup/issues/1139>
* Bugfix: when parsing URL parameter names in an attribute that is not correctly HTML encoded, and near the end of the
current buffer, those parameters may be incorrectly dropped. (Improved CharacterReader mark/reset support.)
<https://github.com/jhy/jsoup/pull/1154>
* Bugfix: boolean attribute values would be returned as null, vs an empty string, when accessed via the
Attribute#getValue() method.
<https://github.com/jhy/jsoup/issues/1065>
* Bugfix: orphan Attribute objects (i.e. created outside of a parse or an Element) would throw an NPE on
Attribute#setValue(val)
<https://github.com/jhy/jsoup/issues/1107>
* Bugfix: Element.shallowClone() was not making a clone of its attributes.
<https://github.com/jhy/jsoup/issues/1201>
* Bugfix: fixed an ArrayIndexOutOfBoundsException in HttpConnection.looksLikeUtf8 when testing small strings in
specific ranges.
<https://github.com/jhy/jsoup/issues/1172>
* Updated jetty-server (which is used for integration tests) to latest 9.2 series (9.2.28).
*** Release 1.11.3 [2018-Apr-15]
* Improvement: CDATA sections are now treated as whitespace preserving (regardless of the containing element), and are
round-tripped into output HTML.
<https://github.com/jhy/jsoup/issues/406>
<https://github.com/jhy/jsoup/issues/965>
* Improvement: added support for Deflate encoding.
<https://github.com/jhy/jsoup/pull/982>
* Improvement: when parsing <pre> tags, skip the first newline if present.
<https://github.com/jhy/jsoup/issues/825>
* Improvement: support nested quotes for attribute selection queries.
<https://github.com/jhy/jsoup/pull/988>
* Improvement: character references from Windows-1252 that are not valid Unicode are mapped to the appropriate
Unicode replacement.
<https://github.com/jhy/jsoup/pull/1046>
* Improvement: accept a custom SSL socket factory in Jsoup.Connection.
<https://github.com/jhy/jsoup/pull/1038>
* Bugfix: "Mark has been invalidated" exception was thrown when parsing some URLs on Android <= 6.
<https://github.com/jhy/jsoup/issues/990>
* Bugfix: The Element.text() for <div>One</div>Two was "OneTwo", not "One Two".
<https://github.com/jhy/jsoup/issues/812>
* Bugfix: boolean attributes with empty string values were not collapsing in HTML output.
<https://github.com/jhy/jsoup/issues/985>
* Bugfix: when using the XML Parser set to lowercase normalize tags, uppercase closing tags were not correctly
handled.
<https://github.com/jhy/jsoup/issues/998>
* Bugfix: when parsing from a URL, an end tag could be read incorrectly if it started on a buffer boundary.
<https://github.com/jhy/jsoup/issues/995>
* Bugfix: when parsing from a URL, if the remote server failed to complete its write (i.e. it writes less than the
Content Length header promised on a gzipped stream), the parse method would incorrectly throw an unchecked
exception. It now throws the declared IOException.
<https://github.com/jhy/jsoup/issues/980>
* Bugfix: leaf nodes (such as text nodes) where throwing an unsupported operation exception on childNodes(), instead
of just returning an empty list.
<https://github.com/jhy/jsoup/issues/1032>
* Bugfix: documents with a leading UTF-8 BOM did not have that BOM consumed, so it acted as a zero width no-break
space, which could impact the parse tree.
<https://github.com/jhy/jsoup/issues/1003>
* Bugfix: when parsing an invalid XML declaration, the parse would fail.
<https://github.com/jhy/jsoup/issues/1015>
*** Release 1.11.2 [2017-Nov-19]
* Improvement: added a new pseudo selector :matchText, which allows text nodes to match as if they were elements.
This enables finding text that is only marked by a "br" tag, for example.
<https://github.com/jhy/jsoup/issues/550>
* Change: marked Connection.validateTLSCertificates() as deprecated.
* Improvement: normalize invisible characters (like soft-hyphens) in Element.text().
<https://github.com/jhy/jsoup/issues/978>
* Improvement: added Element.wholeText(), to easily get the un-normalized text value of an element and its children.
<https://github.com/jhy/jsoup/pull/564>
* Bugfix: in a deep DOM stack, a StackOverFlow exception could occur when generating implied end tags.
<https://github.com/jhy/jsoup/issues/966>
* Bugfix: when parsing attribute values that happened to cross a buffer boundary, a character was dropped.
<https://github.com/jhy/jsoup/issues/967>
* Bugfix: fixed an issue that prevented using infinite timeouts in Jsoup.Connection.
<https://github.com/jhy/jsoup/issues/968>
* Bugfix: whitespace preserving tags were not honoured when nested deeper than two levels deep.
<https://github.com/jhy/jsoup/issues/722>
* Bugfix: an unterminated comment token at the end of the HTML input would cause an out of bounds exception.
<https://github.com/jhy/jsoup/issues/972>
* Bugfix: an NPE in the Cleaner which would occur if an <a href> attribute value was missing.
<https://github.com/jhy/jsoup/issues/973>
* Bugfix: when serializing the same document in a multiple threads, on Android, with a character set that is not ascii
or UTF-8, an encoding exception could occur.
<https://github.com/jhy/jsoup/issues/970>
* Bugfix: removing a form value from the DOM would not remove it from FormData.
<https://github.com/jhy/jsoup/pull/969>
* Bugfix: in the W3CDom transformer, siblings were incorrectly inheriting namespaces defined on previous siblings.
<https://github.com/jhy/jsoup/issues/977>
*** Release 1.11.1 [2017-Nov-06]
* Updated language level to Java 7 from Java 5. To maintain Android support (of minversion 8), try-with-resources are
not used.
<https://github.com/jhy/jsoup/issues/899>
* When loading content from a URL or a file, the content is now parsed as it streams in from the network or disk,
rather than being fully buffered before parsing. This substantially reduces memory consumption & large garbage
objects when loading large files. Note that this change means that a response, once parsed, may not be parsed
again from the same response object unless you call response.bufferUp() first, which will buffer the full response
into memory.
<https://github.com/jhy/jsoup/issues/904>
* Added Connection.Response.bodyStream(), a method to get the response body as an input stream. This is useful for
saving a large response straight to a file, without buffering fully into memory first.
* Performance improvements in text and HTML generation (through less GC).
* Reduced memory consumption of text, scripts, and comments in the DOM by 40%, by refactoring the node
hierarchy to not track childnodes or attributes by default for lead nodes. For the average document, that's about a
30% memory reduction.
<https://github.com/jhy/jsoup/issues/911>
* Reduced memory consumption of Elements by refactoring their Attributes to be a simple pair of arrays, vs a
LinkedHashSet.
<https://github.com/jhy/jsoup/issues/911>
* Added support for Element.selectFirst(query), to efficiently find the first matching element.
* Added Element.appendTo(parent) to simplify slinging elements about.
<https://github.com/jhy/jsoup/pull/662>
* Added support for multiple headers with the same name in Jsoup.Connect
* Added Element.shallowClone() and Node.shallowClone(), to allow cloning nodes without getting all their children.
<https://github.com/jhy/jsoup/issues/900>
* Updated Element.text() and the :contains(text) selector to consider character as spaces.
* Updated Jsoup.connect().timeout() to implement a total connect + combined read timeout. Previously it specified
connect and buffer read times only, so to implement a combined total timeout, you had to have another thread send
an interrupt.
* Improved performance of Node.addChildren (was quadratic)
<https://github.com/jhy/jsoup/pull/930>
* Added missing support for template tags in tables
<https://github.com/jhy/jsoup/pull/901>
* In Jsoup.connect file uploads, added the ability to set the uploaded files' mimetype.
<https://github.com/jhy/jsoup/issues/936>
* Improved Node traversal, including less object creation, and partial and filtering traversor support.
<https://github.com/jhy/jsoup/pull/849>
* Bugfix: if a document was re-decoded after character set detection, the HTML parser was not reset correctly,
which could lead to an incorrect DOM.
<https://github.com/jhy/jsoup/issues/877>
* Bugfix: attributes with the same name but different case would be incorrectly treated as different attributes.
<https://github.com/jhy/jsoup/pull/903>
* Bugfix: self-closing tags for known empty elements were incorrectly treated as errors.
<https://github.com/jhy/jsoup/issues/868>
* Bugfix: fixed an issue where a self-closing title, noframes, or style tag would cause the rest of the page to be
incorrectly parsed as data or text.
<https://github.com/jhy/jsoup/issues/906>
* Bugfix: fixed an issue with unknown mixed-case tags
<https://github.com/jhy/jsoup/pull/942>
* Bugfix: fixed an issue where the entity resources were left open after startup, causing a warning.
<https://github.com/jhy/jsoup/pull/928>
* Bugfix: fixed an issue where Element.getElementsByIndexLessThan(index) would incorrectly provide the root element
<https://github.com/jhy/jsoup/pull/918>
* Improved parse time for pages with exceptionally deeply nested tags.
<https://github.com/jhy/jsoup/issues/955>
* Improvement / workaround: modified the Entities implementation to load its data from a .class vs from a jar resource.
Faster, and safer on Android.
<https://github.com/jhy/jsoup/issues/959>
*** Release 1.10.3 [2017-Jun-11]
* Added Elements.eachText() and Elements.eachAttr(name), which return a list of Element's text or attribute values,
respectively. This makes it simpler to for example get a list of each URL on a page:
List<String> urls = doc.select("a").eachAttr("abs:href"");
* Improved selector validation for :contains(...) with unbalanced quotes.
<https://github.com/jhy/jsoup/issues/803>
* Improved the speed of index based CSS selectors and other methods that use elementSiblingIndex, by a factor of 34x.
<https://github.com/jhy/jsoup/pull/862>
* Added Node.clearAttributes(), to simplify removing of all attributes of a Node / Element.
<https://github.com/jhy/jsoup/issues/829>
* Bugfix: if an attribute name started or ended with a control character, the parse would fail with a validation
exception.
<https://github.com/jhy/jsoup/issues/793>
* Bugfix: Element.hasClass() and the ".classname" selector would not find the class attribute case-insensitively.
<https://github.com/jhy/jsoup/issues/814>
* Bugfix: In Jsoup.Connection, if a redirect contained a query string with %xx escapes, they would be double escaped
before the redirect was followed, leading to fetching an incorrect location.
* Bugfix: In Jsoup.Connection, if a request body was set and the connection was redirected, the body would incorrectly
still be sent.
<https://github.com/jhy/jsoup/pull/881>
* Bugfix: In DataUtil when detecting the character set from meta data, and there are two Content-Types defined, use
the one that defines a character set.
<https://github.com/jhy/jsoup/pull/835>
* Bugfix: when parsing unknown tags in case-sensitive HTML mode, end tags would not close scope correctly.
<https://github.com/jhy/jsoup/issues/819>
* In Jsoup.Connection, ensure there is no Content-Type set when being redirected to a GET.
<https://github.com/jhy/jsoup/pull/895>
* Bugfix: in certain locales (Turkey specifically), lowercasing and case insensitivity could fail for specific items.
<https://github.com/jhy/jsoup/pull/820>
* Bugfix: after an element was cloned, changes to its child list where not notifying the element correctly.
<https://github.com/jhy/jsoup/issues/951>
*** Release 1.10.2 [2017-Jan-02]
* Improved startup time, particularly on Android, by reducing garbage generation and CPU execution time when loading
the HTML entity files. About 1.72x faster in this area.
* Added Element.is(query) to check if an element matches this CSS query.
* Added new methods to Elements: next(query), nextAll(query), prev(query), prevAll(query) to select next and previous
element siblings from a current selection, with optional selectors.
* Added Node.root() to get the topmost ancestor of a Node.
* Added the new selector :containsData(), to find elements that hold data, like script and style tags.
* Changed Jsoup.isValid(bodyHtml) to validate that the input contains only body HTML that is safe according to the
safelist, and does not include HTML errors. And in the Jsoup.Cleaner.isValid(Document) method, make sure the doc
only includes body HTML.
<https://github.com/jhy/jsoup/issues/245>
<https://github.com/jhy/jsoup/issues/632>
* In Safelists, validate that a removed protocol exists before removing said protocol.
* Allow the Jsoup.Connect thread to be interrupted when reading the input stream; helps when reading from a long stream
of data that doesn't read timeout.
<https://github.com/jhy/jsoup/pull/712>
* Jsoup.Connect now uses a desktop user agent by default. Many developers were getting caught by not specifying the
user agent, and sending the default 'Java'. That causes many servers to return different content than what they would
to a desktop browser, and what the developer was expecting.
* Increased the default connect/read timeout in Jsoup.Connect to 30 seconds.
* Jsoup.Connect now detects if a header value is actually in UTF-8 vs the HTTP spec of ISO-8859, and converts
the header value appropriately. This improves compatibility with servers that are configured incorrectly.
* Bugfix: in Jsoup.Connect, URLs containing non-URL-safe characters were not encoded to URL safe correctly.
<https://github.com/jhy/jsoup/issues/706>
* Bugfix: a "SYSTEM" flag in doctype tags would be incorrectly removed.
<https://github.com/jhy/jsoup/issues/408>
* Bugfix: removing attributes from an Element with removeAttr() would cause a ConcurrentModificationException.
* Bugfix: the contents of Comment nodes were not returned by Element.data()
* Bugfix: if source checked out on Windows with git autocrlf=true, Entities.load would fail because of the \r char.