,h! d Z dZddlZddlZddlZddlZddlmZ ddlmZ ddl m
Z
m Z m Z m
Z
mZmZ ddlmZ eZdZ G d d
ej Z G d d e Z G d
de Z G d de Zd Zy)zHelper classes for tests.MIT N)TestCase)
BeautifulSoup)CharsetMetaAttributeValueCommentContentMetaAttributeValueDoctype SoupStrainerTag)HTMLParserTreeBuilderu-
A bare string
A tag
A tag that supposedly has contents.
AT&T
This numeric entity is missing the final semicolon:
c > e Zd Zed Zd Zd ZddZd Zd dZ y)
SoupTestc t S N)default_builderselfs M/var/www/html/Resume-Scraper/venv/lib/python3.12/site-packages/bs4/testing.pyr zSoupTest.default_builder@ s c V |j d| j }t |fd|i|S )z*Build a Beautiful Soup object from markup.builder)popr r )r markupkwargsr s r soupz
SoupTest.soupD s- **Y(<(<= V?W???r c D | j di |j | S )z[Turn an HTML fragment into a document.
The details depend on the builder.
)r test_fragment_to_document)r r r s r document_forzSoupTest.document_forI s%
$t##-f-GGOOr Nc | j }t || }||}| j |j | j | y )N)r )r r assertEqualdecoder )r to_parsecompare_parsed_tor objs r assertSoupEqualszSoupTest.assertSoupEqualsP sG &&Hg6 $ ( t'8'89J'KLr c d}|j D ]> }|r8| j ||j | j ||j |}@ y)zyEnsure that next_element and previous_element are properly
set for all descendants of the given element.
N) descendantsr! next_elementprevious_element)r elementearlieres r assertConnectednessz SoupTest.assertConnectednessX sR $$ A G$8$89 !*<*<=G r c d}|j |j "J dj ||j d |j "J dj ||j d |j "J dj ||j d d}d}d}t |j dz
}|j D ]h }d}|dk( r|j |j |u s"J dj ||j | |j |u s"J dj ||j | |j IJ dj ||j d |j |j |dz
u s2J d j ||j |j |dz
|j |dz
j |u sBJ d
j |j |dz
|j |dz
j | |u|j |u s7J d j ||j ||j j |j |u s"J d j ||j | t |t rL|j r@| j |d
}|j "J d
j ||j d ||}n|}||k( r.|j "J d
j ||j d |dz
}k ||n|}||}|s||} |0|j "J d j ||j d y|j F|j |j u s,J d j ||j |j y|j }|S )z.Ensure proper linkage throughout the document.Nz3Bad previous_element
NODE: {}
PREV: {}
EXPECTED: {}z3Bad previous_sibling
NODE: {}
PREV: {}
EXPECTED: {}z/Bad next_sibling
NODE: {}
NEXT: {}
EXPECTED: {}r z/Bad next_element
NODE: {}
NEXT: {}
EXPECTED: {}z2Bad previous_sibling
NODE: {}
PREV {}
EXPECTED: {}z1Bad previous_sibling
NODE: {}
PREV {}
EXPECTED {}z-Bad next_sibling
NODE: {}
NEXT {}
EXPECTED {}z=Bad previous_element
NODE: {}
PREV {}
EXPECTED {}
CONTENTS {}z-Bad next_element
NODE: {}
NEXT {}
EXPECTED {}T) parentr* formatprevious_sibling next_siblinglencontentsr)
isinstancer linkage_validator) r el_recursive_call
descendantidxchild
last_childlast_idxtargets r r8 zSoupTest.linkage_validatorc s8
99 &&.
HOO++T
&&.
HOO++T
??*
DKK
r{{#a'[[ > E J ax99( ??e3 KRR !11R7 OVV !5#9#92 !119 NUU !5#9#94 --S1W1EE JQQ u 5 5r{{377K {{37+88EA FMM C!G,bkk#'.B.O.OQV
) 11Z? [bb !5#9#9:u||G\G\ &22e; JQQ &
(?(?
%%%.. ! 3 3E4 @
!..6 FMM"J$;$;T % '
"
h ))1 FMM u 1 14
1HC}> @ ) 4
% =E 5#4F> --5 JQQ !5#5#5t ((4 --1D1DD JQQ !5#5#5v7J7J & Lr r )F)
__name__
__module__ __qualname__propertyr r r r& r. r8 r r r r r > s1
@
PM pr r c z e Zd ZdZd Zd Zd Zd?dZd Zd Z d Z
d Z d
Z d Z
d Zd
Zd Zd Zd Zd Zd Zd Zd Zd Zd Zd Zd Zd Zd Z d Z d Z d Z d Z d Z!d Z"d! Z#d" Z$d# Z%d$ Z&d% Z'd& Z(d' Zd( Z)d) Z*d* Z+d+ Z,d, Z-d- Z.d. Z/d/ Z0d0 Z1d1 Z2d2 Z3d3 Z4d4 Z5d5 Z6d6 Z7d7 Z8d8 Z9d9 Z:d: Z;d; Zy>)@HTMLTreeBuilderSmokeTestaC A basic test of a treebuilder's competence.
Any HTML treebuilder, present or future, should be able to pass
these tests. With invalid markup, there's room for interpretation,
and different parsers can handle it differently. But with the
markup in these tests, there's not much room for interpretation.
c dD ]@ }| j d }|j | }| j d|j B y)zmVerify that all HTML4 and HTML5 empty element (aka void element) tags
are handled correctly.
)areabasebrcolembedhrimginputkeygenlinkmenuitemmetaparamsourcetrackwbrspacerframe TN)r new_tagr! is_empty_element)r namer r[ s r test_empty_element_tagsz0HTMLTreeBuilderSmokeTest.test_empty_element_tags sF
=D 99R=Dll4(G T7#;#; <
=r c | j d }t j |d }t j | }| j |j
t | j |j |j y Nz
foo r pickledumpsloadsr! __class__r r" r treedumpedloadeds r !test_pickle_and_unpickle_identityz:HTMLTreeBuilderSmokeTest.test_pickle_and_unpickle_identity b yy ) dA& f% ))=9 $++-8r c Z | j | \ }}|j d }| j |j t | j || | j |j d dt
| | | j |j j d d y)z8Assert that a given doctype string is handled correctly.r utf8Nfoo_document_with_doctyper6 r! rf r encoder5 pr doctype_fragment doctype_strr doctypes r assertDoctypeHandledz-HTMLTreeBuilderSmokeTest.assertDoctypeHandled s 7 78H I T --" **G4 "23 KK 1[!1 2
+U3r c f d|d|d}|dz }| j | }|j d |fS )z5Generate and parse a document with the given doctype.zz
foo
rn )r rr )r ru doctype_stringrw r r s r rq z/HTMLTreeBuilderSmokeTest._document_with_doctype s9 .0@A>)yy ~~f%t++r c H | j d | j d y)z?Make sure normal, everyday HTML doctypes are handled correctly.htmlz4html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN"Nrx r s r test_normal_doctypesz-HTMLTreeBuilderSmokeTest.test_normal_doctypes
s" !!&) !! B Dr c | j d }|j d }| j d|j y )Nz
r rZ )r r6 r! strip)r r rw s r test_empty_doctypez+HTMLTreeBuilderSmokeTest.test_empty_doctype s4 yy &--" W]]_-r c j dD ] }| j d| \ }}|j d }| j |j t | j |d | j |j d d t
| d | j |j j d d y )N)rw DocTyper~ r rn s ro rp rt s r test_mixed_case_doctypez0HTMLTreeBuilderSmokeTest.test_mixed_case_doctype s 6 8 $ ; ;(! K mmA&G W . . 8 Wf - F#$5S%56"
TVV__Q / 7# 8r c * d}| j | y )Nznhtml PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd"r )r rw s r test_public_doctype_with_urlz5HTMLTreeBuilderSmokeTest.test_public_doctype_with_url- s C !!'*r c & | j d y )Nz$foo SYSTEM "http://www.example.com/"r r s r test_system_doctypez,HTMLTreeBuilderSmokeTest.test_system_doctype1 s !!"HIr c & | j d y )Nz#xsl:stylesheet SYSTEM "htmlent.dtd"r r s r test_namespaced_system_doctypez7HTMLTreeBuilderSmokeTest.test_namespaced_system_doctype4 !!"GHr c & | j d y )Nz#xsl:stylesheet PUBLIC "htmlent.dtd"r r s r test_namespaced_public_doctypez7HTMLTreeBuilderSmokeTest.test_namespaced_public_doctype8 r r c d}| j | }| j |j d j dd |j dd y)zJA real XHTML document should come out more or less the same as it went in.
Hello.
Goodbye.
utf-8
r N)r r! rr replacer r r s r test_real_xhtml_documentz1HTMLTreeBuilderSmokeTest.test_real_xhtml_document< sN yy KK ( ( 4 NN5# & (r c ~ d}| j | }| j dt |j d y)ztWhen a namespaced XML document is parsed as HTML it should
be treated as HTML with weird tag names.
s. contentra zns1:fooNr r! r5 find_allr s r test_namespaced_htmlz-HTMLTreeBuilderSmokeTest.test_namespaced_htmlI s6 Gyy C
i 8 9:r c d}| j | }| j ||j d}| j | }| j ||j d y )Nzs rn )r r! r" rr r s r test_processing_instructionz4HTMLTreeBuilderSmokeTest.test_processing_instructionQ sY
.yy /.yy V!45r c B t j | j y)zMake sure you can copy the tree builder.
This is important because the builder is part of a
BeautifulSoup object, and we want to be able to copy that.
N)copydeepcopyr r s r
test_deepcopyz&HTMLTreeBuilderSmokeTest.test_deepcopy^ s
d**+r c | j d }| j |j j | j t |j d y)zA
tag is never designated as an empty-element tag.
Even if the markup shows it as an empty-element tag, it
shouldn't be presented that way.
N)r assertFalsers r\ r! strr r s r !test_p_tag_is_never_empty_elementz:HTMLTreeBuilderSmokeTest.test_p_tag_is_never_empty_elementf sB yy 001 TVVi0r c p | j dd | j dd | j dd y)zA tag that's not closed by the end of the document should be closed.
This applies to all tags except empty-element tags.
r zzz
Nr& r s r test_unclosed_tags_get_closedz6HTMLTreeBuilderSmokeTest.test_unclosed_tags_get_closedp s4
eY/ eY/ fg.r c | j d }| j |j j | j t |j d y)zA tag is designated as an empty-element tag.
Some parsers treat as one tag, some parsers as
two tags, but it should always be an empty-element tag.
z r N)r
assertTruerJ r\ r! r r s r #test_br_is_always_empty_element_tagzr r s r test_nested_formatting_elementsz8HTMLTreeBuilderSmokeTest.test_nested_formatting_elements s 23r c r d}| j | }| j d|j d d y )Nz
Ordinary HEAD element test
Hello, world!
ztext/javascriptscripttype)r r! find)r r~ r s r test_double_headz)HTMLTreeBuilderSmokeTest.test_double_head s7 yy *DIIh,?,GHr c h d}| j | | j | }|j d }| j |j t
|j d }| j ||j |j d }| j ||j y )Nz
foobaz
foobar)textro baz)r& r r r! rf r r) r* )r r r commentro r s r test_commentz%HTMLTreeBuilderSmokeTest.test_comment s - f%yy )))* **G4 iiUi# #"2"23iiUi# #"6"67r c d}d}| j | | j | | j | }| j |j j | | j | }| j |j
j | | j d }| j |j
j d y)zWhitespace must be preserved in
and zN)r& r r! preprettifytextarea)r
pre_markuptextarea_markupr s r -test_preserved_whitespace_in_pre_and_textareazFHTMLTreeBuilderSmokeTest.test_preserved_whitespace_in_pre_and_textarea s &
< j) o.yy$ **,j9yy ) //1?Cyy01 //13JKr c v d}| j | d}| j | d}| j | y)z+Inline elements can be nested indefinitely.zInside a B tagz!
Nr )r b_tag nested_b_tagdouble_nested_b_tags r test_nested_inline_elementsz4HTMLTreeBuilderSmokeTest.test_nested_inline_elements s< ' e$: l+ O l+r c | j d }|j }| j |j j j
d | j |j j
d y)z Block elements can be nested.z*
Foo
FooN)r
blockquoter! rs bstring)r r r s r test_nested_block_level_elementsz9HTMLTreeBuilderSmokeTest.test_nested_block_level_elements sR yyEF__
..6 ,,e4r c N d}| j |d | j d y)z$One table can go inside another one.z[
Here's another table:
foo
zh
Here's another table:
foo
z{
Foo
Bar
Baz
Nr )r r s r test_correctly_nested_tablesz5HTMLTreeBuilderSmokeTest.test_correctly_nested_tables s6 "
! "
; ro barclassdivzfoo bar)class_)r r! r r r s r *test_multivalued_attribute_with_whitespacezCHTMLTreeBuilderSmokeTest.test_multivalued_attribute_with_whitespace sW 0yy % '):;
499U99#EFr c ~ d}| j | }| j dg|j j d y )Nz1
cssr )r r! r r s r (test_deeply_nested_multivalued_attributezAHTMLTreeBuilderSmokeTest.test_deeply_nested_multivalued_attribute s7 Eyy %$((,,w"78r c l d}| j | }| j ddg|j d y )Nzar r )r r! r~ r s r "test_multivalued_attribute_on_htmlz;HTMLTreeBuilderSmokeTest.test_multivalued_attribute_on_html s4 -yy #sTYYw%78r c ( | j dd y )Nzzr r s r 3test_angle_brackets_in_attribute_values_are_escapedzLHTMLTreeBuilderSmokeTest.test_angle_brackets_in_attribute_values_are_escaped s /1HIr c ( | j dd y )Nz$
• AT&T is in the s&p 500
u)
• AT&T is in the s&p 500
r r s r 3test_strings_resembling_character_entity_referenceszLHTMLTreeBuilderSmokeTest.test_strings_resembling_character_entity_references s
2 :
r c ( | j dd y )Nz
Bob's Bar
z
Bob's Bar
r r s r test_apos_entityz)HTMLTreeBuilderSmokeTest.test_apos_entity s #
r c v d}| j | }| j d|j j y )Nz%
“Hello” -☃
u “Hello” -☃r r! rs r r s r *test_entities_in_foreign_document_encodingzCHTMLTreeBuilderSmokeTest.test_entities_in_foreign_document_encoding s0 9yy +TVV]];r c d}| j d| | j d| | j d| | j d| y )Nu zzzzr r expects r 0test_entities_in_attributes_converted_to_unicodezIHTMLTreeBuilderSmokeTest.test_entities_in_attributes_converted_to_unicode sK H 8&A 8&A 8&A :FCr c d}| j d| | j d| | j d| | j d| y )Nu
piñata
z
piñata
z
piñata
z
piñata
z
piñata
r r s r *test_entities_in_text_converted_to_unicodezCHTMLTreeBuilderSmokeTest.test_entities_in_text_converted_to_unicode sK B 2F; 2F; 2F; 4f=r c ( | j dd y )Nz#
I said "good day!"
z
I said "good day!"
r r s r ,test_quot_entity_converted_to_quotation_markzEHTMLTreeBuilderSmokeTest.test_quot_entity_converted_to_quotation_mark& s C 9 ;r c t d}| j d| | j d| | j d| y )Nu �z�z�z
�r r s r test_out_of_range_entityz1HTMLTreeBuilderSmokeTest.test_out_of_range_entity* s9 , 16: 2F; ov6r c | j d }| j d|j j j j
| j d|j j
| j | y)zDMostly to prevent a recurrence of a bug in the html5lib treebuilder.z!
foo
rs N)r r! h2r r) r] rs r. r s r test_multipart_stringsz/HTMLTreeBuilderSmokeTest.test_multipart_strings0 s[ yy=> dggnn 9 9 > >? dffkk* &r c L | j dd | j dd y)zqVerify consistent handling of empty-element tags,
no matter how they come in through the markup.
z
z
Nr r s r r^ z0HTMLTreeBuilderSmokeTest.test_empty_element_tags7 s(
/1BC 24EFr c d}| j | }| j d|j j | j | y)8Prevent recurrence of a bug in the html5lib treebuilder.z?
foo
N)r assertNotEqualr~ bodyr. r contentr s r #test_head_tag_between_head_and_bodyz s?
yy! D$))..1 &r c ` d}| j | }| j |j y)r z
r )r r expecteds r 1test_entities_in_strings_converted_during_parsingzJHTMLTreeBuilderSmokeTest.test_entities_in_strings_converted_during_parsing s ?Y dH-r c v d}| j | }| j |j j d y )Ns
Foo
u ‘Foo’r )r quoter s r )test_smart_quotes_converted_on_the_way_inzBHTMLTreeBuilderSmokeTest.test_smart_quotes_converted_on_the_way_in s4 &yy FFMM N Pr c r | j d }| j |j j d y )Nzu )r r! r r r s r 0test_non_breaking_spaces_converted_on_the_way_inzIHTMLTreeBuilderSmokeTest.test_non_breaking_spaces_converted_on_the_way_in s* yy./ (@Ar c d}dj d }| j | }| j |j j d | y )Nr r r )rr r r! rs )r r r r s r &test_entities_converted_on_the_way_outz?HTMLTreeBuilderSmokeTest.test_entities_converted_on_the_way_out sB >Y``ahiyy w/:r c d}|j d }| j | }|j d }|j dd }|j d }| j || y )Nu
Sacré bleu!
z
iso-8859-1r z ISO-Latin-1)rr r r r! )r unicode_htmliso_latin_htmlr resultr s r test_real_iso_latin_documentz5HTMLTreeBuilderSmokeTest.test_real_iso_latin_document sp
&,,\: yy (W%
''
w? ??7+
*r c d}|j d }| j | }| j |j d |j d | j |j d |j d y )Nsk
Shift-JISŃR[fBOꂽ{̃t@CłB
z shift-jisr euc_jp)r" r r! rr )r shift_jis_htmlr& r s r test_real_shift_jis_documentz5HTMLTreeBuilderSmokeTest.test_real_shift_jis_document sv
$ &,,[9 yy &
W-|/B/B7/KL X. 0C0CH0MNr c d}| j |d }|j dv sJ | j |j d |j d j d y )Ns Hebrew (ISO 8859-8) in Visual Directionality