⚝
One Hat Cyber Team
⚝
Your IP:
216.73.216.72
Server IP:
41.128.143.86
Server:
Linux host.raqmix.cloud 6.8.0-1025-azure #30~22.04.1-Ubuntu SMP Wed Mar 12 15:28:20 UTC 2025 x86_64
Server Software:
Apache
PHP Version:
8.3.23
Buat File
|
Buat Folder
Eksekusi
Dir :
~
/
lib
/
python3
/
dist-packages
/
lxml
/
html
/
__pycache__
/
View File Name :
clean.cpython-310.pyc
o ;/bn @ s d Z ddlmZ ddlZddlZddlZzddlmZ ddlm Z W n e y3 ddl mZm Z Y nw ddl m Z ddlmZ dd lmZmZ dd lmZmZ ze W n ey_ eZY nw ze W n eyo eZY nw ze W n ey eefZY nw g d Ze d ej ej B j Z e d ej j Z!ej dgej"d dkrej#fndR j$Z%e dej j&Z'e dej j&Z(e dej j$Z)dd Z*e dj Z+e dej ej B Z,e -dZ.e j-ddeidZ/G d d d e0Z1e1 Z2e2j3Z3e d ej e d ej gZ4g d Z5e d!ej e d"ej e d#gZ6d$gZ7e4e5e6e7fd%d&Z8d'd( Z9d)d* Z:e8j e:_ g d+Z;d,gZ<d-e;e<ed.fd/d0Z=d1d2 Z>d3d4 Z?e d5ej Z@d6d7 ZAdS )8zcA cleanup tool for HTML. Removes unwanted tags and content. See the `Cleaner` class for details. )absolute_importN)urlsplit) unquote_plus)r r )etree)defs) fromstringXHTML_NAMESPACE) xhtml_to_html_transform_result) clean_htmlcleanCleanerautolink autolink_html word_breakword_break_htmlzexpression\s*\(.*?\)z @\s*importz </?[a-zA-Z]+|\son[a-zA-Z]+\s*= zdata:image/(.+);base64,z:(javascript|jscript|livescript|vbscript|data|about|mocha):z (xml|svg)c C s8 d}t | D ] }t|r dS |d7 }qtt| |kS )Nr T )_find_image_dataurls_is_unsafe_image_typelen_possibly_malicious_schemes)ssafe_image_urls image_typer r 1/usr/lib/python3/dist-packages/lxml/html/clean.py_has_javascript_schemeV s r z [\s\x00-\x08\x0B\x0C\x0E-\x19]+z\[if[\s\n\r]+.*?][\s\n\r]*>z descendant-or-self::*[@style]zdescendant-or-self::a [normalize-space(@href) and substring(normalize-space(@href),1,1) != '#'] |descendant-or-self::x:a[normalize-space(@href) and substring(normalize-space(@href),1,1) != '#']x) namespacesc @ s e Zd ZdZdZdZdZdZdZdZ dZ dZ dZ dZ dZdZdZdZdZdZdZdZejZdZdZddhZdd Ze d d d d gd d d d dZ dd Z dd Z dd Z dd Z!dd Z"d"ddZ#dd Z$e%&d e%j'j(Z)d d Z*d d! Z+dS )#r a Instances cleans the document of each of the possible offending elements. The cleaning is controlled by attributes; you can override attributes in a subclass, or set them in the constructor. ``scripts``: Removes any ``<script>`` tags. ``javascript``: Removes any Javascript, like an ``onclick`` attribute. Also removes stylesheets as they could contain Javascript. ``comments``: Removes any comments. ``style``: Removes any style tags. ``inline_style`` Removes any style attributes. Defaults to the value of the ``style`` option. ``links``: Removes any ``<link>`` tags ``meta``: Removes any ``<meta>`` tags ``page_structure``: Structural parts of a page: ``<head>``, ``<html>``, ``<title>``. ``processing_instructions``: Removes any processing instructions. ``embedded``: Removes any embedded objects (flash, iframes) ``frames``: Removes any frame-related tags ``forms``: Removes any form tags ``annoying_tags``: Tags that aren't *wrong*, but are annoying. ``<blink>`` and ``<marquee>`` ``remove_tags``: A list of tags to remove. Only the tags will be removed, their content will get pulled up into the parent tag. ``kill_tags``: A list of tags to kill. Killing also removes the tag's content, i.e. the whole subtree, not just the tag itself. ``allow_tags``: A list of tags to include (default include all). ``remove_unknown_tags``: Remove any tags that aren't standard parts of HTML. ``safe_attrs_only``: If true, only include 'safe' attributes (specifically the list from the feedparser HTML sanitisation web site). ``safe_attrs``: A set of attribute names to override the default list of attributes considered 'safe' (when safe_attrs_only=True). ``add_nofollow``: If true, then any <a> tags will have ``rel="nofollow"`` added to them. ``host_whitelist``: A list or set of hosts that you can use for embedded content (for content like ``<object>``, ``<link rel="stylesheet">``, etc). You can also implement/override the method ``allow_embedded_url(el, url)`` or ``allow_element(el)`` to implement more complex rules for what can be embedded. Anything that passes this test will be shown, regardless of the value of (for instance) ``embedded``. Note that this parameter might not work as intended if you do not make the links absolute before doing the cleaning. Note that you may also need to set ``whitelist_tags``. ``whitelist_tags``: A set of tags that can be included with ``host_whitelist``. The default is ``iframe`` and ``embed``; you may wish to include other tags like ``script``, or you may want to implement ``allow_embedded_url`` for more control. Set to None to include all tags. This modifies the document *in place*. TFNr iframeembedc K s t }| D ]-\}}t| ||}|d ur.|dur.|dur.t|ttttfs.td||f t | || q| j d u rBd|vrB| j | _ | drU| drPt dd| _d S d S )NTFzUnknown parameter: %s=%r inline_style allow_tagsremove_unknown_tagsIIt does not make sense to pass in both allow_tags and remove_unknown_tags)objectitemsgetattr isinstance frozensetsettuplelist TypeErrorsetattrr" styleget ValueErrorr$ )selfkwnot_an_attributenamevaluedefaultr r r __init__ s" zCleaner.__init__srchrefcoder& )scriptlinkappletr r! layerac C s z|j }W n ty Y nw | }t| |dD ]}d|_q| js)| | t| jp.d}t| j p5d}t| j p<d}| j rF| d | j rht| j}|tjD ]}|j}| D ] } | |vrf|| = q]qT| jr| j ru| jtjks|tjD ]}|j}| D ] } | dr|| = qq{|j| jdd | jst|D ]%}|d} td | } t d | } | | r|jd= q| | kr|d| q| j st |dD ]3}|d d ! d kr|" q|j#pd } td | } t d | } | | rd |_#q| | kr| |_#q| jr| tj$ | j%r| tj& | j r!| d | jr+t'|d | j(r5| d n(| j s=| jr]t |d D ]}d|dd v r[| )|s[|" qD| j*rf| d | j+ro|,d | j-rt |dD ]*}|. } | dur| jdvr| . } | dur| jdvs| du r|" qz|,d |,d | j/r|,tj0 | j1r| d |,d | j2r|,d g } g }| D ]+}|j|v r| )|rq|3| q|j|v r| )|rq| 3| q| r | d |kr | 4d}d|_|j5 n |r8|d |kr8|4d}|jd kr4d|_|5 |6 |D ]}|" q>| D ]}|7 qH| j8r`|r[t9d ttj:}|r| jsm| tj$ | j%sw| tj& g }| D ]}|j|vr|3| q}|r|d |u r|4d}d|_|j5 |D ]}|7 q| j;rt<|D ].}| =|s|d}|rd |v rd d | v rӐqd!| }nd }|d| qdS dS )"z& Cleans the document. imageimgr r= onF)resolve_base_hrefr0 typeztext/javascriptz /* deleted */r> stylesheetrelmeta)headhtmltitleparamN)r? r& )r? )r r! r@ r& rN form)buttoninputselecttextarea)blinkmarqueer divrL r% nofollowz nofollow z %s z %s nofollow)>getrootAttributeErrorr itertagcommentskill_conditional_commentsr+ kill_tags remove_tagsr# scriptsaddsafe_attrs_only safe_attrsr Elementattribkeys javascriptr startswith rewrite_links_remove_javascript_linkr" _find_styled_elementsr1 _replace_css_javascript_replace_css_import_has_sneaky_javascriptr0 r- lowerstrip drop_treetextCommentprocessing_instructionsProcessingInstructionstrip_attributeslinks allow_elementrJ page_structureupdateembedded getparentframes frame_tagsforms annoying_tagsappendpopclearreversedrop_tagr$ r2 tags add_nofollow_find_external_links allow_follow)r3 docrX elr^ r_ r# rc re anameoldnewparent_remove_killbadrI r r r __call__ sD zCleaner.__call__c C s dS )zF Override to suppress rel="nofollow" on some anchors. Fr )r3 anchorr r r r s zCleaner.allow_followc C s| |j | jvrdS | j|j }t|ttfr/|D ]}||}|s# dS | ||s, dS qdS ||}|s8dS | ||S )z Decide whether an element is configured to be accepted or rejected. :param el: an element. :return: true to accept the element or false to reject/discard it. FT)r[ _tag_link_attrsr) r- r, r1 allow_embedded_url)r3 r attrone_attrurlr r r rx s zCleaner.allow_elementc C s^ | j dur |j| j vr dS t|\}}}}}| ddd }|dvr&dS || jv r-dS dS )a Decide whether a URL that was found in an element's attributes or text if configured to be accepted or rejected. :param el: an element. :param url: a URL found on the element. :return: true to accept the URL and false to reject it. NF:r r )httphttpsT)whitelist_tagsr[ r ro splithost_whitelist)r3 r r schemenetlocpathqueryfragmentr r r r s zCleaner.allow_embedded_urlc s" t j | | fddtj dS )z IE conditional comments basically embed HTML that the parser doesn't normally see. We can't allow anything like that, so we'll kill any comments that could be conditional. c s | j S N)rr )r has_conditional_commentr r <lambda> s z3Cleaner.kill_conditional_comments.<locals>.<lambda>N)_conditional_comment_research_kill_elementsr rs )r3 r r r r r] s z!Cleaner.kill_conditional_commentsc C s< g }| |D ] }||r|| q|D ]}| qd S r )rZ r rq )r3 r conditioniterater r r r r r s zCleaner._kill_elementsc C s t dt|}t|r dS |S )NrF )_substitute_whitespacer r )r3 r> r r r r rj s z Cleaner._remove_javascript_linkz /\*.*?\*/c C sj | d|}|dd}td|}| }t|rdS d|v r!dS d|v r'dS d|v r-dS t|r3dS dS )a Depending on the browser, stuff like ``e x p r e s s i o n(...)`` can get interpreted, or ``expre/* stuff */ssion(...)``. This checks for attempt to do stuff like this. Typically the response will be to kill the entire style; if you have just a bit of Javascript in the style another rule will catch that and remove only the Javascript from the style; this catches more sneaky attempts. rF \Tz expression(z@importz </noscriptF)_substitute_commentsreplacer ro r _looks_like_tag_content)r3 r0 r r r rn s z Cleaner._has_sneaky_javascriptc C s8 t |}t|trt|}nt|}| | t||S r )rG r) basestringr copydeepcopyr )r3 rL result_typer r r r r / s zCleaner.clean_htmlr ),__name__ __module__ __qualname____doc__r` rg r\ r0 r" rw rJ ry rt r{ r} r r r_ r# r^ r$ rb r rc r r r r9 dictr r r rx r r] r rj recompileSsubr rn r r r r r r m sZ ^ : r zb(?P<body>https?://(?P<host>[a-z0-9._-]+)(?:/[/\-_.,a-z0-9%&?;=~]*)?(?:\([/\-_.,a-z0-9%&?;=~]*\))?)z9mailto:(?P<body>[a-z0-9._-]+@(?P<host>[a-z0-9_.-]+[a-z])))rS prer< rK rR rA z ^localhostz\bexample\.(?:com|org|net)$z^127\.0\.0\.1$nolinkc C s | j |v rdS | d}|r | }|D ] }||v r dS qt| D ].}t|||||d |jrPt|j||| jd\}} | rP||_| |} | | | d | d < q"| j rmt| j ||| jd\}} | ro|| _ | | dd< dS dS dS )a Turn any URLs into links. It will search for links identified by the given regular expressions (by default mailto and http(s) links). It won't link text in an element in avoid_elements, or an element with a class in avoid_classes. It won't link to anything with a host that matches one of the regular expressions in avoid_hosts (default localhost and 127.0.0.1). If you pass in an element, the element's tail will not be substituted, only the contents of the element. Nclass) link_regexesavoid_elements avoid_hosts avoid_classes)factoryr r ) r[ r1 r r- r tail _link_text makeelementindexrr ) r r r r r class_name match_classchildrr tail_childrenr pre_childrenr r r r O sB r c C s d}g }d} d\}}|D ]=} |} | j | | d} | d u r n| d} |D ] } | | r2| } nq%nq| d u r:q |d u sD| |k rJ| }| }q |d u ri|r^|d jrXJ | |d _n|rbJ | } ||fS |d}| }|ds||d r|d8 }|d d }| d | }|r|d jrJ ||d _n|rJ |}|d }|d | |d }|s|}|ds|d r|d d }||_|| | |d } q) NrF r r )NN)poshost.,rA r; body) r groupendstartr endswithr+ rr r )rr r r r leading_textrw last_pos best_matchbest_posregex regex_posmatchr host_regexr> r prev_textr r r r r r | sn r c O sF t | }t| trt| }nt| }t|g|R i | t||S r )rG r) r r r r r r rL argsr4 r r r r r r s r )r rS r< nobreak( i c C s | j tv rdS | d}|r%d}| }|D ] }||v r d} nq|r%dS | jr0t| j||| _| D ]}t|||||d |jrHt|j|||_q2dS )a Breaks any long words found in the body of the text (not attributes). Doesn't effect any of the tags in avoid_elements, by default ``<textarea>`` and ``<pre>`` Breaks words by inserting , which is a unicode character for Zero Width Space character. This generally takes up no space in rendering, but does copy as a space, and in monospace contexts usually takes up space. See http://www.cs.tut.fi/~jkorpela/html/nobr.html for a discussion Nr FT) max_widthr r break_character)r[ _avoid_word_break_elementsr1 r rr _break_textr r ) r r r r r r dont_breakavoidr r r r r s2 r c O s0 t | }t| }t|g|R i | t||S r )rG r r r r r r r r s r c C s: | }|D ]}t||krt|||}| ||} q| S r )r r _insert_breakr )rr r r wordsword replacementr r r r s r z[^a-z]c C s | }d}t | |krA| d | }tt|}|r-|d }| |d kr-| d | }||| 7 }| t |d } t | |ks || 7 }|S )NrF r )r r- _break_prefer_refinditerr )r widthr orig_wordresultr breaks last_breakr r r r s r )Br __future__r r r sysurlparser urllibr ImportError urllib.parselxmlr lxml.htmlr r r r r unichr NameErrorchrunicodestrr bytes__all__r r Ir rl rm version_infoASCIIr r findallr r r r r r XPathrk r r& r r r _link_regexes_avoid_elements _avoid_hosts_avoid_classesr r r r _avoid_word_break_classesr r r r r r r r r <module> s N -: )