📁 File Manager Pro
v10.0.3 | PHP: 8.1.34
Server: Apache
2026-06-22 07:19:23
📂
/ (Root)
/
opt
/
alt
/
python33
/
lib
/
python3.3
/
site-packages
/
pip
/
_vendor
/
distlib
/
__pycache__
📍 /opt/alt/python33/lib/python3.3/site-packages/pip/_vendor/distlib/__pycache__
🔄 Refresh
✏️
Editing: locators.cpython-33.pyc
Read Only
� 7�Reb� c @ s d d l Z d d l m Z d d l Z d d l Z d d l Z d d l Z d d l Z y d d l Z Wn e k r� d d l Z Yn Xd d l Z d d l m Z d d l m Z m Z m Z m Z m Z m Z m Z m Z m Z m Z m Z m Z m Z m Z d d l m Z m Z m! Z! d d l" m# Z# d d l$ m% Z% m& Z& m' Z' m( Z( m) Z) m* Z* m+ Z+ m, Z, d d l- m. Z. m/ Z/ d d l0 m1 Z1 m2 Z2 e j3 e4 � Z5 e j6 d � Z7 e j6 d e j8 � Z9 e j6 d � Z: d Z; e< d d � Z= Gd d � d e � Z> Gd d � d e? � Z@ Gd d � d e@ � ZA Gd d � d e@ � ZB Gd d � d e? � ZC Gd d � d e@ � ZD Gd d � d e@ � ZE Gd d � d e@ � ZF Gd! d" � d" e@ � ZG Gd# d$ � d$ e@ � ZH eH eF � eD d% d& d' �d( d) �ZI eI jJ ZJ e j6 d* � ZK Gd+ d, � d, e? � ZL d S(- i N( u BytesIOi ( u DistlibException( u urljoinu urlparseu urlunparseu url2pathnameu pathname2urlu queueu quoteu unescapeu string_typesu build_openeru HTTPRedirectHandleru Requestu HTTPErroru URLError( u Distributionu DistributionPathu make_dist( u Metadata( u cached_propertyu parse_credentialsu ensure_slashu split_filenameu get_project_datau parse_requirementu parse_name_and_versionu ServerProxy( u get_schemeu UnsupportedVersionError( u Wheelu is_compatibleu ^(\w+)=([a-f0-9]+)u ;\s*charset\s*=\s*(.*)\s*$u text/html|application/x(ht)?mlu http://python.org/pypic C s1 | d k r t } n t | d d �} | j � S( u� Return all distribution names known by an index. :param url: The URL of the index. :return: A list of all known distribution names. u timeoutg @N( u Noneu DEFAULT_INDEXu ServerProxyu list_packages( u urlu client( ( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu get_all_distribution_names) s u get_all_distribution_namesc B s4 | Ee Z d Z d Z d d � Z e Z Z Z d S( u RedirectHandleruE A class to work around a bug in some Python 3.2.x releases. c C s� d } x( d D] } | | k r | | } Pq q W| d k rA d St | � } | j d k r� t | j � | � } t | d � r� | j | | � q� | | | <n t j | | | | | | � S( Nu locationu uriu u replace_header( u locationu uri( u Noneu urlparseu schemeu urljoinu get_full_urlu hasattru replace_headeru BaseRedirectHandleru http_error_302( u selfu requ fpu codeu msgu headersu newurlu keyu urlparts( ( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu http_error_302= s u RedirectHandler.http_error_302N( u __name__u __module__u __qualname__u __doc__u http_error_302u http_error_301u http_error_303u http_error_307( u __locals__( ( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu RedirectHandler4 s u RedirectHandlerc B s� | Ee Z d Z d Z d* Z d+ Z d, Z d) Z e d- Z d d d � Z d d � Z d d � Z d d � Z e e e � Z d d � Z d d � Z d d � Z d d � Z d d � Z d d � Z d! d" � Z d# d$ � Z d% d& � Z d. d' d( � Z d) S(/ u LocatoruG A base class for locators - things that locate distributions. u .tar.gzu .tar.bz2u .taru .zipu .tgzu .tbzu .eggu .exeu .whlu .pdfu defaultc C s1 i | _ | | _ t t � � | _ d | _ d S( u^ Initialise an instance. :param scheme: Because locators look for most recent versions, they need to know the version scheme to use. This specifies the current PEP-recommended scheme - use ``'legacy'`` if you need to support existing distributions on PyPI. N( u _cacheu schemeu build_openeru RedirectHandleru openeru Noneu matcher( u selfu scheme( ( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu __init__c s u Locator.__init__c C s | j j � d S( N( u _cacheu clear( u self( ( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu clear_cacheu s u Locator.clear_cachec C s | j S( N( u _scheme( u self( ( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu _get_schemex s u Locator._get_schemec C s | | _ d S( N( u _scheme( u selfu value( ( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu _set_scheme{ s u Locator._set_schemec C s t d � � d S( u= For a given project, get a dictionary mapping available versions to Distribution instances. This should be implemented in subclasses. If called from a locate() request, self.matcher will be set to a matcher for the requirement to satisfy, otherwise it will be None. u Please implement in the subclassN( u NotImplementedError( u selfu name( ( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu _get_project� s u Locator._get_projectc C s t d � � d S( uJ Return all the distribution names known to this locator. u Please implement in the subclassN( u NotImplementedError( u self( ( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu get_distribution_names� s u Locator.get_distribution_namesc C s` | j d k r! | j | � } n; | | j k r@ | j | } n | j | � } | | j | <| S( u� For a given project, get a dictionary mapping available versions to Distribution instances. This calls _get_project to do all the work, and just implements a caching layer on top. N( u _cacheu Noneu _get_project( u selfu nameu result( ( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu get_project� s u Locator.get_projectc C s7 t | � } | j d k d | j k t j | j � f S( uu Give an url a score which can be used to choose preferred URLs for a given project release. u httpsu pypi.python.org( u urlparseu schemeu netlocu posixpathu basenameu path( u selfu urlu t( ( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu score_url� s u Locator.score_urlc C s{ | } | rw | j | � } | j | � } | | k r? | } n | | k ra t j d | | � qw t j d | | � n | S( uL Choose one of two URLs where both are candidates for distribution archives for the same version of a distribution (for example, .tar.gz vs. zip). The current implement favours http:// URLs over https://, archives from PyPI over those from other locations and then the archive name. u Not replacing %r with %ru Replacing %r with %r( u score_urlu loggeru debug( u selfu url1u url2u resultu s1u s2( ( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu prefer_url� s u Locator.prefer_urlc C s t | | � S( uZ Attempt to split a filename in project name, version and Python version. ( u split_filename( u selfu filenameu project_name( ( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu split_filename� s u Locator.split_filenamec C s� d d � } d } t | � \ } } } } } } | j � j d � r[ t j d | | � n t j | � } | r� | j � \ } } n d \ } } | } | r� | d d k r� | d d � } n | j d � r�y� t | � } t | | j � r�| d k rd } n | | j | � } | r�i | j d 6| j d 6| j d 6t | | | | | d f � d 6d j d d � | j D� � d 6} q�n Wq�t k r�} z t j d | � WYd d } ~ Xq�Xn| j | j � r�t j | � } } x� | j D]� } | j | � r�| d t | � � } | j | | � } | sHt j d | � nu | \ } } } | sm| | | � r�i | d 6| d 6| d 6t | | | | | d f � d 6} | r�| | d <q�n Pq�q�Wn | r�| r�| | d | <n | S( u See if a URL is a candidate for a download URL for a project (the URL has typically been scraped from an HTML page). If it is, a dictionary is returned with keys "name", "version", "filename" and "url"; otherwise, None is returned. c S sV | j � | j � } } | | k r. d } n$ | j d d � | j d d � k } | S( Nu _u -T( u loweru Trueu replace( u name1u name2u result( ( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu same_project� s $u: Locator.convert_url_to_download_info.<locals>.same_projectu egg=u %s: version hint in fragment: %ri u /Nu .whlu nameu versionu filenameu u urlu , c S s/ g | ]% } d j t | d d � � � � q S( u .i N( u joinu list( u .0u v( ( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu <listcomp>� s u8 Locator.convert_url_to_download_info.<locals>.<listcomp>u python-versionu invalid path for wheel: %su No match for project/version: %su %s_digest( NNi����i����T( u Noneu urlparseu loweru startswithu loggeru debugu HASHER_HASHu matchu groupsu endswithu Wheelu is_compatibleu wheel_tagsu Trueu nameu versionu filenameu urlunparseu joinu pyveru Exceptionu warningu downloadable_extensionsu posixpathu basenameu lenu split_filename( u selfu urlu project_nameu same_projectu resultu schemeu netlocu pathu paramsu queryu fragu mu algou digestu origpathu wheelu includeu eu filenameu extu tu nameu versionu pyver( ( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu convert_url_to_download_info� sj '& u$ Locator.convert_url_to_download_infoc C sE d } x8 d D]0 } d | } | | k r | | | f } Pq q W| S( u� Get a digest from a dictionary by looking at keys of the form 'algo_digest'. Returns a 2-tuple (algo, digest) if found, else None. Currently looks only for SHA256, then MD5. u sha256u md5u %s_digestN( u sha256u md5( u None( u selfu infou resultu algou key( ( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu _get_digest s u Locator._get_digestc C s� | j d � } | j d � } | | k r@ | | } | j } n! t | | d | j �} | j } | j | � | _ | j | d k r� | j | j | d � | _ n | | _ | | | <d S( u� Update a result dictionary (the final result from _get_project) with a dictionary for a specific version, whih typically holds information gleaned from a filename or URL for an archive for the distribution. u nameu versionu schemeu urlN( u popu metadatau make_distu schemeu _get_digestu digestu source_urlu prefer_urlu locator( u selfu resultu infou nameu versionu distu md( ( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu _update_version_data# s u Locator._update_version_datac C s� d } t | � } | d k r1 t d | � � n t | j � } | j | j � | _ } t j d | t | � j � | j | j � } | r�g } | j } x� | D]� } ye | j | � s� t j d | | � n< | s� | | � j r� | j | � n t j d | | j � Wq� t k r5t j d | | � Yq� Xq� Wt | � d k rdt | d | j �} n | r�t j d | � | | d } q�n | r�| j r�| j | _ n d | _ | S( u Find the most recent distribution which matches the given requirement. :param requirement: A requirement of the form 'foo (1.0)' or perhaps 'foo (>= 1.0, < 2.0, != 1.3)' :param prereleases: If ``True``, allow pre-release versions to be located. Otherwise, pre-release versions are not returned. :return: A :class:`Distribution` instance, or ``None`` if no such distribution could be located. u Not a valid requirement: %ru matcher: %s (%s)u %s did not match %ru% skipping pre-release version %s of %su error matching %s with %ri u keyu sorted list: %sNi����( u Noneu parse_requirementu DistlibExceptionu get_schemeu schemeu matcheru requirementu loggeru debugu typeu __name__u get_projectu nameu version_classu matchu is_prereleaseu appendu Exceptionu warningu lenu sortedu keyu extras( u selfu requirementu prereleasesu resultu ru schemeu matcheru versionsu slistu vclsu k( ( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu locate7 s> u Locator.locateN( u .tar.gzu .tar.bz2u .taru .zipu .tgzu .tbz( u .eggu .exeu .whl( u .pdf( u .whlF( u __name__u __module__u __qualname__u __doc__u source_extensionsu binary_extensionsu excluded_extensionsu Noneu wheel_tagsu downloadable_extensionsu __init__u clear_cacheu _get_schemeu _set_schemeu propertyu schemeu _get_projectu get_distribution_namesu get_projectu score_urlu prefer_urlu split_filenameu convert_url_to_download_infou _get_digestu _update_version_datau Falseu locate( u __locals__( ( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu LocatorS s* M u Locatorc sD | Ee Z d Z d Z � f d d � Z d d � Z d d � Z � S( u PyPIRPCLocatoru� This locator uses XML-RPC to locate distributions. It therefore cannot be used with simple mirrors (that only mirror file content). c s8 t t | � j | � | | _ t | d d �| _ d S( u� Initialise an instance. :param url: The URL to use for XML-RPC. :param kwargs: Passed to the superclass constructor. u timeoutg @N( u superu PyPIRPCLocatoru __init__u base_urlu ServerProxyu client( u selfu urlu kwargs( u __class__( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu __init__m s u PyPIRPCLocator.__init__c C s t | j j � � S( uJ Return all the distribution names known to this locator. ( u setu clientu list_packages( u self( ( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu get_distribution_namesx s u% PyPIRPCLocator.get_distribution_namesc C s i } | j j | d � } x� | D]� } | j j | | � } | j j | | � } t d | j � } | d | _ | d | _ | j d � | _ | j d g � | _ | j d � | _ t | � } | r" | d } | d | _ | j | � | _ | | _ | | | <q" q" W| S( Nu schemeu nameu versionu licenseu keywordsu summaryi u urlT( u clientu package_releasesu Trueu release_urlsu release_datau Metadatau schemeu nameu versionu getu licenseu keywordsu summaryu Distributionu source_urlu _get_digestu digestu locator( u selfu nameu resultu versionsu vu urlsu datau metadatau distu info( ( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu _get_project~ s& u PyPIRPCLocator._get_project( u __name__u __module__u __qualname__u __doc__u __init__u get_distribution_namesu _get_project( u __locals__( ( u __class__u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu PyPIRPCLocatorh s u PyPIRPCLocatorc sD | Ee Z d Z d Z � f d d � Z d d � Z d d � Z � S( u PyPIJSONLocatoruw This locator uses PyPI's JSON interface. It's very limited in functionality nad probably not worth using. c s) t t | � j | � t | � | _ d S( N( u superu PyPIJSONLocatoru __init__u ensure_slashu base_url( u selfu urlu kwargs( u __class__( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu __init__� s u PyPIJSONLocator.__init__c C s t d � � d S( uJ Return all the distribution names known to this locator. u Not available from this locatorN( u NotImplementedError( u self( ( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu get_distribution_names� s u& PyPIJSONLocator.get_distribution_namesc C sb i } t | j d t | � � } y| j j | � } | j � j � } t j | � } t d | j � } | d } | d | _ | d | _ | j d � | _ | j d g � | _ | j d � | _ t | � } | d } | r%| d } | d | _ | j | � | _ | | _ | | | j <n Wn5 t k r]} z t j d | � WYd d } ~ Xn X| S( Nu %s/jsonu schemeu infou nameu versionu licenseu keywordsu summaryu urlsi u urlu JSON fetch failed: %s( u urljoinu base_urlu quoteu openeru openu readu decodeu jsonu loadsu Metadatau schemeu nameu versionu getu licenseu keywordsu summaryu Distributionu source_urlu _get_digestu digestu locatoru Exceptionu loggeru exception( u selfu nameu resultu urlu respu datau du mdu distu urlsu infou e( ( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu _get_project� s0 #u PyPIJSONLocator._get_project( u __name__u __module__u __qualname__u __doc__u __init__u get_distribution_namesu _get_project( u __locals__( ( u __class__u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu PyPIJSONLocator� s u PyPIJSONLocatorc B s� | Ee Z d Z d Z e j d e j e j Be j B� Z e j d e j e j B� Z d d � Z e j d e j � Z e d d � � Z d S( u Pageu4 This class represents a scraped HTML page. u� (rel\s*=\s*(?:"(?P<rel1>[^"]*)"|'(?P<rel2>[^']*)'|(?P<rel3>[^>\s ]*))\s+)? href\s*=\s*(?:"(?P<url1>[^"]*)"|'(?P<url2>[^']*)'|(?P<url3>[^>\s ]*)) (\s+rel\s*=\s*(?:"(?P<rel4>[^"]*)"|'(?P<rel5>[^']*)'|(?P<rel6>[^>\s ]*)))? u! <base\s+href\s*=\s*['"]?([^'">]+)c C sM | | _ | | _ | _ | j j | j � } | rI | j d � | _ n d S( uk Initialise an instance with the Unicode page contents and the URL they came from. i N( u datau base_urlu urlu _baseu searchu group( u selfu datau urlu m( ( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu __init__� s u Page.__init__u [^a-z0-9$&+,/:;=?@.#%_\\|-]c C s d d � } t � } x� | j j | j � D]� } | j d � } | d py | d py | d py | d py | d py | d } | d p� | d p� | d } t | j | � } t | � } | j j d d � | � } | j | | f � q+ Wt | d d d � d d �} | S( u� Return the URLs of all the links on a page together with information about their "rel" attribute, for determining which ones to treat as downloads and which ones to queue for further scraping. c S s@ t | � \ } } } } } } t | | t | � | | | f � S( u Tidy up an URL.( u urlparseu urlunparseu quote( u urlu schemeu netlocu pathu paramsu queryu frag( ( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu clean� s u Page.links.<locals>.cleanu u rel1u rel2u rel3u rel4u rel5u rel6u url1u url2u url3c S s d t | j d � � S( Nu %%%2xi ( u ordu group( u m( ( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu <lambda>� s u Page.links.<locals>.<lambda>u keyc S s | d S( Ni ( ( u t( ( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu <lambda>� s u reverseT( u setu _hrefu finditeru datau groupdictu urljoinu base_urlu unescapeu _clean_reu subu addu sortedu True( u selfu cleanu resultu matchu du relu url( ( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu links� s u Page.linksN( u __name__u __module__u __qualname__u __doc__u reu compileu Iu Su Xu _hrefu _baseu __init__u _clean_reu cached_propertyu links( u __locals__( ( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu Page� s u Pagec s� | Ee Z d Z d Z i e j d 6d d � d 6d d � d 6Z d d � f d d � Z d d � Z d d � Z d d � Z e j d e j � Z d d � Z d d � Z d d � Z d d � Z d d � Z e j d � Z d d � Z � S( u SimpleScrapingLocatoru� A locator which scrapes HTML pages to locate downloads for a distribution. This runs multiple threads to do the I/O; performance is at least as good as pip's PackageFinder, which works in an analogous fashion. u deflatec C s t j d t t � � j � S( Nu fileobj( u gzipu GzipFileu BytesIOu du read( u b( ( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu <lambda> s u SimpleScrapingLocator.<lambda>u gzipc C s | S( N( ( u b( ( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu <lambda> s u nonei c s� t t | � j | � t | � | _ | | _ i | _ t � | _ t j � | _ t � | _ d | _ | | _ t j � | _ t j � | _ d S( u� Initialise an instance. :param url: The root URL to use for scraping. :param timeout: The timeout, in seconds, to be applied to requests. This defaults to ``None`` (no timeout specified). :param num_workers: The number of worker threads you want to do I/O, This defaults to 10. :param kwargs: Passed to the superclass. NF( u superu SimpleScrapingLocatoru __init__u ensure_slashu base_urlu timeoutu _page_cacheu setu _seenu queueu Queueu _to_fetchu _bad_hostsu Falseu skip_externalsu num_workersu threadingu RLocku _locku _gplock( u selfu urlu timeoutu num_workersu kwargs( u __class__( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu __init__ s u SimpleScrapingLocator.__init__c C sc g | _ xS t | j � D]B } t j d | j � } | j d � | j � | j j | � q Wd S( u� Threads are created only when get_project is called, and terminate before it returns. They are there primarily to parallelise I/O (i.e. fetching web pages). u targetNT( u _threadsu rangeu num_workersu threadingu Threadu _fetchu setDaemonu Trueu startu append( u selfu iu t( ( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu _prepare_threads s u& SimpleScrapingLocator._prepare_threadsc C sO x! | j D] } | j j d � q Wx | j D] } | j � q. Wg | _ d S( uu Tell all the threads to terminate (by sending a sentinel value) and wait for them to do so. N( u _threadsu _to_fetchu putu Noneu join( u selfu t( ( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu _wait_threads, s u# SimpleScrapingLocator._wait_threadsc C s� i } | j �� | | _ | | _ t | j d t | � � } | j j � | j j � | j � z1 t j d | � | j j | � | j j � Wd | j � X| ` Wd QX| S( Nu %s/u Queueing %s( u _gplocku resultu project_nameu urljoinu base_urlu quoteu _seenu clearu _page_cacheu _prepare_threadsu loggeru debugu _to_fetchu putu joinu _wait_threads( u selfu nameu resultu url( ( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu _get_project9 s u" SimpleScrapingLocator._get_projectu< \b(linux-(i\d86|x86_64|arm\w+)|win(32|-amd64)|macosx-?\d+)\bc C s | j j | � S( uD Does an URL refer to a platform-specific download? ( u platform_dependentu search( u selfu url( ( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu _is_platform_dependentN s u, SimpleScrapingLocator._is_platform_dependentc C sp | j | � r d } n | j | | j � } t j d | | � | rl | j � | j | j | � Wd QXn | S( u% See if an URL is a suitable download for a project. If it is, register information in the result dictionary (for _get_project) about the specific version it's for. Note that the return value isn't actually used other than as a boolean value. u process_download: %s -> %sN( u _is_platform_dependentu Noneu convert_url_to_download_infou project_nameu loggeru debugu _locku _update_version_datau result( u selfu urlu info( ( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu _process_downloadT s u' SimpleScrapingLocator._process_downloadc C s t | � \ } } } } } } | j | j | j | j � rG d } n� | j rl | j | j � rl d } n� | j | j � s� d } ny | d k r� d } nd | d k r� d } nO | j | � r� d } n7 | j d d � d } | j � d k r� d } n d } t j d | | | | � | S( u� Determine whether a link URL from a referring page and with a particular "rel" attribute should be queued for scraping. u homepageu downloadu httpu httpsu ftpu :i i u localhostu# should_queue: %s (%s) from %s -> %sF( u homepageu download( u httpu httpsu ftpT( u urlparseu endswithu source_extensionsu binary_extensionsu excluded_extensionsu Falseu skip_externalsu startswithu base_urlu _is_platform_dependentu splitu loweru Trueu loggeru debug( u selfu linku referreru relu schemeu netlocu pathu _u resultu host( ( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu _should_queueh s* u# SimpleScrapingLocator._should_queuec C s� x� | j j � } z� | r� | j | � } | d k r< w n x� | j D]y \ } } | | j k rF | j j | � | j | � r� | j | | | � r� t j d | | � | j j | � q� qF qF Wn Wd | j j � X| s Pq q d S( u� Get a URL to fetch from the work queue, get the HTML page, examine its links for download candidates and candidates for further scraping. This is a handy method to run in a thread. u Queueing %s from %sN( u _to_fetchu getu get_pageu Noneu linksu _seenu addu _process_downloadu _should_queueu loggeru debugu putu task_done( u selfu urlu pageu linku rel( ( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu _fetch� s" !u SimpleScrapingLocator._fetchc C s t | � \ } } } } } } | d k rZ t j j t | � � rZ t t | � d � } n | | j k r� | j | } t j d | | � n�| j d d � d } d } | | j k r� t j d | | � nAt | d i d d 6�} zy8t j d | � | j j | d | j �} t j d | � | j � } | j d d � } t j | � r | j � } | j � } | j d � } | r�| j | } | | � } n d } t j | � } | r�| j d � } n y | j | � } Wn! t k r | j d � } Yn Xt | | � } | | j | <n Wn� t k rm} z* | j d k r[t j d | | � n WYd d } ~ Xn� t! k r�} z8 t j d | | � | j" � | j j# | � Wd QXWYd d } ~ Xn8 t$ k r�} z t j d | | � WYd d } ~ Xn XWd | | j | <X| S( u Get the HTML for an URL, possibly from an in-memory cache. XXX TODO Note: this cache is never actually cleared. It's assumed that the data won't get stale over the lifetime of a locator instance (not necessarily true for the default_locator). u fileu index.htmlu Returning %s from cache: %su :i i u Skipping %s due to bad host %su headersu identityu Accept-encodingu Fetching %su timeoutu Fetched %su Content-Typeu u Content-Encodingu utf-8u latin-1i� u Fetch failed: %s: %sN(% u urlparseu osu pathu isdiru url2pathnameu urljoinu ensure_slashu _page_cacheu loggeru debugu splitu Noneu _bad_hostsu Requestu openeru openu timeoutu infou getu HTML_CONTENT_TYPEu matchu geturlu readu decodersu CHARSETu searchu groupu decodeu UnicodeErroru Pageu HTTPErroru codeu exceptionu URLErroru _locku addu Exception( u selfu urlu schemeu netlocu pathu _u resultu hostu requ respu headersu content_typeu final_urlu datau encodingu decoderu mu e( ( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu get_page� sZ $ ( (*u SimpleScrapingLocator.get_pageu <a href=[^>]*>([^<]+)<c C sq t � } | j | j � } | s7 t d | j � � n x3 | j j | j � D] } | j | j d � � qM W| S( uJ Return all the distribution names known to this locator. u Unable to get %si ( u setu get_pageu base_urlu DistlibExceptionu _distname_reu finditeru datau addu group( u selfu resultu pageu match( ( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu get_distribution_names� s u, SimpleScrapingLocator.get_distribution_namesN( u __name__u __module__u __qualname__u __doc__u zlibu decompressu decodersu Noneu __init__u _prepare_threadsu _wait_threadsu _get_projectu reu compileu Iu platform_dependentu _is_platform_dependentu _process_downloadu _should_queueu _fetchu get_pageu _distname_reu get_distribution_names( u __locals__( ( u __class__u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu SimpleScrapingLocator� s$ ;u SimpleScrapingLocatorc sP | Ee Z d Z d Z � f d d � Z d d � Z d d � Z d d � Z � S( u DirectoryLocatoru? This class locates distributions in a directory tree. c so | j d d � | _ t t | � j | � t j j | � } t j j | � sb t d | � � n | | _ d S( u� Initialise an instance. :param path: The root of the directory tree to search. :param kwargs: Passed to the superclass constructor, except for: * recursive - if True (the default), subdirectories are recursed into. If False, only the top-level directory is searched, u recursiveu Not a directory: %rNT( u popu Trueu recursiveu superu DirectoryLocatoru __init__u osu pathu abspathu isdiru DistlibExceptionu base_dir( u selfu pathu kwargs( u __class__( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu __init__� s u DirectoryLocator.__init__c C s | j | j � S( u� Should a filename be considered as a candidate for a distribution archive? As well as the filename, the directory which contains it is provided, though not used by the current implementation. ( u endswithu downloadable_extensions( u selfu filenameu parent( ( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu should_include s u DirectoryLocator.should_includec C s� i } x� t j | j � D]� \ } } } x� | D]� } | j | | � r/ t j j | | � } t d d t t j j | � � d d d f � } | j | | � } | r� | j | | � q� q/ q/ W| j s Pq q W| S( Nu fileu ( u osu walku base_diru should_includeu pathu joinu urlunparseu pathname2urlu abspathu convert_url_to_download_infou _update_version_datau recursive( u selfu nameu resultu rootu dirsu filesu fnu urlu info( ( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu _get_project s " u DirectoryLocator._get_projectc C s� t � } x� t j | j � D]� \ } } } x� | D]� } | j | | � r2 t j j | | � } t d d t t j j | � � d d d f � } | j | d � } | r� | j | d � q� q2 q2 W| j s Pq q W| S( uJ Return all the distribution names known to this locator. u fileu u nameN( u setu osu walku base_diru should_includeu pathu joinu urlunparseu pathname2urlu abspathu convert_url_to_download_infou Noneu addu recursive( u selfu resultu rootu dirsu filesu fnu urlu info( ( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu get_distribution_names s " u' DirectoryLocator.get_distribution_names( u __name__u __module__u __qualname__u __doc__u __init__u should_includeu _get_projectu get_distribution_names( u __locals__( ( u __class__u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu DirectoryLocator� s u DirectoryLocatorc B s2 | Ee Z d Z d Z d d � Z d d � Z d S( u JSONLocatoru This locator uses special extended metadata (not available on PyPI) and is the basis of performant dependency resolution in distlib. Other locators require archive downloads before dependencies can be determined! As you might imagine, that can be slow. c C s t d � � d S( uJ Return all the distribution names known to this locator. u Not available from this locatorN( u NotImplementedError( u self( ( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu get_distribution_names2 s u" JSONLocator.get_distribution_namesc C s i } t | � } | r x� | j d g � D]� } | d d k s+ | d d k rW q+ n t | d | d d | j d d � d | j �} | j } | d | _ d | k r� | d r� d | d f | _ n | j d i � | _ | j d i � | _ | | | j <q+ Wn | S( Nu filesu ptypeu sdistu pyversionu sourceu nameu versionu summaryu Placeholder for summaryu schemeu urlu digestu md5u requirementsu exports( u get_project_datau getu make_distu schemeu metadatau source_urlu digestu dependenciesu exportsu version( u selfu nameu resultu datau infou distu md( ( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu _get_project8 s$ u JSONLocator._get_projectN( u __name__u __module__u __qualname__u __doc__u get_distribution_namesu _get_project( u __locals__( ( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu JSONLocator+ s u JSONLocatorc s8 | Ee Z d Z d Z � f d d � Z d d � Z � S( u DistPathLocatoru� This locator finds installed distributions in a path. It can be useful for adding to an :class:`AggregatingLocator`. c s8 t t | � j | � t | t � s+ t � | | _ d S( us Initialise an instance. :param distpath: A :class:`DistributionPath` instance to search. N( u superu DistPathLocatoru __init__u isinstanceu DistributionPathu AssertionErroru distpath( u selfu distpathu kwargs( u __class__( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu __init__U s u DistPathLocator.__init__c C s; | j j | � } | d k r' i } n i | | j 6} | S( N( u distpathu get_distributionu Noneu version( u selfu nameu distu result( ( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu _get_project_ s u DistPathLocator._get_project( u __name__u __module__u __qualname__u __doc__u __init__u _get_project( u __locals__( ( u __class__u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu DistPathLocatorP s u DistPathLocatorc sw | Ee Z d Z d Z � f d d � Z � f d d � Z d d � Z e e j j e � Z d d � Z d d � Z � S( u AggregatingLocatoruI This class allows you to chain and/or merge a list of locators. c s8 | j d d � | _ | | _ t t | � j | � d S( u� Initialise an instance. :param locators: The list of locators to search. :param kwargs: Passed to the superclass constructor, except for: * merge - if False (the default), the first successful search from any of the locators is returned. If True, the results from all locators are merged (this can be slow). u mergeNF( u popu Falseu mergeu locatorsu superu AggregatingLocatoru __init__( u selfu locatorsu kwargs( u __class__( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu __init__l s u AggregatingLocator.__init__c s5 t t | � j � x | j D] } | j � q Wd S( N( u superu AggregatingLocatoru clear_cacheu locators( u selfu locator( u __class__( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu clear_cache| s u AggregatingLocator.clear_cachec C s* | | _ x | j D] } | | _ q Wd S( N( u _schemeu locatorsu scheme( u selfu valueu locator( ( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu _set_scheme� s u AggregatingLocator._set_schemec C s� i } x� | j D]� } | j | � } | r | j rD | j | � q� | j d k r\ d } n3 d } x* | D]" } | j j | � ri d } Pqi qi W| r� | } Pq� q q W| S( NTF( u locatorsu get_projectu mergeu updateu matcheru Noneu Trueu Falseu match( u selfu nameu resultu locatoru du foundu k( ( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu _get_project� s" u AggregatingLocator._get_projectc C sJ t � } x: | j D]/ } y | | j � O} Wq t k rA Yq Xq W| S( uJ Return all the distribution names known to this locator. ( u setu locatorsu get_distribution_namesu NotImplementedError( u selfu resultu locator( ( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu get_distribution_names� s u) AggregatingLocator.get_distribution_names( u __name__u __module__u __qualname__u __doc__u __init__u clear_cacheu _set_schemeu propertyu Locatoru schemeu fgetu _get_projectu get_distribution_names( u __locals__( ( u __class__u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu AggregatingLocatorh s u AggregatingLocatoru https://pypi.python.org/simple/u timeoutg @u schemeu legacyu1 (?P<name>[\w-]+)\s*\(\s*(==\s*)?(?P<ver>[^)]+)\)$c B sw | Ee Z d Z d Z d d d � Z d d � Z d d � Z d d � Z d d � Z d d � Z d d d d � Z d S( u DependencyFinderu0 Locate dependencies for distributions. c C s( | p t | _ t | j j � | _ d S( uf Initialise an instance, using the specified locator to locate distributions. N( u default_locatoru locatoru get_schemeu scheme( u selfu locator( ( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu __init__� s u DependencyFinder.__init__c C s� t j d | � | j } | | j | <| | j | | j f <x^ | j D]S } t | � \ } } t j d | | | � | j j | t � � j | | f � qF Wd S( u� Add a distribution to the finder. This will update internal information about who provides what. :param dist: The distribution to add. u adding distribution %su Add to provided: %s, %s, %sN( u loggeru debugu keyu dists_by_nameu distsu versionu providesu parse_name_and_versionu providedu setdefaultu setu add( u selfu distu nameu pu version( ( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu add_distribution� s u! DependencyFinder.add_distributionc C s� t j d | � | j } | j | =| j | | j f =xl | j D]a } t | � \ } } t j d | | | � | j | } | j | | f � | s@ | j | =q@ q@ Wd S( u� Remove a distribution from the finder. This will update internal information about who provides what. :param dist: The distribution to remove. u removing distribution %su Remove from provided: %s, %s, %sN( u loggeru debugu keyu dists_by_nameu distsu versionu providesu parse_name_and_versionu providedu remove( u selfu distu nameu pu versionu s( ( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu remove_distribution� s u$ DependencyFinder.remove_distributionc C sQ y | j j | � } Wn4 t k rL | j � d } | j j | � } Yn X| S( u� Get a version matcher for a requirement. :param reqt: The requirement :type reqt: str :return: A version matcher (an instance of :class:`distlib.version.Matcher`). i ( u schemeu matcheru UnsupportedVersionErroru split( u selfu reqtu matcheru name( ( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu get_matcher� s u DependencyFinder.get_matcherc C s� | j | � } | j } t � } | j } | | k r� x` | | D]Q \ } } y | j | � } Wn t k rz d } Yn X| rA | j | � PqA qA Wn | S( u� Find the distributions which can fulfill a requirement. :param reqt: The requirement. :type reqt: str :return: A set of distribution which can fulfill the requirement. F( u get_matcheru keyu setu providedu matchu UnsupportedVersionErroru Falseu add( u selfu reqtu matcheru nameu resultu providedu versionu provideru match( ( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu find_providers� s u DependencyFinder.find_providersc C s� | j | } t � } x? | D]7 } | j | � } | j | j � s | j | � q q W| r� | j d | | | f � d } nZ | j | � | j | =x- | D]% } | j j | t � � j | � q� W| j | � d } | S( u� Attempt to replace one provider with another. This is typically used when resolving dependencies from multiple sources, e.g. A requires (B >= 1.0) while C requires (B >= 1.1). For successful replacement, ``provider`` must meet all the requirements which ``other`` fulfills. :param provider: The provider we are trying to replace with. :param other: The provider we're trying to replace. :param problems: If False is returned, this will contain what problems prevented replacement. This is currently a tuple of the literal string 'cantreplace', ``provider``, ``other`` and the set of requirements that ``provider`` couldn't fulfill. :return: True if we can replace ``other`` with ``provider``, else False. u cantreplaceFT( u reqtsu setu get_matcheru matchu versionu addu Falseu remove_distributionu setdefaultu add_distributionu True( u selfu provideru otheru problemsu rlistu unmatchedu su matcheru result( ( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu try_to_replace s # u DependencyFinder.try_to_replacec C s i | _ i | _ i | _ i | _ t | p0 g � } d | k rk | j d � | t d d d g � O} n t | t � r� | } } t j d | � nK | j j | d | �} } | d k r� t d | � � n t j d | � d | _ t � } t | g � } t | g � } x�| r�| j � } | j } | | j k rO| j | � n/ | j | } | | k r~| j | | | � n | j | j B} | j } t � } | | k r�xA d D]6 } d | } | | k r�| t | d | � O} q�q�Wn | | B| B} x�| D]�} | j | � } | s+t j d | � | j j | d | �} | d k rv| rv| j j | d d �} n | d k r�t j d | � | j d | f � q+| j | j } } | | f | j k r�| j | � n | j | � | | k r+| | k r+| j | � t j d | j � q+n xw | D]o } | j } | | j k rr| j j | t � � j | � q2| j | } | | k r2| j | | | � q2q2WqWqWt | j j � � } x< | D]4 } | | k | _ | j r�t j d | j � q�q�Wt j d | � | | f S( u� Find a distribution and all distributions it depends on. :param requirement: The requirement specifying the distribution to find, or a Distribution instance. :param meta_extras: A list of meta extras such as :test:, :build: and so on. :param prereleases: If ``True``, allow pre-release versions to be returned - otherwise, don't return prereleases unless they're all that's available. Return a set of :class:`Distribution` instances and a set of problems. The distributions returned should be such that they have the :attr:`required` attribute set to ``True`` if they were from the ``requirement`` passed to ``find()``, and they have the :attr:`build_time_dependency` attribute set to ``True`` unless they are post-installation dependencies of the ``requirement``. The problems should be a tuple consisting of the string ``'unsatisfied'`` and the requirement which couldn't be satisfied by any distribution known to the locator. u :*:u :test:u :build:u :dev:u passed %s as requirementu prereleasesu Unable to locate %ru located %su testu buildu devu :%s:u %s_requiresu No providers found for %ru Cannot satisfy %ru unsatisfiedu Adding %s to install_distsu# %s is a build-time dependency only.u find done for %sNT( u testu buildu dev( u providedu distsu dists_by_nameu reqtsu setu removeu isinstanceu Distributionu loggeru debugu locatoru locateu Noneu DistlibExceptionu Trueu requestedu popu keyu add_distributionu try_to_replaceu run_requiresu meta_requiresu build_requiresu getattru find_providersu addu versionu name_and_versionu setdefaultu valuesu build_time_dependency( u selfu requirementu meta_extrasu prereleasesu distu odistu problemsu todou install_distsu nameu otheru ireqtsu sreqtsu ereqtsu keyu eu all_reqtsu ru providersu provideru nu vu pu dists( ( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu find> s� ! " " u DependencyFinder.findNF( u __name__u __module__u __qualname__u __doc__u Noneu __init__u add_distributionu remove_distributionu get_matcheru find_providersu try_to_replaceu Falseu find( u __locals__( ( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu DependencyFinder� s 'u DependencyFinder(M u gzipu iou BytesIOu jsonu loggingu osu posixpathu reu threadingu ImportErroru dummy_threadingu zlibu u DistlibExceptionu compatu urljoinu urlparseu urlunparseu url2pathnameu pathname2urlu queueu quoteu unescapeu string_typesu build_openeru HTTPRedirectHandleru BaseRedirectHandleru Requestu HTTPErroru URLErroru databaseu Distributionu DistributionPathu make_distu metadatau Metadatau utilu cached_propertyu parse_credentialsu ensure_slashu split_filenameu get_project_datau parse_requirementu parse_name_and_versionu ServerProxyu versionu get_schemeu UnsupportedVersionErroru wheelu Wheelu is_compatibleu getLoggeru __name__u loggeru compileu HASHER_HASHu Iu CHARSETu HTML_CONTENT_TYPEu DEFAULT_INDEXu Noneu get_all_distribution_namesu RedirectHandleru objectu Locatoru PyPIRPCLocatoru PyPIJSONLocatoru Pageu SimpleScrapingLocatoru DirectoryLocatoru JSONLocatoru DistPathLocatoru AggregatingLocatoru default_locatoru locateu NAME_VERSION_REu DependencyFinder( ( ( u5 /tmp/pip-zej_zi-build/pip/_vendor/distlib/locators.pyu <module> sV ^ : � +*:�A%N
💾 Save Changes
❌ Cancel