whoami7 - Manager
:
/
lib
/
python2.7
/
site-packages
/
IPython
/
parallel
/
client
/
Upload File:
files >> //lib/python2.7/site-packages/IPython/parallel/client/asyncresult.pyo
� M�UVc @ s d Z d d l m Z d d l Z d d l Z d d l m Z d d l m Z d d l m Z m Z m Z d d l m Z d d l m Z d d l m Z d � Z e � Z e d � � Z d e f d � � YZ d e f d � � YZ d e f d � � YZ d d d g Z d S( s" AsyncResult objects for the clienti����( t print_functionN( t datetime( t MessageTracker( t clear_outputt displayt display_pretty( t decorator( t error( t string_typesc C s t | d t �d S( Nt raw( R t True( t s( ( sG /usr/lib/python2.7/site-packages/IPython/parallel/client/asyncresult.pyt _raw_text s c O s8 | j d � | j s( t j d � � n | | | | � S( s6 Call spin() to sync state prior to calling the method.i s result not ready( t waitt _readyR t TimeoutError( t ft selft argst kwargs( ( sG /usr/lib/python2.7/site-packages/IPython/parallel/client/asyncresult.pyt check_ready s t AsyncResultc B s� e Z d Z d% Z d% Z d% Z e Z e f Z d d% d% e d � Z d � Z d � Z d d � Z d � Z d � Z d d � Z d � Z d d � Z e d � � Z e Z e d � � Z e d � � Z d � Z d � Z e d � � Z d d � Z d � Z d � Z d � Z d � Z e e! d � Z" e d � � Z# e d � � Z$ e e% d � � � Z& e e% d � � � Z' d d d � Z( d � Z) d d% d � Z* d! � Z+ d d" � Z, e% d# d$ � � Z- RS(& s� Class for representing results of non-blocking calls. Provides the same interface as :py:class:`multiprocessing.pool.AsyncResult`. t unknownc C s� t | t � r$ | g } t | _ n t | _ | d k rB t } n | | _ | | _ | | _ | | _ | | _ | | _ t | _ t | _ d | _ g | j D] } | j j | ^ q� | _ d S( N( t isinstanceR R t _single_resultt Falset Nonet finished_trackert _clientt msg_idst _fnamet _targetst _trackert ownerR t _outputs_readyt _successt metadatat _metadata( R t clientR t fnamet targetst trackerR! t id( ( sG /usr/lib/python2.7/site-packages/IPython/parallel/client/asyncresult.pyt __init__/ s c C s2 | j r d | j j Sd | j j | j f Sd S( Ns <%s: finished>s <%s: %s>( R t __class__t __name__R ( R ( ( sG /usr/lib/python2.7/site-packages/IPython/parallel/client/asyncresult.pyt __repr__G s c C s | j r | d S| Sd S( s� Reconstruct our result from actual result list (always a list) Override me in subclasses for turning a list of results into the expected form. i N( R ( R t res( ( sG /usr/lib/python2.7/site-packages/IPython/parallel/client/asyncresult.pyt _reconstruct_resultN s i����c C sT | j � s | j | � n | j rA | j r5 | j S| j � n t j d � � d S( s/ Return the result when it arrives. If `timeout` is not ``None`` and the result does not arrive within `timeout` seconds then ``TimeoutError`` is raised. If the remote call raised an exception then that exception will be reraised by get() inside a `RemoteError`. s Result not ready.N( t readyR R R# t _resultt _exceptionR R ( R t timeout( ( sG /usr/lib/python2.7/site-packages/IPython/parallel/client/asyncresult.pyt getY s c C s" | j � s t j d � � n d S( Ns Result not ready.( R1 R R ( R ( ( sG /usr/lib/python2.7/site-packages/IPython/parallel/client/asyncresult.pyt _check_readyl s c C s9 | j s | j d � n | j s2 | j d � n | j S( s& Return whether the call has completed.i ( R R R" t _wait_for_outputs( R ( ( sG /usr/lib/python2.7/site-packages/IPython/parallel/client/asyncresult.pyR1 p s c C s� | j r | j | � d S| j j | j | � | _ | j r�z� y� t t | j j j | j � � } | | _ | j r� | d } t | t � r� | � q� n t j | | j � } | j | � | _ Wn% t k r� } | | _ t | _ n Xt | _ Wd | d k s| d k rd } n | j | � | j r�g | j D] } | j j j | � ^ q:| _ g | j D] } | j j j | � ^ qhn Xn d S( sv Wait until the result is available or until `timeout` seconds pass. This method always returns None. Ni i ( R R7 R R R t listt mapt resultsR5 R2 R R t ExceptionR t collect_exceptionsR R0 R3 R R# R R R! R$ t popR% ( R R4 R: t rt et mid( ( sG /usr/lib/python2.7/site-packages/IPython/parallel/client/asyncresult.pyR y s2 ! .c C s | j S( s� Return whether the call completed without raising an exception. Will raise ``AssertionError`` if the result is not ready. ( R# ( R ( ( sG /usr/lib/python2.7/site-packages/IPython/parallel/client/asyncresult.pyt successful� s c C s� | j | � } | j r$ | g } n g | j D] } | d ^ q. } i } xU t | | � D]D \ } } | | k r� t d | j | � | f � � qZ | | | <qZ W| S( sj Get the results as a dict, keyed by engine_id. timeout behavior is described in `get()`. t engine_ids, Cannot build dict, %i jobs ran on engine #%i( R5 R R% t zipt ValueErrort count( R R4 R: t mdt engine_idst rdictRB t result( ( sG /usr/lib/python2.7/site-packages/IPython/parallel/client/asyncresult.pyt get_dict� s c C s | j � S( s. result property wrapper for `get(timeout=-1)`.( R5 ( R ( ( sG /usr/lib/python2.7/site-packages/IPython/parallel/client/asyncresult.pyRI � s c C s | j r | j d S| j Sd S( s* property for accessing execution metadata.i N( R R% ( R ( ( sG /usr/lib/python2.7/site-packages/IPython/parallel/client/asyncresult.pyR$ � s c C s | j � S( s result property as a dict.( RJ ( R ( ( sG /usr/lib/python2.7/site-packages/IPython/parallel/client/asyncresult.pyt result_dict� s c C s | j d � S( Ni ( RJ ( R ( ( sG /usr/lib/python2.7/site-packages/IPython/parallel/client/asyncresult.pyt __dict__� s c C s" | j j | j d | j d t �S( s abort my tasks.R( t block( R t abortR R R ( R ( ( sG /usr/lib/python2.7/site-packages/IPython/parallel/client/asyncresult.pyRN � s c C s | j j S( s) check whether my messages have been sent.( R t done( R ( ( sG /usr/lib/python2.7/site-packages/IPython/parallel/client/asyncresult.pyt sent� s c C s | j j | � S( s� wait for pyzmq send to complete. This is necessary when sending arrays that you intend to edit in-place. `timeout` is in seconds, and will raise TimeoutError if it is reached before the send completes. ( R R ( R R4 ( ( sG /usr/lib/python2.7/site-packages/IPython/parallel/client/asyncresult.pyt wait_for_send� s c C s� t | t � r: | j � t j | j | g | j � d St | t � rm | j � t j | j | | j � St | t � r� | j d � g | j D] } | | ^ q� } | j r� | d S| Sn t d t | � � � d S( sZ getitem returns result value(s) if keyed by int/slice, or metadata if key is str. i s4 Invalid key type %r, must be 'int','slice', or 'str'N( R t intR6 R R< R2 R t sliceR R R% R t TypeErrort type( R t keyRF t values( ( sG /usr/lib/python2.7/site-packages/IPython/parallel/client/asyncresult.pyt __getitem__� s ! c C sN y | j | � SWn6 t j t f k rI t d | j j | f � � n Xd S( s? getattr maps to getitem for convenient attr access to metadata.s %r object has no attribute %rN( RX R R t KeyErrort AttributeErrorR, R- ( R RV ( ( sG /usr/lib/python2.7/site-packages/IPython/parallel/client/asyncresult.pyt __getattr__ s c c s� | j r t d � � n y | j d � } WnK t j k rx xN | j D]) } t | j | | j � } | j � VqH Wn Xx | D] } | Vq� Wd S( Ns3 AsyncResults with a single result are not iterable.i ( R RT R5 R R R R R R ( R t rlistt msg_idt arR> ( ( sG /usr/lib/python2.7/site-packages/IPython/parallel/client/asyncresult.pyt __iter__ s c C s t | j � S( N( t lenR ( R ( ( sG /usr/lib/python2.7/site-packages/IPython/parallel/client/asyncresult.pyt __len__ s c C sJ t | t � s | | � } n t | t � s< | | � } n | | j � S( s, compute the difference between two sets of timestamps The default behavior is to use the earliest of the first and the latest of the second list, but this can be changed by passing a different Parameters ---------- start : one or more datetime objects (e.g. ar.submitted) end : one or more datetime objects (e.g. ar.received) start_key : callable Function to call on `start` to extract the relevant entry [defalt: min] end_key : callable Function to call on `end` to extract the relevant entry [default: max] Returns ------- dt : float The time elapsed (in seconds) between the two selected timestamps. ( R R t total_seconds( R t startt endt start_keyt end_key( ( sG /usr/lib/python2.7/site-packages/IPython/parallel/client/asyncresult.pyt timedelta$ s c C s9 | j d � t | � t t | j � j | j j � � S( s� the number of tasks which have been completed at this point. Fractional progress would be given by 1.0 * ar.progress / len(ar) i ( R R` t setR t intersectionR t outstanding( R ( ( sG /usr/lib/python2.7/site-packages/IPython/parallel/client/asyncresult.pyt progressG s c C s� | j � r | j St j � } } xU | j D]J } | | j j k r- | j j | d } | rw | | k rw | } qw q- q- W| | j � S( s% elapsed time since initial submissiont submitted( R1 t wall_timeR t nowR R R$ Rb ( R Rn Rl R] t stamp( ( sG /usr/lib/python2.7/site-packages/IPython/parallel/client/asyncresult.pyt elapsedP s c C s: d } x- | j D]" } | | d | d j � 7} q W| S( s� serial computation time of a parallel calculation Computed as the sum of (completed-started) of each task i t completedt started( R% Rb ( R t tRF ( ( sG /usr/lib/python2.7/site-packages/IPython/parallel/client/asyncresult.pyt serial_time^ s c C s | j | j | j � S( s actual computation time of a parallel calculation Computed as the time between the latest `received` stamp and the earliest `submitted`. Only reliable if Client was spinning/waiting when the task finished, because the `received` timestamp is created when a result is pulled off of the zmq queue, which happens as a result of `client.spin()`. For similar comparison of other timestamp pairs, check out AsyncResult.timedelta. ( Rg Rl t received( R ( ( sG /usr/lib/python2.7/site-packages/IPython/parallel/client/asyncresult.pyRm j s g �?c C s� | d k r d } n t | � } t j � } x} | j � r� | d k s_ t j � | | k r� | j | � t d t � t d | j | | j f d d �t j j � q0 Wt � t d � d S( s8 interactive wait, printing progress at regular intervalsi����i R s! %4i/%i tasks finished after %4i sRd t RO N( R R` t timeR1 R R R t printRk Rp t syst stdoutt flush( R t intervalR4 t Nt tic( ( sG /usr/lib/python2.7/site-packages/IPython/parallel/client/asyncresult.pyt wait_interactive{ s 2 #c C s] y t � } Wn t k r! d SX| d p/ i } | | d <| j j d | d d | � d S( s- republish individual displaypub content dictsNR$ t enginet data( t get_ipythont NameErrort display_pubt publish( R t contentt eidt ipRF ( ( sG /usr/lib/python2.7/site-packages/IPython/parallel/client/asyncresult.pyt _republish_displaypub� s Rv c C s� | s d S| d k r" t j } n | j d � r7 d n d } | j d � t | j d � � k } | r� | r� | j d � r� | d } n t d | | f d | d | �d S( Ns Rv s %s%st fileRd ( R Ry Rz t endswithRE RR t startswithRx ( R t textt prefixR� Rd t multiline( ( sG /usr/lib/python2.7/site-packages/IPython/parallel/client/asyncresult.pyt _display_stream� s $ c C s� | j | j � | j | j d t j �y t � Wn t k rH d SXx$ | j D] } | j | | j � qS W| j d k r� t | j � � n d S( NR� ( R� Rz t stderrRy R� R� t outputsR� RB t execute_resultR R R5 ( R t output( ( sG /usr/lib/python2.7/site-packages/IPython/parallel/client/asyncresult.pyt _display_single_result� s c C s� | j s | j r d S| d k r, d } n t j � } xx t r� | j j | j j � t d � | j D� � | _ | j s� | d k r� t j � | | k r� Pn t j d � q; Wd S( sN wait for the 'status=idle' message that indicates we have all outputs Ni����c s s | ] } | d Vq d S( t outputs_readyN( ( t .0RF ( ( sG /usr/lib/python2.7/site-packages/IPython/parallel/client/asyncresult.pys <genexpr>� s i g{�G�z�?( R" R# R Rw R R t _flush_iopubt _iopub_sockett allR% t sleep( R R4 R~ ( ( sG /usr/lib/python2.7/site-packages/IPython/parallel/client/asyncresult.pyR7 � s "RU c C s= | j r | j � d S| j } | j } | j } | j } | j � } | j } | d k rEx�t | | | | | | � D]� \ } } } } } } | j | d | � | j | d | d t j �y t � Wn t k r� d SX| s� | d k rt d | � n x | D] } | j | | � q W| d k rx t | � qx qx Wn�| d k r)x1 t | | � D] \ } } | j | d | � qaWx: t | | � D]) \ } } | j | d | d t j �q�Wy t � Wn t k r�d SX| d k r�t d � t | | � D� � } t d � | D� � } x� t | � D]X } xO | D]G } | | } t | � | k r=t d | � | j | | | � q=q=Wq0WnX xU t | | � D]D \ } } | r�t d | � n x | D] } | j | | � q�Wq�WxO t | | | � D]( \ } } } | d k r�t | � q�q�Wn t d | � � d S( s� republish the outputs of the computation Parameters ---------- groupby : str [default: type] if 'type': Group outputs by type (show all stdout, then all stderr, etc.): [stdout:1] foo [stdout:2] foo [stderr:1] bar [stderr:2] bar if 'engine': Display outputs for each engine before moving on to the next: [stdout:1] foo [stderr:1] bar [stdout:2] foo [stderr:2] bar if 'order': Like 'type', but further collate individual displaypub outputs. This is meant for cases of each command producing several plots, and you would like to see all of the first plots together, then all of the second plots, and so on. NR� s [stdout:%i] s [stderr:%i] R� s [output:%i]RU t orderc s s! | ] \ } } | | f Vq d S( N( ( R� R� R� ( ( sG /usr/lib/python2.7/site-packages/IPython/parallel/client/asyncresult.pys <genexpr> s c s s | ] } t | � Vq d S( N( R` ( R� R� ( ( sG /usr/lib/python2.7/site-packages/IPython/parallel/client/asyncresult.pys <genexpr> s s: groupby must be one of 'type', 'engine', 'collate', not %r( s typeR� ( R R� Rz R� R� R� R5 RB RC R� Ry R� R� R R R� R t dictt maxt rangeR` RD ( R t groupbyt stdoutst stderrst execute_resultst output_listsR: R( R� Rz R� R� R> R� R� t output_dictR} t i( ( sG /usr/lib/python2.7/site-packages/IPython/parallel/client/asyncresult.pyt display_outputs� sf . ! " " N(. R- t __module__t __doc__R R R R R R R! R+ R. R0 R5 R6 R1 R RA RJ t propertyRI R> R$ RK RL RN RP RQ RX R[ R_ Ra t minR� Rg Rk Rp R Rt Rm R R� R� R� R7 R� ( ( ( sG /usr/lib/python2.7/site-packages/IPython/parallel/client/asyncresult.pyR # sT & # t AsyncMapResultc B sA e Z d Z d e d � Z d � Z d � Z d � Z d � Z RS( sZ Class for representing results of non-blocking gathers. This will properly reconstruct the gather. This class is iterable at any time, and will wait on results as they come. If ordered=False, then the first results to arrive will come first, otherwise results will be yielded in the order they were submitted. Rv c C s8 t j | | | d | �| | _ t | _ | | _ d S( NR' ( R R+ t _mapObjectR R t ordered( R R& R t mapObjectR' R� ( ( sG /usr/lib/python2.7/site-packages/IPython/parallel/client/asyncresult.pyR+ = s c C s | j j | � S( s) Perform the gather on the actual results.( R� t joinPartitions( R R/ ( ( sG /usr/lib/python2.7/site-packages/IPython/parallel/client/asyncresult.pyR0 C s c c s8 | j r | j n | j } x | � D] } | Vq% Wd S( N( R� t _ordered_itert _unordered_iter( R t itR> ( ( sG /usr/lib/python2.7/site-packages/IPython/parallel/client/asyncresult.pyR_ H s c c s� y | j d � } Wn t j k r� x� | j D]] } t | j | | j � } | j � } y x | D] } | Vqd WWq0 t k r� | Vq0 Xq0 Wn Xx | D] } | Vq� Wd S( sC iterator for results *as they arrive*, preserving submission order.i N( R5 R R R R R R RT ( R R\ R] R^ R> ( ( sG /usr/lib/python2.7/site-packages/IPython/parallel/client/asyncresult.pyR� N s c c s" y | j d � } Wn� t j k rt | j � } x� | ry | j j | d � Wn t j k rk n X| j | j j � } | j | � } xm | r� | j � } t | j | | j � } | j � } y x | D] } | Vq� WWq� t k r� | Vq� Xq� Wq8 Wn Xx | D] } | VqWd S( sP iterator for results *as they arrive*, on FCFS basis, ignoring submission order.i g����MbP?N( R5 R R Rh R R R t differenceRj R= R R RT ( R R\ t pendingR1 R] R^ R> ( ( sG /usr/lib/python2.7/site-packages/IPython/parallel/client/asyncresult.pyR� e s, ( R- R� R� R R+ R0 R_ R� R� ( ( ( sG /usr/lib/python2.7/site-packages/IPython/parallel/client/asyncresult.pyR� 1 s t AsyncHubResultc B s& e Z d Z d d � Z d d � Z RS( s� Class to wrap pending results that must be requested from the Hub. Note that waiting/polling on these objects requires polling the Hubover the network, so use `AsyncHubResult.wait()` sparingly. i����c C s t | _ d S( s. no-op, because HubResults are never incompleteN( R R" ( R R4 ( ( sG /usr/lib/python2.7/site-packages/IPython/parallel/client/asyncresult.pyR7 � s c C s� t j � } | j r d Sg | j D] } | | j j k r# | ^ q# } | j j | | � } | r@g | j D] } | | j j k rl | ^ ql } | s� t | _ q@| j j | d t �} | d } xd | r*| d k s� t j � | | k r*| j j | d t �} | d } | r� t j d � q� q� W| s@t | _ q@n | j r�z� y� t t | j j j | j � � } | | _ | j r�| d } t | t � r�| � q�n t j | | j � } | j | � | _ Wn% t k r�} | | _ t | _ n Xt | _ Wd g | j D] } | j j | ^ q| _ | j r�g | j D] } | j j j | � ^ q@g | j D] } | j j j | � ^ qin Xn d S( s wait for result to complete.Nt status_onlyR� i g�������?( Rw R R R Rj R R: R t result_statusR R� R8 R9 R5 R2 R R R; R R< R R0 R3 R# R$ R% R! R= ( R R4 Rc t mt local_idst local_readyt remote_idsRH R� R: R> R? R@ ( ( sG /usr/lib/python2.7/site-packages/IPython/parallel/client/asyncresult.pyR � sJ .. + ! ) )( R- R� R� R7 R ( ( ( sG /usr/lib/python2.7/site-packages/IPython/parallel/client/asyncresult.pyR� � s ( R� t __future__R Ry Rw R t zmqR t IPython.core.displayR R R t IPython.external.decoratorR t IPython.parallelR t IPython.utils.py3compatR R R R t objectR R� R� t __all__( ( ( sG /usr/lib/python2.7/site-packages/IPython/parallel/client/asyncresult.pyt <module> s$ � � W7
Copyright ©2021 || Defacer Indonesia