whoami7 - Manager
:
/
lib
/
python2.7
/
site-packages
/
IPython
/
parallel
/
client
/
Upload File:
files >> //lib/python2.7/site-packages/IPython/parallel/client/view.pyc
� M�UVc @ s� d Z d d l m Z d d l Z d d l Z d d l Z d d l m Z d d l m Z d d l Z d d l m Z d d l m Z d d l m Z m Z m Z m Z m Z m Z m Z m Z m Z d d l m Z d d l m Z d d l m Z m Z d d l m! Z! m" Z" m# Z# d d l$ m% Z& d d l' m( Z( m) Z) d d l* m+ Z+ m, Z, m- Z- m. Z. e d � � Z/ e d � � Z0 e d � � Z1 e d e f d � � Y� Z2 e d e2 f d � � Y� Z3 e d e2 f d � � Y� Z4 d d g Z5 d S( s Views of remote engines.i����( t print_functionN( t contextmanager( t ModuleType( t skip_doctest( t pickleutil( t HasTraitst Anyt Boolt Listt Dictt Sett Instancet CFloatt Integer( t decorator( t util( t Dependencyt dependent( t string_typest iteritemst PY3i ( t map( t AsyncResultt AsyncMapResult( t ParallelFunctiont parallelt remotet getnamec O sw t | j j � } z | | | | � } Wd t | j j � | } | j j | } | j j | � | j j | � X| S( sK Keep our history and outstanding attributes up to date after a method call.N( t lent clientt historyt extendt outstandingt update( t ft selft argst kwargst n_previoust rett nmsgst msg_ids( ( s@ /usr/lib/python2.7/site-packages/IPython/parallel/client/view.pyt save_ids# s c O sS | j r | | | | � St | _ z | | | | � } Wd t | _ | j � X| S( s@ sync relevant results from self.client to our results attribute.N( t _in_sync_resultst Truet Falset _sync_results( R" R# R$ R% R' ( ( s@ /usr/lib/python2.7/site-packages/IPython/parallel/client/view.pyt sync_results0 s c O s | | | | � } | j � | S( s call spin after the method.( t spin( R" R# R$ R% R' ( ( s@ /usr/lib/python2.7/site-packages/IPython/parallel/client/view.pyt spin_after= s t Viewc B s� e Z d Z e e � Z e e � Z e � Z e � Z e � Z e � Z e d � Z e d � Z e d d d g � Z e e � Z e � Z e � Z d d d � Z d � Z d � Z d � Z e d � � Z d � Z e e d d � � � Z! d � Z" d � Z# e$ d � � Z% e d � � Z& e d d d � � Z' d d d d � Z( d e d � Z) g g d � Z* d e e d d � Z+ e$ d d e d � � Z, e d � � Z- d � Z. d � Z/ d � Z0 d d � Z1 d d d � Z2 RS( sV Base View class for more convenint apply(f,*args,**kwargs) syntax via attributes. Don't use this class, use subclasses. Methods ------- spin flushes incoming results and registration state changes control methods spin, and requesting `ids` also ensures up to date wait wait on one or more msg_ids execution methods apply legacy: execute, run data movement push, pull, scatter, gather query methods get_result, queue_status, purge_results, result_status control methods abort, shutdown s IPython.parallel.Clients zmq.Sockett targetst blockt trackc K sc t t | � j d | d | � | j | _ | j | _ | j | � | j t k s_ t d � � d S( NR t _sockets+ Don't use base View objects, use subclasses( t superR2 t __init__t resultsR4 t set_flagst __class__t AssertionError( R# R t sockett flags( ( s@ /usr/lib/python2.7/site-packages/IPython/parallel/client/view.pyR8 v s c C sF t | j � } t | � d k r2 | d d } n d | j j | f S( Ni i s ...]s <%s %s>( t strR3 R R; t __name__( R# t strtargets( ( s@ /usr/lib/python2.7/site-packages/IPython/parallel/client/view.pyt __repr__ s c C sF t | j t � r t | j � St | j t � r5 d St | j � Sd S( Ni ( t isinstanceR3 t listR t intR ( R# ( ( s@ /usr/lib/python2.7/site-packages/IPython/parallel/client/view.pyt __len__� s c K sS xL t | � D]> \ } } | | j k r; t d | � � q t | | | � q Wd S( s� set my attribute flags by keyword. Views determine behavior with a few attributes (`block`, `track`, etc.). These attributes can be set all at once by name with this method. Parameters ---------- block : bool whether to wait for results track : bool whether to create a MessageTracker to allow the user to safely edit after arrays and buffers during non-copying sends. s Invalid name: %rN( R t _flag_namest KeyErrort setattr( R# R% t namet value( ( s@ /usr/lib/python2.7/site-packages/IPython/parallel/client/view.pyR: � s c k sX i } x$ | j D] } t | | � | | <q W| j | � z d VWd | j | � Xd S( s� temporarily set flags, for use in `with` statements. See set_flags for permanent setting of flags Examples -------- >>> view.track=False ... >>> with view.temp_flags(track=True): ... ar = view.apply(dostuff, my_big_array) ... ar.tracker.wait() # wait for send to finish >>> view.track False N( RG t getattrR: ( R# R% t saved_flagsR" ( ( s@ /usr/lib/python2.7/site-packages/IPython/parallel/client/view.pyt temp_flags� s c C sC | j j | j j � } | j j | � } | j j | � | _ d S( s] to be called by @sync_results decorator after submitting any tasks. N( R t differenceR t intersection( R# t deltat completed( ( s@ /usr/lib/python2.7/site-packages/IPython/parallel/client/view.pyR. � s c K s t d � � d S( s% wrapper for client.send_apply_requests Implement in subclassesN( t NotImplementedError( R# R" R$ R% R4 t options( ( s@ /usr/lib/python2.7/site-packages/IPython/parallel/client/view.pyt _really_apply� s c O s | j | | | � S( sJ calls ``f(*args, **kwargs)`` on remote engines, returning the result. This method sets all apply flags via this View's attributes. Returns :class:`~IPython.parallel.client.asyncresult.AsyncResult` instance if ``self.block`` is False, otherwise the return value of ``f(*args, **kwargs)``. ( RU ( R# R" R$ R% ( ( s@ /usr/lib/python2.7/site-packages/IPython/parallel/client/view.pyt apply� s c O s | j | | | d t �S( s� calls ``f(*args, **kwargs)`` on remote engines in a nonblocking manner. Returns :class:`~IPython.parallel.client.asyncresult.AsyncResult` instance. R4 ( RU R- ( R# R" R$ R% ( ( s@ /usr/lib/python2.7/site-packages/IPython/parallel/client/view.pyt apply_async� s c O s | j | | | d t �S( sl calls ``f(*args, **kwargs)`` on remote engines in a blocking manner, returning the result. R4 ( RU R, ( R# R" R$ R% ( ( s@ /usr/lib/python2.7/site-packages/IPython/parallel/client/view.pyt apply_sync� s c C s | j j � d S( s spin the client, and syncN( R R0 ( R# ( ( s@ /usr/lib/python2.7/site-packages/IPython/parallel/client/view.pyR0 � s i����c C s+ | d k r | j } n | j j | | � S( sc waits on one or more `jobs`, for up to `timeout` seconds. Parameters ---------- jobs : int, str, or list of ints and/or strs, or one or more AsyncResult objects ints are indices to self.history strs are msg_ids default: wait on all outstanding messages timeout : float a time in seconds, after which to give up. default is -1, which means no timeout Returns ------- True : when all msg_ids are done False : timeout reached, some msg_ids still outstanding N( t NoneR R t wait( R# t jobst timeout( ( s@ /usr/lib/python2.7/site-packages/IPython/parallel/client/view.pyRZ � s c C sv | d k r | n | j } | d k r- | n | j } | d k rH | n t | j � } | j j d | d | d | � S( s� Abort jobs on my engines. Parameters ---------- jobs : None, str, list of strs, optional if None: abort all jobs. else: abort specific msg_id(s). R[ R3 R4 N( RY R4 R3 RD R R t abort( R# R[ R3 R4 ( ( s@ /usr/lib/python2.7/site-packages/IPython/parallel/client/view.pyR] s !c C s4 | d k r | n | j } | j j d | d | � S( s$ Fetch the Queue status of my enginesR3 t verboseN( RY R3 R t queue_status( R# R3 R^ ( ( s@ /usr/lib/python2.7/site-packages/IPython/parallel/client/view.pyR_ s c C s= | d k s | d k r$ | j } n | j j d | d | � S( s3 Instruct the controller to forget specific results.t allR[ R3 N( RY R3 R t purge_results( R# R[ R3 ( ( s@ /usr/lib/python2.7/site-packages/IPython/parallel/client/view.pyRa $ s c C sd | d k r | j n | } | d k s3 | d k r? | j } n | j j d | d | d | d | � S( sO Terminates one or more engine processes, optionally including the hub. R` R3 t restartt hubR4 N( RY R4 R3 R t shutdown( R# R3 Rb Rc R4 ( ( s@ /usr/lib/python2.7/site-packages/IPython/parallel/client/view.pyRd * s c C s� | d k r d } n t | t � r4 | j | } ng t | t t t f � r� t | � } x@ t | � D]/ \ } } t | t � re | j | | | <qe qe Wn | j j | d | d | �S( s� return one or more results, specified by history index or msg_id. See :meth:`IPython.parallel.client.client.Client.get_result` for details. i����R4 t ownerN( RY RC RE R RD t tuplet sett enumerateR t get_result( R# t indices_or_msg_idsR4 Re t it index( ( s@ /usr/lib/python2.7/site-packages/IPython/parallel/client/view.pyRi 2 s c O s t � d S( s override in subclassesN( RS ( R# R" t sequencesR% ( ( s@ /usr/lib/python2.7/site-packages/IPython/parallel/client/view.pyR H s c O s8 d | k r t d � � n t | d <| j | | | � S( s� Parallel version of builtin :func:`python:map`, using this view's engines. This is equivalent to ``map(...block=False)``. See `self.map` for details. R4 s2 map_async doesn't take a `block` keyword argument.( t TypeErrorR- R ( R# R" Rm R% ( ( s@ /usr/lib/python2.7/site-packages/IPython/parallel/client/view.pyt map_asyncM s c O s8 d | k r t d � � n t | d <| j | | | � S( s� Parallel version of builtin :func:`python:map`, using this view's engines. This is equivalent to ``map(...block=True)``. See `self.map` for details. R4 s1 map_sync doesn't take a `block` keyword argument.( Rn R, R ( R# R" Rm R% ( ( s@ /usr/lib/python2.7/site-packages/IPython/parallel/client/view.pyt map_syncY s c O s t | j | | | � � S( sZ Parallel version of :func:`itertools.imap`. See `self.map` for details. ( t iterRo ( R# R" Rm R% ( ( s@ /usr/lib/python2.7/site-packages/IPython/parallel/client/view.pyt imape s c K s. | d k r | j n | } t | d | | �S( s% Decorator for making a RemoteFunctionR4 N( RY R4 R ( R# R4 R> ( ( s@ /usr/lib/python2.7/site-packages/IPython/parallel/client/view.pyR r s t bc K s4 | d k r | j n | } t | d | d | | �S( s' Decorator for making a ParallelFunctiont distR4 N( RY R4 R ( R# Rt R4 R> ( ( s@ /usr/lib/python2.7/site-packages/IPython/parallel/client/view.pyR w s N(3 R@ t __module__t __doc__R R- R4 R, R5 R R3 R R R R R R9 R R R6 RG R+ t _targetst _identsRY R8 RB RF R: R RN R. R/ R* RU RV RW R1 RX R0 RZ R] R_ Ra Rd Ri R Ro Rp Rr R R ( ( ( s@ /usr/lib/python2.7/site-packages/IPython/parallel/client/view.pyR2 H sP # t DirectViewc B sL e Z d Z d d d d � Z e d � � Z e e e d � � Z d � Z d � Z e e d d d d d d � � � Z e d � � Z e e e d d d � � � Z d d d � Z d � Z d d d d � Z d � Z d d d � Z d e d d d d � Z e e d d d d � � � Z d � Z d � Z d d d � Z d d � Z RS( sh Direct Multiplexer View of one or more engines. These are created via indexed access to a client: >>> dv_1 = client[1] >>> dv_all = client[:] >>> dv_even = client[::2] >>> dv_some = client[1:3] This object provides dictionary access to engine namespaces: # push a=5: >>> dv['a'] = 5 # pull 'foo': >>> dv['foo'] c C s) t t | � j d | d | d | � d S( NR R= R3 ( R7 Ry R8 ( R# R R= R3 ( ( s@ /usr/lib/python2.7/site-packages/IPython/parallel/client/view.pyR8 � s c C s | j t � S( sX sync_imports(local=True) as a property. See sync_imports for details. ( t sync_importsR, ( R# ( ( s@ /usr/lib/python2.7/site-packages/IPython/parallel/client/view.pyt importer� s c # s� d d l m � � j � t � � g � t j d � � � i i g d � � � � � � � � f d � } | � _ z- y d VWn t k r� � r� � q� n XWd � � _ Xx � D] } | j � q� Wd S( sA Context Manager for performing simultaneous local and remote imports. 'import x as y' will *not* work. The 'as y' part will simply be ignored. If `local=True`, then the package will also be imported locally. If `quiet=True`, no output will be produced when attempting remote imports. Note that remote-only (`local=False`) imports have not been implemented. >>> with view.sync_imports(): ... from numpy import recarray importing recarray from numpy on engine(s) i����( t builtin_modc S so d d l } t � } t | d | d | �} | rZ x5 | D] } t | | � | | <q: Wn | j | | | <d S( s� the function to be passed to apply, that actually performs the import on the engine, and loads up the user namespace. i����Nt fromlistt level( t syst globalst __import__RL t modules( RJ R} R~ R t user_nst modt key( ( s@ /usr/lib/python2.7/site-packages/IPython/parallel/client/view.pyt remote_import� s i c s# � j } � � _ t j � r4 � | | | | | � St j � � r_ � | | | | | � } n t d � � t j � | d d j | p� g � } | d k r| � k r� j | � � s� | r� t d d j | � | f � q� t d | � n � j � j � | | | � � n | � _ | S( si the drop-in replacement for __import__, that optionally imports locally as well. s' remote-only imports not yet implementedt :t ,i s! importing %s from %s on engine(s)s importing %s on engine(s)( R� t impt lock_heldt acquire_lockRS t release_lockt joint addt printt appendRW ( RJ R� t localsR} R~ t save_importR� R� ( R| t localt local_importR� t quietR� R9 R# ( s@ /usr/lib/python2.7/site-packages/IPython/parallel/client/view.pyt view_import� s& " N( t IPython.utils.py3compatR| R� Rg R t interactivet ImportErrort get( R# R� R� R� t r( ( R| R� R� R� R� R� R9 R# s@ /usr/lib/python2.7/site-packages/IPython/parallel/client/view.pyRz � s" 0# c C s t j � | j t j � S( s� Expand serialization support with dill adds support for closures, etc. This calls IPython.utils.pickleutil.use_dill() here and on each engine. ( R t use_dillRV ( R# ( ( s@ /usr/lib/python2.7/site-packages/IPython/parallel/client/view.pyR� � s c C s t j � | j t j � S( s7 Expand serialization support with cloudpickle. ( R t use_cloudpickleRV ( R# ( ( s@ /usr/lib/python2.7/site-packages/IPython/parallel/client/view.pyR� � s c C s� | d k r g n | } | d k r* i n | } | d k rE | j n | } | d k r` | j n | } | d k r{ | j n | } | j j | � \ } } g } g } xg | D]_ } | j j | j | | | d | d | �} | r� | j | d � n | j | d d � q� Wt | t � r+| d } n | t k r=d n t j | � } t | j | d t | � d | d | d t �} | r�y | j � SWq�t k r�q�Xn | S( s� calls f(*args, **kwargs) on remote engines, returning the result. This method sets all of `apply`'s flags via this View's attributes. Parameters ---------- f : callable args : list [default: empty] kwargs : dict [default: empty] targets : target list [default: self.targets] where to run block : bool [default: self.block] whether to block track : bool [default: self.track] whether to ask zmq to track the message, for safe non-copying sends Returns ------- if self.block is False: returns AsyncResult else: returns actual result of f(*args, **kwargs) on the engine(s) This will be a list of self.targets is also a list (even length 1), or the single result if self.targets is an integer engine id R5 t identt trackert headert msg_idi t fnameR3 Re N( RY R4 R5 R3 R t _build_targetst send_apply_requestR6 R� RC RE R- t zmqt MessageTrackerR R R, R� t KeyboardInterrupt( R# R" R$ R% R3 R4 R5 Rx Rw R) t trackersR� t msgR� t ar( ( s@ /usr/lib/python2.7/site-packages/IPython/parallel/client/view.pyRU s2 ! ! !! c O s� | j d | j � } x3 | j � D]% } | d k r" t d | � � q" q" Wt | � d k si t d � � t | | d | | �} | j | � S( s5 ``view.map(f, *sequences, block=self.block)`` => list|AsyncMapResult Parallel version of builtin `map`, using this View's `targets`. There will be one task per target, so work will be chunked if the sequences are longer than `targets`. Results can be iterated as they are ready, but will become available in chunks. Parameters ---------- f : callable function to be mapped *sequences: one or more sequences of matching length the sequences to be distributed and passed to `f` block : bool whether to wait for the result or not [default self.block] Returns ------- If block=False An :class:`~IPython.parallel.client.asyncresult.AsyncMapResult` instance. An object like AsyncResult, but which reassembles the sequence of results into a single list. AsyncMapResults can be iterated through before all results are complete. else A list, the result of ``map(f,*sequences)`` R4 R5 s invalid keyword arg, %ri s% must have some sequences to map onto!( s blocks track( t popR4 t keysRn R R< R R ( R# R" Rm R% R4 t kt pf( ( s@ /usr/lib/python2.7/site-packages/IPython/parallel/client/view.pyR D s " c C s | d k r | j n | } | d k r0 | j n | } | j j | � \ } } g } g } xG | D]? } | j j | j | d | d | �} | j | d d � qa Wt | t � r� | d } n t | j | d d d | d t �} | ry | j � Wqt k r qXn | S( si Executes `code` on `targets` in blocking or nonblocking manner. ``execute`` is always `bound` (affects engine namespace) Parameters ---------- code : str the code string to be executed block : bool whether or not to wait until done to return default: self.block t silentR� R� R� i R� t executeR3 Re N( RY R4 R3 R R� t send_execute_requestR6 R� RC RE R R, R� R� ( R# t codeR� R3 R4 Rx Rw R) R� R� R� R� ( ( s@ /usr/lib/python2.7/site-packages/IPython/parallel/client/view.pyR� o s" $ $ c C sA t | d � � } | j � d } Wd QX| j | d | d | �S( s� Execute contents of `filename` on my engine(s). This simply reads the contents of the file and calls `execute`. Parameters ---------- filename : str The path to the file targets : int/str/list of ints/strs the engines on which to execute default : all block : bool whether or not to wait until done default: self.block R� s NR4 R3 ( t opent readR� ( R# t filenameR3 R4 R" R� ( ( s@ /usr/lib/python2.7/site-packages/IPython/parallel/client/view.pyt run� s c C s | j | d | j d | j �S( sP update remote namespace with dict `ns` See `push` for details. R4 R5 ( t pushR4 R5 ( R# t ns( ( s@ /usr/lib/python2.7/site-packages/IPython/parallel/client/view.pyR! � s c C s� | d k r | n | j } | d k r- | n | j } | d k rH | n | j } t | t � sy t d t | � � � n | j t j d | d | d | d | �S( s update remote namespace with dict `ns` Parameters ---------- ns : dict dict of keys with which to update engine namespace(s) block : bool [default : self.block] whether to wait to be notified of engine receipt s Must be a dict, not %sR% R4 R5 R3 N( RY R4 R5 R3 RC t dictRn t typeRU R t _push( R# R� R3 R4 R5 ( ( s@ /usr/lib/python2.7/site-packages/IPython/parallel/client/view.pyR� � s c C s | j | d t �S( sX get object(s) by `key_s` from remote namespace see `pull` for details. R4 ( t pullR, ( R# t key_s( ( s@ /usr/lib/python2.7/site-packages/IPython/parallel/client/view.pyR� � s c C s� | d k r | n | j } | d k r- | n | j } | rE | j n | j } t | t � r` nd t | t t t f � r� xI | D]. } t | t � s t d t | � � � q q Wn t d | � � | j t j | f d | d | �S( s� get object(s) by `name` from remote namespace will return one object if it is a key. can also take a list of keys, in which case it will return a list of objects. s keys must be str, not type %rs names must be strs, not %rR4 R3 N( RY R4 R3 RX RW RC R RD Rf Rg Rn R� RU R t _pull( R# t namesR3 R4 t applierR� ( ( s@ /usr/lib/python2.7/site-packages/IPython/parallel/client/view.pyR� � s Rs c C s� | d k r | n | j } | d k r- | n | j } | d k rH | n | j } | j j | � d } t j | � } t | � } g } g } x� t | � D]� \ } } | j | | | � } | r� t | � d k r� i | d | 6} n i | | 6} | j | d t d | d | �} | j | j � | r� | j | j � q� q� W| r\t j | � } n d } t | j | d d d | d | d t �} | r�| j � n | Sd S( sZ Partition a Python sequence and send the partitions to a set of engines. i i R4 R5 R3 R� t scatterR� Re N( RY R4 R5 R3 R R� t Mapt distsR Rh t getPartitionR� R- R R) R� t _trackerR� R� R R, RZ ( R# R� t seqRt t flattenR3 R4 R5 t mapObjectt npartsR) R� Rl t engineidt partitionR� R� R� ( ( s@ /usr/lib/python2.7/site-packages/IPython/parallel/client/view.pyR� � s2 ! c C s� | d k r | n | j } | d k r- | n | j } t j | � } g } | j j | � d } x? t | � D]1 \ } } | j | j | d t d | �j � qo Wt | j | | d d �} | r� y | j � SWq� t k r� q� Xn | S( sZ Gather a partitioned sequence on a set of engines as a single local seq. i R4 R3 R� t gatherN( RY R4 R3 R� R� R R� Rh R R� R- R) R R� R� ( R# R� Rt R3 R4 R� R) Rl R� R� ( ( s@ /usr/lib/python2.7/site-packages/IPython/parallel/client/view.pyR� s ) c C s | j | � S( N( R� ( R# R� ( ( s@ /usr/lib/python2.7/site-packages/IPython/parallel/client/view.pyt __getitem__" s c C s | j i | | 6� d S( N( R! ( R# R� RK ( ( s@ /usr/lib/python2.7/site-packages/IPython/parallel/client/view.pyt __setitem__% s c C sO | d k r | n | j } | d k r- | n | j } | j j d | d | � S( s* Clear the remote namespaces on my engines.R3 R4 N( RY R4 R3 R t clear( R# R3 R4 ( ( s@ /usr/lib/python2.7/site-packages/IPython/parallel/client/view.pyR� ( s t c C sb d d l m } y t � } Wn t k r; t d � d SX| | | | � } | j j | � d S( s= Activate IPython magics associated with this View Defines the magics `%px, %autopx, %pxresult, %%px, %pxconfig` Parameters ---------- suffix: str [default: ''] The suffix, if any, for the magics. This allows you to have multiple views associated with parallel magics at the same time. e.g. ``rc[::2].activate(suffix='_even')`` will give you the magics ``%px_even``, ``%pxresult_even``, etc. for running magics on the even engines. i����( t ParallelMagicssA The IPython parallel magics (%px, etc.) only work within IPython.N( t IPython.parallel.client.magicsR� t get_ipythont NameErrorR� t magics_managert register( R# t suffixR� t ipt M( ( s@ /usr/lib/python2.7/site-packages/IPython/parallel/client/view.pyt activate2 s N( R@ Ru Rv RY R8 t propertyR{ R R, R- Rz R� R� R/ R* RU R R� R� R! R� R� R� R� R� R� R� R� R� ( ( ( s@ /usr/lib/python2.7/site-packages/IPython/parallel/client/view.pyRy | s6 X <+! ' t LoadBalancedViewc B s� e Z d Z e � Z e � Z e � Z e d � Z e � Z e d d d d d d d g � Z d d d � Z d � Z d � Z d � Z e e d d d d d d d d d d � � � Z e e d � � � Z RS( su An load-balancing View that only executes via the Task scheduler. Load-balanced views can be created with the client's `view` method: >>> v = client.load_balanced_view() or targets can be specified, to restrict the potential destinations: >>> v = client.load_balanced_view([1,3]) which would restrict loadbalancing to between engines 1 and 3. i R3 R4 R5 t followt afterR\ t retriesc K s2 t t | � j d | d | | � | j | _ d S( NR R= ( R7 R� R8 t _task_scheme( R# R R= R> ( ( s@ /usr/lib/python2.7/site-packages/IPython/parallel/client/view.pyR8 h s "c C s� | d k s% t | t t t f � r) t St | t t t f � ro x� | D] } t | t t f � sH t SqH Wn� t | t � r� t | j � � t t � j � j � � k r� t St | d t � s� t Sx, | d D] } t | t � s� t Sq� Wn t St S( s@ validate a dependency. For use in `set_flags`. R) N( RY RC R R R R, RD Rg Rf R- R� R� t as_dict( R# t dept d( ( s@ /usr/lib/python2.7/site-packages/IPython/parallel/client/view.pyt _validate_dependencyl s % - c C sS t | t � r | j � St | t � r/ | j S| d k r? g St t | � � Sd S( sC helper for building jsonable dependencies from various input forms.N( RC R R� R R) RY RD ( R# R� ( ( s@ /usr/lib/python2.7/site-packages/IPython/parallel/client/view.pyt _render_dependency� s c K s t t | � j | � xY d D]Q } | | k r | | } | j | � r[ t | | | � qn t d | � � q q Wd | k r| d } t | t t t d � f � s� t r� t | t � r� t d t | � � � q� n | d k r| d k rt d | � � qn | | _ n d S( s� set my attribute flags by keyword. A View is a wrapper for the Client's apply method, but with attributes that specify keyword arguments, those attributes can be set by keyword argument with this method. Parameters ---------- block : bool whether to wait for results track : bool whether to create a MessageTracker to allow the user to safely edit after arrays and buffers during non-copying sends. after : Dependency or collection of msg_ids Only for load-balanced execution (targets=None) Specify a list of msg_ids as a time-based dependency. This job will only be run *after* the dependencies have been met. follow : Dependency or collection of msg_ids Only for load-balanced execution (targets=None) Specify a list of msg_ids as a location-based dependency. This job will only be run on an engine where this dependency is met. timeout : float/int or None Only for load-balanced execution (targets=None) Specify an amount of time (in seconds) for the scheduler to wait for dependencies to be met before failing with a DependencyTimeout. retries : int Number of times a task will be retried on failure. R� R� s Invalid dependency: %rR\ s Invalid type for timeout: %ri s Invalid timeout: %sN( s follows after( R7 R� R: R� RI t ValueErrorRC RE t floatR� RY R t longRn R\ ( R# R% RJ RK t t( ( s@ /usr/lib/python2.7/site-packages/IPython/parallel/client/view.pyR: � s ' c C s� | j j rG d } | j d k r8 | d 7} | d 7} n t | � � n | j d k r� d } | sz | sz | sz | sz | r� t | � � n t | t � r� t j | t � q� n | d k r� g n | } | d k r� i n | } | d k r� | j n | } | d k r| j n | } | d k r)| j n | } | d k rD| j n | } | d k r_| j n | } | d k rz| j n | } | d k r�| j n | } t | t � s�t d t | � � � n | d k r�g } n5 | j j | � d } g | D] } | j � ^ q�} | j | � } | j | � } t d | d | d | d | d | � } | j j | j | | | d | d | �} | t k r�d n | d } t | j | d d d t | � d d d | d t �} | r�y | j � SWq�t k r�q�Xn | S( sf calls f(*args, **kwargs) on a remote engine, returning the result. This method temporarily sets all of `apply`'s flags for a single call. Parameters ---------- f : callable args : list [default: empty] kwargs : dict [default: empty] block : bool [default: self.block] whether to block track : bool [default: self.track] whether to ask zmq to track the message, for safe non-copying sends !!!!!! TODO: THE REST HERE !!!! Returns ------- if self.block is False: returns AsyncResult else: returns actual result of f(*args, **kwargs) on the engine(s) This will be a list of self.targets is also a list (even length 1), or the single result if self.targets is an integer engine id s Task farming is disabledt pures- because the pure ZMQ scheduler cannot handles disappearing engines.s7 Pure ZMQ scheduler doesn't support the following flags:s retries must be int, not %ri R� R� R\ R3 R� R5 t metadataR� R� R� R� Re N( R6 t closedR� t RuntimeErrorRC R t warningst warnt RuntimeWarningRY R4 R5 R� R� R� R\ R3 RE Rn R� R R� t decodeR� R� R� R- R R R, R� R� ( R# R" R$ R% R4 R5 R� R� R\ R3 R� R� t identsR� R� R� R� ( ( s@ /usr/lib/python2.7/site-packages/IPython/parallel/client/view.pyRU � sR % '! # c O s� | j d | j � } | j d d � } | j d t � } t | j � � } | j t d d g � � } | r� t d t | � � � n t | � d k s� t d � � t | | d | d | d | �} | j | � S( s� ``view.map(f, *sequences, block=self.block, chunksize=1, ordered=True)`` => list|AsyncMapResult Parallel version of builtin `map`, load-balanced by this View. `block`, and `chunksize` can be specified by keyword only. Each `chunksize` elements will be a separate task, and will be load-balanced. This lets individual elements be available for iteration as soon as they arrive. Parameters ---------- f : callable function to be mapped *sequences: one or more sequences of matching length the sequences to be distributed and passed to `f` block : bool [default self.block] whether to wait for the result or not track : bool whether to create a MessageTracker to allow the user to safely edit after arrays and buffers during non-copying sends. chunksize : int [default 1] how many elements should be in each task. ordered : bool [default True] Whether the results should be gathered as they arrive, or enforce the order of submission. Only applies when iterating through AsyncMapResult as results arrive. Has no effect when block=True. Returns ------- if block=False An :class:`~IPython.parallel.client.asyncresult.AsyncMapResult` instance. An object like AsyncResult, but which reassembles the sequence of results into a single list. AsyncMapResults can be iterated through before all results are complete. else A list, the result of ``map(f,*sequences)`` R4 t chunksizei t ordereds Invalid kwargs: %si s% must have some sequences to map onto!( R� R4 R, Rg R� t difference_updateRn RD R R< R R ( R# R" Rm R% R4 R� R� t keysett extra_keysR� ( ( s@ /usr/lib/python2.7/site-packages/IPython/parallel/client/view.pyR ' s 0 !N( R@ Ru Rv R R� R� R R\ R R� R� R RG RY R8 R� R� R: R/ R* RU R ( ( ( s@ /usr/lib/python2.7/site-packages/IPython/parallel/client/view.pyR� P s$ ! 9 Z(6 Rv t __future__R R� R R� t contextlibR t typesR R� t IPython.testing.skipdoctestR t IPython.utilsR t IPython.utils.traitletsR R R R R R R R R t IPython.external.decoratorR t IPython.parallelR t& IPython.parallel.controller.dependencyR R R� R R R R� R R� t asyncresultR R t remotefunctionR R R R R* R/ R1 R2 Ry R� t __all__( ( ( s@ /usr/lib/python2.7/site-packages/IPython/parallel/client/view.pyt <module> s< @ " � 4� ��
Copyright ©2021 || Defacer Indonesia