whoami7 - Manager
:
/
lib
/
python2.7
/
site-packages
/
IPython
/
parallel
/
apps
/
Upload File:
files >> //lib/python2.7/site-packages/IPython/parallel/apps/ipengineapp.pyo
� M�UVc @ sP d Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l m Z d d l m Z d d l m Z m Z m Z m Z d d l m Z d d l m Z d d l m Z d d l m Z m Z m Z d d l m Z d d l m Z d d l m Z d d l m! Z! d d l" m# Z# d d l$ m% Z% d d l& m' Z' m( Z( m) Z) m* Z* m+ Z+ m, Z, d Z- d Z. d Z/ d Z0 d e f d � � YZ1 e2 d d d d d d d d d d d! d" d# d$ d% d& d' d( d) d* d+ d, d- d. � Z3 e3 j4 e � e3 j4 e � i Z5 e5 j4 e � e5 j4 e � d/ e f d0 � � YZ6 e6 j7 Z8 e9 d1 k rLe8 � n d S(2 sD The IPython engine application Authors: * Brian Granger * MinRK i����N( t ioloop( t ProfileDir( t BaseParallelApplicationt base_aliasest base_flagst catch_config_error( t EnginePUBHandler( t IPythonKernel( t IPKernelApp( t Sessiont session_aliasest session_flags( t ZMQInteractiveShell( t Configurable( t EngineFactory( t disambiguate_ip_address( t import_item( t cast_bytes( t Boolt Unicodet Dictt Listt Floatt Instances� Start an IPython engine for parallel computing. IPython engines run in parallel and perform computations on behalf of a client and controller. A controller needs to be started before the engines. The engine can be configured using command line options or using a cluster directory. Cluster directories contain config, log and security files and are usually located in your ipython directory and named as "profile_name". See the `profile` and `profile-dir` options for details. s� ipengine --ip=192.168.0.1 --port=1000 # connect to hub at ip and port ipengine --log-to-file --log-level=DEBUG # log to a file with DEBUG verbosity sh from mpi4py import MPI as mpi mpi.size = mpi.COMM_WORLD.Get_size() mpi.rank = mpi.COMM_WORLD.Get_rank() sf from PyTrilinos import Epetra class SimpleStruct: pass mpi = SimpleStruct() mpi.rank = 0 mpi.size = 0 t MPIc B sg e Z d Z e d d e d d �Z d � Z e d d e d d �Z e i e d 6e d 6d e �Z RS( s# Configurable for MPI initializationt t configt helpsC How to enable MPI (mpi4py, pytrilinos, or empty string to disable).c C s( | j s$ | j j | d � | _ n d S( NR ( t init_scriptt default_initst get( t selft namet oldt new( ( sE /usr/lib/python2.7/site-packages/IPython/parallel/apps/ipengineapp.pyt _use_changedd s s Initialization code for MPIt mpi4pyt pytrilinos( t __name__t __module__t __doc__R t Truet useR# R R t mpi4py_initt pytrilinos_initR ( ( ( sE /usr/lib/python2.7/site-packages/IPython/parallel/apps/ipengineapp.pyR ^ s t files IPEngineApp.url_filet cs IPEngineApp.startup_commandt ss IPEngineApp.startup_scriptt urls EngineFactory.urlt sshs EngineFactory.sshservert sshkeys EngineFactory.sshkeyt ips EngineFactory.ipt transports EngineFactory.transportt ports EngineFactory.regportt locations EngineFactory.locationt timeouts EngineFactory.timeoutt mpis MPI.uset IPEngineAppc B sO e Z d Z e Z e Z e e e e e e e g � Z e d d e d d �Z e d d e d d �Z e d d e d d �Z e d d e d d �Z e d d e �Z d � Z e d d e d d �Z e e � Z e e � Z e e � Z e d � � Z d � Z! d � Z" d � Z# d � Z$ d � Z% d � Z& e' d d � � Z) d � Z* RS( t ipengineu R R s% specify a script to be run at startupR s& specify a command to be run at startups The full location of the file containing the connection information for the controller. If this is not given, the file must be in the security directory of the cluster directory. This location is resolved using the `profile` or `profile_dir` options.i s The maximum number of seconds to wait for url_file to exist. This is useful for batch-systems and shared-filesystems where the controller and engine are started at the same time and it may take a moment for the controller to write the connector files.u ipcontroller-engine.jsonc C s* | r d | } n d } d | | _ d S( Ns ipcontroller-%st ipcontrollers %s-engine.json( t url_file_name( R R R! R" t base( ( sE /usr/lib/python2.7/site-packages/IPython/parallel/apps/ipengineapp.pyt _cluster_id_changed� s s[ The URL for the iploggerapp instance, for forwarding logging to a central location.c C s | j j S( s= allow access to the Kernel object, so I look like IPKernelApp( t enginet kernel( R ( ( sE /usr/lib/python2.7/site-packages/IPython/parallel/apps/ipengineapp.pyR@ � s c C s: | j } | j s6 t j j | j j | j � | _ n d S( s� Set the url file. Here we don't try to actually see if it exists for is valid as that is hadled by the connection logic. N( R t url_filet ost patht joint profile_dirt security_dirR< ( R R ( ( sE /usr/lib/python2.7/site-packages/IPython/parallel/apps/ipengineapp.pyt find_url_file� s c C s� | j j d | j � | j } t | j � �| } d } d } d } x` | s� y t j | j � � } WqF t k r� | | k r� � n | d 7} t j d � qF XqF WWd QXd | k r� | d | j _ n d | k r� | j d � | j _ n | j j } | d j d � \ } } t | | � } d | | f | d <t | d � | j _ | d | j _ | d d | d | j _ | d | j _ | d | j _ | j j d � | j j d | � | | _ d S( sn load config from a JSON connector file, at a *lower* priority than command-line/config files. s Loading url_file %ri i R i g �?Ns EngineFactory.locationR6 s EngineFactory.sshserverR1 t interfaces ://s %s://%st keyt signature_schemes :%it registrationt packt unpacks Config changed:s %r( t logt infoRA R t opent jsont loadst readt ValueErrort timet sleepR R6 R t sshservert splitR R R RI RJ R0 t packert unpackert debugt connection_info( R R t ft num_triest max_triest dR6 t protoR3 ( ( sE /usr/lib/python2.7/site-packages/IPython/parallel/apps/ipengineapp.pyt load_connector_file� s< c K su | j d k r d S| j j d � | j } | j d | j � | j d | j � | j d | j � | j d | j j � t | � } | _ | t _ | j � | j | j d | j � | _ | j j d | j � | j | j | j � | _ | j j d | j � | j j j t j � | _ | j | j | j � | _ | j j d | j � | j � | j � | j � d S( s< Promote engine to listening kernel, accessible to frontends.Ns9 Opening ports for direct connections as an IPython kernelR RN RE t sessioni s shell ROUTER Channel on port: %is iopub PUB Channel on port: %is stdin ROUTER Channel on port: %i( t kernel_appt NoneRN RO R@ t setdefaultR RE R? Rc R t _instancet init_connection_filet _bind_sockett shell_streamst shell_portR[ t iopub_sockett iopub_portt contextt sockett zmqt ROUTERt stdin_sockett stdin_portt init_heartbeatt log_connection_infot write_connection_file( R t kwargsR@ t app( ( sE /usr/lib/python2.7/site-packages/IPython/parallel/apps/ipengineapp.pyt bind_kernel� s* c C s� t j j d d � | j } | j � t | j j j � � } | j t | j j j � � � } | j t d d d g � � r� t } d | _ n t } | j r2t j j | j � r2| j j d | j � | j j d | j � t j � } xC t j j | j � r.t j � | | j k r.t j d � q� Wn t j j | j � rT| j � n, | s�| j j d | j � | j d � n g } x/ d D]' } d | | k r�| | j } Pq�q�Wg } x/ d D]' } d | | k r�| | j } Pq�q�W| | j _ | | j _ | j r$| j | j � n | j r@| j | j � n y( t d | d | j d | j � | _ Wn* | j j d d t �| j d � n Xd S( Ni R R3 R0 R5 s url_file %r not founds, Waiting up to %.1f seconds for it to arrive.g�������?s! Fatal: url file never arrived: %si R t InteractiveShellApps %s.exec_liness %s.exec_filesR RN R\ s Couldn't start the Enginet exc_info( s IPKernelAppRz ( s IPKernelAppRz (! t sysRC t insertR RG t setR t keyst uniont RegistrationFactoryt intersectionR) t wait_for_url_filet FalseRB t existsRA RN t warnRU RV Rb t fatalt exitt exec_linest exec_filesR t startup_scriptt appendt startup_commandR\ R? t error( R R R t url_specifiedt ticR� Rx R� ( ( sE /usr/lib/python2.7/site-packages/IPython/parallel/apps/ipengineapp.pyt init_engine! sT ! 2 c C s� | j r� | j j d | j � | j j } | j t j � } | j | j � t | j | � } | j | j � | j j | � n d S( Ns Forwarding logging to %s( t log_urlRN RO R? Rn Ro Rp t PUBt connectR t setLevelt log_levelt addHandler( R Rn t lsockt handler( ( sE /usr/lib/python2.7/site-packages/IPython/parallel/apps/ipengineapp.pyt forward_logging` s c B sv e d | � | _ | j j } | rl y5 | j j d � | j j | � | e � f d UWqr d a qr Xn d a d S( Nt parents Initializing MPI:( R R8 R RN RO t globalsRe ( R t mpi_import_statement( ( sE /usr/lib/python2.7/site-packages/IPython/parallel/apps/ipengineapp.pyt init_mpij s c C s8 t t | � j | � | j � | j � | j � d S( N( t superR9 t initializeR� R� R� ( R t argv( ( sE /usr/lib/python2.7/site-packages/IPython/parallel/apps/ipengineapp.pyR� y s c C sI | j j � y | j j j � Wn! t k rD | j j d � n Xd S( Ns% Engine Interrupted, shutting down... ( R? t startt loopt KeyboardInterruptRN t critical( R ( ( sE /usr/lib/python2.7/site-packages/IPython/parallel/apps/ipengineapp.pyR� � s N(+ R& R' R t _descriptiont descriptiont _examplest examplesR R R R R t KernelR t classesR R) R� R� RA R R� R< R> R� R R Rd R t aliasest flagst propertyR@ RG Rb Ry R� R� R� R Re R� R� ( ( ( sE /usr/lib/python2.7/site-packages/IPython/parallel/apps/ipengineapp.pyR9 � s: 0 ( ? t __main__(: R( RQ RB R| RU Rp t zmq.eventloopR t IPython.core.profiledirR t IPython.parallel.apps.baseappR R R R t IPython.kernel.zmq.logR t IPython.kernel.zmq.ipkernelR R� t IPython.kernel.zmq.kernelappR t IPython.kernel.zmq.sessionR R R t IPython.kernel.zmq.zmqshellR t IPython.config.configurableR t IPython.parallel.engine.engineR t IPython.parallel.utilR t IPython.utils.importstringR t IPython.utils.py3compatR t IPython.utils.traitletsR R R R R R R� R� R+ R, R t dictR� t updateR� R9 t launch_instancet launch_new_instanceR& ( ( ( sE /usr/lib/python2.7/site-packages/IPython/parallel/apps/ipengineapp.pyt <module> s\ " . �
Copyright ©2021 || Defacer Indonesia