16 Commits

Author SHA1 Message Date
Brendan Smithyman ad99b24a82 Change to new import standard for IPython Parallel. 2015-08-24 11:09:17 -04:00
Brendan Smithyman 3f02ce9073 Store more useful information in jobs. 2015-07-02 14:25:45 -04:00
Brendan Smithyman 12e64f418c Change location of endpointName setting. 2015-07-02 14:25:15 -04:00
Brendan Smithyman c507955903 Source estimation code. 2015-06-29 18:45:44 -04:00
Brendan Smithyman 0cf783d993 Improvements to scheduler (now use slices).
Change name "dispatcher" to "problem".
2015-06-29 14:30:12 -04:00
Brendan Smithyman 0987897896 Rename. 2015-06-29 09:49:45 -04:00
Brendan Smithyman 0db348cdce Begin to restructure such that the objects in the Endpoint are Survey and Problem subclasses. 2015-06-23 10:48:22 -04:00
Brendan Smithyman 0cd0308d44 Fixed error when the 'mkl' package is not installed.' 2015-06-22 14:42:11 -04:00
Brendan Smithyman 522c6c943e Make changes to allow for better integration with Endpoint code. 2015-06-22 11:02:58 -04:00
Brendan Smithyman aef3958794 Updated "Endpoint" architecture. 2015-05-11 10:28:16 -04:00
Brendan Smithyman 064caa1427 Refactor to use Endpoint namespacing.
Now everything in the remote memory footprint sits inside an object called an 'Endpoint'. The interfaces to set up and hold fields, etc. are generic, and are initialized as callables in the remote namespace, so they should be able to be adapted to different data backends (Fields objects, HDF5, etc.).
2015-05-07 17:14:02 -04:00
Brendan Smithyman d5cb4adf1f Add support for bootstrapping remote namespace based on code from Problem or Dispatcher. 2015-05-07 14:01:46 -04:00
Brendan Smithyman 75e3163a47 Added some prototypes for parallel constructs.
SuperReference acts like an IPython.parallel.Reference instance specialized for function calls. If it's scheduled by a call to 'apply' on a Load Balanced View, it will raise UnmetDependency errors until it's scheduled on a worker that is allowed by its 'rank' attribute. This can therefore point at functions that are known to be defined on particular workers.

Endpoint is a prototype layout for an object to hold multiple Problems, Fields, etc. on the remote workers. The idea is to clean up the remote namespace and reduce the use of globals().
2015-05-07 13:32:37 -04:00
Brendan Smithyman c982fb131a Move module-level functions to static methods for their respective classes. 2015-05-06 12:21:46 -04:00
Brendan Smithyman 97f832031a Created SystemGraph subclass of the networkx.DiGraph class that knows how to render itself in the IPython Notebook using d3.js. 2015-05-05 17:03:45 -04:00
Brendan Smithyman 29195e6608 Incorporating the first parts of my parallel distributed tools.
DataWrappers.py contains the CommonReducer class, which enables pass-through math operations and function calls on dictionaries.
Parallel.py contains the job scheduler, remote interface (w/ MPI support) and several helper functions.
2015-05-01 17:04:59 -04:00