I have a .NET app that will be spawning tasks to run on an MS HPC cluster. We re not using any of that fancy DryadLINQ stuff, just remotely executing an exe on the cluster and passing arguments via the command line. The task will be .NET code, and I d like the calling app to get an actual Exception object when an error occurs on HPC.
What s the best general technique for accomplishing this?
Let me know if you need any more info.
Thanks!
You can t pass the exception back from your executable to the client HPC app when you re using the batch scheduler. If it s good enough to know that one of the tasks or jobs that you queued failed, then you can hold onto a SchedulerJob object and add a callback to the OnJobState or OnTaskState event. Whenever your job (or a task in that job) changes state you ll get the jobid/taskid and state change information in your callback; then you can check if the state was changed to "Failed" and act on that information.
To mark a task or job as "Failed", have your executable exit with a non-zero exit code. If you need details on the actual exception, the best you can do is print it to stdout.
If you really need all the exception details, an alternative might be to use the SOA framework for your computations. Advantages would be:
your compute requests look like WCF method calls
you get detailed exceptions back when your code throws
you can use the SOA debugger extension to Visual Studio to debug your code
Disadvantages would be:
Here are some resources to get you started (a search for "Windows HPC SOA" should get you much more):
As a learning experience I recently tried implementing Quicksort with 3 way partitioning in C#. Apart from needing to add an extra range check on the left/right variables before the recursive call, ...
I m the only developer in my company, and am getting along well as an autodidact, but I know I m missing out on the education one gets from working with and having code reviewed by more senior devs. ...
I have two EF entities. One has a property called HouseNumber. The other has two properties, one called StartHouseNumber and one called EndHouseNumber. I want to create a many to many association ...
I m using decimal type (.net), and I want to see if two numbers are equal. But I only want to be accurate to 10 decimal places. For example take these three numbers. I want them all to be equal. 0....
I m creating an STA version of the SynchronizationContext for use in Windows Workflow 4.0. I m wondering what to do about exceptions when Post-ing callbacks. The SynchronizationContext can be used ...
I ve got some code which sets up a datacontext. Often enough, the datacontext should be set to some underlying data collection, such as an ObservableCollection - but occasionally I d like to set it ...
I am building an application with C#. I managed to turn this into a single instance application by checking if the same process is already running. Process[] pname = Process.GetProcessesByName("...
NOTE I have asked the related question (with an accepted answer): How to combine DataTrigger and Trigger? I think I need to combine an EventTrigger and a DataTrigger to achieve what I m after: when ...
