Showing posts with label Parallel.Foreach. Show all posts
Showing posts with label Parallel.Foreach. Show all posts

Sunday, April 30, 2017

Parallel.Invoke – Task Parallel Library


In my previous article, I explained about Parallel.For and Parallel.Foreach Loop in detail. In this article I will explain, how to use Parallel.Invoke to do multiple tasks concurrently.

Parallel.For and Parallel.Foreach can be used to loop asynchronously, but Parallel.Invoke can be used to do multiple tasks concurrently. Parallel.Invoke method is part of System.Threading.Tasks and accept array of action delegates as input and run all action delegates in parallel.

You can use Parallel.Invoke method when you want to do multiple tasks in parallel. This will be always faster than calling all the tasks synchronously. Task parallel library internally manages to divide and run multiple task in different threads in parallel. It also manages thread scheduling and scaling automatically as per the number of cores on your computer. There is no guarantee in which order all your tasks are executed and completed. See below example.

Code –

namespace ParallelInvoke
{
using System.Threading;
using System.Threading.Tasks;
class Program
{
    static void Main(string[] args)
    {
        Parallel.Invoke(() =>
        {
            Console.WriteLine("Starting first task");
            Console.WriteLine("Thread ID - {0}", Thread.CurrentThread.ManagedThreadId);
            DoFirstTask();
        }, () =>
        {
            Console.WriteLine("Starting second task");
            Console.WriteLine("Thread ID - {0}", Thread.CurrentThread.ManagedThreadId);
            DoSecondTask();
        }, () =>
        {
            Console.WriteLine("Starting third task");
            Console.WriteLine("Thread ID - {0}", Thread.CurrentThread.ManagedThreadId);
            DoThirdTask();
        }
            );
        Console.ReadLine();
    }
    public static void DoFirstTask()
    {
        List<int> numbers = new List<int>() { 1, 2, 3, 4, 5, 6, 7, 8, 9, 10 };
        Console.WriteLine("Total numbers - {0}", numbers.Count());
        Console.WriteLine("First task completed.");
    }
    public static void DoSecondTask()
    {
        List<int> numbers = new List<int>() { 1, 2, 3, 4, 5, 6, 7, 8, 9, 10 };
        Console.WriteLine("Sum of all numbers - {0}", numbers.Sum());
        Console.WriteLine("Second task completed.");
    }
    public static void DoThirdTask()
    {
        List<int> numbers = new List<int>() { 1, 2, 3, 4, 5, 6, 7, 8, 9, 10 };
        Console.WriteLine("Average of all numbers - {0}", numbers.Average());
        Console.WriteLine("Third task completed.");
    }
}
}

Output –


As you can see in above example, there are three delegates assigned to Parallel.Invoke method to execute. As i mentioned earlier that all delegates runs in different threads concurrently hence the order of task execution is different. You can also check managed thread id for each task on which they are executing.

Cancelling Parallel.Invoke method –


You can cancel any task which is running via Parallel.Invoke method based on certain condition. Parallel.Invoke method has overload which accepts ParallelOptions in which you can specify cancellation token. See Parallel.Invoke overload method which accept ParallelOptions as parameter.

public static void Invoke(ParallelOptions parallelOptions, params Action[] actions);

See below little bit of modified code to accept cancel request.

Code –
namespace ParallelInvoke
{
using System.Threading;
using System.Threading.Tasks;
class Program
{
    static CancellationTokenSource cancelToken = new CancellationTokenSource();
    static void Main(string[] args)
    {
        ParallelOptions options = new ParallelOptions();
        options.CancellationToken = cancelToken.Token;
        try
        {
            Parallel.Invoke(options, () =>
            {
                Console.WriteLine("Starting first task");
                Console.WriteLine("Thread ID - {0}", Thread.CurrentThread.ManagedThreadId);
                DoFirstTask();
            }, () =>
            {
                Console.WriteLine("Starting second task");
                Console.WriteLine("Thread ID - {0}", Thread.CurrentThread.ManagedThreadId);
                DoSecondTask();
                options.CancellationToken.ThrowIfCancellationRequested();
            }, () =>
            {
                Console.WriteLine("Starting third task");
                Console.WriteLine("Thread ID - {0}", Thread.CurrentThread.ManagedThreadId);
                DoThirdTask();
            }
            );
        }
        catch (OperationCanceledException ex)
        {
            Console.ForegroundColor = ConsoleColor.Red;
            Console.WriteLine("Error Message - {0}", ex.Message);
        }
           
        Console.ReadLine();
    }
    public static void DoFirstTask()
    {
        List<int> numbers = new List<int>() { 1, 2, 3, 4, 5, 6, 7, 8, 9, 10 };
        Console.WriteLine("Total numbers - {0}", numbers.Count());
        Console.WriteLine("First task completed.");
    }
    public static void DoSecondTask()
    {
        List<int> numbers = new List<int>();
        if (numbers.Count <= 0)
        {
            cancelToken.Cancel();
            return;
        }
        Console.WriteLine("Sum of all numbers - {0}", numbers.Sum());
        Console.WriteLine("Second task completed.");
    }
    public static void DoThirdTask()
    {
        List<int> numbers = new List<int>() { 1, 2, 3, 4, 5, 6, 7, 8, 9, 10 };
        Console.WriteLine("Average of all numbers - {0}", numbers.Average());
        Console.WriteLine("Third task completed.");
    }
}
}

Output –


As you can see in above example, CancellationTokenSource and ParallelOptions used to cancel Parallel.Invoke method. This cancellation process is similar to the cancellation process for Parallel.For and Parallel.Foreach. In above example, DoSecondTask method has condition to cancel the Parallel.Invoke method. Once this condition is true, the parallel options will throw OperationCanceledException and Parallel.Invoke method will be cancelled.

Exception Handling –


Exception handling in Parallel.Invoke is also similar to Parallel.For and Parallel.Foreach. There is no special mechanism provided by Task Parallel Library to handle exceptions. We can use try catch block to catch exception inside parallel.invoke method. 

See below modified code to handle exceptions.

Code –
namespace ParallelInvoke
{
using System.Collections.Concurrent;
using System.Threading;
using System.Threading.Tasks;
class Program
{
    public static ConcurrentQueue<Exception> exceptionQueue = new ConcurrentQueue<Exception>();
    static void Main(string[] args)
    {
        try
        {
            Parallel.Invoke(() =>
            {
                Console.WriteLine("Starting first task");
                Console.WriteLine("Thread ID - {0}", Thread.CurrentThread.ManagedThreadId);
                DoFirstTask();
            }, () =>
            {
                Console.WriteLine("Starting second task");
                Console.WriteLine("Thread ID - {0}", Thread.CurrentThread.ManagedThreadId);
                DoSecondTask();
                if (exceptionQueue.Count > 0) throw new AggregateException(exceptionQueue);
            }, () =>
            {
                Console.WriteLine("Starting third task");
                Console.WriteLine("Thread ID - {0}", Thread.CurrentThread.ManagedThreadId);
                DoThirdTask();
            }
            );
        }
        catch (AggregateException ex)
        {
            foreach (Exception e in ex.InnerExceptions)
            {
                Console.ForegroundColor = ConsoleColor.Red;
                Console.WriteLine("Error Message - {0}", e.InnerException.Message);
            }
        }
        Console.ReadLine();
    }
    public static void DoFirstTask()
    {
        List<int> numbers = new List<int>() { 1, 2, 3, 4, 5, 6, 7, 8, 9, 10 };
        Console.WriteLine("Total numbers - {0}", numbers.Count());
        Console.WriteLine("First task completed.");
    }
    public static void DoSecondTask()
    {
        List<int> numbers = new List<int>();
        if (numbers.Count <= 0)
        {
            exceptionQueue.Enqueue(new Exception("numbers list is empty"));
        }
        Console.WriteLine("Sum of all numbers - {0}", numbers.Sum());
        Console.WriteLine("Second task completed.");
    }
    public static void DoThirdTask()
    {
        List<int> numbers = new List<int>() { 1, 2, 3, 4, 5, 6, 7, 8, 9, 10 };
        Console.WriteLine("Average of all numbers - {0}", numbers.Average());
        Console.WriteLine("Third task completed.");
    }
}
}

Output –


As you can see in above example, exception thrown from DoSecondTask method. ConcurrentQueue has been used to safely add multiple exception thrown from multiple threads. Parallel.Invoke method covered with try catch block. So if any exception thrown from delegate, this will enqueue inside ConcurrentQueue and once all tasks are completed, you can check which exceptions occurred by iterating all the InnerException.

You can download full code from Gist.

I hope this article helps you to know more about Parallel.Invoke and Task Parallel Library. Please leave your feedback in comments below.

References –

See Also –


Sunday, February 26, 2017

How to cancel a Parallel.For and Parallel.Foreach loop – Task Parallel Library


In my previous article, I explained about Parallel.For and Parallel.Foreach loop in detail. In this article I will explain, how to cancel running or ongoing Parallel.For and Parallel.Foreach loop on certain event.

Parallel.For and Parallel.Foreach has overload methods to pass ParallelOptions to accept cancel request from user. We need to set CancelationToken to ParallelOptions and pass it to Parallel.For and Parallel.Foreach methods. When user request for cancelling parallel loop via cancellation token, then the parallel loop will throw an OperationCanceledException and cancel the parallel loop. See below example for more information.

Code –


Output –




As you can see in above example, when user request for cancel the parallel loop, cancellation token of parallel options will throw an OperationCanceledException and cancel the running parallel loop.


References –

See also –


Monday, December 26, 2016

How to handle exception in Parallel.For and Parallel.Foreach loop? – Task Parallel Library


In my previous article, I explained about Parallel.For andParallel.Foreach loop in detail. In this article I will explain, how to handle exception in Parallel.For and Parallel.Foreach loop.

Parallel.For and Parallel.Foreach methods doesn’t provide any special mechanism to handle exception thrown from parallel loops. We can catch unhandled exceptions using try catch block inside parallel loop. When you add any try catch block to catch exception in parallel loop, there is possibility that the same exception may throw by multiple threads in parallel. So we need to wrap try catch block inside parallel loop and also on method from where we call parallel loop to catch all types of exceptions. See below example.

Code –

Output –


As you can see in above example, all exception thrown from Parallel.For loop is captured as ArgumentException and added to ConcurrentQueue from multiple threads. If parallel loop has any exception occurred, then we need to iterate all the exception to get exception message.

References –

See also –