Barrier (computer science)

 

Barrier (computer science)

From Wikipedia, the free encyclopedia

 

Jump to: navigation, search

 

[edit] Threads synchronization primitive

In parallel computing, a barrier is a type of synchronization method. A barrier for a group of threads or processes in the source code means any thread/process must stop at this point and cannot proceed until all other threads/processes reach this barrier.

Many collective routines and directive-based parallel languages impose implicit barriers. For example, a parallel do loop in Fortran with OpenMP will not be allowed to continue on any thread until the last iteration is completed. This is in case the program relies on the result of the loop immediately after its completion. In message passing, any global communication (such as reduction or scatter) may imply a barrier.

See also

Rendezvous (Plan 9).

[edit] Processor and compiler barriers

Memory barrier is a class of instructions which cause a processor to enforce an ordering constraint on memory operations issued before and after the barrier instruction.

A barrier can also be a high level programming language statement which prevent the compiler from reordering other operations over the barrier statement during optimization passes. Different classes of barrier exist and may apply to a specific set of operations only.

[edit] Dynamic Barriers

Classic barrier constructs define the set of participating processes/threads statically. This is usually done either at program startup or when a barrier like the Pthreads barrier is instantiated. This restricts the possible applications for which barriers can be used.

To support more dynamic programming paradigms like fork/join parallelism, the sets of participants have to be dynamic. Thus, the set of processes/threads participating in a barrier operation needs to be able to change over time. X10 introduced the concept of clocks for that purpose, which provide a dynamic barrier semantic. Building on clocks, phasers^[1] have been proposed to add even more flexibility to barrier synchronization. With phasers it is possible to express data dependencies between the participating processes explicit to avoid unnecessary over-synchronization.

[edit] References

1. ^ Shirako, J.; Peixotto, D. M.; Sarkar, V.; Scherer, W. N. (2008). Phasers. pp. 277. doi:10.1145/1375527.1375568.  edit

[hide]v · d · eParallel computing topics   General Cloud computing · High-performance computing · Cluster computing · Distributed computing · Grid computing   Parallelism (levels) Bit · Instruction · Data · Task   Threads Superthreading · Hyperthreading   Theory Amdahl's law · Gustafson's law · Cost efficiency · Karp–Flatt metric · slowdown · speedup   Elements Process · Thread · Fiber · PRAM · Instruction window   Coordination Multiprocessing · Multithreading (computer architecture) · Memory coherency · Cache coherency · Cache invalidation · Barrier · Synchronization · Application checkpointing   Programming Models (Implicit parallelism · Explicit parallelism · Concurrency) · Flynn's taxonomy (SISD • SIMD • MISD • MIMD (SPMD)) · Thread (computer science)  · Non-blocking algorithm   Hardware Multiprocessing (Symmetric · Asymmetric) · Memory (NUMA · COMA · distributed · shared · distributed shared) · SMT MPP · Superscalar · Vector processor · Supercomputer · Beowulf   APIs Ateji PX · POSIX Threads · OpenMP · OpenHMPP · PVM · MPI · UPC · Intel Threading Building Blocks · Boost.Thread · Global Arrays · Charm++ · Cilk · Co-array Fortran · OpenCL  · CUDA  · Dryad  · DryadLINQ   Problems Embarrassingly parallel · Grand Challenge · Software lockout  · Scalability  · Race conditions  · Deadlock  · Livelock  · Deterministic algorithm · Parallel slowdown

 

the original link: http://en.wikipedia.org/wiki/Barrier_(computer_science)