2018-01-09 03:02:51 +08:00
|
|
|
.. raw:: html
|
|
|
|
|
|
|
|
|
|
<style type="text/css">
|
|
|
|
|
.none { background-color: #FFCCCC }
|
2019-09-05 01:15:37 +08:00
|
|
|
.part { background-color: #FFFF99 }
|
2018-01-09 03:02:51 +08:00
|
|
|
.good { background-color: #CCFF99 }
|
|
|
|
|
</style>
|
|
|
|
|
|
|
|
|
|
.. role:: none
|
2019-09-05 01:15:37 +08:00
|
|
|
.. role:: part
|
2018-01-09 03:02:51 +08:00
|
|
|
.. role:: good
|
|
|
|
|
|
2018-07-27 01:53:45 +08:00
|
|
|
.. contents::
|
|
|
|
|
:local:
|
|
|
|
|
|
2018-01-09 03:02:51 +08:00
|
|
|
==================
|
|
|
|
|
OpenMP Support
|
|
|
|
|
==================
|
|
|
|
|
|
2019-01-19 03:57:37 +08:00
|
|
|
Clang fully supports OpenMP 4.5. Clang supports offloading to X86_64, AArch64,
|
|
|
|
|
PPC64[LE] and has `basic support for Cuda devices`_.
|
2018-01-09 03:02:51 +08:00
|
|
|
|
2019-09-05 01:15:37 +08:00
|
|
|
* #pragma omp declare simd: :part:`Partial`. We support parsing/semantic
|
2019-01-19 03:57:37 +08:00
|
|
|
analysis + generation of special attributes for X86 target, but still
|
|
|
|
|
missing the LLVM pass for vectorization.
|
2018-07-27 01:53:45 +08:00
|
|
|
|
|
|
|
|
In addition, the LLVM OpenMP runtime `libomp` supports the OpenMP Tools
|
2019-01-19 03:57:37 +08:00
|
|
|
Interface (OMPT) on x86, x86_64, AArch64, and PPC64 on Linux, Windows, and macOS.
|
|
|
|
|
|
2019-10-30 22:38:11 +08:00
|
|
|
For the list of supported features from OpenMP 5.0 see `OpenMP implementation details`_.
|
|
|
|
|
|
2019-01-19 03:57:37 +08:00
|
|
|
General improvements
|
|
|
|
|
--------------------
|
|
|
|
|
- New collapse clause scheme to avoid expensive remainder operations.
|
|
|
|
|
Compute loop index variables after collapsing a loop nest via the
|
|
|
|
|
collapse clause by replacing the expensive remainder operation with
|
|
|
|
|
multiplications and additions.
|
|
|
|
|
|
|
|
|
|
- The default schedules for the `distribute` and `for` constructs in a
|
|
|
|
|
parallel region and in SPMD mode have changed to ensure coalesced
|
|
|
|
|
accesses. For the `distribute` construct, a static schedule is used
|
|
|
|
|
with a chunk size equal to the number of threads per team (default
|
|
|
|
|
value of threads or as specified by the `thread_limit` clause if
|
|
|
|
|
present). For the `for` construct, the schedule is static with chunk
|
|
|
|
|
size of one.
|
2019-10-30 22:32:08 +08:00
|
|
|
|
2019-01-19 03:57:37 +08:00
|
|
|
- Simplified SPMD code generation for `distribute parallel for` when
|
|
|
|
|
the new default schedules are applicable.
|
2018-07-27 01:53:45 +08:00
|
|
|
|
|
|
|
|
.. _basic support for Cuda devices:
|
|
|
|
|
|
|
|
|
|
Cuda devices support
|
|
|
|
|
====================
|
|
|
|
|
|
|
|
|
|
Directives execution modes
|
|
|
|
|
--------------------------
|
|
|
|
|
|
|
|
|
|
Clang code generation for target regions supports two modes: the SPMD and
|
|
|
|
|
non-SPMD modes. Clang chooses one of these two modes automatically based on the
|
|
|
|
|
way directives and clauses on those directives are used. The SPMD mode uses a
|
|
|
|
|
simplified set of runtime functions thus increasing performance at the cost of
|
|
|
|
|
supporting some OpenMP features. The non-SPMD mode is the most generic mode and
|
|
|
|
|
supports all currently available OpenMP features. The compiler will always
|
|
|
|
|
attempt to use the SPMD mode wherever possible. SPMD mode will not be used if:
|
|
|
|
|
|
|
|
|
|
- The target region contains user code (other than OpenMP-specific
|
|
|
|
|
directives) in between the `target` and the `parallel` directives.
|
|
|
|
|
|
|
|
|
|
Data-sharing modes
|
|
|
|
|
------------------
|
|
|
|
|
|
|
|
|
|
Clang supports two data-sharing models for Cuda devices: `Generic` and `Cuda`
|
|
|
|
|
modes. The default mode is `Generic`. `Cuda` mode can give an additional
|
|
|
|
|
performance and can be activated using the `-fopenmp-cuda-mode` flag. In
|
|
|
|
|
`Generic` mode all local variables that can be shared in the parallel regions
|
|
|
|
|
are stored in the global memory. In `Cuda` mode local variables are not shared
|
|
|
|
|
between the threads and it is user responsibility to share the required data
|
|
|
|
|
between the threads in the parallel regions.
|
|
|
|
|
|
2019-01-10 04:38:35 +08:00
|
|
|
Collapsed loop nest counter
|
|
|
|
|
---------------------------
|
|
|
|
|
|
2019-02-06 04:38:36 +08:00
|
|
|
When using the collapse clause on a loop nest the default behavior is to
|
2019-01-10 04:38:35 +08:00
|
|
|
automatically extend the representation of the loop counter to 64 bits for
|
|
|
|
|
the cases where the sizes of the collapsed loops are not known at compile
|
|
|
|
|
time. To prevent this conservative choice and use at most 32 bits,
|
|
|
|
|
compile your program with the `-fopenmp-optimistic-collapse`.
|
|
|
|
|
|
|
|
|
|
|
2018-07-27 01:53:45 +08:00
|
|
|
Features not supported or with limited support for Cuda devices
|
|
|
|
|
---------------------------------------------------------------
|
|
|
|
|
|
|
|
|
|
- Cancellation constructs are not supported.
|
|
|
|
|
|
|
|
|
|
- Doacross loop nest is not supported.
|
|
|
|
|
|
|
|
|
|
- User-defined reductions are supported only for trivial types.
|
|
|
|
|
|
|
|
|
|
- Nested parallelism: inner parallel regions are executed sequentially.
|
|
|
|
|
|
|
|
|
|
- Static linking of libraries containing device code is not supported yet.
|
|
|
|
|
|
|
|
|
|
- Automatic translation of math functions in target regions to device-specific
|
|
|
|
|
math functions is not implemented yet.
|
|
|
|
|
|
2019-02-06 04:38:36 +08:00
|
|
|
- Debug information for OpenMP target regions is supported, but sometimes it may
|
|
|
|
|
be required to manually specify the address class of the inspected variables.
|
|
|
|
|
In some cases the local variables are actually allocated in the global memory,
|
|
|
|
|
but the debug info may be not aware of it.
|
2018-07-27 01:53:45 +08:00
|
|
|
|
2019-09-05 01:15:37 +08:00
|
|
|
|
|
|
|
|
.. _OpenMP implementation details:
|
|
|
|
|
|
|
|
|
|
OpenMP 5.0 Implementation Details
|
|
|
|
|
---------------------------------
|
|
|
|
|
|
|
|
|
|
The following table provides a quick overview over various OpenMP 5.0 features
|
|
|
|
|
and their implementation status. Please contact *openmp-dev* at
|
|
|
|
|
*lists.llvm.org* for more information or if you want to help with the
|
|
|
|
|
implementation.
|
|
|
|
|
|
|
|
|
|
+------------------------------+--------------------------------------------------------------+--------------------------+-----------------------------------------------------------------------+
|
|
|
|
|
|Category | Feature | Status | Reviews |
|
|
|
|
|
+==============================+==============================================================+==========================+=======================================================================+
|
|
|
|
|
| loop extension | support != in the canonical loop form | :good:`done` | D54441 |
|
|
|
|
|
+------------------------------+--------------------------------------------------------------+--------------------------+-----------------------------------------------------------------------+
|
|
|
|
|
| loop extension | #pragma omp loop (directive) | :none:`unclaimed` | |
|
|
|
|
|
+------------------------------+--------------------------------------------------------------+--------------------------+-----------------------------------------------------------------------+
|
2019-11-05 23:13:16 +08:00
|
|
|
| loop extension | collapse imperfectly nested loop | :good:`done` | |
|
2019-09-05 01:15:37 +08:00
|
|
|
+------------------------------+--------------------------------------------------------------+--------------------------+-----------------------------------------------------------------------+
|
2019-09-11 22:44:30 +08:00
|
|
|
| loop extension | collapse non-rectangular nested loop | :good:`done` | |
|
2019-09-05 01:15:37 +08:00
|
|
|
+------------------------------+--------------------------------------------------------------+--------------------------+-----------------------------------------------------------------------+
|
2019-11-05 23:13:16 +08:00
|
|
|
| loop extension | C++ range-base for loop | :good:`done` | |
|
2019-09-05 01:15:37 +08:00
|
|
|
+------------------------------+--------------------------------------------------------------+--------------------------+-----------------------------------------------------------------------+
|
|
|
|
|
| loop extension | clause: nosimd for SIMD directives | :none:`unclaimed` | |
|
|
|
|
|
+------------------------------+--------------------------------------------------------------+--------------------------+-----------------------------------------------------------------------+
|
|
|
|
|
| loop extension | inclusive scan extension (matching C++17 PSTL) | :none:`unclaimed` | |
|
|
|
|
|
+------------------------------+--------------------------------------------------------------+--------------------------+-----------------------------------------------------------------------+
|
|
|
|
|
| memory mangagement | memory allocators | :good:`done` | r341687,r357929 |
|
|
|
|
|
+------------------------------+--------------------------------------------------------------+--------------------------+-----------------------------------------------------------------------+
|
|
|
|
|
| memory mangagement | allocate directive and allocate clause | :good:`done` | r355614,r335952 |
|
|
|
|
|
+------------------------------+--------------------------------------------------------------+--------------------------+-----------------------------------------------------------------------+
|
|
|
|
|
| OMPD | OMPD interfaces | :part:`not upstream` | https://github.com/OpenMPToolsInterface/LLVM-openmp/tree/ompd-tests |
|
|
|
|
|
+------------------------------+--------------------------------------------------------------+--------------------------+-----------------------------------------------------------------------+
|
|
|
|
|
| OMPT | OMPT interfaces | :part:`mostly done` | |
|
|
|
|
|
+------------------------------+--------------------------------------------------------------+--------------------------+-----------------------------------------------------------------------+
|
|
|
|
|
| thread affinity extension | thread affinity extension | :good:`done` | |
|
|
|
|
|
+------------------------------+--------------------------------------------------------------+--------------------------+-----------------------------------------------------------------------+
|
|
|
|
|
| task extension | taskloop reduction | :good:`done` | |
|
|
|
|
|
+------------------------------+--------------------------------------------------------------+--------------------------+-----------------------------------------------------------------------+
|
|
|
|
|
| task extension | task affinity | :part:`not upstream` | |
|
|
|
|
|
+------------------------------+--------------------------------------------------------------+--------------------------+-----------------------------------------------------------------------+
|
|
|
|
|
| task extension | clause: depend on the taskwait construct | :part:`worked on` | |
|
|
|
|
|
+------------------------------+--------------------------------------------------------------+--------------------------+-----------------------------------------------------------------------+
|
|
|
|
|
| task extension | depend objects and detachable tasks | :part:`worked on` | |
|
|
|
|
|
+------------------------------+--------------------------------------------------------------+--------------------------+-----------------------------------------------------------------------+
|
|
|
|
|
| task extension | mutexinoutset dependence-type for tasks | :good:`done` | D53380,D57576 |
|
|
|
|
|
+------------------------------+--------------------------------------------------------------+--------------------------+-----------------------------------------------------------------------+
|
|
|
|
|
| task extension | combined taskloop constructs | :none:`unclaimed` | |
|
|
|
|
|
+------------------------------+--------------------------------------------------------------+--------------------------+-----------------------------------------------------------------------+
|
2019-10-11 04:15:54 +08:00
|
|
|
| task extension | master taskloop | :good:`done` | |
|
2019-09-05 01:15:37 +08:00
|
|
|
+------------------------------+--------------------------------------------------------------+--------------------------+-----------------------------------------------------------------------+
|
2019-11-05 23:13:16 +08:00
|
|
|
| task extension | parallel master taskloop | :good:`done` | |
|
2019-09-05 01:15:37 +08:00
|
|
|
+------------------------------+--------------------------------------------------------------+--------------------------+-----------------------------------------------------------------------+
|
2019-11-05 23:13:16 +08:00
|
|
|
| task extension | master taskloop simd | :good:`done` | |
|
2019-09-05 01:15:37 +08:00
|
|
|
+------------------------------+--------------------------------------------------------------+--------------------------+-----------------------------------------------------------------------+
|
2019-11-05 23:13:16 +08:00
|
|
|
| task extension | parallel master taskloop simd | :good:`done` | |
|
2019-09-05 01:15:37 +08:00
|
|
|
+------------------------------+--------------------------------------------------------------+--------------------------+-----------------------------------------------------------------------+
|
|
|
|
|
| SIMD extension | atomic and critical constructs inside SIMD code | :none:`unclaimed` | |
|
|
|
|
|
+------------------------------+--------------------------------------------------------------+--------------------------+-----------------------------------------------------------------------+
|
|
|
|
|
| SIMD extension | SIMD nontemporal | :none:`unclaimed` | |
|
|
|
|
|
+------------------------------+--------------------------------------------------------------+--------------------------+-----------------------------------------------------------------------+
|
|
|
|
|
| device extension | infer target functions from initializers | :part:`worked on` | |
|
|
|
|
|
+------------------------------+--------------------------------------------------------------+--------------------------+-----------------------------------------------------------------------+
|
|
|
|
|
| device extension | infer target variables from initializers | :part:`worked on` | |
|
|
|
|
|
+------------------------------+--------------------------------------------------------------+--------------------------+-----------------------------------------------------------------------+
|
|
|
|
|
| device extension | OMP_TARGET_OFFLOAD environment variable | :good:`done` | D50522 |
|
|
|
|
|
+------------------------------+--------------------------------------------------------------+--------------------------+-----------------------------------------------------------------------+
|
|
|
|
|
| device extension | support full 'defaultmap' functionality | :part:`worked on` | |
|
|
|
|
|
+------------------------------+--------------------------------------------------------------+--------------------------+-----------------------------------------------------------------------+
|
|
|
|
|
| device extension | device specific functions | :none:`unclaimed` | |
|
|
|
|
|
+------------------------------+--------------------------------------------------------------+--------------------------+-----------------------------------------------------------------------+
|
|
|
|
|
| device extension | clause: device_type | :good:`done` | |
|
|
|
|
|
+------------------------------+--------------------------------------------------------------+--------------------------+-----------------------------------------------------------------------+
|
|
|
|
|
| device extension | clause: in_reduction | :none:`unclaimed` | r308768 |
|
|
|
|
|
+------------------------------+--------------------------------------------------------------+--------------------------+-----------------------------------------------------------------------+
|
|
|
|
|
| device extension | omp_get_device_num() | :part:`worked on` | D54342 |
|
|
|
|
|
+------------------------------+--------------------------------------------------------------+--------------------------+-----------------------------------------------------------------------+
|
|
|
|
|
| device extension | structure mapping of references | :none:`unclaimed` | |
|
|
|
|
|
+------------------------------+--------------------------------------------------------------+--------------------------+-----------------------------------------------------------------------+
|
|
|
|
|
| device extension | nested target declare | :good:`done` | D51378 |
|
|
|
|
|
+------------------------------+--------------------------------------------------------------+--------------------------+-----------------------------------------------------------------------+
|
|
|
|
|
| device extension | implicitly map 'this' (this[:1]) | :good:`done` | D55982 |
|
|
|
|
|
+------------------------------+--------------------------------------------------------------+--------------------------+-----------------------------------------------------------------------+
|
|
|
|
|
| device extension | allow access to the reference count (omp_target_is_present) | :part:`worked on` | |
|
|
|
|
|
+------------------------------+--------------------------------------------------------------+--------------------------+-----------------------------------------------------------------------+
|
|
|
|
|
| device extension | requires directive (unified shared memory) | :part:`worked on` | |
|
|
|
|
|
+------------------------------+--------------------------------------------------------------+--------------------------+-----------------------------------------------------------------------+
|
|
|
|
|
| device extension | clause: unified_address, unified_shared_memory | :part:`worked on` | D52625,D52359 |
|
|
|
|
|
+------------------------------+--------------------------------------------------------------+--------------------------+-----------------------------------------------------------------------+
|
|
|
|
|
| device extension | clause: reverse_offload | :none:`unclaimed parts` | D52780 |
|
|
|
|
|
+------------------------------+--------------------------------------------------------------+--------------------------+-----------------------------------------------------------------------+
|
|
|
|
|
| device extension | clause: atomic_default_mem_order | :none:`unclaimed parts` | D53513 |
|
|
|
|
|
+------------------------------+--------------------------------------------------------------+--------------------------+-----------------------------------------------------------------------+
|
|
|
|
|
| device extension | clause: dynamic_allocators | :none:`unclaimed parts` | D53079 |
|
|
|
|
|
+------------------------------+--------------------------------------------------------------+--------------------------+-----------------------------------------------------------------------+
|
|
|
|
|
| device extension | user-defined mappers | :part:`worked on` | D56326,D58638,D58523,D58074,D60972,D59474 |
|
|
|
|
|
+------------------------------+--------------------------------------------------------------+--------------------------+-----------------------------------------------------------------------+
|
|
|
|
|
| device extension | mapping lambda expression | :good:`done` | D51107 |
|
|
|
|
|
+------------------------------+--------------------------------------------------------------+--------------------------+-----------------------------------------------------------------------+
|
|
|
|
|
| device extension | clause: use_device_addr for target data | :good:`done` | |
|
|
|
|
|
+------------------------------+--------------------------------------------------------------+--------------------------+-----------------------------------------------------------------------+
|
|
|
|
|
| device extension | map(replicate) or map(local) when requires unified_shared_me | :part:`worked on` | D55719,D55892 |
|
|
|
|
|
+------------------------------+--------------------------------------------------------------+--------------------------+-----------------------------------------------------------------------+
|
2019-09-11 22:44:30 +08:00
|
|
|
| device extension | teams construct on the host device | :part:`worked on` | Clang part is done, r371553. |
|
2019-09-05 01:15:37 +08:00
|
|
|
+------------------------------+--------------------------------------------------------------+--------------------------+-----------------------------------------------------------------------+
|
|
|
|
|
| atomic extension | hints for the atomic construct | :part:`worked on` | D51233 |
|
|
|
|
|
+------------------------------+--------------------------------------------------------------+--------------------------+-----------------------------------------------------------------------+
|
|
|
|
|
| base language | C11 support | :none:`unclaimed` | |
|
|
|
|
|
+------------------------------+--------------------------------------------------------------+--------------------------+-----------------------------------------------------------------------+
|
|
|
|
|
| base language | C++11/14/17 support | :none:`unclaimed` | |
|
|
|
|
|
+------------------------------+--------------------------------------------------------------+--------------------------+-----------------------------------------------------------------------+
|
|
|
|
|
| base language | lambda support | :good:`done` | |
|
|
|
|
|
+------------------------------+--------------------------------------------------------------+--------------------------+-----------------------------------------------------------------------+
|
|
|
|
|
| misc extension | array shaping | :none:`unclaimed` | |
|
|
|
|
|
+------------------------------+--------------------------------------------------------------+--------------------------+-----------------------------------------------------------------------+
|
|
|
|
|
| misc extension | library shutdown (omp_pause_resource[_all]) | :none:`unclaimed parts` | D55078 |
|
|
|
|
|
+------------------------------+--------------------------------------------------------------+--------------------------+-----------------------------------------------------------------------+
|
|
|
|
|
| misc extension | metadirectives | :none:`unclaimed` | |
|
|
|
|
|
+------------------------------+--------------------------------------------------------------+--------------------------+-----------------------------------------------------------------------+
|
|
|
|
|
| misc extension | conditional modifier for lastprivate clause | :none:`unclaimed` | |
|
|
|
|
|
+------------------------------+--------------------------------------------------------------+--------------------------+-----------------------------------------------------------------------+
|
2019-09-11 22:44:30 +08:00
|
|
|
| misc extension | user-defined function variants | :part:`worked on` | D67294, D64095 |
|
2019-09-05 01:15:37 +08:00
|
|
|
+------------------------------+--------------------------------------------------------------+--------------------------+-----------------------------------------------------------------------+
|
|
|
|
|
| misc extensions | pointer/reference to pointer based array reductions | :none:`unclaimed` | |
|
|
|
|
|
+------------------------------+--------------------------------------------------------------+--------------------------+-----------------------------------------------------------------------+
|
|
|
|
|
| misc extensions | prevent new type definitions in clauses | :none:`unclaimed` | |
|
|
|
|
|
+------------------------------+--------------------------------------------------------------+--------------------------+-----------------------------------------------------------------------+
|
