maxjhandsome
/
llvm-project
forked from OSchip/llvm-project
1
0
Fork 0
Code Issues Pull Requests Packages Releases Wiki Activity
llvm-project/mlir/test/Dialect/Async/ops.mlir

Ignoring revisions in .git-blame-ignore-revs. Click here to bypass and see the normal blame view.

139 lines
4.1 KiB
MLIR
Raw Normal View History

[MLIR] Add async token/value arguments to async.execute op Async execute operation can take async arguments as dependencies. Change `async.execute` custom parser/printer format to use `%value as %unwrapped: !async.value<!type>` sytax. Reviewed By: mehdi_amini, herhut Differential Revision: https://reviews.llvm.org/D88601
2020-10-09 04:28:09 +08:00
// RUN: mlir-opt %s | FileCheck %s
[MLIR] Add Async dialect with trivial async.region operation Start Async dialect for modeling asynchronous execution. Reviewed By: mehdi_amini, herhut Differential Revision: https://reviews.llvm.org/D88459
2020-09-29 13:47:00 +08:00
[MLIR] Add async.value type to Async dialect Return values from async regions as !async.value<...>. Reviewed By: mehdi_amini, csigg Differential Revision: https://reviews.llvm.org/D88510
2020-09-30 04:55:33 +08:00
// CHECK-LABEL: @identity_token
[MLIR] Add async token/value arguments to async.execute op Async execute operation can take async arguments as dependencies. Change `async.execute` custom parser/printer format to use `%value as %unwrapped: !async.value<!type>` sytax. Reviewed By: mehdi_amini, herhut Differential Revision: https://reviews.llvm.org/D88601
2020-10-09 04:28:09 +08:00
func @identity_token(%arg0: !async.token) -> !async.token {
[MLIR] Add Async dialect with trivial async.region operation Start Async dialect for modeling asynchronous execution. Reviewed By: mehdi_amini, herhut Differential Revision: https://reviews.llvm.org/D88459
2020-09-29 13:47:00 +08:00
// CHECK: return %arg0 : !async.token
return %arg0 : !async.token
}
[MLIR] Add async.value type to Async dialect Return values from async regions as !async.value<...>. Reviewed By: mehdi_amini, csigg Differential Revision: https://reviews.llvm.org/D88510
2020-09-30 04:55:33 +08:00
// CHECK-LABEL: @identity_value
func @identity_value(%arg0 : !async.value<f32>) -> !async.value<f32> {
// CHECK: return %arg0 : !async.value<f32>
return %arg0 : !async.value<f32>
}
[MLIR] Add Async dialect with trivial async.region operation Start Async dialect for modeling asynchronous execution. Reviewed By: mehdi_amini, herhut Differential Revision: https://reviews.llvm.org/D88459
2020-09-29 13:47:00 +08:00
// CHECK-LABEL: @empty_async_execute
func @empty_async_execute() -> !async.token {
[MLIR] Add async token/value arguments to async.execute op Async execute operation can take async arguments as dependencies. Change `async.execute` custom parser/printer format to use `%value as %unwrapped: !async.value<!type>` sytax. Reviewed By: mehdi_amini, herhut Differential Revision: https://reviews.llvm.org/D88601
2020-10-09 04:28:09 +08:00
// CHECK: async.execute
%token = async.execute {
[MLIR] Add Async dialect with trivial async.region operation Start Async dialect for modeling asynchronous execution. Reviewed By: mehdi_amini, herhut Differential Revision: https://reviews.llvm.org/D88459
2020-09-29 13:47:00 +08:00
async.yield
[MLIR] Add async token/value arguments to async.execute op Async execute operation can take async arguments as dependencies. Change `async.execute` custom parser/printer format to use `%value as %unwrapped: !async.value<!type>` sytax. Reviewed By: mehdi_amini, herhut Differential Revision: https://reviews.llvm.org/D88601
2020-10-09 04:28:09 +08:00
}
[MLIR] Add Async dialect with trivial async.region operation Start Async dialect for modeling asynchronous execution. Reviewed By: mehdi_amini, herhut Differential Revision: https://reviews.llvm.org/D88459
2020-09-29 13:47:00 +08:00
[MLIR] Add async token/value arguments to async.execute op Async execute operation can take async arguments as dependencies. Change `async.execute` custom parser/printer format to use `%value as %unwrapped: !async.value<!type>` sytax. Reviewed By: mehdi_amini, herhut Differential Revision: https://reviews.llvm.org/D88601
2020-10-09 04:28:09 +08:00
// CHECK: return %token : !async.token
return %token : !async.token
[MLIR] Add async.value type to Async dialect Return values from async regions as !async.value<...>. Reviewed By: mehdi_amini, csigg Differential Revision: https://reviews.llvm.org/D88510
2020-09-30 04:55:33 +08:00
}
// CHECK-LABEL: @return_async_value
func @return_async_value() -> !async.value<f32> {
[MLIR] Add async token/value arguments to async.execute op Async execute operation can take async arguments as dependencies. Change `async.execute` custom parser/printer format to use `%value as %unwrapped: !async.value<!type>` sytax. Reviewed By: mehdi_amini, herhut Differential Revision: https://reviews.llvm.org/D88601
2020-10-09 04:28:09 +08:00
// CHECK: async.execute -> !async.value<f32>
%token, %results = async.execute -> !async.value<f32> {
[MLIR] Add async.value type to Async dialect Return values from async regions as !async.value<...>. Reviewed By: mehdi_amini, csigg Differential Revision: https://reviews.llvm.org/D88510
2020-09-30 04:55:33 +08:00
%cst = constant 1.000000e+00 : f32
async.yield %cst : f32
[MLIR] Add async token/value arguments to async.execute op Async execute operation can take async arguments as dependencies. Change `async.execute` custom parser/printer format to use `%value as %unwrapped: !async.value<!type>` sytax. Reviewed By: mehdi_amini, herhut Differential Revision: https://reviews.llvm.org/D88601
2020-10-09 04:28:09 +08:00
}
[MLIR] Add async.value type to Async dialect Return values from async regions as !async.value<...>. Reviewed By: mehdi_amini, csigg Differential Revision: https://reviews.llvm.org/D88510
2020-09-30 04:55:33 +08:00
[MLIR] Add async token/value arguments to async.execute op Async execute operation can take async arguments as dependencies. Change `async.execute` custom parser/printer format to use `%value as %unwrapped: !async.value<!type>` sytax. Reviewed By: mehdi_amini, herhut Differential Revision: https://reviews.llvm.org/D88601
2020-10-09 04:28:09 +08:00
// CHECK: return %results : !async.value<f32>
return %results : !async.value<f32>
}
// CHECK-LABEL: @return_captured_value
func @return_captured_value() -> !async.token {
%cst = constant 1.000000e+00 : f32
// CHECK: async.execute -> !async.value<f32>
%token, %results = async.execute -> !async.value<f32> {
async.yield %cst : f32
}
// CHECK: return %token : !async.token
return %token : !async.token
[MLIR] Add async.value type to Async dialect Return values from async regions as !async.value<...>. Reviewed By: mehdi_amini, csigg Differential Revision: https://reviews.llvm.org/D88510
2020-09-30 04:55:33 +08:00
}
// CHECK-LABEL: @return_async_values
func @return_async_values() -> (!async.value<f32>, !async.value<f32>) {
[MLIR] Add async token/value arguments to async.execute op Async execute operation can take async arguments as dependencies. Change `async.execute` custom parser/printer format to use `%value as %unwrapped: !async.value<!type>` sytax. Reviewed By: mehdi_amini, herhut Differential Revision: https://reviews.llvm.org/D88601
2020-10-09 04:28:09 +08:00
%token, %results:2 = async.execute -> (!async.value<f32>, !async.value<f32>) {
[MLIR] Add async.value type to Async dialect Return values from async regions as !async.value<...>. Reviewed By: mehdi_amini, csigg Differential Revision: https://reviews.llvm.org/D88510
2020-09-30 04:55:33 +08:00
%cst1 = constant 1.000000e+00 : f32
%cst2 = constant 2.000000e+00 : f32
async.yield %cst1, %cst2 : f32, f32
[MLIR] Add async token/value arguments to async.execute op Async execute operation can take async arguments as dependencies. Change `async.execute` custom parser/printer format to use `%value as %unwrapped: !async.value<!type>` sytax. Reviewed By: mehdi_amini, herhut Differential Revision: https://reviews.llvm.org/D88601
2020-10-09 04:28:09 +08:00
}
// CHECK: return %results#0, %results#1 : !async.value<f32>, !async.value<f32>
return %results#0, %results#1 : !async.value<f32>, !async.value<f32>
}
// CHECK-LABEL: @async_token_dependencies
func @async_token_dependencies(%arg0: !async.token) -> !async.token {
// CHECK: async.execute [%arg0]
%token = async.execute [%arg0] {
async.yield
}
// CHECK: return %token : !async.token
return %token : !async.token
}
// CHECK-LABEL: @async_value_operands
func @async_value_operands(%arg0: !async.value<f32>) -> !async.token {
// CHECK: async.execute (%arg0 as %arg1: !async.value<f32>) -> !async.value<f32>
%token, %results = async.execute (%arg0 as %arg1: !async.value<f32>) -> !async.value<f32> {
async.yield %arg1 : f32
}
// CHECK: return %token : !async.token
return %token : !async.token
}
// CHECK-LABEL: @async_token_and_value_operands
func @async_token_and_value_operands(%arg0: !async.token, %arg1: !async.value<f32>) -> !async.token {
// CHECK: async.execute [%arg0] (%arg1 as %arg2: !async.value<f32>) -> !async.value<f32>
%token, %results = async.execute [%arg0] (%arg1 as %arg2: !async.value<f32>) -> !async.value<f32> {
async.yield %arg2 : f32
}
// CHECK: return %token : !async.token
return %token : !async.token
}
[MLIR] Add async.value type to Async dialect Return values from async regions as !async.value<...>. Reviewed By: mehdi_amini, csigg Differential Revision: https://reviews.llvm.org/D88510
2020-09-30 04:55:33 +08:00
[MLIR] Add async token/value arguments to async.execute op Async execute operation can take async arguments as dependencies. Change `async.execute` custom parser/printer format to use `%value as %unwrapped: !async.value<!type>` sytax. Reviewed By: mehdi_amini, herhut Differential Revision: https://reviews.llvm.org/D88601
2020-10-09 04:28:09 +08:00
// CHECK-LABEL: @empty_tokens_or_values_operands
func @empty_tokens_or_values_operands() {
// CHECK: async.execute {
%token0 = async.execute [] () -> () { async.yield }
// CHECK: async.execute {
%token1 = async.execute () -> () { async.yield }
// CHECK: async.execute {
%token2 = async.execute -> () { async.yield }
// CHECK: async.execute {
%token3 = async.execute () { async.yield }
// CHECK: async.execute {
%token4 = async.execute [] { async.yield }
return
[MLIR] Add Async dialect with trivial async.region operation Start Async dialect for modeling asynchronous execution. Reviewed By: mehdi_amini, herhut Differential Revision: https://reviews.llvm.org/D88459
2020-09-29 13:47:00 +08:00
}
[mlir] Add async.await operation to async dialect Add async.await operation to "unwrap" async.values Reviewed By: mehdi_amini Differential Revision: https://reviews.llvm.org/D89137
2020-10-13 05:38:42 +08:00
// CHECK-LABEL: @await_token
func @await_token(%arg0: !async.token) {
// CHECK: async.await %arg0
async.await %arg0 : !async.token
return
}
// CHECK-LABEL: @await_value
func @await_value(%arg0: !async.value<f32>) -> f32 {
// CHECK: async.await %arg0
%0 = async.await %arg0 : !async.value<f32>
return %0 : f32
}
[mlir] Transform scf.parallel to scf.for + async.execute Depends On D89958 1. Adds `async.group`/`async.awaitall` to group together multiple async tokens/values 2. Rewrite scf.parallel operation into multiple concurrent async.execute operations over non overlapping subranges of the original loop. Example: ``` scf.for (%i, %j) = (%lbi, %lbj) to (%ubi, %ubj) step (%si, %sj) { "do_some_compute"(%i, %j): () -> () } ``` Converted to: ``` %c0 = constant 0 : index %c1 = constant 1 : index // Compute blocks sizes for each induction variable. %num_blocks_i = ... : index %num_blocks_j = ... : index %block_size_i = ... : index %block_size_j = ... : index // Create an async group to track async execute ops. %group = async.create_group scf.for %bi = %c0 to %num_blocks_i step %c1 { %block_start_i = ... : index %block_end_i = ... : index scf.for %bj = %c0 t0 %num_blocks_j step %c1 { %block_start_j = ... : index %block_end_j = ... : index // Execute the body of original parallel operation for the current // block. %token = async.execute { scf.for %i = %block_start_i to %block_end_i step %si { scf.for %j = %block_start_j to %block_end_j step %sj { "do_some_compute"(%i, %j): () -> () } } } // Add produced async token to the group. async.add_to_group %token, %group } } // Await completion of all async.execute operations. async.await_all %group ``` In this example outer loop launches inner block level loops as separate async execute operations which will be executed concurrently. At the end it waits for the completiom of all async execute operations. Reviewed By: ftynse, mehdi_amini Differential Revision: https://reviews.llvm.org/D89963
2020-11-13 19:01:52 +08:00
// CHECK-LABEL: @create_group_and_await_all
[mlir:Async] Add the size parameter to the async.group Specify the `!async.group` size (the number of tokens that will be added to it) at construction time. `async.await_all` operation can potentially race with `async.execute` operations that keep updating the group, for this reason it is required to know upfront how many tokens will be added to the group. Reviewed By: ftynse, herhut Differential Revision: https://reviews.llvm.org/D104780
2021-06-23 21:24:09 +08:00
func @create_group_and_await_all(%arg0: !async.token,
%arg1: !async.value<f32>) -> index {
%c = constant 2 : index
%0 = async.create_group %c : !async.group
[mlir] Transform scf.parallel to scf.for + async.execute Depends On D89958 1. Adds `async.group`/`async.awaitall` to group together multiple async tokens/values 2. Rewrite scf.parallel operation into multiple concurrent async.execute operations over non overlapping subranges of the original loop. Example: ``` scf.for (%i, %j) = (%lbi, %lbj) to (%ubi, %ubj) step (%si, %sj) { "do_some_compute"(%i, %j): () -> () } ``` Converted to: ``` %c0 = constant 0 : index %c1 = constant 1 : index // Compute blocks sizes for each induction variable. %num_blocks_i = ... : index %num_blocks_j = ... : index %block_size_i = ... : index %block_size_j = ... : index // Create an async group to track async execute ops. %group = async.create_group scf.for %bi = %c0 to %num_blocks_i step %c1 { %block_start_i = ... : index %block_end_i = ... : index scf.for %bj = %c0 t0 %num_blocks_j step %c1 { %block_start_j = ... : index %block_end_j = ... : index // Execute the body of original parallel operation for the current // block. %token = async.execute { scf.for %i = %block_start_i to %block_end_i step %si { scf.for %j = %block_start_j to %block_end_j step %sj { "do_some_compute"(%i, %j): () -> () } } } // Add produced async token to the group. async.add_to_group %token, %group } } // Await completion of all async.execute operations. async.await_all %group ``` In this example outer loop launches inner block level loops as separate async execute operations which will be executed concurrently. At the end it waits for the completiom of all async execute operations. Reviewed By: ftynse, mehdi_amini Differential Revision: https://reviews.llvm.org/D89963
2020-11-13 19:01:52 +08:00
// CHECK: async.add_to_group %arg0
// CHECK: async.add_to_group %arg1
%1 = async.add_to_group %arg0, %0 : !async.token
%2 = async.add_to_group %arg1, %0 : !async.value<f32>
async.await_all %0
%3 = addi %1, %2 : index
return %3 : index
}