maxjhandsome
/
llvm-project
forked from OSchip/llvm-project
1
0
Fork 0
Code Issues Pull Requests Packages Releases Wiki Activity
llvm-project/llvm/test/CodeGen/X86/nontemporal-loads.ll

1666 lines
47 KiB
LLVM
Raw Normal View History

[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
; NOTE: Assertions have been autogenerated by utils/update_llc_test_checks.py
; RUN: llc < %s -mtriple=x86_64-unknown-unknown -mattr=+sse2 | FileCheck %s --check-prefix=SSE --check-prefix=SSE2
; RUN: llc < %s -mtriple=x86_64-unknown-unknown -mattr=+sse4.1 | FileCheck %s --check-prefix=SSE --check-prefix=SSE41
; RUN: llc < %s -mtriple=x86_64-unknown-unknown -mattr=+avx | FileCheck %s --check-prefix=AVX --check-prefix=AVX1
; RUN: llc < %s -mtriple=x86_64-unknown-unknown -mattr=+avx2 | FileCheck %s --check-prefix=AVX --check-prefix=AVX2
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; RUN: llc < %s -mtriple=x86_64-unknown-unknown -mattr=+avx512f | FileCheck %s --check-prefix=AVX512 --check-prefix=AVX512F
; RUN: llc < %s -mtriple=x86_64-unknown-unknown -mattr=+avx512bw | FileCheck %s --check-prefix=AVX512 --check-prefix=AVX512BW
; RUN: llc < %s -mtriple=x86_64-unknown-unknown -mattr=+avx512vl | FileCheck %s --check-prefix=AVX512 --check-prefix=AVX512VL
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
define <4 x float> @test_v4f32(<4 x float>* %src) {
[X86][SSE] Add general lowering of nontemporal vector loads Currently the only way to use the (V)MOVNTDQA nontemporal vector loads instructions is through the int_x86_sse41_movntdqa style builtins. This patch adds support for lowering nontemporal loads from general IR, allowing us to remove the movntdqa builtins in a future patch. We currently still fold nontemporal loads into suitable instructions, we should probably look at removing this (and nontemporal stores as well) or at least make the target's folding implementation aware that its dealing with a nontemporal memory transaction. There is also an issue that VMOVNTDQA only acts on 128-bit vectors on pre-AVX2 hardware - so currently a normal ymm load is still used on AVX1 targets. Differential Review: http://reviews.llvm.org/D20965 llvm-svn: 272010
2016-06-07 21:34:24 +08:00
; SSE2-LABEL: test_v4f32:
; SSE2: # BB#0:
; SSE2-NEXT: movaps (%rdi), %xmm0
; SSE2-NEXT: retq
;
; SSE41-LABEL: test_v4f32:
; SSE41: # BB#0:
; SSE41-NEXT: movntdqa (%rdi), %xmm0
; SSE41-NEXT: retq
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
;
; AVX-LABEL: test_v4f32:
; AVX: # BB#0:
[X86][SSE] Add general lowering of nontemporal vector loads Currently the only way to use the (V)MOVNTDQA nontemporal vector loads instructions is through the int_x86_sse41_movntdqa style builtins. This patch adds support for lowering nontemporal loads from general IR, allowing us to remove the movntdqa builtins in a future patch. We currently still fold nontemporal loads into suitable instructions, we should probably look at removing this (and nontemporal stores as well) or at least make the target's folding implementation aware that its dealing with a nontemporal memory transaction. There is also an issue that VMOVNTDQA only acts on 128-bit vectors on pre-AVX2 hardware - so currently a normal ymm load is still used on AVX1 targets. Differential Review: http://reviews.llvm.org/D20965 llvm-svn: 272010
2016-06-07 21:34:24 +08:00
; AVX-NEXT: vmovntdqa (%rdi), %xmm0
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
; AVX-NEXT: retq
;
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; AVX512-LABEL: test_v4f32:
; AVX512: # BB#0:
[X86][SSE] Add general lowering of nontemporal vector loads Currently the only way to use the (V)MOVNTDQA nontemporal vector loads instructions is through the int_x86_sse41_movntdqa style builtins. This patch adds support for lowering nontemporal loads from general IR, allowing us to remove the movntdqa builtins in a future patch. We currently still fold nontemporal loads into suitable instructions, we should probably look at removing this (and nontemporal stores as well) or at least make the target's folding implementation aware that its dealing with a nontemporal memory transaction. There is also an issue that VMOVNTDQA only acts on 128-bit vectors on pre-AVX2 hardware - so currently a normal ymm load is still used on AVX1 targets. Differential Review: http://reviews.llvm.org/D20965 llvm-svn: 272010
2016-06-07 21:34:24 +08:00
; AVX512-NEXT: vmovntdqa (%rdi), %xmm0
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; AVX512-NEXT: retq
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
%1 = load <4 x float>, <4 x float>* %src, align 16, !nontemporal !1
ret <4 x float> %1
}
define <4 x i32> @test_v4i32(<4 x i32>* %src) {
[X86][SSE] Add general lowering of nontemporal vector loads Currently the only way to use the (V)MOVNTDQA nontemporal vector loads instructions is through the int_x86_sse41_movntdqa style builtins. This patch adds support for lowering nontemporal loads from general IR, allowing us to remove the movntdqa builtins in a future patch. We currently still fold nontemporal loads into suitable instructions, we should probably look at removing this (and nontemporal stores as well) or at least make the target's folding implementation aware that its dealing with a nontemporal memory transaction. There is also an issue that VMOVNTDQA only acts on 128-bit vectors on pre-AVX2 hardware - so currently a normal ymm load is still used on AVX1 targets. Differential Review: http://reviews.llvm.org/D20965 llvm-svn: 272010
2016-06-07 21:34:24 +08:00
; SSE2-LABEL: test_v4i32:
; SSE2: # BB#0:
; SSE2-NEXT: movaps (%rdi), %xmm0
; SSE2-NEXT: retq
;
; SSE41-LABEL: test_v4i32:
; SSE41: # BB#0:
; SSE41-NEXT: movntdqa (%rdi), %xmm0
; SSE41-NEXT: retq
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
;
; AVX-LABEL: test_v4i32:
; AVX: # BB#0:
[X86][SSE] Add general lowering of nontemporal vector loads Currently the only way to use the (V)MOVNTDQA nontemporal vector loads instructions is through the int_x86_sse41_movntdqa style builtins. This patch adds support for lowering nontemporal loads from general IR, allowing us to remove the movntdqa builtins in a future patch. We currently still fold nontemporal loads into suitable instructions, we should probably look at removing this (and nontemporal stores as well) or at least make the target's folding implementation aware that its dealing with a nontemporal memory transaction. There is also an issue that VMOVNTDQA only acts on 128-bit vectors on pre-AVX2 hardware - so currently a normal ymm load is still used on AVX1 targets. Differential Review: http://reviews.llvm.org/D20965 llvm-svn: 272010
2016-06-07 21:34:24 +08:00
; AVX-NEXT: vmovntdqa (%rdi), %xmm0
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
; AVX-NEXT: retq
;
[AVX-512] Fix the 128-bit and 256-bit nontemporal load patterns with elements type other than i64. These loads have all been promoted to v2i64/v4i64 loads so we need bitcasts or we end up selecting VMOVDQA32/VMOVDQU32 instead. llvm-svn: 278316
2016-08-11 14:04:00 +08:00
; AVX512-LABEL: test_v4i32:
; AVX512: # BB#0:
; AVX512-NEXT: vmovntdqa (%rdi), %xmm0
; AVX512-NEXT: retq
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
%1 = load <4 x i32>, <4 x i32>* %src, align 16, !nontemporal !1
ret <4 x i32> %1
}
define <2 x double> @test_v2f64(<2 x double>* %src) {
[X86][SSE] Add general lowering of nontemporal vector loads Currently the only way to use the (V)MOVNTDQA nontemporal vector loads instructions is through the int_x86_sse41_movntdqa style builtins. This patch adds support for lowering nontemporal loads from general IR, allowing us to remove the movntdqa builtins in a future patch. We currently still fold nontemporal loads into suitable instructions, we should probably look at removing this (and nontemporal stores as well) or at least make the target's folding implementation aware that its dealing with a nontemporal memory transaction. There is also an issue that VMOVNTDQA only acts on 128-bit vectors on pre-AVX2 hardware - so currently a normal ymm load is still used on AVX1 targets. Differential Review: http://reviews.llvm.org/D20965 llvm-svn: 272010
2016-06-07 21:34:24 +08:00
; SSE2-LABEL: test_v2f64:
; SSE2: # BB#0:
; SSE2-NEXT: movaps (%rdi), %xmm0
; SSE2-NEXT: retq
;
; SSE41-LABEL: test_v2f64:
; SSE41: # BB#0:
; SSE41-NEXT: movntdqa (%rdi), %xmm0
; SSE41-NEXT: retq
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
;
; AVX-LABEL: test_v2f64:
; AVX: # BB#0:
[X86][SSE] Add general lowering of nontemporal vector loads Currently the only way to use the (V)MOVNTDQA nontemporal vector loads instructions is through the int_x86_sse41_movntdqa style builtins. This patch adds support for lowering nontemporal loads from general IR, allowing us to remove the movntdqa builtins in a future patch. We currently still fold nontemporal loads into suitable instructions, we should probably look at removing this (and nontemporal stores as well) or at least make the target's folding implementation aware that its dealing with a nontemporal memory transaction. There is also an issue that VMOVNTDQA only acts on 128-bit vectors on pre-AVX2 hardware - so currently a normal ymm load is still used on AVX1 targets. Differential Review: http://reviews.llvm.org/D20965 llvm-svn: 272010
2016-06-07 21:34:24 +08:00
; AVX-NEXT: vmovntdqa (%rdi), %xmm0
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
; AVX-NEXT: retq
;
[X86][SSE] Add general lowering of nontemporal vector loads Currently the only way to use the (V)MOVNTDQA nontemporal vector loads instructions is through the int_x86_sse41_movntdqa style builtins. This patch adds support for lowering nontemporal loads from general IR, allowing us to remove the movntdqa builtins in a future patch. We currently still fold nontemporal loads into suitable instructions, we should probably look at removing this (and nontemporal stores as well) or at least make the target's folding implementation aware that its dealing with a nontemporal memory transaction. There is also an issue that VMOVNTDQA only acts on 128-bit vectors on pre-AVX2 hardware - so currently a normal ymm load is still used on AVX1 targets. Differential Review: http://reviews.llvm.org/D20965 llvm-svn: 272010
2016-06-07 21:34:24 +08:00
; AVX512-LABEL: test_v2f64:
; AVX512: # BB#0:
; AVX512-NEXT: vmovntdqa (%rdi), %xmm0
; AVX512-NEXT: retq
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
%1 = load <2 x double>, <2 x double>* %src, align 16, !nontemporal !1
ret <2 x double> %1
}
define <2 x i64> @test_v2i64(<2 x i64>* %src) {
[X86][SSE] Add general lowering of nontemporal vector loads Currently the only way to use the (V)MOVNTDQA nontemporal vector loads instructions is through the int_x86_sse41_movntdqa style builtins. This patch adds support for lowering nontemporal loads from general IR, allowing us to remove the movntdqa builtins in a future patch. We currently still fold nontemporal loads into suitable instructions, we should probably look at removing this (and nontemporal stores as well) or at least make the target's folding implementation aware that its dealing with a nontemporal memory transaction. There is also an issue that VMOVNTDQA only acts on 128-bit vectors on pre-AVX2 hardware - so currently a normal ymm load is still used on AVX1 targets. Differential Review: http://reviews.llvm.org/D20965 llvm-svn: 272010
2016-06-07 21:34:24 +08:00
; SSE2-LABEL: test_v2i64:
; SSE2: # BB#0:
; SSE2-NEXT: movaps (%rdi), %xmm0
; SSE2-NEXT: retq
;
; SSE41-LABEL: test_v2i64:
; SSE41: # BB#0:
; SSE41-NEXT: movntdqa (%rdi), %xmm0
; SSE41-NEXT: retq
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
;
; AVX-LABEL: test_v2i64:
; AVX: # BB#0:
[X86][SSE] Add general lowering of nontemporal vector loads Currently the only way to use the (V)MOVNTDQA nontemporal vector loads instructions is through the int_x86_sse41_movntdqa style builtins. This patch adds support for lowering nontemporal loads from general IR, allowing us to remove the movntdqa builtins in a future patch. We currently still fold nontemporal loads into suitable instructions, we should probably look at removing this (and nontemporal stores as well) or at least make the target's folding implementation aware that its dealing with a nontemporal memory transaction. There is also an issue that VMOVNTDQA only acts on 128-bit vectors on pre-AVX2 hardware - so currently a normal ymm load is still used on AVX1 targets. Differential Review: http://reviews.llvm.org/D20965 llvm-svn: 272010
2016-06-07 21:34:24 +08:00
; AVX-NEXT: vmovntdqa (%rdi), %xmm0
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
; AVX-NEXT: retq
;
[X86][SSE] Add general lowering of nontemporal vector loads Currently the only way to use the (V)MOVNTDQA nontemporal vector loads instructions is through the int_x86_sse41_movntdqa style builtins. This patch adds support for lowering nontemporal loads from general IR, allowing us to remove the movntdqa builtins in a future patch. We currently still fold nontemporal loads into suitable instructions, we should probably look at removing this (and nontemporal stores as well) or at least make the target's folding implementation aware that its dealing with a nontemporal memory transaction. There is also an issue that VMOVNTDQA only acts on 128-bit vectors on pre-AVX2 hardware - so currently a normal ymm load is still used on AVX1 targets. Differential Review: http://reviews.llvm.org/D20965 llvm-svn: 272010
2016-06-07 21:34:24 +08:00
; AVX512-LABEL: test_v2i64:
; AVX512: # BB#0:
; AVX512-NEXT: vmovntdqa (%rdi), %xmm0
; AVX512-NEXT: retq
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
%1 = load <2 x i64>, <2 x i64>* %src, align 16, !nontemporal !1
ret <2 x i64> %1
}
define <8 x i16> @test_v8i16(<8 x i16>* %src) {
[X86][SSE] Add general lowering of nontemporal vector loads Currently the only way to use the (V)MOVNTDQA nontemporal vector loads instructions is through the int_x86_sse41_movntdqa style builtins. This patch adds support for lowering nontemporal loads from general IR, allowing us to remove the movntdqa builtins in a future patch. We currently still fold nontemporal loads into suitable instructions, we should probably look at removing this (and nontemporal stores as well) or at least make the target's folding implementation aware that its dealing with a nontemporal memory transaction. There is also an issue that VMOVNTDQA only acts on 128-bit vectors on pre-AVX2 hardware - so currently a normal ymm load is still used on AVX1 targets. Differential Review: http://reviews.llvm.org/D20965 llvm-svn: 272010
2016-06-07 21:34:24 +08:00
; SSE2-LABEL: test_v8i16:
; SSE2: # BB#0:
; SSE2-NEXT: movaps (%rdi), %xmm0
; SSE2-NEXT: retq
;
; SSE41-LABEL: test_v8i16:
; SSE41: # BB#0:
; SSE41-NEXT: movntdqa (%rdi), %xmm0
; SSE41-NEXT: retq
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
;
; AVX-LABEL: test_v8i16:
; AVX: # BB#0:
[X86][SSE] Add general lowering of nontemporal vector loads Currently the only way to use the (V)MOVNTDQA nontemporal vector loads instructions is through the int_x86_sse41_movntdqa style builtins. This patch adds support for lowering nontemporal loads from general IR, allowing us to remove the movntdqa builtins in a future patch. We currently still fold nontemporal loads into suitable instructions, we should probably look at removing this (and nontemporal stores as well) or at least make the target's folding implementation aware that its dealing with a nontemporal memory transaction. There is also an issue that VMOVNTDQA only acts on 128-bit vectors on pre-AVX2 hardware - so currently a normal ymm load is still used on AVX1 targets. Differential Review: http://reviews.llvm.org/D20965 llvm-svn: 272010
2016-06-07 21:34:24 +08:00
; AVX-NEXT: vmovntdqa (%rdi), %xmm0
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
; AVX-NEXT: retq
;
[X86][SSE] Add general lowering of nontemporal vector loads Currently the only way to use the (V)MOVNTDQA nontemporal vector loads instructions is through the int_x86_sse41_movntdqa style builtins. This patch adds support for lowering nontemporal loads from general IR, allowing us to remove the movntdqa builtins in a future patch. We currently still fold nontemporal loads into suitable instructions, we should probably look at removing this (and nontemporal stores as well) or at least make the target's folding implementation aware that its dealing with a nontemporal memory transaction. There is also an issue that VMOVNTDQA only acts on 128-bit vectors on pre-AVX2 hardware - so currently a normal ymm load is still used on AVX1 targets. Differential Review: http://reviews.llvm.org/D20965 llvm-svn: 272010
2016-06-07 21:34:24 +08:00
; AVX512-LABEL: test_v8i16:
; AVX512: # BB#0:
; AVX512-NEXT: vmovntdqa (%rdi), %xmm0
; AVX512-NEXT: retq
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
%1 = load <8 x i16>, <8 x i16>* %src, align 16, !nontemporal !1
ret <8 x i16> %1
}
define <16 x i8> @test_v16i8(<16 x i8>* %src) {
[X86][SSE] Add general lowering of nontemporal vector loads Currently the only way to use the (V)MOVNTDQA nontemporal vector loads instructions is through the int_x86_sse41_movntdqa style builtins. This patch adds support for lowering nontemporal loads from general IR, allowing us to remove the movntdqa builtins in a future patch. We currently still fold nontemporal loads into suitable instructions, we should probably look at removing this (and nontemporal stores as well) or at least make the target's folding implementation aware that its dealing with a nontemporal memory transaction. There is also an issue that VMOVNTDQA only acts on 128-bit vectors on pre-AVX2 hardware - so currently a normal ymm load is still used on AVX1 targets. Differential Review: http://reviews.llvm.org/D20965 llvm-svn: 272010
2016-06-07 21:34:24 +08:00
; SSE2-LABEL: test_v16i8:
; SSE2: # BB#0:
; SSE2-NEXT: movaps (%rdi), %xmm0
; SSE2-NEXT: retq
;
; SSE41-LABEL: test_v16i8:
; SSE41: # BB#0:
; SSE41-NEXT: movntdqa (%rdi), %xmm0
; SSE41-NEXT: retq
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
;
; AVX-LABEL: test_v16i8:
; AVX: # BB#0:
[X86][SSE] Add general lowering of nontemporal vector loads Currently the only way to use the (V)MOVNTDQA nontemporal vector loads instructions is through the int_x86_sse41_movntdqa style builtins. This patch adds support for lowering nontemporal loads from general IR, allowing us to remove the movntdqa builtins in a future patch. We currently still fold nontemporal loads into suitable instructions, we should probably look at removing this (and nontemporal stores as well) or at least make the target's folding implementation aware that its dealing with a nontemporal memory transaction. There is also an issue that VMOVNTDQA only acts on 128-bit vectors on pre-AVX2 hardware - so currently a normal ymm load is still used on AVX1 targets. Differential Review: http://reviews.llvm.org/D20965 llvm-svn: 272010
2016-06-07 21:34:24 +08:00
; AVX-NEXT: vmovntdqa (%rdi), %xmm0
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
; AVX-NEXT: retq
;
[X86][SSE] Add general lowering of nontemporal vector loads Currently the only way to use the (V)MOVNTDQA nontemporal vector loads instructions is through the int_x86_sse41_movntdqa style builtins. This patch adds support for lowering nontemporal loads from general IR, allowing us to remove the movntdqa builtins in a future patch. We currently still fold nontemporal loads into suitable instructions, we should probably look at removing this (and nontemporal stores as well) or at least make the target's folding implementation aware that its dealing with a nontemporal memory transaction. There is also an issue that VMOVNTDQA only acts on 128-bit vectors on pre-AVX2 hardware - so currently a normal ymm load is still used on AVX1 targets. Differential Review: http://reviews.llvm.org/D20965 llvm-svn: 272010
2016-06-07 21:34:24 +08:00
; AVX512-LABEL: test_v16i8:
; AVX512: # BB#0:
; AVX512-NEXT: vmovntdqa (%rdi), %xmm0
; AVX512-NEXT: retq
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
%1 = load <16 x i8>, <16 x i8>* %src, align 16, !nontemporal !1
ret <16 x i8> %1
}
; And now YMM versions.
define <8 x float> @test_v8f32(<8 x float>* %src) {
[X86][SSE] Add general lowering of nontemporal vector loads Currently the only way to use the (V)MOVNTDQA nontemporal vector loads instructions is through the int_x86_sse41_movntdqa style builtins. This patch adds support for lowering nontemporal loads from general IR, allowing us to remove the movntdqa builtins in a future patch. We currently still fold nontemporal loads into suitable instructions, we should probably look at removing this (and nontemporal stores as well) or at least make the target's folding implementation aware that its dealing with a nontemporal memory transaction. There is also an issue that VMOVNTDQA only acts on 128-bit vectors on pre-AVX2 hardware - so currently a normal ymm load is still used on AVX1 targets. Differential Review: http://reviews.llvm.org/D20965 llvm-svn: 272010
2016-06-07 21:34:24 +08:00
; SSE2-LABEL: test_v8f32:
; SSE2: # BB#0:
; SSE2-NEXT: movaps (%rdi), %xmm0
; SSE2-NEXT: movaps 16(%rdi), %xmm1
; SSE2-NEXT: retq
;
; SSE41-LABEL: test_v8f32:
; SSE41: # BB#0:
; SSE41-NEXT: movntdqa (%rdi), %xmm0
; SSE41-NEXT: movntdqa 16(%rdi), %xmm1
; SSE41-NEXT: retq
;
; AVX1-LABEL: test_v8f32:
; AVX1: # BB#0:
[X86][AVX1] Split 256-bit vector non-temporal loads to keep it non-temporal (PR32744) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304718
2017-06-06 00:02:01 +08:00
; AVX1-NEXT: vmovntdqa (%rdi), %xmm0
; AVX1-NEXT: vmovntdqa 16(%rdi), %xmm1
; AVX1-NEXT: vinsertf128 $1, %xmm1, %ymm0, %ymm0
[X86][SSE] Add general lowering of nontemporal vector loads Currently the only way to use the (V)MOVNTDQA nontemporal vector loads instructions is through the int_x86_sse41_movntdqa style builtins. This patch adds support for lowering nontemporal loads from general IR, allowing us to remove the movntdqa builtins in a future patch. We currently still fold nontemporal loads into suitable instructions, we should probably look at removing this (and nontemporal stores as well) or at least make the target's folding implementation aware that its dealing with a nontemporal memory transaction. There is also an issue that VMOVNTDQA only acts on 128-bit vectors on pre-AVX2 hardware - so currently a normal ymm load is still used on AVX1 targets. Differential Review: http://reviews.llvm.org/D20965 llvm-svn: 272010
2016-06-07 21:34:24 +08:00
; AVX1-NEXT: retq
;
; AVX2-LABEL: test_v8f32:
; AVX2: # BB#0:
; AVX2-NEXT: vmovntdqa (%rdi), %ymm0
; AVX2-NEXT: retq
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
;
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; AVX512-LABEL: test_v8f32:
; AVX512: # BB#0:
[X86][SSE] Add general lowering of nontemporal vector loads Currently the only way to use the (V)MOVNTDQA nontemporal vector loads instructions is through the int_x86_sse41_movntdqa style builtins. This patch adds support for lowering nontemporal loads from general IR, allowing us to remove the movntdqa builtins in a future patch. We currently still fold nontemporal loads into suitable instructions, we should probably look at removing this (and nontemporal stores as well) or at least make the target's folding implementation aware that its dealing with a nontemporal memory transaction. There is also an issue that VMOVNTDQA only acts on 128-bit vectors on pre-AVX2 hardware - so currently a normal ymm load is still used on AVX1 targets. Differential Review: http://reviews.llvm.org/D20965 llvm-svn: 272010
2016-06-07 21:34:24 +08:00
; AVX512-NEXT: vmovntdqa (%rdi), %ymm0
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; AVX512-NEXT: retq
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
%1 = load <8 x float>, <8 x float>* %src, align 32, !nontemporal !1
ret <8 x float> %1
}
define <8 x i32> @test_v8i32(<8 x i32>* %src) {
[X86][SSE] Add general lowering of nontemporal vector loads Currently the only way to use the (V)MOVNTDQA nontemporal vector loads instructions is through the int_x86_sse41_movntdqa style builtins. This patch adds support for lowering nontemporal loads from general IR, allowing us to remove the movntdqa builtins in a future patch. We currently still fold nontemporal loads into suitable instructions, we should probably look at removing this (and nontemporal stores as well) or at least make the target's folding implementation aware that its dealing with a nontemporal memory transaction. There is also an issue that VMOVNTDQA only acts on 128-bit vectors on pre-AVX2 hardware - so currently a normal ymm load is still used on AVX1 targets. Differential Review: http://reviews.llvm.org/D20965 llvm-svn: 272010
2016-06-07 21:34:24 +08:00
; SSE2-LABEL: test_v8i32:
; SSE2: # BB#0:
; SSE2-NEXT: movaps (%rdi), %xmm0
; SSE2-NEXT: movaps 16(%rdi), %xmm1
; SSE2-NEXT: retq
;
; SSE41-LABEL: test_v8i32:
; SSE41: # BB#0:
; SSE41-NEXT: movntdqa (%rdi), %xmm0
; SSE41-NEXT: movntdqa 16(%rdi), %xmm1
; SSE41-NEXT: retq
;
; AVX1-LABEL: test_v8i32:
; AVX1: # BB#0:
[X86][AVX1] Split 256-bit vector non-temporal loads to keep it non-temporal (PR32744) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304718
2017-06-06 00:02:01 +08:00
; AVX1-NEXT: vmovntdqa (%rdi), %xmm0
; AVX1-NEXT: vmovntdqa 16(%rdi), %xmm1
; AVX1-NEXT: vinsertf128 $1, %xmm1, %ymm0, %ymm0
[X86][SSE] Add general lowering of nontemporal vector loads Currently the only way to use the (V)MOVNTDQA nontemporal vector loads instructions is through the int_x86_sse41_movntdqa style builtins. This patch adds support for lowering nontemporal loads from general IR, allowing us to remove the movntdqa builtins in a future patch. We currently still fold nontemporal loads into suitable instructions, we should probably look at removing this (and nontemporal stores as well) or at least make the target's folding implementation aware that its dealing with a nontemporal memory transaction. There is also an issue that VMOVNTDQA only acts on 128-bit vectors on pre-AVX2 hardware - so currently a normal ymm load is still used on AVX1 targets. Differential Review: http://reviews.llvm.org/D20965 llvm-svn: 272010
2016-06-07 21:34:24 +08:00
; AVX1-NEXT: retq
;
; AVX2-LABEL: test_v8i32:
; AVX2: # BB#0:
; AVX2-NEXT: vmovntdqa (%rdi), %ymm0
; AVX2-NEXT: retq
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
;
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; AVX512F-LABEL: test_v8i32:
; AVX512F: # BB#0:
[X86][SSE] Add general lowering of nontemporal vector loads Currently the only way to use the (V)MOVNTDQA nontemporal vector loads instructions is through the int_x86_sse41_movntdqa style builtins. This patch adds support for lowering nontemporal loads from general IR, allowing us to remove the movntdqa builtins in a future patch. We currently still fold nontemporal loads into suitable instructions, we should probably look at removing this (and nontemporal stores as well) or at least make the target's folding implementation aware that its dealing with a nontemporal memory transaction. There is also an issue that VMOVNTDQA only acts on 128-bit vectors on pre-AVX2 hardware - so currently a normal ymm load is still used on AVX1 targets. Differential Review: http://reviews.llvm.org/D20965 llvm-svn: 272010
2016-06-07 21:34:24 +08:00
; AVX512F-NEXT: vmovntdqa (%rdi), %ymm0
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; AVX512F-NEXT: retq
;
; AVX512BW-LABEL: test_v8i32:
; AVX512BW: # BB#0:
[X86][SSE] Add general lowering of nontemporal vector loads Currently the only way to use the (V)MOVNTDQA nontemporal vector loads instructions is through the int_x86_sse41_movntdqa style builtins. This patch adds support for lowering nontemporal loads from general IR, allowing us to remove the movntdqa builtins in a future patch. We currently still fold nontemporal loads into suitable instructions, we should probably look at removing this (and nontemporal stores as well) or at least make the target's folding implementation aware that its dealing with a nontemporal memory transaction. There is also an issue that VMOVNTDQA only acts on 128-bit vectors on pre-AVX2 hardware - so currently a normal ymm load is still used on AVX1 targets. Differential Review: http://reviews.llvm.org/D20965 llvm-svn: 272010
2016-06-07 21:34:24 +08:00
; AVX512BW-NEXT: vmovntdqa (%rdi), %ymm0
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; AVX512BW-NEXT: retq
;
; AVX512VL-LABEL: test_v8i32:
; AVX512VL: # BB#0:
[AVX-512] Fix duplicate column in AVX512 execution dependency table that was preventing VMOVDQU32/VMOVDQA32 from being recognized. Fix a bug in the code that stops execution dependency fix from turning operations on 32-bit integer element types into operations on 64-bit integer element types. llvm-svn: 277327
2016-08-01 15:55:33 +08:00
; AVX512VL-NEXT: vmovaps (%rdi), %ymm0
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; AVX512VL-NEXT: retq
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
%1 = load <8 x i32>, <8 x i32>* %src, align 32, !nontemporal !1
ret <8 x i32> %1
}
define <4 x double> @test_v4f64(<4 x double>* %src) {
[X86][SSE] Add general lowering of nontemporal vector loads Currently the only way to use the (V)MOVNTDQA nontemporal vector loads instructions is through the int_x86_sse41_movntdqa style builtins. This patch adds support for lowering nontemporal loads from general IR, allowing us to remove the movntdqa builtins in a future patch. We currently still fold nontemporal loads into suitable instructions, we should probably look at removing this (and nontemporal stores as well) or at least make the target's folding implementation aware that its dealing with a nontemporal memory transaction. There is also an issue that VMOVNTDQA only acts on 128-bit vectors on pre-AVX2 hardware - so currently a normal ymm load is still used on AVX1 targets. Differential Review: http://reviews.llvm.org/D20965 llvm-svn: 272010
2016-06-07 21:34:24 +08:00
; SSE2-LABEL: test_v4f64:
; SSE2: # BB#0:
; SSE2-NEXT: movaps (%rdi), %xmm0
; SSE2-NEXT: movaps 16(%rdi), %xmm1
; SSE2-NEXT: retq
;
; SSE41-LABEL: test_v4f64:
; SSE41: # BB#0:
; SSE41-NEXT: movntdqa (%rdi), %xmm0
; SSE41-NEXT: movntdqa 16(%rdi), %xmm1
; SSE41-NEXT: retq
;
; AVX1-LABEL: test_v4f64:
; AVX1: # BB#0:
[X86][AVX1] Split 256-bit vector non-temporal loads to keep it non-temporal (PR32744) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304718
2017-06-06 00:02:01 +08:00
; AVX1-NEXT: vmovntdqa (%rdi), %xmm0
; AVX1-NEXT: vmovntdqa 16(%rdi), %xmm1
; AVX1-NEXT: vinsertf128 $1, %xmm1, %ymm0, %ymm0
[X86][SSE] Add general lowering of nontemporal vector loads Currently the only way to use the (V)MOVNTDQA nontemporal vector loads instructions is through the int_x86_sse41_movntdqa style builtins. This patch adds support for lowering nontemporal loads from general IR, allowing us to remove the movntdqa builtins in a future patch. We currently still fold nontemporal loads into suitable instructions, we should probably look at removing this (and nontemporal stores as well) or at least make the target's folding implementation aware that its dealing with a nontemporal memory transaction. There is also an issue that VMOVNTDQA only acts on 128-bit vectors on pre-AVX2 hardware - so currently a normal ymm load is still used on AVX1 targets. Differential Review: http://reviews.llvm.org/D20965 llvm-svn: 272010
2016-06-07 21:34:24 +08:00
; AVX1-NEXT: retq
;
; AVX2-LABEL: test_v4f64:
; AVX2: # BB#0:
; AVX2-NEXT: vmovntdqa (%rdi), %ymm0
; AVX2-NEXT: retq
;
; AVX512-LABEL: test_v4f64:
; AVX512: # BB#0:
; AVX512-NEXT: vmovntdqa (%rdi), %ymm0
; AVX512-NEXT: retq
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
%1 = load <4 x double>, <4 x double>* %src, align 32, !nontemporal !1
ret <4 x double> %1
}
define <4 x i64> @test_v4i64(<4 x i64>* %src) {
[X86][SSE] Add general lowering of nontemporal vector loads Currently the only way to use the (V)MOVNTDQA nontemporal vector loads instructions is through the int_x86_sse41_movntdqa style builtins. This patch adds support for lowering nontemporal loads from general IR, allowing us to remove the movntdqa builtins in a future patch. We currently still fold nontemporal loads into suitable instructions, we should probably look at removing this (and nontemporal stores as well) or at least make the target's folding implementation aware that its dealing with a nontemporal memory transaction. There is also an issue that VMOVNTDQA only acts on 128-bit vectors on pre-AVX2 hardware - so currently a normal ymm load is still used on AVX1 targets. Differential Review: http://reviews.llvm.org/D20965 llvm-svn: 272010
2016-06-07 21:34:24 +08:00
; SSE2-LABEL: test_v4i64:
; SSE2: # BB#0:
; SSE2-NEXT: movaps (%rdi), %xmm0
; SSE2-NEXT: movaps 16(%rdi), %xmm1
; SSE2-NEXT: retq
;
; SSE41-LABEL: test_v4i64:
; SSE41: # BB#0:
; SSE41-NEXT: movntdqa (%rdi), %xmm0
; SSE41-NEXT: movntdqa 16(%rdi), %xmm1
; SSE41-NEXT: retq
;
; AVX1-LABEL: test_v4i64:
; AVX1: # BB#0:
[X86][AVX1] Split 256-bit vector non-temporal loads to keep it non-temporal (PR32744) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304718
2017-06-06 00:02:01 +08:00
; AVX1-NEXT: vmovntdqa (%rdi), %xmm0
; AVX1-NEXT: vmovntdqa 16(%rdi), %xmm1
; AVX1-NEXT: vinsertf128 $1, %xmm1, %ymm0, %ymm0
[X86][SSE] Add general lowering of nontemporal vector loads Currently the only way to use the (V)MOVNTDQA nontemporal vector loads instructions is through the int_x86_sse41_movntdqa style builtins. This patch adds support for lowering nontemporal loads from general IR, allowing us to remove the movntdqa builtins in a future patch. We currently still fold nontemporal loads into suitable instructions, we should probably look at removing this (and nontemporal stores as well) or at least make the target's folding implementation aware that its dealing with a nontemporal memory transaction. There is also an issue that VMOVNTDQA only acts on 128-bit vectors on pre-AVX2 hardware - so currently a normal ymm load is still used on AVX1 targets. Differential Review: http://reviews.llvm.org/D20965 llvm-svn: 272010
2016-06-07 21:34:24 +08:00
; AVX1-NEXT: retq
;
; AVX2-LABEL: test_v4i64:
; AVX2: # BB#0:
; AVX2-NEXT: vmovntdqa (%rdi), %ymm0
; AVX2-NEXT: retq
;
; AVX512-LABEL: test_v4i64:
; AVX512: # BB#0:
; AVX512-NEXT: vmovntdqa (%rdi), %ymm0
; AVX512-NEXT: retq
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
%1 = load <4 x i64>, <4 x i64>* %src, align 32, !nontemporal !1
ret <4 x i64> %1
}
define <16 x i16> @test_v16i16(<16 x i16>* %src) {
[X86][SSE] Add general lowering of nontemporal vector loads Currently the only way to use the (V)MOVNTDQA nontemporal vector loads instructions is through the int_x86_sse41_movntdqa style builtins. This patch adds support for lowering nontemporal loads from general IR, allowing us to remove the movntdqa builtins in a future patch. We currently still fold nontemporal loads into suitable instructions, we should probably look at removing this (and nontemporal stores as well) or at least make the target's folding implementation aware that its dealing with a nontemporal memory transaction. There is also an issue that VMOVNTDQA only acts on 128-bit vectors on pre-AVX2 hardware - so currently a normal ymm load is still used on AVX1 targets. Differential Review: http://reviews.llvm.org/D20965 llvm-svn: 272010
2016-06-07 21:34:24 +08:00
; SSE2-LABEL: test_v16i16:
; SSE2: # BB#0:
; SSE2-NEXT: movaps (%rdi), %xmm0
; SSE2-NEXT: movaps 16(%rdi), %xmm1
; SSE2-NEXT: retq
;
; SSE41-LABEL: test_v16i16:
; SSE41: # BB#0:
; SSE41-NEXT: movntdqa (%rdi), %xmm0
; SSE41-NEXT: movntdqa 16(%rdi), %xmm1
; SSE41-NEXT: retq
;
; AVX1-LABEL: test_v16i16:
; AVX1: # BB#0:
[X86][AVX1] Split 256-bit vector non-temporal loads to keep it non-temporal (PR32744) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304718
2017-06-06 00:02:01 +08:00
; AVX1-NEXT: vmovntdqa (%rdi), %xmm0
; AVX1-NEXT: vmovntdqa 16(%rdi), %xmm1
; AVX1-NEXT: vinsertf128 $1, %xmm1, %ymm0, %ymm0
[X86][SSE] Add general lowering of nontemporal vector loads Currently the only way to use the (V)MOVNTDQA nontemporal vector loads instructions is through the int_x86_sse41_movntdqa style builtins. This patch adds support for lowering nontemporal loads from general IR, allowing us to remove the movntdqa builtins in a future patch. We currently still fold nontemporal loads into suitable instructions, we should probably look at removing this (and nontemporal stores as well) or at least make the target's folding implementation aware that its dealing with a nontemporal memory transaction. There is also an issue that VMOVNTDQA only acts on 128-bit vectors on pre-AVX2 hardware - so currently a normal ymm load is still used on AVX1 targets. Differential Review: http://reviews.llvm.org/D20965 llvm-svn: 272010
2016-06-07 21:34:24 +08:00
; AVX1-NEXT: retq
;
; AVX2-LABEL: test_v16i16:
; AVX2: # BB#0:
; AVX2-NEXT: vmovntdqa (%rdi), %ymm0
; AVX2-NEXT: retq
;
; AVX512-LABEL: test_v16i16:
; AVX512: # BB#0:
; AVX512-NEXT: vmovntdqa (%rdi), %ymm0
; AVX512-NEXT: retq
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
%1 = load <16 x i16>, <16 x i16>* %src, align 32, !nontemporal !1
ret <16 x i16> %1
}
define <32 x i8> @test_v32i8(<32 x i8>* %src) {
[X86][SSE] Add general lowering of nontemporal vector loads Currently the only way to use the (V)MOVNTDQA nontemporal vector loads instructions is through the int_x86_sse41_movntdqa style builtins. This patch adds support for lowering nontemporal loads from general IR, allowing us to remove the movntdqa builtins in a future patch. We currently still fold nontemporal loads into suitable instructions, we should probably look at removing this (and nontemporal stores as well) or at least make the target's folding implementation aware that its dealing with a nontemporal memory transaction. There is also an issue that VMOVNTDQA only acts on 128-bit vectors on pre-AVX2 hardware - so currently a normal ymm load is still used on AVX1 targets. Differential Review: http://reviews.llvm.org/D20965 llvm-svn: 272010
2016-06-07 21:34:24 +08:00
; SSE2-LABEL: test_v32i8:
; SSE2: # BB#0:
; SSE2-NEXT: movaps (%rdi), %xmm0
; SSE2-NEXT: movaps 16(%rdi), %xmm1
; SSE2-NEXT: retq
;
; SSE41-LABEL: test_v32i8:
; SSE41: # BB#0:
; SSE41-NEXT: movntdqa (%rdi), %xmm0
; SSE41-NEXT: movntdqa 16(%rdi), %xmm1
; SSE41-NEXT: retq
;
; AVX1-LABEL: test_v32i8:
; AVX1: # BB#0:
[X86][AVX1] Split 256-bit vector non-temporal loads to keep it non-temporal (PR32744) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304718
2017-06-06 00:02:01 +08:00
; AVX1-NEXT: vmovntdqa (%rdi), %xmm0
; AVX1-NEXT: vmovntdqa 16(%rdi), %xmm1
; AVX1-NEXT: vinsertf128 $1, %xmm1, %ymm0, %ymm0
[X86][SSE] Add general lowering of nontemporal vector loads Currently the only way to use the (V)MOVNTDQA nontemporal vector loads instructions is through the int_x86_sse41_movntdqa style builtins. This patch adds support for lowering nontemporal loads from general IR, allowing us to remove the movntdqa builtins in a future patch. We currently still fold nontemporal loads into suitable instructions, we should probably look at removing this (and nontemporal stores as well) or at least make the target's folding implementation aware that its dealing with a nontemporal memory transaction. There is also an issue that VMOVNTDQA only acts on 128-bit vectors on pre-AVX2 hardware - so currently a normal ymm load is still used on AVX1 targets. Differential Review: http://reviews.llvm.org/D20965 llvm-svn: 272010
2016-06-07 21:34:24 +08:00
; AVX1-NEXT: retq
;
; AVX2-LABEL: test_v32i8:
; AVX2: # BB#0:
; AVX2-NEXT: vmovntdqa (%rdi), %ymm0
; AVX2-NEXT: retq
;
; AVX512-LABEL: test_v32i8:
; AVX512: # BB#0:
; AVX512-NEXT: vmovntdqa (%rdi), %ymm0
; AVX512-NEXT: retq
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
%1 = load <32 x i8>, <32 x i8>* %src, align 32, !nontemporal !1
ret <32 x i8> %1
}
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; And now ZMM versions.
define <16 x float> @test_v16f32(<16 x float>* %src) {
[X86][SSE] Add general lowering of nontemporal vector loads Currently the only way to use the (V)MOVNTDQA nontemporal vector loads instructions is through the int_x86_sse41_movntdqa style builtins. This patch adds support for lowering nontemporal loads from general IR, allowing us to remove the movntdqa builtins in a future patch. We currently still fold nontemporal loads into suitable instructions, we should probably look at removing this (and nontemporal stores as well) or at least make the target's folding implementation aware that its dealing with a nontemporal memory transaction. There is also an issue that VMOVNTDQA only acts on 128-bit vectors on pre-AVX2 hardware - so currently a normal ymm load is still used on AVX1 targets. Differential Review: http://reviews.llvm.org/D20965 llvm-svn: 272010
2016-06-07 21:34:24 +08:00
; SSE2-LABEL: test_v16f32:
; SSE2: # BB#0:
; SSE2-NEXT: movaps (%rdi), %xmm0
; SSE2-NEXT: movaps 16(%rdi), %xmm1
; SSE2-NEXT: movaps 32(%rdi), %xmm2
; SSE2-NEXT: movaps 48(%rdi), %xmm3
; SSE2-NEXT: retq
;
; SSE41-LABEL: test_v16f32:
; SSE41: # BB#0:
; SSE41-NEXT: movntdqa (%rdi), %xmm0
; SSE41-NEXT: movntdqa 16(%rdi), %xmm1
; SSE41-NEXT: movntdqa 32(%rdi), %xmm2
; SSE41-NEXT: movntdqa 48(%rdi), %xmm3
; SSE41-NEXT: retq
;
; AVX1-LABEL: test_v16f32:
; AVX1: # BB#0:
[X86][AVX1] Split 256-bit vector non-temporal loads to keep it non-temporal (PR32744) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304718
2017-06-06 00:02:01 +08:00
; AVX1-NEXT: vmovntdqa (%rdi), %xmm0
; AVX1-NEXT: vmovntdqa 16(%rdi), %xmm1
; AVX1-NEXT: vinsertf128 $1, %xmm1, %ymm0, %ymm0
; AVX1-NEXT: vmovntdqa 32(%rdi), %xmm1
; AVX1-NEXT: vmovntdqa 48(%rdi), %xmm2
; AVX1-NEXT: vinsertf128 $1, %xmm2, %ymm1, %ymm1
[X86][SSE] Add general lowering of nontemporal vector loads Currently the only way to use the (V)MOVNTDQA nontemporal vector loads instructions is through the int_x86_sse41_movntdqa style builtins. This patch adds support for lowering nontemporal loads from general IR, allowing us to remove the movntdqa builtins in a future patch. We currently still fold nontemporal loads into suitable instructions, we should probably look at removing this (and nontemporal stores as well) or at least make the target's folding implementation aware that its dealing with a nontemporal memory transaction. There is also an issue that VMOVNTDQA only acts on 128-bit vectors on pre-AVX2 hardware - so currently a normal ymm load is still used on AVX1 targets. Differential Review: http://reviews.llvm.org/D20965 llvm-svn: 272010
2016-06-07 21:34:24 +08:00
; AVX1-NEXT: retq
;
; AVX2-LABEL: test_v16f32:
; AVX2: # BB#0:
; AVX2-NEXT: vmovntdqa (%rdi), %ymm0
; AVX2-NEXT: vmovntdqa 32(%rdi), %ymm1
; AVX2-NEXT: retq
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
;
; AVX512-LABEL: test_v16f32:
; AVX512: # BB#0:
[X86][SSE] Add general lowering of nontemporal vector loads Currently the only way to use the (V)MOVNTDQA nontemporal vector loads instructions is through the int_x86_sse41_movntdqa style builtins. This patch adds support for lowering nontemporal loads from general IR, allowing us to remove the movntdqa builtins in a future patch. We currently still fold nontemporal loads into suitable instructions, we should probably look at removing this (and nontemporal stores as well) or at least make the target's folding implementation aware that its dealing with a nontemporal memory transaction. There is also an issue that VMOVNTDQA only acts on 128-bit vectors on pre-AVX2 hardware - so currently a normal ymm load is still used on AVX1 targets. Differential Review: http://reviews.llvm.org/D20965 llvm-svn: 272010
2016-06-07 21:34:24 +08:00
; AVX512-NEXT: vmovntdqa (%rdi), %zmm0
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; AVX512-NEXT: retq
[X86][AVX512] Fixed 512-bit vector nontemporal load alignment llvm-svn: 271673
2016-06-03 22:12:43 +08:00
%1 = load <16 x float>, <16 x float>* %src, align 64, !nontemporal !1
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
ret <16 x float> %1
}
define <16 x i32> @test_v16i32(<16 x i32>* %src) {
[X86][SSE] Add general lowering of nontemporal vector loads Currently the only way to use the (V)MOVNTDQA nontemporal vector loads instructions is through the int_x86_sse41_movntdqa style builtins. This patch adds support for lowering nontemporal loads from general IR, allowing us to remove the movntdqa builtins in a future patch. We currently still fold nontemporal loads into suitable instructions, we should probably look at removing this (and nontemporal stores as well) or at least make the target's folding implementation aware that its dealing with a nontemporal memory transaction. There is also an issue that VMOVNTDQA only acts on 128-bit vectors on pre-AVX2 hardware - so currently a normal ymm load is still used on AVX1 targets. Differential Review: http://reviews.llvm.org/D20965 llvm-svn: 272010
2016-06-07 21:34:24 +08:00
; SSE2-LABEL: test_v16i32:
; SSE2: # BB#0:
; SSE2-NEXT: movaps (%rdi), %xmm0
; SSE2-NEXT: movaps 16(%rdi), %xmm1
; SSE2-NEXT: movaps 32(%rdi), %xmm2
; SSE2-NEXT: movaps 48(%rdi), %xmm3
; SSE2-NEXT: retq
;
; SSE41-LABEL: test_v16i32:
; SSE41: # BB#0:
; SSE41-NEXT: movntdqa (%rdi), %xmm0
; SSE41-NEXT: movntdqa 16(%rdi), %xmm1
; SSE41-NEXT: movntdqa 32(%rdi), %xmm2
; SSE41-NEXT: movntdqa 48(%rdi), %xmm3
; SSE41-NEXT: retq
;
; AVX1-LABEL: test_v16i32:
; AVX1: # BB#0:
[X86][AVX1] Split 256-bit vector non-temporal loads to keep it non-temporal (PR32744) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304718
2017-06-06 00:02:01 +08:00
; AVX1-NEXT: vmovntdqa (%rdi), %xmm0
; AVX1-NEXT: vmovntdqa 16(%rdi), %xmm1
; AVX1-NEXT: vinsertf128 $1, %xmm1, %ymm0, %ymm0
; AVX1-NEXT: vmovntdqa 32(%rdi), %xmm1
; AVX1-NEXT: vmovntdqa 48(%rdi), %xmm2
; AVX1-NEXT: vinsertf128 $1, %xmm2, %ymm1, %ymm1
[X86][SSE] Add general lowering of nontemporal vector loads Currently the only way to use the (V)MOVNTDQA nontemporal vector loads instructions is through the int_x86_sse41_movntdqa style builtins. This patch adds support for lowering nontemporal loads from general IR, allowing us to remove the movntdqa builtins in a future patch. We currently still fold nontemporal loads into suitable instructions, we should probably look at removing this (and nontemporal stores as well) or at least make the target's folding implementation aware that its dealing with a nontemporal memory transaction. There is also an issue that VMOVNTDQA only acts on 128-bit vectors on pre-AVX2 hardware - so currently a normal ymm load is still used on AVX1 targets. Differential Review: http://reviews.llvm.org/D20965 llvm-svn: 272010
2016-06-07 21:34:24 +08:00
; AVX1-NEXT: retq
;
; AVX2-LABEL: test_v16i32:
; AVX2: # BB#0:
; AVX2-NEXT: vmovntdqa (%rdi), %ymm0
; AVX2-NEXT: vmovntdqa 32(%rdi), %ymm1
; AVX2-NEXT: retq
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
;
; AVX512-LABEL: test_v16i32:
; AVX512: # BB#0:
[X86][SSE] Add general lowering of nontemporal vector loads Currently the only way to use the (V)MOVNTDQA nontemporal vector loads instructions is through the int_x86_sse41_movntdqa style builtins. This patch adds support for lowering nontemporal loads from general IR, allowing us to remove the movntdqa builtins in a future patch. We currently still fold nontemporal loads into suitable instructions, we should probably look at removing this (and nontemporal stores as well) or at least make the target's folding implementation aware that its dealing with a nontemporal memory transaction. There is also an issue that VMOVNTDQA only acts on 128-bit vectors on pre-AVX2 hardware - so currently a normal ymm load is still used on AVX1 targets. Differential Review: http://reviews.llvm.org/D20965 llvm-svn: 272010
2016-06-07 21:34:24 +08:00
; AVX512-NEXT: vmovntdqa (%rdi), %zmm0
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; AVX512-NEXT: retq
[X86][AVX512] Fixed 512-bit vector nontemporal load alignment llvm-svn: 271673
2016-06-03 22:12:43 +08:00
%1 = load <16 x i32>, <16 x i32>* %src, align 64, !nontemporal !1
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
ret <16 x i32> %1
}
define <8 x double> @test_v8f64(<8 x double>* %src) {
[X86][SSE] Add general lowering of nontemporal vector loads Currently the only way to use the (V)MOVNTDQA nontemporal vector loads instructions is through the int_x86_sse41_movntdqa style builtins. This patch adds support for lowering nontemporal loads from general IR, allowing us to remove the movntdqa builtins in a future patch. We currently still fold nontemporal loads into suitable instructions, we should probably look at removing this (and nontemporal stores as well) or at least make the target's folding implementation aware that its dealing with a nontemporal memory transaction. There is also an issue that VMOVNTDQA only acts on 128-bit vectors on pre-AVX2 hardware - so currently a normal ymm load is still used on AVX1 targets. Differential Review: http://reviews.llvm.org/D20965 llvm-svn: 272010
2016-06-07 21:34:24 +08:00
; SSE2-LABEL: test_v8f64:
; SSE2: # BB#0:
; SSE2-NEXT: movaps (%rdi), %xmm0
; SSE2-NEXT: movaps 16(%rdi), %xmm1
; SSE2-NEXT: movaps 32(%rdi), %xmm2
; SSE2-NEXT: movaps 48(%rdi), %xmm3
; SSE2-NEXT: retq
;
; SSE41-LABEL: test_v8f64:
; SSE41: # BB#0:
; SSE41-NEXT: movntdqa (%rdi), %xmm0
; SSE41-NEXT: movntdqa 16(%rdi), %xmm1
; SSE41-NEXT: movntdqa 32(%rdi), %xmm2
; SSE41-NEXT: movntdqa 48(%rdi), %xmm3
; SSE41-NEXT: retq
;
; AVX1-LABEL: test_v8f64:
; AVX1: # BB#0:
[X86][AVX1] Split 256-bit vector non-temporal loads to keep it non-temporal (PR32744) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304718
2017-06-06 00:02:01 +08:00
; AVX1-NEXT: vmovntdqa (%rdi), %xmm0
; AVX1-NEXT: vmovntdqa 16(%rdi), %xmm1
; AVX1-NEXT: vinsertf128 $1, %xmm1, %ymm0, %ymm0
; AVX1-NEXT: vmovntdqa 32(%rdi), %xmm1
; AVX1-NEXT: vmovntdqa 48(%rdi), %xmm2
; AVX1-NEXT: vinsertf128 $1, %xmm2, %ymm1, %ymm1
[X86][SSE] Add general lowering of nontemporal vector loads Currently the only way to use the (V)MOVNTDQA nontemporal vector loads instructions is through the int_x86_sse41_movntdqa style builtins. This patch adds support for lowering nontemporal loads from general IR, allowing us to remove the movntdqa builtins in a future patch. We currently still fold nontemporal loads into suitable instructions, we should probably look at removing this (and nontemporal stores as well) or at least make the target's folding implementation aware that its dealing with a nontemporal memory transaction. There is also an issue that VMOVNTDQA only acts on 128-bit vectors on pre-AVX2 hardware - so currently a normal ymm load is still used on AVX1 targets. Differential Review: http://reviews.llvm.org/D20965 llvm-svn: 272010
2016-06-07 21:34:24 +08:00
; AVX1-NEXT: retq
;
; AVX2-LABEL: test_v8f64:
; AVX2: # BB#0:
; AVX2-NEXT: vmovntdqa (%rdi), %ymm0
; AVX2-NEXT: vmovntdqa 32(%rdi), %ymm1
; AVX2-NEXT: retq
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
;
; AVX512-LABEL: test_v8f64:
; AVX512: # BB#0:
[X86][SSE] Add general lowering of nontemporal vector loads Currently the only way to use the (V)MOVNTDQA nontemporal vector loads instructions is through the int_x86_sse41_movntdqa style builtins. This patch adds support for lowering nontemporal loads from general IR, allowing us to remove the movntdqa builtins in a future patch. We currently still fold nontemporal loads into suitable instructions, we should probably look at removing this (and nontemporal stores as well) or at least make the target's folding implementation aware that its dealing with a nontemporal memory transaction. There is also an issue that VMOVNTDQA only acts on 128-bit vectors on pre-AVX2 hardware - so currently a normal ymm load is still used on AVX1 targets. Differential Review: http://reviews.llvm.org/D20965 llvm-svn: 272010
2016-06-07 21:34:24 +08:00
; AVX512-NEXT: vmovntdqa (%rdi), %zmm0
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; AVX512-NEXT: retq
[X86][AVX512] Fixed 512-bit vector nontemporal load alignment llvm-svn: 271673
2016-06-03 22:12:43 +08:00
%1 = load <8 x double>, <8 x double>* %src, align 64, !nontemporal !1
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
ret <8 x double> %1
}
define <8 x i64> @test_v8i64(<8 x i64>* %src) {
[X86][SSE] Add general lowering of nontemporal vector loads Currently the only way to use the (V)MOVNTDQA nontemporal vector loads instructions is through the int_x86_sse41_movntdqa style builtins. This patch adds support for lowering nontemporal loads from general IR, allowing us to remove the movntdqa builtins in a future patch. We currently still fold nontemporal loads into suitable instructions, we should probably look at removing this (and nontemporal stores as well) or at least make the target's folding implementation aware that its dealing with a nontemporal memory transaction. There is also an issue that VMOVNTDQA only acts on 128-bit vectors on pre-AVX2 hardware - so currently a normal ymm load is still used on AVX1 targets. Differential Review: http://reviews.llvm.org/D20965 llvm-svn: 272010
2016-06-07 21:34:24 +08:00
; SSE2-LABEL: test_v8i64:
; SSE2: # BB#0:
; SSE2-NEXT: movaps (%rdi), %xmm0
; SSE2-NEXT: movaps 16(%rdi), %xmm1
; SSE2-NEXT: movaps 32(%rdi), %xmm2
; SSE2-NEXT: movaps 48(%rdi), %xmm3
; SSE2-NEXT: retq
;
; SSE41-LABEL: test_v8i64:
; SSE41: # BB#0:
; SSE41-NEXT: movntdqa (%rdi), %xmm0
; SSE41-NEXT: movntdqa 16(%rdi), %xmm1
; SSE41-NEXT: movntdqa 32(%rdi), %xmm2
; SSE41-NEXT: movntdqa 48(%rdi), %xmm3
; SSE41-NEXT: retq
;
; AVX1-LABEL: test_v8i64:
; AVX1: # BB#0:
[X86][AVX1] Split 256-bit vector non-temporal loads to keep it non-temporal (PR32744) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304718
2017-06-06 00:02:01 +08:00
; AVX1-NEXT: vmovntdqa (%rdi), %xmm0
; AVX1-NEXT: vmovntdqa 16(%rdi), %xmm1
; AVX1-NEXT: vinsertf128 $1, %xmm1, %ymm0, %ymm0
; AVX1-NEXT: vmovntdqa 32(%rdi), %xmm1
; AVX1-NEXT: vmovntdqa 48(%rdi), %xmm2
; AVX1-NEXT: vinsertf128 $1, %xmm2, %ymm1, %ymm1
[X86][SSE] Add general lowering of nontemporal vector loads Currently the only way to use the (V)MOVNTDQA nontemporal vector loads instructions is through the int_x86_sse41_movntdqa style builtins. This patch adds support for lowering nontemporal loads from general IR, allowing us to remove the movntdqa builtins in a future patch. We currently still fold nontemporal loads into suitable instructions, we should probably look at removing this (and nontemporal stores as well) or at least make the target's folding implementation aware that its dealing with a nontemporal memory transaction. There is also an issue that VMOVNTDQA only acts on 128-bit vectors on pre-AVX2 hardware - so currently a normal ymm load is still used on AVX1 targets. Differential Review: http://reviews.llvm.org/D20965 llvm-svn: 272010
2016-06-07 21:34:24 +08:00
; AVX1-NEXT: retq
;
; AVX2-LABEL: test_v8i64:
; AVX2: # BB#0:
; AVX2-NEXT: vmovntdqa (%rdi), %ymm0
; AVX2-NEXT: vmovntdqa 32(%rdi), %ymm1
; AVX2-NEXT: retq
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
;
; AVX512-LABEL: test_v8i64:
; AVX512: # BB#0:
[X86][SSE] Add general lowering of nontemporal vector loads Currently the only way to use the (V)MOVNTDQA nontemporal vector loads instructions is through the int_x86_sse41_movntdqa style builtins. This patch adds support for lowering nontemporal loads from general IR, allowing us to remove the movntdqa builtins in a future patch. We currently still fold nontemporal loads into suitable instructions, we should probably look at removing this (and nontemporal stores as well) or at least make the target's folding implementation aware that its dealing with a nontemporal memory transaction. There is also an issue that VMOVNTDQA only acts on 128-bit vectors on pre-AVX2 hardware - so currently a normal ymm load is still used on AVX1 targets. Differential Review: http://reviews.llvm.org/D20965 llvm-svn: 272010
2016-06-07 21:34:24 +08:00
; AVX512-NEXT: vmovntdqa (%rdi), %zmm0
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; AVX512-NEXT: retq
[X86][AVX512] Fixed 512-bit vector nontemporal load alignment llvm-svn: 271673
2016-06-03 22:12:43 +08:00
%1 = load <8 x i64>, <8 x i64>* %src, align 64, !nontemporal !1
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
ret <8 x i64> %1
}
define <32 x i16> @test_v32i16(<32 x i16>* %src) {
[X86][SSE] Add general lowering of nontemporal vector loads Currently the only way to use the (V)MOVNTDQA nontemporal vector loads instructions is through the int_x86_sse41_movntdqa style builtins. This patch adds support for lowering nontemporal loads from general IR, allowing us to remove the movntdqa builtins in a future patch. We currently still fold nontemporal loads into suitable instructions, we should probably look at removing this (and nontemporal stores as well) or at least make the target's folding implementation aware that its dealing with a nontemporal memory transaction. There is also an issue that VMOVNTDQA only acts on 128-bit vectors on pre-AVX2 hardware - so currently a normal ymm load is still used on AVX1 targets. Differential Review: http://reviews.llvm.org/D20965 llvm-svn: 272010
2016-06-07 21:34:24 +08:00
; SSE2-LABEL: test_v32i16:
; SSE2: # BB#0:
; SSE2-NEXT: movaps (%rdi), %xmm0
; SSE2-NEXT: movaps 16(%rdi), %xmm1
; SSE2-NEXT: movaps 32(%rdi), %xmm2
; SSE2-NEXT: movaps 48(%rdi), %xmm3
; SSE2-NEXT: retq
;
; SSE41-LABEL: test_v32i16:
; SSE41: # BB#0:
; SSE41-NEXT: movntdqa (%rdi), %xmm0
; SSE41-NEXT: movntdqa 16(%rdi), %xmm1
; SSE41-NEXT: movntdqa 32(%rdi), %xmm2
; SSE41-NEXT: movntdqa 48(%rdi), %xmm3
; SSE41-NEXT: retq
;
; AVX1-LABEL: test_v32i16:
; AVX1: # BB#0:
[X86][AVX1] Split 256-bit vector non-temporal loads to keep it non-temporal (PR32744) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304718
2017-06-06 00:02:01 +08:00
; AVX1-NEXT: vmovntdqa (%rdi), %xmm0
; AVX1-NEXT: vmovntdqa 16(%rdi), %xmm1
; AVX1-NEXT: vinsertf128 $1, %xmm1, %ymm0, %ymm0
; AVX1-NEXT: vmovntdqa 32(%rdi), %xmm1
; AVX1-NEXT: vmovntdqa 48(%rdi), %xmm2
; AVX1-NEXT: vinsertf128 $1, %xmm2, %ymm1, %ymm1
[X86][SSE] Add general lowering of nontemporal vector loads Currently the only way to use the (V)MOVNTDQA nontemporal vector loads instructions is through the int_x86_sse41_movntdqa style builtins. This patch adds support for lowering nontemporal loads from general IR, allowing us to remove the movntdqa builtins in a future patch. We currently still fold nontemporal loads into suitable instructions, we should probably look at removing this (and nontemporal stores as well) or at least make the target's folding implementation aware that its dealing with a nontemporal memory transaction. There is also an issue that VMOVNTDQA only acts on 128-bit vectors on pre-AVX2 hardware - so currently a normal ymm load is still used on AVX1 targets. Differential Review: http://reviews.llvm.org/D20965 llvm-svn: 272010
2016-06-07 21:34:24 +08:00
; AVX1-NEXT: retq
;
; AVX2-LABEL: test_v32i16:
; AVX2: # BB#0:
; AVX2-NEXT: vmovntdqa (%rdi), %ymm0
; AVX2-NEXT: vmovntdqa 32(%rdi), %ymm1
; AVX2-NEXT: retq
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
;
; AVX512F-LABEL: test_v32i16:
; AVX512F: # BB#0:
[X86][SSE] Add general lowering of nontemporal vector loads Currently the only way to use the (V)MOVNTDQA nontemporal vector loads instructions is through the int_x86_sse41_movntdqa style builtins. This patch adds support for lowering nontemporal loads from general IR, allowing us to remove the movntdqa builtins in a future patch. We currently still fold nontemporal loads into suitable instructions, we should probably look at removing this (and nontemporal stores as well) or at least make the target's folding implementation aware that its dealing with a nontemporal memory transaction. There is also an issue that VMOVNTDQA only acts on 128-bit vectors on pre-AVX2 hardware - so currently a normal ymm load is still used on AVX1 targets. Differential Review: http://reviews.llvm.org/D20965 llvm-svn: 272010
2016-06-07 21:34:24 +08:00
; AVX512F-NEXT: vmovntdqa (%rdi), %ymm0
; AVX512F-NEXT: vmovntdqa 32(%rdi), %ymm1
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; AVX512F-NEXT: retq
;
; AVX512BW-LABEL: test_v32i16:
; AVX512BW: # BB#0:
[X86][SSE] Add general lowering of nontemporal vector loads Currently the only way to use the (V)MOVNTDQA nontemporal vector loads instructions is through the int_x86_sse41_movntdqa style builtins. This patch adds support for lowering nontemporal loads from general IR, allowing us to remove the movntdqa builtins in a future patch. We currently still fold nontemporal loads into suitable instructions, we should probably look at removing this (and nontemporal stores as well) or at least make the target's folding implementation aware that its dealing with a nontemporal memory transaction. There is also an issue that VMOVNTDQA only acts on 128-bit vectors on pre-AVX2 hardware - so currently a normal ymm load is still used on AVX1 targets. Differential Review: http://reviews.llvm.org/D20965 llvm-svn: 272010
2016-06-07 21:34:24 +08:00
; AVX512BW-NEXT: vmovntdqa (%rdi), %zmm0
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; AVX512BW-NEXT: retq
;
; AVX512VL-LABEL: test_v32i16:
; AVX512VL: # BB#0:
[X86][SSE] Add general lowering of nontemporal vector loads Currently the only way to use the (V)MOVNTDQA nontemporal vector loads instructions is through the int_x86_sse41_movntdqa style builtins. This patch adds support for lowering nontemporal loads from general IR, allowing us to remove the movntdqa builtins in a future patch. We currently still fold nontemporal loads into suitable instructions, we should probably look at removing this (and nontemporal stores as well) or at least make the target's folding implementation aware that its dealing with a nontemporal memory transaction. There is also an issue that VMOVNTDQA only acts on 128-bit vectors on pre-AVX2 hardware - so currently a normal ymm load is still used on AVX1 targets. Differential Review: http://reviews.llvm.org/D20965 llvm-svn: 272010
2016-06-07 21:34:24 +08:00
; AVX512VL-NEXT: vmovntdqa (%rdi), %ymm0
; AVX512VL-NEXT: vmovntdqa 32(%rdi), %ymm1
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; AVX512VL-NEXT: retq
[X86][AVX512] Fixed 512-bit vector nontemporal load alignment llvm-svn: 271673
2016-06-03 22:12:43 +08:00
%1 = load <32 x i16>, <32 x i16>* %src, align 64, !nontemporal !1
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
ret <32 x i16> %1
}
define <64 x i8> @test_v64i8(<64 x i8>* %src) {
[X86][SSE] Add general lowering of nontemporal vector loads Currently the only way to use the (V)MOVNTDQA nontemporal vector loads instructions is through the int_x86_sse41_movntdqa style builtins. This patch adds support for lowering nontemporal loads from general IR, allowing us to remove the movntdqa builtins in a future patch. We currently still fold nontemporal loads into suitable instructions, we should probably look at removing this (and nontemporal stores as well) or at least make the target's folding implementation aware that its dealing with a nontemporal memory transaction. There is also an issue that VMOVNTDQA only acts on 128-bit vectors on pre-AVX2 hardware - so currently a normal ymm load is still used on AVX1 targets. Differential Review: http://reviews.llvm.org/D20965 llvm-svn: 272010
2016-06-07 21:34:24 +08:00
; SSE2-LABEL: test_v64i8:
; SSE2: # BB#0:
; SSE2-NEXT: movaps (%rdi), %xmm0
; SSE2-NEXT: movaps 16(%rdi), %xmm1
; SSE2-NEXT: movaps 32(%rdi), %xmm2
; SSE2-NEXT: movaps 48(%rdi), %xmm3
; SSE2-NEXT: retq
;
; SSE41-LABEL: test_v64i8:
; SSE41: # BB#0:
; SSE41-NEXT: movntdqa (%rdi), %xmm0
; SSE41-NEXT: movntdqa 16(%rdi), %xmm1
; SSE41-NEXT: movntdqa 32(%rdi), %xmm2
; SSE41-NEXT: movntdqa 48(%rdi), %xmm3
; SSE41-NEXT: retq
;
; AVX1-LABEL: test_v64i8:
; AVX1: # BB#0:
[X86][AVX1] Split 256-bit vector non-temporal loads to keep it non-temporal (PR32744) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304718
2017-06-06 00:02:01 +08:00
; AVX1-NEXT: vmovntdqa (%rdi), %xmm0
; AVX1-NEXT: vmovntdqa 16(%rdi), %xmm1
; AVX1-NEXT: vinsertf128 $1, %xmm1, %ymm0, %ymm0
; AVX1-NEXT: vmovntdqa 32(%rdi), %xmm1
; AVX1-NEXT: vmovntdqa 48(%rdi), %xmm2
; AVX1-NEXT: vinsertf128 $1, %xmm2, %ymm1, %ymm1
[X86][SSE] Add general lowering of nontemporal vector loads Currently the only way to use the (V)MOVNTDQA nontemporal vector loads instructions is through the int_x86_sse41_movntdqa style builtins. This patch adds support for lowering nontemporal loads from general IR, allowing us to remove the movntdqa builtins in a future patch. We currently still fold nontemporal loads into suitable instructions, we should probably look at removing this (and nontemporal stores as well) or at least make the target's folding implementation aware that its dealing with a nontemporal memory transaction. There is also an issue that VMOVNTDQA only acts on 128-bit vectors on pre-AVX2 hardware - so currently a normal ymm load is still used on AVX1 targets. Differential Review: http://reviews.llvm.org/D20965 llvm-svn: 272010
2016-06-07 21:34:24 +08:00
; AVX1-NEXT: retq
;
; AVX2-LABEL: test_v64i8:
; AVX2: # BB#0:
; AVX2-NEXT: vmovntdqa (%rdi), %ymm0
; AVX2-NEXT: vmovntdqa 32(%rdi), %ymm1
; AVX2-NEXT: retq
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
;
; AVX512F-LABEL: test_v64i8:
; AVX512F: # BB#0:
[X86][SSE] Add general lowering of nontemporal vector loads Currently the only way to use the (V)MOVNTDQA nontemporal vector loads instructions is through the int_x86_sse41_movntdqa style builtins. This patch adds support for lowering nontemporal loads from general IR, allowing us to remove the movntdqa builtins in a future patch. We currently still fold nontemporal loads into suitable instructions, we should probably look at removing this (and nontemporal stores as well) or at least make the target's folding implementation aware that its dealing with a nontemporal memory transaction. There is also an issue that VMOVNTDQA only acts on 128-bit vectors on pre-AVX2 hardware - so currently a normal ymm load is still used on AVX1 targets. Differential Review: http://reviews.llvm.org/D20965 llvm-svn: 272010
2016-06-07 21:34:24 +08:00
; AVX512F-NEXT: vmovntdqa (%rdi), %ymm0
; AVX512F-NEXT: vmovntdqa 32(%rdi), %ymm1
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; AVX512F-NEXT: retq
;
; AVX512BW-LABEL: test_v64i8:
; AVX512BW: # BB#0:
[X86][SSE] Add general lowering of nontemporal vector loads Currently the only way to use the (V)MOVNTDQA nontemporal vector loads instructions is through the int_x86_sse41_movntdqa style builtins. This patch adds support for lowering nontemporal loads from general IR, allowing us to remove the movntdqa builtins in a future patch. We currently still fold nontemporal loads into suitable instructions, we should probably look at removing this (and nontemporal stores as well) or at least make the target's folding implementation aware that its dealing with a nontemporal memory transaction. There is also an issue that VMOVNTDQA only acts on 128-bit vectors on pre-AVX2 hardware - so currently a normal ymm load is still used on AVX1 targets. Differential Review: http://reviews.llvm.org/D20965 llvm-svn: 272010
2016-06-07 21:34:24 +08:00
; AVX512BW-NEXT: vmovntdqa (%rdi), %zmm0
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; AVX512BW-NEXT: retq
;
; AVX512VL-LABEL: test_v64i8:
; AVX512VL: # BB#0:
[X86][SSE] Add general lowering of nontemporal vector loads Currently the only way to use the (V)MOVNTDQA nontemporal vector loads instructions is through the int_x86_sse41_movntdqa style builtins. This patch adds support for lowering nontemporal loads from general IR, allowing us to remove the movntdqa builtins in a future patch. We currently still fold nontemporal loads into suitable instructions, we should probably look at removing this (and nontemporal stores as well) or at least make the target's folding implementation aware that its dealing with a nontemporal memory transaction. There is also an issue that VMOVNTDQA only acts on 128-bit vectors on pre-AVX2 hardware - so currently a normal ymm load is still used on AVX1 targets. Differential Review: http://reviews.llvm.org/D20965 llvm-svn: 272010
2016-06-07 21:34:24 +08:00
; AVX512VL-NEXT: vmovntdqa (%rdi), %ymm0
; AVX512VL-NEXT: vmovntdqa 32(%rdi), %ymm1
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; AVX512VL-NEXT: retq
[X86][AVX512] Fixed 512-bit vector nontemporal load alignment llvm-svn: 271673
2016-06-03 22:12:43 +08:00
%1 = load <64 x i8>, <64 x i8>* %src, align 64, !nontemporal !1
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
ret <64 x i8> %1
}
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
; Check cases where the load would be folded.
define <4 x float> @test_arg_v4f32(<4 x float> %arg, <4 x float>* %src) {
; SSE-LABEL: test_arg_v4f32:
; SSE: # BB#0:
; SSE-NEXT: addps (%rdi), %xmm0
; SSE-NEXT: retq
;
; AVX-LABEL: test_arg_v4f32:
; AVX: # BB#0:
[X86][SSE] Non-temporal loads shouldn't be folded if it can be avoided (PR32743) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304717
2017-06-05 23:43:03 +08:00
; AVX-NEXT: vmovntdqa (%rdi), %xmm1
; AVX-NEXT: vaddps %xmm1, %xmm0, %xmm0
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
; AVX-NEXT: retq
;
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; AVX512-LABEL: test_arg_v4f32:
; AVX512: # BB#0:
[X86][SSE] Non-temporal loads shouldn't be folded if it can be avoided (PR32743) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304717
2017-06-05 23:43:03 +08:00
; AVX512-NEXT: vmovntdqa (%rdi), %xmm1
; AVX512-NEXT: vaddps %xmm1, %xmm0, %xmm0
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; AVX512-NEXT: retq
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
%1 = load <4 x float>, <4 x float>* %src, align 16, !nontemporal !1
%2 = fadd <4 x float> %arg, %1
ret <4 x float> %2
}
define <4 x i32> @test_arg_v4i32(<4 x i32> %arg, <4 x i32>* %src) {
; SSE-LABEL: test_arg_v4i32:
; SSE: # BB#0:
; SSE-NEXT: paddd (%rdi), %xmm0
; SSE-NEXT: retq
;
; AVX-LABEL: test_arg_v4i32:
; AVX: # BB#0:
[X86][SSE] Non-temporal loads shouldn't be folded if it can be avoided (PR32743) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304717
2017-06-05 23:43:03 +08:00
; AVX-NEXT: vmovntdqa (%rdi), %xmm1
; AVX-NEXT: vpaddd %xmm1, %xmm0, %xmm0
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
; AVX-NEXT: retq
;
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; AVX512-LABEL: test_arg_v4i32:
; AVX512: # BB#0:
[X86][SSE] Non-temporal loads shouldn't be folded if it can be avoided (PR32743) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304717
2017-06-05 23:43:03 +08:00
; AVX512-NEXT: vmovntdqa (%rdi), %xmm1
; AVX512-NEXT: vpaddd %xmm1, %xmm0, %xmm0
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; AVX512-NEXT: retq
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
%1 = load <4 x i32>, <4 x i32>* %src, align 16, !nontemporal !1
%2 = add <4 x i32> %arg, %1
ret <4 x i32> %2
}
define <2 x double> @test_arg_v2f64(<2 x double> %arg, <2 x double>* %src) {
; SSE-LABEL: test_arg_v2f64:
; SSE: # BB#0:
; SSE-NEXT: addpd (%rdi), %xmm0
; SSE-NEXT: retq
;
; AVX-LABEL: test_arg_v2f64:
; AVX: # BB#0:
[X86][SSE] Non-temporal loads shouldn't be folded if it can be avoided (PR32743) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304717
2017-06-05 23:43:03 +08:00
; AVX-NEXT: vmovntdqa (%rdi), %xmm1
; AVX-NEXT: vaddpd %xmm1, %xmm0, %xmm0
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
; AVX-NEXT: retq
;
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; AVX512-LABEL: test_arg_v2f64:
; AVX512: # BB#0:
[X86][SSE] Non-temporal loads shouldn't be folded if it can be avoided (PR32743) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304717
2017-06-05 23:43:03 +08:00
; AVX512-NEXT: vmovntdqa (%rdi), %xmm1
; AVX512-NEXT: vaddpd %xmm1, %xmm0, %xmm0
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; AVX512-NEXT: retq
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
%1 = load <2 x double>, <2 x double>* %src, align 16, !nontemporal !1
%2 = fadd <2 x double> %arg, %1
ret <2 x double> %2
}
define <2 x i64> @test_arg_v2i64(<2 x i64> %arg, <2 x i64>* %src) {
; SSE-LABEL: test_arg_v2i64:
; SSE: # BB#0:
; SSE-NEXT: paddq (%rdi), %xmm0
; SSE-NEXT: retq
;
; AVX-LABEL: test_arg_v2i64:
; AVX: # BB#0:
[X86][SSE] Non-temporal loads shouldn't be folded if it can be avoided (PR32743) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304717
2017-06-05 23:43:03 +08:00
; AVX-NEXT: vmovntdqa (%rdi), %xmm1
; AVX-NEXT: vpaddq %xmm1, %xmm0, %xmm0
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
; AVX-NEXT: retq
;
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; AVX512-LABEL: test_arg_v2i64:
; AVX512: # BB#0:
[X86][SSE] Non-temporal loads shouldn't be folded if it can be avoided (PR32743) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304717
2017-06-05 23:43:03 +08:00
; AVX512-NEXT: vmovntdqa (%rdi), %xmm1
; AVX512-NEXT: vpaddq %xmm1, %xmm0, %xmm0
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; AVX512-NEXT: retq
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
%1 = load <2 x i64>, <2 x i64>* %src, align 16, !nontemporal !1
%2 = add <2 x i64> %arg, %1
ret <2 x i64> %2
}
define <8 x i16> @test_arg_v8i16(<8 x i16> %arg, <8 x i16>* %src) {
; SSE-LABEL: test_arg_v8i16:
; SSE: # BB#0:
; SSE-NEXT: paddw (%rdi), %xmm0
; SSE-NEXT: retq
;
; AVX-LABEL: test_arg_v8i16:
; AVX: # BB#0:
[X86][SSE] Non-temporal loads shouldn't be folded if it can be avoided (PR32743) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304717
2017-06-05 23:43:03 +08:00
; AVX-NEXT: vmovntdqa (%rdi), %xmm1
; AVX-NEXT: vpaddw %xmm1, %xmm0, %xmm0
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
; AVX-NEXT: retq
;
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; AVX512-LABEL: test_arg_v8i16:
; AVX512: # BB#0:
[X86][SSE] Non-temporal loads shouldn't be folded if it can be avoided (PR32743) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304717
2017-06-05 23:43:03 +08:00
; AVX512-NEXT: vmovntdqa (%rdi), %xmm1
; AVX512-NEXT: vpaddw %xmm1, %xmm0, %xmm0
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; AVX512-NEXT: retq
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
%1 = load <8 x i16>, <8 x i16>* %src, align 16, !nontemporal !1
%2 = add <8 x i16> %arg, %1
ret <8 x i16> %2
}
define <16 x i8> @test_arg_v16i8(<16 x i8> %arg, <16 x i8>* %src) {
; SSE-LABEL: test_arg_v16i8:
; SSE: # BB#0:
; SSE-NEXT: paddb (%rdi), %xmm0
; SSE-NEXT: retq
;
; AVX-LABEL: test_arg_v16i8:
; AVX: # BB#0:
[X86][SSE] Non-temporal loads shouldn't be folded if it can be avoided (PR32743) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304717
2017-06-05 23:43:03 +08:00
; AVX-NEXT: vmovntdqa (%rdi), %xmm1
; AVX-NEXT: vpaddb %xmm1, %xmm0, %xmm0
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
; AVX-NEXT: retq
;
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; AVX512-LABEL: test_arg_v16i8:
; AVX512: # BB#0:
[X86][SSE] Non-temporal loads shouldn't be folded if it can be avoided (PR32743) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304717
2017-06-05 23:43:03 +08:00
; AVX512-NEXT: vmovntdqa (%rdi), %xmm1
; AVX512-NEXT: vpaddb %xmm1, %xmm0, %xmm0
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; AVX512-NEXT: retq
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
%1 = load <16 x i8>, <16 x i8>* %src, align 16, !nontemporal !1
%2 = add <16 x i8> %arg, %1
ret <16 x i8> %2
}
; And now YMM versions.
define <8 x float> @test_arg_v8f32(<8 x float> %arg, <8 x float>* %src) {
; SSE-LABEL: test_arg_v8f32:
; SSE: # BB#0:
; SSE-NEXT: addps (%rdi), %xmm0
; SSE-NEXT: addps 16(%rdi), %xmm1
; SSE-NEXT: retq
;
[X86][SSE] Non-temporal loads shouldn't be folded if it can be avoided (PR32743) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304717
2017-06-05 23:43:03 +08:00
; AVX1-LABEL: test_arg_v8f32:
; AVX1: # BB#0:
[X86][AVX1] Split 256-bit vector non-temporal loads to keep it non-temporal (PR32744) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304718
2017-06-06 00:02:01 +08:00
; AVX1-NEXT: vmovntdqa (%rdi), %xmm1
; AVX1-NEXT: vmovntdqa 16(%rdi), %xmm2
; AVX1-NEXT: vinsertf128 $1, %xmm2, %ymm1, %ymm1
; AVX1-NEXT: vaddps %ymm1, %ymm0, %ymm0
[X86][SSE] Non-temporal loads shouldn't be folded if it can be avoided (PR32743) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304717
2017-06-05 23:43:03 +08:00
; AVX1-NEXT: retq
;
; AVX2-LABEL: test_arg_v8f32:
; AVX2: # BB#0:
; AVX2-NEXT: vmovntdqa (%rdi), %ymm1
; AVX2-NEXT: vaddps %ymm1, %ymm0, %ymm0
; AVX2-NEXT: retq
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
;
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; AVX512-LABEL: test_arg_v8f32:
; AVX512: # BB#0:
[X86][SSE] Non-temporal loads shouldn't be folded if it can be avoided (PR32743) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304717
2017-06-05 23:43:03 +08:00
; AVX512-NEXT: vmovntdqa (%rdi), %ymm1
; AVX512-NEXT: vaddps %ymm1, %ymm0, %ymm0
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; AVX512-NEXT: retq
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
%1 = load <8 x float>, <8 x float>* %src, align 32, !nontemporal !1
%2 = fadd <8 x float> %arg, %1
ret <8 x float> %2
}
define <8 x i32> @test_arg_v8i32(<8 x i32> %arg, <8 x i32>* %src) {
; SSE-LABEL: test_arg_v8i32:
; SSE: # BB#0:
; SSE-NEXT: paddd (%rdi), %xmm0
; SSE-NEXT: paddd 16(%rdi), %xmm1
; SSE-NEXT: retq
;
; AVX1-LABEL: test_arg_v8i32:
; AVX1: # BB#0:
[X86][AVX1] Split 256-bit vector non-temporal loads to keep it non-temporal (PR32744) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304718
2017-06-06 00:02:01 +08:00
; AVX1-NEXT: vmovntdqa (%rdi), %xmm1
; AVX1-NEXT: vmovntdqa 16(%rdi), %xmm2
; AVX1-NEXT: vextractf128 $1, %ymm0, %xmm3
; AVX1-NEXT: vpaddd %xmm2, %xmm3, %xmm2
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
; AVX1-NEXT: vpaddd %xmm1, %xmm0, %xmm0
; AVX1-NEXT: vinsertf128 $1, %xmm2, %ymm0, %ymm0
; AVX1-NEXT: retq
;
; AVX2-LABEL: test_arg_v8i32:
; AVX2: # BB#0:
[X86][SSE] Non-temporal loads shouldn't be folded if it can be avoided (PR32743) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304717
2017-06-05 23:43:03 +08:00
; AVX2-NEXT: vmovntdqa (%rdi), %ymm1
; AVX2-NEXT: vpaddd %ymm1, %ymm0, %ymm0
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
; AVX2-NEXT: retq
;
[X86][SSE] Non-temporal loads shouldn't be folded if it can be avoided (PR32743) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304717
2017-06-05 23:43:03 +08:00
; AVX512F-LABEL: test_arg_v8i32:
; AVX512F: # BB#0:
; AVX512F-NEXT: vmovntdqa (%rdi), %ymm1
; AVX512F-NEXT: vpaddd %ymm1, %ymm0, %ymm0
; AVX512F-NEXT: retq
;
; AVX512BW-LABEL: test_arg_v8i32:
; AVX512BW: # BB#0:
; AVX512BW-NEXT: vmovntdqa (%rdi), %ymm1
; AVX512BW-NEXT: vpaddd %ymm1, %ymm0, %ymm0
; AVX512BW-NEXT: retq
;
; AVX512VL-LABEL: test_arg_v8i32:
; AVX512VL: # BB#0:
; AVX512VL-NEXT: vpaddd (%rdi), %ymm0, %ymm0
; AVX512VL-NEXT: retq
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
%1 = load <8 x i32>, <8 x i32>* %src, align 32, !nontemporal !1
%2 = add <8 x i32> %arg, %1
ret <8 x i32> %2
}
define <4 x double> @test_arg_v4f64(<4 x double> %arg, <4 x double>* %src) {
; SSE-LABEL: test_arg_v4f64:
; SSE: # BB#0:
; SSE-NEXT: addpd (%rdi), %xmm0
; SSE-NEXT: addpd 16(%rdi), %xmm1
; SSE-NEXT: retq
;
[X86][SSE] Non-temporal loads shouldn't be folded if it can be avoided (PR32743) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304717
2017-06-05 23:43:03 +08:00
; AVX1-LABEL: test_arg_v4f64:
; AVX1: # BB#0:
[X86][AVX1] Split 256-bit vector non-temporal loads to keep it non-temporal (PR32744) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304718
2017-06-06 00:02:01 +08:00
; AVX1-NEXT: vmovntdqa (%rdi), %xmm1
; AVX1-NEXT: vmovntdqa 16(%rdi), %xmm2
; AVX1-NEXT: vinsertf128 $1, %xmm2, %ymm1, %ymm1
; AVX1-NEXT: vaddpd %ymm1, %ymm0, %ymm0
[X86][SSE] Non-temporal loads shouldn't be folded if it can be avoided (PR32743) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304717
2017-06-05 23:43:03 +08:00
; AVX1-NEXT: retq
;
; AVX2-LABEL: test_arg_v4f64:
; AVX2: # BB#0:
; AVX2-NEXT: vmovntdqa (%rdi), %ymm1
; AVX2-NEXT: vaddpd %ymm1, %ymm0, %ymm0
; AVX2-NEXT: retq
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
;
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; AVX512-LABEL: test_arg_v4f64:
; AVX512: # BB#0:
[X86][SSE] Non-temporal loads shouldn't be folded if it can be avoided (PR32743) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304717
2017-06-05 23:43:03 +08:00
; AVX512-NEXT: vmovntdqa (%rdi), %ymm1
; AVX512-NEXT: vaddpd %ymm1, %ymm0, %ymm0
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; AVX512-NEXT: retq
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
%1 = load <4 x double>, <4 x double>* %src, align 32, !nontemporal !1
%2 = fadd <4 x double> %arg, %1
ret <4 x double> %2
}
define <4 x i64> @test_arg_v4i64(<4 x i64> %arg, <4 x i64>* %src) {
; SSE-LABEL: test_arg_v4i64:
; SSE: # BB#0:
; SSE-NEXT: paddq (%rdi), %xmm0
; SSE-NEXT: paddq 16(%rdi), %xmm1
; SSE-NEXT: retq
;
; AVX1-LABEL: test_arg_v4i64:
; AVX1: # BB#0:
[X86][AVX1] Split 256-bit vector non-temporal loads to keep it non-temporal (PR32744) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304718
2017-06-06 00:02:01 +08:00
; AVX1-NEXT: vmovntdqa (%rdi), %xmm1
; AVX1-NEXT: vmovntdqa 16(%rdi), %xmm2
; AVX1-NEXT: vextractf128 $1, %ymm0, %xmm3
; AVX1-NEXT: vpaddq %xmm2, %xmm3, %xmm2
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
; AVX1-NEXT: vpaddq %xmm1, %xmm0, %xmm0
; AVX1-NEXT: vinsertf128 $1, %xmm2, %ymm0, %ymm0
; AVX1-NEXT: retq
;
; AVX2-LABEL: test_arg_v4i64:
; AVX2: # BB#0:
[X86][SSE] Non-temporal loads shouldn't be folded if it can be avoided (PR32743) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304717
2017-06-05 23:43:03 +08:00
; AVX2-NEXT: vmovntdqa (%rdi), %ymm1
; AVX2-NEXT: vpaddq %ymm1, %ymm0, %ymm0
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
; AVX2-NEXT: retq
;
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; AVX512-LABEL: test_arg_v4i64:
; AVX512: # BB#0:
[X86][SSE] Non-temporal loads shouldn't be folded if it can be avoided (PR32743) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304717
2017-06-05 23:43:03 +08:00
; AVX512-NEXT: vmovntdqa (%rdi), %ymm1
; AVX512-NEXT: vpaddq %ymm1, %ymm0, %ymm0
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; AVX512-NEXT: retq
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
%1 = load <4 x i64>, <4 x i64>* %src, align 32, !nontemporal !1
%2 = add <4 x i64> %arg, %1
ret <4 x i64> %2
}
define <16 x i16> @test_arg_v16i16(<16 x i16> %arg, <16 x i16>* %src) {
; SSE-LABEL: test_arg_v16i16:
; SSE: # BB#0:
; SSE-NEXT: paddw (%rdi), %xmm0
; SSE-NEXT: paddw 16(%rdi), %xmm1
; SSE-NEXT: retq
;
; AVX1-LABEL: test_arg_v16i16:
; AVX1: # BB#0:
[X86][AVX1] Split 256-bit vector non-temporal loads to keep it non-temporal (PR32744) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304718
2017-06-06 00:02:01 +08:00
; AVX1-NEXT: vmovntdqa (%rdi), %xmm1
; AVX1-NEXT: vmovntdqa 16(%rdi), %xmm2
; AVX1-NEXT: vextractf128 $1, %ymm0, %xmm3
; AVX1-NEXT: vpaddw %xmm2, %xmm3, %xmm2
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
; AVX1-NEXT: vpaddw %xmm1, %xmm0, %xmm0
; AVX1-NEXT: vinsertf128 $1, %xmm2, %ymm0, %ymm0
; AVX1-NEXT: retq
;
; AVX2-LABEL: test_arg_v16i16:
; AVX2: # BB#0:
[X86][SSE] Non-temporal loads shouldn't be folded if it can be avoided (PR32743) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304717
2017-06-05 23:43:03 +08:00
; AVX2-NEXT: vmovntdqa (%rdi), %ymm1
; AVX2-NEXT: vpaddw %ymm1, %ymm0, %ymm0
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
; AVX2-NEXT: retq
;
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; AVX512-LABEL: test_arg_v16i16:
; AVX512: # BB#0:
[X86][SSE] Non-temporal loads shouldn't be folded if it can be avoided (PR32743) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304717
2017-06-05 23:43:03 +08:00
; AVX512-NEXT: vmovntdqa (%rdi), %ymm1
; AVX512-NEXT: vpaddw %ymm1, %ymm0, %ymm0
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; AVX512-NEXT: retq
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
%1 = load <16 x i16>, <16 x i16>* %src, align 32, !nontemporal !1
%2 = add <16 x i16> %arg, %1
ret <16 x i16> %2
}
define <32 x i8> @test_arg_v32i8(<32 x i8> %arg, <32 x i8>* %src) {
; SSE-LABEL: test_arg_v32i8:
; SSE: # BB#0:
; SSE-NEXT: paddb (%rdi), %xmm0
; SSE-NEXT: paddb 16(%rdi), %xmm1
; SSE-NEXT: retq
;
; AVX1-LABEL: test_arg_v32i8:
; AVX1: # BB#0:
[X86][AVX1] Split 256-bit vector non-temporal loads to keep it non-temporal (PR32744) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304718
2017-06-06 00:02:01 +08:00
; AVX1-NEXT: vmovntdqa (%rdi), %xmm1
; AVX1-NEXT: vmovntdqa 16(%rdi), %xmm2
; AVX1-NEXT: vextractf128 $1, %ymm0, %xmm3
; AVX1-NEXT: vpaddb %xmm2, %xmm3, %xmm2
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
; AVX1-NEXT: vpaddb %xmm1, %xmm0, %xmm0
; AVX1-NEXT: vinsertf128 $1, %xmm2, %ymm0, %ymm0
; AVX1-NEXT: retq
;
; AVX2-LABEL: test_arg_v32i8:
; AVX2: # BB#0:
[X86][SSE] Non-temporal loads shouldn't be folded if it can be avoided (PR32743) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304717
2017-06-05 23:43:03 +08:00
; AVX2-NEXT: vmovntdqa (%rdi), %ymm1
; AVX2-NEXT: vpaddb %ymm1, %ymm0, %ymm0
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
; AVX2-NEXT: retq
;
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; AVX512-LABEL: test_arg_v32i8:
; AVX512: # BB#0:
[X86][SSE] Non-temporal loads shouldn't be folded if it can be avoided (PR32743) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304717
2017-06-05 23:43:03 +08:00
; AVX512-NEXT: vmovntdqa (%rdi), %ymm1
; AVX512-NEXT: vpaddb %ymm1, %ymm0, %ymm0
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; AVX512-NEXT: retq
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
%1 = load <32 x i8>, <32 x i8>* %src, align 32, !nontemporal !1
%2 = add <32 x i8> %arg, %1
ret <32 x i8> %2
}
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; And now ZMM versions.
define <16 x float> @test_arg_v16f32(<16 x float> %arg, <16 x float>* %src) {
; SSE-LABEL: test_arg_v16f32:
; SSE: # BB#0:
; SSE-NEXT: addps (%rdi), %xmm0
; SSE-NEXT: addps 16(%rdi), %xmm1
; SSE-NEXT: addps 32(%rdi), %xmm2
; SSE-NEXT: addps 48(%rdi), %xmm3
; SSE-NEXT: retq
;
[X86][SSE] Non-temporal loads shouldn't be folded if it can be avoided (PR32743) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304717
2017-06-05 23:43:03 +08:00
; AVX1-LABEL: test_arg_v16f32:
; AVX1: # BB#0:
[X86][AVX1] Split 256-bit vector non-temporal loads to keep it non-temporal (PR32744) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304718
2017-06-06 00:02:01 +08:00
; AVX1-NEXT: vmovntdqa 32(%rdi), %xmm2
; AVX1-NEXT: vmovntdqa 48(%rdi), %xmm3
; AVX1-NEXT: vinsertf128 $1, %xmm3, %ymm2, %ymm2
; AVX1-NEXT: vmovntdqa (%rdi), %xmm3
; AVX1-NEXT: vmovntdqa 16(%rdi), %xmm4
; AVX1-NEXT: vinsertf128 $1, %xmm4, %ymm3, %ymm3
; AVX1-NEXT: vaddps %ymm3, %ymm0, %ymm0
; AVX1-NEXT: vaddps %ymm2, %ymm1, %ymm1
[X86][SSE] Non-temporal loads shouldn't be folded if it can be avoided (PR32743) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304717
2017-06-05 23:43:03 +08:00
; AVX1-NEXT: retq
;
; AVX2-LABEL: test_arg_v16f32:
; AVX2: # BB#0:
; AVX2-NEXT: vmovntdqa 32(%rdi), %ymm2
; AVX2-NEXT: vmovntdqa (%rdi), %ymm3
; AVX2-NEXT: vaddps %ymm3, %ymm0, %ymm0
; AVX2-NEXT: vaddps %ymm2, %ymm1, %ymm1
; AVX2-NEXT: retq
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
;
; AVX512-LABEL: test_arg_v16f32:
; AVX512: # BB#0:
[X86][SSE] Non-temporal loads shouldn't be folded if it can be avoided (PR32743) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304717
2017-06-05 23:43:03 +08:00
; AVX512-NEXT: vmovntdqa (%rdi), %zmm1
; AVX512-NEXT: vaddps %zmm1, %zmm0, %zmm0
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; AVX512-NEXT: retq
[X86][AVX512] Fixed 512-bit vector nontemporal load alignment llvm-svn: 271673
2016-06-03 22:12:43 +08:00
%1 = load <16 x float>, <16 x float>* %src, align 64, !nontemporal !1
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
%2 = fadd <16 x float> %arg, %1
ret <16 x float> %2
}
define <16 x i32> @test_arg_v16i32(<16 x i32> %arg, <16 x i32>* %src) {
; SSE-LABEL: test_arg_v16i32:
; SSE: # BB#0:
; SSE-NEXT: paddd (%rdi), %xmm0
; SSE-NEXT: paddd 16(%rdi), %xmm1
; SSE-NEXT: paddd 32(%rdi), %xmm2
; SSE-NEXT: paddd 48(%rdi), %xmm3
; SSE-NEXT: retq
;
; AVX1-LABEL: test_arg_v16i32:
; AVX1: # BB#0:
[X86][AVX1] Split 256-bit vector non-temporal loads to keep it non-temporal (PR32744) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304718
2017-06-06 00:02:01 +08:00
; AVX1-NEXT: vmovntdqa 32(%rdi), %xmm2
; AVX1-NEXT: vmovntdqa 48(%rdi), %xmm3
; AVX1-NEXT: vmovntdqa (%rdi), %xmm4
; AVX1-NEXT: vmovntdqa 16(%rdi), %xmm5
; AVX1-NEXT: vextractf128 $1, %ymm0, %xmm6
; AVX1-NEXT: vpaddd %xmm5, %xmm6, %xmm5
; AVX1-NEXT: vpaddd %xmm4, %xmm0, %xmm0
; AVX1-NEXT: vinsertf128 $1, %xmm5, %ymm0, %ymm0
; AVX1-NEXT: vextractf128 $1, %ymm1, %xmm4
; AVX1-NEXT: vpaddd %xmm3, %xmm4, %xmm3
; AVX1-NEXT: vpaddd %xmm2, %xmm1, %xmm1
; AVX1-NEXT: vinsertf128 $1, %xmm3, %ymm1, %ymm1
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; AVX1-NEXT: retq
;
; AVX2-LABEL: test_arg_v16i32:
; AVX2: # BB#0:
[X86][SSE] Non-temporal loads shouldn't be folded if it can be avoided (PR32743) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304717
2017-06-05 23:43:03 +08:00
; AVX2-NEXT: vmovntdqa 32(%rdi), %ymm2
; AVX2-NEXT: vmovntdqa (%rdi), %ymm3
; AVX2-NEXT: vpaddd %ymm3, %ymm0, %ymm0
; AVX2-NEXT: vpaddd %ymm2, %ymm1, %ymm1
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; AVX2-NEXT: retq
;
; AVX512-LABEL: test_arg_v16i32:
; AVX512: # BB#0:
[X86][SSE] Non-temporal loads shouldn't be folded if it can be avoided (PR32743) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304717
2017-06-05 23:43:03 +08:00
; AVX512-NEXT: vmovntdqa (%rdi), %zmm1
; AVX512-NEXT: vpaddd %zmm1, %zmm0, %zmm0
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; AVX512-NEXT: retq
[X86][AVX512] Fixed 512-bit vector nontemporal load alignment llvm-svn: 271673
2016-06-03 22:12:43 +08:00
%1 = load <16 x i32>, <16 x i32>* %src, align 64, !nontemporal !1
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
%2 = add <16 x i32> %arg, %1
ret <16 x i32> %2
}
define <8 x double> @test_arg_v8f64(<8 x double> %arg, <8 x double>* %src) {
; SSE-LABEL: test_arg_v8f64:
; SSE: # BB#0:
; SSE-NEXT: addpd (%rdi), %xmm0
; SSE-NEXT: addpd 16(%rdi), %xmm1
; SSE-NEXT: addpd 32(%rdi), %xmm2
; SSE-NEXT: addpd 48(%rdi), %xmm3
; SSE-NEXT: retq
;
[X86][SSE] Non-temporal loads shouldn't be folded if it can be avoided (PR32743) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304717
2017-06-05 23:43:03 +08:00
; AVX1-LABEL: test_arg_v8f64:
; AVX1: # BB#0:
[X86][AVX1] Split 256-bit vector non-temporal loads to keep it non-temporal (PR32744) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304718
2017-06-06 00:02:01 +08:00
; AVX1-NEXT: vmovntdqa 32(%rdi), %xmm2
; AVX1-NEXT: vmovntdqa 48(%rdi), %xmm3
; AVX1-NEXT: vinsertf128 $1, %xmm3, %ymm2, %ymm2
; AVX1-NEXT: vmovntdqa (%rdi), %xmm3
; AVX1-NEXT: vmovntdqa 16(%rdi), %xmm4
; AVX1-NEXT: vinsertf128 $1, %xmm4, %ymm3, %ymm3
; AVX1-NEXT: vaddpd %ymm3, %ymm0, %ymm0
; AVX1-NEXT: vaddpd %ymm2, %ymm1, %ymm1
[X86][SSE] Non-temporal loads shouldn't be folded if it can be avoided (PR32743) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304717
2017-06-05 23:43:03 +08:00
; AVX1-NEXT: retq
;
; AVX2-LABEL: test_arg_v8f64:
; AVX2: # BB#0:
; AVX2-NEXT: vmovntdqa 32(%rdi), %ymm2
; AVX2-NEXT: vmovntdqa (%rdi), %ymm3
; AVX2-NEXT: vaddpd %ymm3, %ymm0, %ymm0
; AVX2-NEXT: vaddpd %ymm2, %ymm1, %ymm1
; AVX2-NEXT: retq
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
;
; AVX512-LABEL: test_arg_v8f64:
; AVX512: # BB#0:
[X86][SSE] Non-temporal loads shouldn't be folded if it can be avoided (PR32743) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304717
2017-06-05 23:43:03 +08:00
; AVX512-NEXT: vmovntdqa (%rdi), %zmm1
; AVX512-NEXT: vaddpd %zmm1, %zmm0, %zmm0
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; AVX512-NEXT: retq
[X86][AVX512] Fixed 512-bit vector nontemporal load alignment llvm-svn: 271673
2016-06-03 22:12:43 +08:00
%1 = load <8 x double>, <8 x double>* %src, align 64, !nontemporal !1
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
%2 = fadd <8 x double> %arg, %1
ret <8 x double> %2
}
define <8 x i64> @test_arg_v8i64(<8 x i64> %arg, <8 x i64>* %src) {
; SSE-LABEL: test_arg_v8i64:
; SSE: # BB#0:
; SSE-NEXT: paddq (%rdi), %xmm0
; SSE-NEXT: paddq 16(%rdi), %xmm1
; SSE-NEXT: paddq 32(%rdi), %xmm2
; SSE-NEXT: paddq 48(%rdi), %xmm3
; SSE-NEXT: retq
;
; AVX1-LABEL: test_arg_v8i64:
; AVX1: # BB#0:
[X86][AVX1] Split 256-bit vector non-temporal loads to keep it non-temporal (PR32744) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304718
2017-06-06 00:02:01 +08:00
; AVX1-NEXT: vmovntdqa 32(%rdi), %xmm2
; AVX1-NEXT: vmovntdqa 48(%rdi), %xmm3
; AVX1-NEXT: vmovntdqa (%rdi), %xmm4
; AVX1-NEXT: vmovntdqa 16(%rdi), %xmm5
; AVX1-NEXT: vextractf128 $1, %ymm0, %xmm6
; AVX1-NEXT: vpaddq %xmm5, %xmm6, %xmm5
; AVX1-NEXT: vpaddq %xmm4, %xmm0, %xmm0
; AVX1-NEXT: vinsertf128 $1, %xmm5, %ymm0, %ymm0
; AVX1-NEXT: vextractf128 $1, %ymm1, %xmm4
; AVX1-NEXT: vpaddq %xmm3, %xmm4, %xmm3
; AVX1-NEXT: vpaddq %xmm2, %xmm1, %xmm1
; AVX1-NEXT: vinsertf128 $1, %xmm3, %ymm1, %ymm1
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; AVX1-NEXT: retq
;
; AVX2-LABEL: test_arg_v8i64:
; AVX2: # BB#0:
[X86][SSE] Non-temporal loads shouldn't be folded if it can be avoided (PR32743) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304717
2017-06-05 23:43:03 +08:00
; AVX2-NEXT: vmovntdqa 32(%rdi), %ymm2
; AVX2-NEXT: vmovntdqa (%rdi), %ymm3
; AVX2-NEXT: vpaddq %ymm3, %ymm0, %ymm0
; AVX2-NEXT: vpaddq %ymm2, %ymm1, %ymm1
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; AVX2-NEXT: retq
;
; AVX512-LABEL: test_arg_v8i64:
; AVX512: # BB#0:
[X86][SSE] Non-temporal loads shouldn't be folded if it can be avoided (PR32743) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304717
2017-06-05 23:43:03 +08:00
; AVX512-NEXT: vmovntdqa (%rdi), %zmm1
; AVX512-NEXT: vpaddq %zmm1, %zmm0, %zmm0
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; AVX512-NEXT: retq
[X86][AVX512] Fixed 512-bit vector nontemporal load alignment llvm-svn: 271673
2016-06-03 22:12:43 +08:00
%1 = load <8 x i64>, <8 x i64>* %src, align 64, !nontemporal !1
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
%2 = add <8 x i64> %arg, %1
ret <8 x i64> %2
}
define <32 x i16> @test_arg_v32i16(<32 x i16> %arg, <32 x i16>* %src) {
; SSE-LABEL: test_arg_v32i16:
; SSE: # BB#0:
; SSE-NEXT: paddw (%rdi), %xmm0
; SSE-NEXT: paddw 16(%rdi), %xmm1
; SSE-NEXT: paddw 32(%rdi), %xmm2
; SSE-NEXT: paddw 48(%rdi), %xmm3
; SSE-NEXT: retq
;
; AVX1-LABEL: test_arg_v32i16:
; AVX1: # BB#0:
[X86][AVX1] Split 256-bit vector non-temporal loads to keep it non-temporal (PR32744) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304718
2017-06-06 00:02:01 +08:00
; AVX1-NEXT: vmovntdqa 32(%rdi), %xmm2
; AVX1-NEXT: vmovntdqa 48(%rdi), %xmm3
; AVX1-NEXT: vmovntdqa (%rdi), %xmm4
; AVX1-NEXT: vmovntdqa 16(%rdi), %xmm5
; AVX1-NEXT: vextractf128 $1, %ymm0, %xmm6
; AVX1-NEXT: vpaddw %xmm5, %xmm6, %xmm5
; AVX1-NEXT: vpaddw %xmm4, %xmm0, %xmm0
; AVX1-NEXT: vinsertf128 $1, %xmm5, %ymm0, %ymm0
; AVX1-NEXT: vextractf128 $1, %ymm1, %xmm4
; AVX1-NEXT: vpaddw %xmm3, %xmm4, %xmm3
; AVX1-NEXT: vpaddw %xmm2, %xmm1, %xmm1
; AVX1-NEXT: vinsertf128 $1, %xmm3, %ymm1, %ymm1
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; AVX1-NEXT: retq
;
; AVX2-LABEL: test_arg_v32i16:
; AVX2: # BB#0:
[X86][SSE] Non-temporal loads shouldn't be folded if it can be avoided (PR32743) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304717
2017-06-05 23:43:03 +08:00
; AVX2-NEXT: vmovntdqa 32(%rdi), %ymm2
; AVX2-NEXT: vmovntdqa (%rdi), %ymm3
; AVX2-NEXT: vpaddw %ymm3, %ymm0, %ymm0
; AVX2-NEXT: vpaddw %ymm2, %ymm1, %ymm1
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; AVX2-NEXT: retq
;
; AVX512F-LABEL: test_arg_v32i16:
; AVX512F: # BB#0:
[X86][SSE] Non-temporal loads shouldn't be folded if it can be avoided (PR32743) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304717
2017-06-05 23:43:03 +08:00
; AVX512F-NEXT: vmovntdqa 32(%rdi), %ymm2
; AVX512F-NEXT: vmovntdqa (%rdi), %ymm3
; AVX512F-NEXT: vpaddw %ymm3, %ymm0, %ymm0
; AVX512F-NEXT: vpaddw %ymm2, %ymm1, %ymm1
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; AVX512F-NEXT: retq
;
; AVX512BW-LABEL: test_arg_v32i16:
; AVX512BW: # BB#0:
[X86][SSE] Non-temporal loads shouldn't be folded if it can be avoided (PR32743) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304717
2017-06-05 23:43:03 +08:00
; AVX512BW-NEXT: vmovntdqa (%rdi), %zmm1
; AVX512BW-NEXT: vpaddw %zmm1, %zmm0, %zmm0
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; AVX512BW-NEXT: retq
;
; AVX512VL-LABEL: test_arg_v32i16:
; AVX512VL: # BB#0:
[X86][SSE] Non-temporal loads shouldn't be folded if it can be avoided (PR32743) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304717
2017-06-05 23:43:03 +08:00
; AVX512VL-NEXT: vmovntdqa 32(%rdi), %ymm2
; AVX512VL-NEXT: vmovntdqa (%rdi), %ymm3
; AVX512VL-NEXT: vpaddw %ymm3, %ymm0, %ymm0
; AVX512VL-NEXT: vpaddw %ymm2, %ymm1, %ymm1
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; AVX512VL-NEXT: retq
[X86][AVX512] Fixed 512-bit vector nontemporal load alignment llvm-svn: 271673
2016-06-03 22:12:43 +08:00
%1 = load <32 x i16>, <32 x i16>* %src, align 64, !nontemporal !1
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
%2 = add <32 x i16> %arg, %1
ret <32 x i16> %2
}
define <64 x i8> @test_arg_v64i8(<64 x i8> %arg, <64 x i8>* %src) {
; SSE-LABEL: test_arg_v64i8:
; SSE: # BB#0:
; SSE-NEXT: paddb (%rdi), %xmm0
; SSE-NEXT: paddb 16(%rdi), %xmm1
; SSE-NEXT: paddb 32(%rdi), %xmm2
; SSE-NEXT: paddb 48(%rdi), %xmm3
; SSE-NEXT: retq
;
; AVX1-LABEL: test_arg_v64i8:
; AVX1: # BB#0:
[X86][AVX1] Split 256-bit vector non-temporal loads to keep it non-temporal (PR32744) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304718
2017-06-06 00:02:01 +08:00
; AVX1-NEXT: vmovntdqa 32(%rdi), %xmm2
; AVX1-NEXT: vmovntdqa 48(%rdi), %xmm3
; AVX1-NEXT: vmovntdqa (%rdi), %xmm4
; AVX1-NEXT: vmovntdqa 16(%rdi), %xmm5
; AVX1-NEXT: vextractf128 $1, %ymm0, %xmm6
; AVX1-NEXT: vpaddb %xmm5, %xmm6, %xmm5
; AVX1-NEXT: vpaddb %xmm4, %xmm0, %xmm0
; AVX1-NEXT: vinsertf128 $1, %xmm5, %ymm0, %ymm0
; AVX1-NEXT: vextractf128 $1, %ymm1, %xmm4
; AVX1-NEXT: vpaddb %xmm3, %xmm4, %xmm3
; AVX1-NEXT: vpaddb %xmm2, %xmm1, %xmm1
; AVX1-NEXT: vinsertf128 $1, %xmm3, %ymm1, %ymm1
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; AVX1-NEXT: retq
;
; AVX2-LABEL: test_arg_v64i8:
; AVX2: # BB#0:
[X86][SSE] Non-temporal loads shouldn't be folded if it can be avoided (PR32743) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304717
2017-06-05 23:43:03 +08:00
; AVX2-NEXT: vmovntdqa 32(%rdi), %ymm2
; AVX2-NEXT: vmovntdqa (%rdi), %ymm3
; AVX2-NEXT: vpaddb %ymm3, %ymm0, %ymm0
; AVX2-NEXT: vpaddb %ymm2, %ymm1, %ymm1
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; AVX2-NEXT: retq
;
; AVX512F-LABEL: test_arg_v64i8:
; AVX512F: # BB#0:
[X86][SSE] Non-temporal loads shouldn't be folded if it can be avoided (PR32743) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304717
2017-06-05 23:43:03 +08:00
; AVX512F-NEXT: vmovntdqa 32(%rdi), %ymm2
; AVX512F-NEXT: vmovntdqa (%rdi), %ymm3
; AVX512F-NEXT: vpaddb %ymm3, %ymm0, %ymm0
; AVX512F-NEXT: vpaddb %ymm2, %ymm1, %ymm1
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; AVX512F-NEXT: retq
;
; AVX512BW-LABEL: test_arg_v64i8:
; AVX512BW: # BB#0:
[X86][SSE] Non-temporal loads shouldn't be folded if it can be avoided (PR32743) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304717
2017-06-05 23:43:03 +08:00
; AVX512BW-NEXT: vmovntdqa (%rdi), %zmm1
; AVX512BW-NEXT: vpaddb %zmm1, %zmm0, %zmm0
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; AVX512BW-NEXT: retq
;
; AVX512VL-LABEL: test_arg_v64i8:
; AVX512VL: # BB#0:
[X86][SSE] Non-temporal loads shouldn't be folded if it can be avoided (PR32743) Differential Revision: https://reviews.llvm.org/D33728 llvm-svn: 304717
2017-06-05 23:43:03 +08:00
; AVX512VL-NEXT: vmovntdqa 32(%rdi), %ymm2
; AVX512VL-NEXT: vmovntdqa (%rdi), %ymm3
; AVX512VL-NEXT: vpaddb %ymm3, %ymm0, %ymm0
; AVX512VL-NEXT: vpaddb %ymm2, %ymm1, %ymm1
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; AVX512VL-NEXT: retq
[X86][AVX512] Fixed 512-bit vector nontemporal load alignment llvm-svn: 271673
2016-06-03 22:12:43 +08:00
%1 = load <64 x i8>, <64 x i8>* %src, align 64, !nontemporal !1
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
%2 = add <64 x i8> %arg, %1
ret <64 x i8> %2
}
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
; Unaligned non-temporal loads (not supported)
define <4 x float> @test_unaligned_v4f32(<4 x float>* %src) {
; SSE-LABEL: test_unaligned_v4f32:
; SSE: # BB#0:
; SSE-NEXT: movups (%rdi), %xmm0
; SSE-NEXT: retq
;
; AVX-LABEL: test_unaligned_v4f32:
; AVX: # BB#0:
; AVX-NEXT: vmovups (%rdi), %xmm0
; AVX-NEXT: retq
;
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; AVX512-LABEL: test_unaligned_v4f32:
; AVX512: # BB#0:
; AVX512-NEXT: vmovups (%rdi), %xmm0
; AVX512-NEXT: retq
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
%1 = load <4 x float>, <4 x float>* %src, align 1, !nontemporal !1
ret <4 x float> %1
}
define <4 x i32> @test_unaligned_v4i32(<4 x i32>* %src) {
; SSE-LABEL: test_unaligned_v4i32:
; SSE: # BB#0:
; SSE-NEXT: movups (%rdi), %xmm0
; SSE-NEXT: retq
;
; AVX-LABEL: test_unaligned_v4i32:
; AVX: # BB#0:
; AVX-NEXT: vmovups (%rdi), %xmm0
; AVX-NEXT: retq
;
[AVX-512] Fix duplicate column in AVX512 execution dependency table that was preventing VMOVDQU32/VMOVDQA32 from being recognized. Fix a bug in the code that stops execution dependency fix from turning operations on 32-bit integer element types into operations on 64-bit integer element types. llvm-svn: 277327
2016-08-01 15:55:33 +08:00
; AVX512-LABEL: test_unaligned_v4i32:
; AVX512: # BB#0:
; AVX512-NEXT: vmovups (%rdi), %xmm0
; AVX512-NEXT: retq
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
%1 = load <4 x i32>, <4 x i32>* %src, align 1, !nontemporal !1
ret <4 x i32> %1
}
define <2 x double> @test_unaligned_v2f64(<2 x double>* %src) {
; SSE-LABEL: test_unaligned_v2f64:
; SSE: # BB#0:
; SSE-NEXT: movups (%rdi), %xmm0
; SSE-NEXT: retq
;
; AVX-LABEL: test_unaligned_v2f64:
; AVX: # BB#0:
; AVX-NEXT: vmovups (%rdi), %xmm0
; AVX-NEXT: retq
;
[AVX512] Add VLX packed move instructions to the execution dependency fix pass and update tests. llvm-svn: 277304
2016-08-01 04:20:01 +08:00
; AVX512-LABEL: test_unaligned_v2f64:
; AVX512: # BB#0:
; AVX512-NEXT: vmovups (%rdi), %xmm0
; AVX512-NEXT: retq
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
%1 = load <2 x double>, <2 x double>* %src, align 1, !nontemporal !1
ret <2 x double> %1
}
define <2 x i64> @test_unaligned_v2i64(<2 x i64>* %src) {
; SSE-LABEL: test_unaligned_v2i64:
; SSE: # BB#0:
; SSE-NEXT: movups (%rdi), %xmm0
; SSE-NEXT: retq
;
; AVX-LABEL: test_unaligned_v2i64:
; AVX: # BB#0:
; AVX-NEXT: vmovups (%rdi), %xmm0
; AVX-NEXT: retq
;
[AVX-512] Fix duplicate column in AVX512 execution dependency table that was preventing VMOVDQU32/VMOVDQA32 from being recognized. Fix a bug in the code that stops execution dependency fix from turning operations on 32-bit integer element types into operations on 64-bit integer element types. llvm-svn: 277327
2016-08-01 15:55:33 +08:00
; AVX512-LABEL: test_unaligned_v2i64:
; AVX512: # BB#0:
; AVX512-NEXT: vmovups (%rdi), %xmm0
; AVX512-NEXT: retq
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
%1 = load <2 x i64>, <2 x i64>* %src, align 1, !nontemporal !1
ret <2 x i64> %1
}
define <8 x i16> @test_unaligned_v8i16(<8 x i16>* %src) {
; SSE-LABEL: test_unaligned_v8i16:
; SSE: # BB#0:
; SSE-NEXT: movups (%rdi), %xmm0
; SSE-NEXT: retq
;
; AVX-LABEL: test_unaligned_v8i16:
; AVX: # BB#0:
; AVX-NEXT: vmovups (%rdi), %xmm0
; AVX-NEXT: retq
;
[AVX-512] Fix duplicate column in AVX512 execution dependency table that was preventing VMOVDQU32/VMOVDQA32 from being recognized. Fix a bug in the code that stops execution dependency fix from turning operations on 32-bit integer element types into operations on 64-bit integer element types. llvm-svn: 277327
2016-08-01 15:55:33 +08:00
; AVX512-LABEL: test_unaligned_v8i16:
; AVX512: # BB#0:
; AVX512-NEXT: vmovups (%rdi), %xmm0
; AVX512-NEXT: retq
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
%1 = load <8 x i16>, <8 x i16>* %src, align 1, !nontemporal !1
ret <8 x i16> %1
}
define <16 x i8> @test_unaligned_v16i8(<16 x i8>* %src) {
; SSE-LABEL: test_unaligned_v16i8:
; SSE: # BB#0:
; SSE-NEXT: movups (%rdi), %xmm0
; SSE-NEXT: retq
;
; AVX-LABEL: test_unaligned_v16i8:
; AVX: # BB#0:
; AVX-NEXT: vmovups (%rdi), %xmm0
; AVX-NEXT: retq
;
[AVX-512] Fix duplicate column in AVX512 execution dependency table that was preventing VMOVDQU32/VMOVDQA32 from being recognized. Fix a bug in the code that stops execution dependency fix from turning operations on 32-bit integer element types into operations on 64-bit integer element types. llvm-svn: 277327
2016-08-01 15:55:33 +08:00
; AVX512-LABEL: test_unaligned_v16i8:
; AVX512: # BB#0:
; AVX512-NEXT: vmovups (%rdi), %xmm0
; AVX512-NEXT: retq
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
%1 = load <16 x i8>, <16 x i8>* %src, align 1, !nontemporal !1
ret <16 x i8> %1
}
; And now YMM versions.
define <8 x float> @test_unaligned_v8f32(<8 x float>* %src) {
; SSE-LABEL: test_unaligned_v8f32:
; SSE: # BB#0:
; SSE-NEXT: movups (%rdi), %xmm0
; SSE-NEXT: movups 16(%rdi), %xmm1
; SSE-NEXT: retq
;
; AVX-LABEL: test_unaligned_v8f32:
; AVX: # BB#0:
; AVX-NEXT: vmovups (%rdi), %ymm0
; AVX-NEXT: retq
;
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; AVX512-LABEL: test_unaligned_v8f32:
; AVX512: # BB#0:
; AVX512-NEXT: vmovups (%rdi), %ymm0
; AVX512-NEXT: retq
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
%1 = load <8 x float>, <8 x float>* %src, align 1, !nontemporal !1
ret <8 x float> %1
}
define <8 x i32> @test_unaligned_v8i32(<8 x i32>* %src) {
; SSE-LABEL: test_unaligned_v8i32:
; SSE: # BB#0:
; SSE-NEXT: movups (%rdi), %xmm0
; SSE-NEXT: movups 16(%rdi), %xmm1
; SSE-NEXT: retq
;
; AVX-LABEL: test_unaligned_v8i32:
; AVX: # BB#0:
; AVX-NEXT: vmovups (%rdi), %ymm0
; AVX-NEXT: retq
;
[AVX-512] Fix duplicate column in AVX512 execution dependency table that was preventing VMOVDQU32/VMOVDQA32 from being recognized. Fix a bug in the code that stops execution dependency fix from turning operations on 32-bit integer element types into operations on 64-bit integer element types. llvm-svn: 277327
2016-08-01 15:55:33 +08:00
; AVX512-LABEL: test_unaligned_v8i32:
; AVX512: # BB#0:
; AVX512-NEXT: vmovups (%rdi), %ymm0
; AVX512-NEXT: retq
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
%1 = load <8 x i32>, <8 x i32>* %src, align 1, !nontemporal !1
ret <8 x i32> %1
}
define <4 x double> @test_unaligned_v4f64(<4 x double>* %src) {
; SSE-LABEL: test_unaligned_v4f64:
; SSE: # BB#0:
; SSE-NEXT: movups (%rdi), %xmm0
; SSE-NEXT: movups 16(%rdi), %xmm1
; SSE-NEXT: retq
;
; AVX-LABEL: test_unaligned_v4f64:
; AVX: # BB#0:
; AVX-NEXT: vmovups (%rdi), %ymm0
; AVX-NEXT: retq
;
[AVX512] Add VLX packed move instructions to the execution dependency fix pass and update tests. llvm-svn: 277304
2016-08-01 04:20:01 +08:00
; AVX512-LABEL: test_unaligned_v4f64:
; AVX512: # BB#0:
; AVX512-NEXT: vmovups (%rdi), %ymm0
; AVX512-NEXT: retq
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
%1 = load <4 x double>, <4 x double>* %src, align 1, !nontemporal !1
ret <4 x double> %1
}
define <4 x i64> @test_unaligned_v4i64(<4 x i64>* %src) {
; SSE-LABEL: test_unaligned_v4i64:
; SSE: # BB#0:
; SSE-NEXT: movups (%rdi), %xmm0
; SSE-NEXT: movups 16(%rdi), %xmm1
; SSE-NEXT: retq
;
; AVX-LABEL: test_unaligned_v4i64:
; AVX: # BB#0:
; AVX-NEXT: vmovups (%rdi), %ymm0
; AVX-NEXT: retq
;
[AVX-512] Fix duplicate column in AVX512 execution dependency table that was preventing VMOVDQU32/VMOVDQA32 from being recognized. Fix a bug in the code that stops execution dependency fix from turning operations on 32-bit integer element types into operations on 64-bit integer element types. llvm-svn: 277327
2016-08-01 15:55:33 +08:00
; AVX512-LABEL: test_unaligned_v4i64:
; AVX512: # BB#0:
; AVX512-NEXT: vmovups (%rdi), %ymm0
; AVX512-NEXT: retq
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
%1 = load <4 x i64>, <4 x i64>* %src, align 1, !nontemporal !1
ret <4 x i64> %1
}
define <16 x i16> @test_unaligned_v16i16(<16 x i16>* %src) {
; SSE-LABEL: test_unaligned_v16i16:
; SSE: # BB#0:
; SSE-NEXT: movups (%rdi), %xmm0
; SSE-NEXT: movups 16(%rdi), %xmm1
; SSE-NEXT: retq
;
; AVX-LABEL: test_unaligned_v16i16:
; AVX: # BB#0:
; AVX-NEXT: vmovups (%rdi), %ymm0
; AVX-NEXT: retq
;
[AVX-512] Fix duplicate column in AVX512 execution dependency table that was preventing VMOVDQU32/VMOVDQA32 from being recognized. Fix a bug in the code that stops execution dependency fix from turning operations on 32-bit integer element types into operations on 64-bit integer element types. llvm-svn: 277327
2016-08-01 15:55:33 +08:00
; AVX512-LABEL: test_unaligned_v16i16:
; AVX512: # BB#0:
; AVX512-NEXT: vmovups (%rdi), %ymm0
; AVX512-NEXT: retq
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
%1 = load <16 x i16>, <16 x i16>* %src, align 1, !nontemporal !1
ret <16 x i16> %1
}
define <32 x i8> @test_unaligned_v32i8(<32 x i8>* %src) {
; SSE-LABEL: test_unaligned_v32i8:
; SSE: # BB#0:
; SSE-NEXT: movups (%rdi), %xmm0
; SSE-NEXT: movups 16(%rdi), %xmm1
; SSE-NEXT: retq
;
; AVX-LABEL: test_unaligned_v32i8:
; AVX: # BB#0:
; AVX-NEXT: vmovups (%rdi), %ymm0
; AVX-NEXT: retq
;
[AVX-512] Fix duplicate column in AVX512 execution dependency table that was preventing VMOVDQU32/VMOVDQA32 from being recognized. Fix a bug in the code that stops execution dependency fix from turning operations on 32-bit integer element types into operations on 64-bit integer element types. llvm-svn: 277327
2016-08-01 15:55:33 +08:00
; AVX512-LABEL: test_unaligned_v32i8:
; AVX512: # BB#0:
; AVX512-NEXT: vmovups (%rdi), %ymm0
; AVX512-NEXT: retq
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
%1 = load <32 x i8>, <32 x i8>* %src, align 1, !nontemporal !1
ret <32 x i8> %1
}
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; And now ZMM versions.
define <16 x float> @test_unaligned_v16f32(<16 x float>* %src) {
; SSE-LABEL: test_unaligned_v16f32:
; SSE: # BB#0:
; SSE-NEXT: movups (%rdi), %xmm0
; SSE-NEXT: movups 16(%rdi), %xmm1
; SSE-NEXT: movups 32(%rdi), %xmm2
; SSE-NEXT: movups 48(%rdi), %xmm3
; SSE-NEXT: retq
;
; AVX-LABEL: test_unaligned_v16f32:
; AVX: # BB#0:
; AVX-NEXT: vmovups (%rdi), %ymm0
; AVX-NEXT: vmovups 32(%rdi), %ymm1
; AVX-NEXT: retq
;
; AVX512-LABEL: test_unaligned_v16f32:
; AVX512: # BB#0:
; AVX512-NEXT: vmovups (%rdi), %zmm0
; AVX512-NEXT: retq
%1 = load <16 x float>, <16 x float>* %src, align 1, !nontemporal !1
ret <16 x float> %1
}
define <16 x i32> @test_unaligned_v16i32(<16 x i32>* %src) {
; SSE-LABEL: test_unaligned_v16i32:
; SSE: # BB#0:
; SSE-NEXT: movups (%rdi), %xmm0
; SSE-NEXT: movups 16(%rdi), %xmm1
; SSE-NEXT: movups 32(%rdi), %xmm2
; SSE-NEXT: movups 48(%rdi), %xmm3
; SSE-NEXT: retq
;
; AVX-LABEL: test_unaligned_v16i32:
; AVX: # BB#0:
; AVX-NEXT: vmovups (%rdi), %ymm0
; AVX-NEXT: vmovups 32(%rdi), %ymm1
; AVX-NEXT: retq
;
; AVX512-LABEL: test_unaligned_v16i32:
; AVX512: # BB#0:
[AVX-512] Fix duplicate column in AVX512 execution dependency table that was preventing VMOVDQU32/VMOVDQA32 from being recognized. Fix a bug in the code that stops execution dependency fix from turning operations on 32-bit integer element types into operations on 64-bit integer element types. llvm-svn: 277327
2016-08-01 15:55:33 +08:00
; AVX512-NEXT: vmovups (%rdi), %zmm0
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; AVX512-NEXT: retq
%1 = load <16 x i32>, <16 x i32>* %src, align 1, !nontemporal !1
ret <16 x i32> %1
}
define <8 x double> @test_unaligned_v8f64(<8 x double>* %src) {
; SSE-LABEL: test_unaligned_v8f64:
; SSE: # BB#0:
; SSE-NEXT: movups (%rdi), %xmm0
; SSE-NEXT: movups 16(%rdi), %xmm1
; SSE-NEXT: movups 32(%rdi), %xmm2
; SSE-NEXT: movups 48(%rdi), %xmm3
; SSE-NEXT: retq
;
; AVX-LABEL: test_unaligned_v8f64:
; AVX: # BB#0:
; AVX-NEXT: vmovups (%rdi), %ymm0
; AVX-NEXT: vmovups 32(%rdi), %ymm1
; AVX-NEXT: retq
;
; AVX512-LABEL: test_unaligned_v8f64:
; AVX512: # BB#0:
[AVX512] Add initial support for the Execution Domain fixing pass to change some EVEX instructions. llvm-svn: 276393
2016-07-22 13:00:52 +08:00
; AVX512-NEXT: vmovups (%rdi), %zmm0
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; AVX512-NEXT: retq
%1 = load <8 x double>, <8 x double>* %src, align 1, !nontemporal !1
ret <8 x double> %1
}
define <8 x i64> @test_unaligned_v8i64(<8 x i64>* %src) {
; SSE-LABEL: test_unaligned_v8i64:
; SSE: # BB#0:
; SSE-NEXT: movups (%rdi), %xmm0
; SSE-NEXT: movups 16(%rdi), %xmm1
; SSE-NEXT: movups 32(%rdi), %xmm2
; SSE-NEXT: movups 48(%rdi), %xmm3
; SSE-NEXT: retq
;
; AVX-LABEL: test_unaligned_v8i64:
; AVX: # BB#0:
; AVX-NEXT: vmovups (%rdi), %ymm0
; AVX-NEXT: vmovups 32(%rdi), %ymm1
; AVX-NEXT: retq
;
; AVX512-LABEL: test_unaligned_v8i64:
; AVX512: # BB#0:
[AVX-512] Fix duplicate column in AVX512 execution dependency table that was preventing VMOVDQU32/VMOVDQA32 from being recognized. Fix a bug in the code that stops execution dependency fix from turning operations on 32-bit integer element types into operations on 64-bit integer element types. llvm-svn: 277327
2016-08-01 15:55:33 +08:00
; AVX512-NEXT: vmovups (%rdi), %zmm0
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; AVX512-NEXT: retq
%1 = load <8 x i64>, <8 x i64>* %src, align 1, !nontemporal !1
ret <8 x i64> %1
}
define <32 x i16> @test_unaligned_v32i16(<32 x i16>* %src) {
; SSE-LABEL: test_unaligned_v32i16:
; SSE: # BB#0:
; SSE-NEXT: movups (%rdi), %xmm0
; SSE-NEXT: movups 16(%rdi), %xmm1
; SSE-NEXT: movups 32(%rdi), %xmm2
; SSE-NEXT: movups 48(%rdi), %xmm3
; SSE-NEXT: retq
;
; AVX-LABEL: test_unaligned_v32i16:
; AVX: # BB#0:
; AVX-NEXT: vmovups (%rdi), %ymm0
; AVX-NEXT: vmovups 32(%rdi), %ymm1
; AVX-NEXT: retq
;
; AVX512F-LABEL: test_unaligned_v32i16:
; AVX512F: # BB#0:
; AVX512F-NEXT: vmovups (%rdi), %ymm0
; AVX512F-NEXT: vmovups 32(%rdi), %ymm1
; AVX512F-NEXT: retq
;
; AVX512BW-LABEL: test_unaligned_v32i16:
; AVX512BW: # BB#0:
; AVX512BW-NEXT: vmovdqu16 (%rdi), %zmm0
; AVX512BW-NEXT: retq
;
; AVX512VL-LABEL: test_unaligned_v32i16:
; AVX512VL: # BB#0:
[AVX-512] Fix duplicate column in AVX512 execution dependency table that was preventing VMOVDQU32/VMOVDQA32 from being recognized. Fix a bug in the code that stops execution dependency fix from turning operations on 32-bit integer element types into operations on 64-bit integer element types. llvm-svn: 277327
2016-08-01 15:55:33 +08:00
; AVX512VL-NEXT: vmovups (%rdi), %ymm0
; AVX512VL-NEXT: vmovups 32(%rdi), %ymm1
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; AVX512VL-NEXT: retq
%1 = load <32 x i16>, <32 x i16>* %src, align 1, !nontemporal !1
ret <32 x i16> %1
}
define <64 x i8> @test_unaligned_v64i8(<64 x i8>* %src) {
; SSE-LABEL: test_unaligned_v64i8:
; SSE: # BB#0:
; SSE-NEXT: movups (%rdi), %xmm0
; SSE-NEXT: movups 16(%rdi), %xmm1
; SSE-NEXT: movups 32(%rdi), %xmm2
; SSE-NEXT: movups 48(%rdi), %xmm3
; SSE-NEXT: retq
;
; AVX-LABEL: test_unaligned_v64i8:
; AVX: # BB#0:
; AVX-NEXT: vmovups (%rdi), %ymm0
; AVX-NEXT: vmovups 32(%rdi), %ymm1
; AVX-NEXT: retq
;
; AVX512F-LABEL: test_unaligned_v64i8:
; AVX512F: # BB#0:
; AVX512F-NEXT: vmovups (%rdi), %ymm0
; AVX512F-NEXT: vmovups 32(%rdi), %ymm1
; AVX512F-NEXT: retq
;
; AVX512BW-LABEL: test_unaligned_v64i8:
; AVX512BW: # BB#0:
; AVX512BW-NEXT: vmovdqu8 (%rdi), %zmm0
; AVX512BW-NEXT: retq
;
; AVX512VL-LABEL: test_unaligned_v64i8:
; AVX512VL: # BB#0:
[AVX-512] Fix duplicate column in AVX512 execution dependency table that was preventing VMOVDQU32/VMOVDQA32 from being recognized. Fix a bug in the code that stops execution dependency fix from turning operations on 32-bit integer element types into operations on 64-bit integer element types. llvm-svn: 277327
2016-08-01 15:55:33 +08:00
; AVX512VL-NEXT: vmovups (%rdi), %ymm0
; AVX512VL-NEXT: vmovups 32(%rdi), %ymm1
[X86][AVX512] Added 512-bit vector nontemporal load tests llvm-svn: 271668
2016-06-03 21:42:49 +08:00
; AVX512VL-NEXT: retq
%1 = load <64 x i8>, <64 x i8>* %src, align 1, !nontemporal !1
ret <64 x i8> %1
}
[X86][SSE] Added nontemporal load tests These currently all lower to regular loads, generic nontemporal load support will be added in a future patch llvm-svn: 271659
2016-06-03 19:00:55 +08:00
!1 = !{i32 1}