Commit Graph

146 Commits

Author SHA1 Message Date
sunsuodong bab6c17399 code review 2022-03-18 01:16:02 -07:00
yefeng 63f1786356 parallel predict support GPU && one Runner bind one model pool 2022-03-14 10:22:25 +08:00
yeyunpeng2020 f670a635f0 add encryption to lite 2022-03-08 09:15:10 +08:00
yefeng 4b06963e1f parall predict remove param 2022-03-02 09:43:18 +08:00
yefeng 58756a44f9 parallel predict support numa 2022-03-01 12:29:41 +08:00
i-robot 56a1bb2330
!30475 add LiteKernel quant_type
Merge pull request !30475 from liyan2022/dev_nvgpu
2022-02-26 09:40:57 +00:00
yefeng c301bf16a2 copy from 1.6 2022-02-23 20:32:29 +08:00
albert-yan 14b9f5797d add LiteKernel quant_type 2022-02-23 17:34:36 +08:00
i-robot f9da3f44dc
!30098 [MSLITE] change kMindIR_Opt to kMindIR_Lite
Merge pull request !30098 from ling/clean
2022-02-17 09:40:26 +00:00
i-robot c74d4c8007
!30126 [MS][LITE] add multiModelHW api for quant model
Merge pull request !30126 from zhengjun10/quant
2022-02-17 09:37:16 +00:00
zhengjun10 d48a480aa4 add multiModelHW api for quant model 2022-02-16 16:45:52 +08:00
ling 1f0db7ac05 [MSLITE] change kMindIR_Opt to kMindIR_Lite 2022-02-15 17:45:49 +08:00
sunsuodong d3a67a0233 fix build warning 2022-02-14 23:08:35 -08:00
i-robot b961b313f0
!29679 [MS][LITE] fix SetData interface bug
Merge pull request !29679 from jianghui58/bugfix_0129
2022-02-12 09:54:33 +00:00
jianghui58 fe3ba7e49c fix SetData bug && code review 2022-02-11 16:59:51 +08:00
i-robot 01363adce2
!29667 [MS][LITE] sync grad op codecheck
Merge pull request !29667 from zhengjun10/codecheck
2022-02-08 11:22:27 +00:00
yangruoqi713 3afea5ce9d [MSLITE][DEVELOP] code review for lite: base op directory, include directory 2022-02-08 09:53:41 +08:00
zhengjun10 9c4e4c8366 sync codehub check 2022-02-07 15:43:01 +08:00
albert.liyan@huawei.com 7b03487a68 support nvgpu quant 2022-01-08 15:24:11 +08:00
i-robot 4fcd69067c !28088 Ascend710 online infer.
Merge pull request !28088 from chenping/runtime
2021-12-27 08:34:07 +00:00
chenping 68e93e3b18 model_zoo模型在Ascend710上的在线推理调试 2021-12-26 15:28:03 +08:00
Emir Haleva 059c8fb283 Extend cxx_api to other ToD methods 2021-12-23 07:33:16 +02:00
He Wei d28b189495 Move some basic type defines to mindapi 2021-12-21 09:38:33 +08:00
i-robot 5503948658 !27610 Support Ascend710 device to run converter and benchmark.
Merge pull request !27610 from chenping/master
2021-12-20 12:20:38 +00:00
xuanyue 1dd50a0a6f open ConverterContext and open special nodes 2021-12-18 23:07:29 +08:00
i-robot 4fdd5b4958 !27791 [MS][LITE] add runstep and featuremap api
Merge pull request !27791 from zhengjun10/runstep
2021-12-18 07:51:43 +00:00
i-robot ae6ac1a52e !27772 [MSLITE][GPU] opengl use old benchmark bugfix and remove opengl Dependent library
Merge pull request !27772 from Greatpan/master_gl
2021-12-17 02:32:30 +00:00
zhengjun10 a11c9d6900 add runstep and featuremap api 2021-12-17 10:02:18 +08:00
chenping eacab8afe8 Support Convert and Benchmark for Ascend710. 2021-12-16 20:02:49 +08:00
greatpanc c8e043597b opengl old benchmark bugfix and remove opengl Dependent library 2021-12-16 19:47:36 +08:00
YangLuo fa7ed720c8 Saving dataset into Mindir and load for inference phase 2 2021-12-16 16:46:51 +08:00
xuyongfei 0a0419498f C++ inference interface Ascend310DeviceInfo+Ascend910DeviceInfo->AscendDeviceInfo 2021-12-10 16:41:10 +08:00
i-robot ed1c99a831 !27305 opengl bugfix
Merge pull request !27305 from Greatpan/master
2021-12-07 07:46:47 +00:00
greatpanc 29b852f46d opengl bugfix 2021-12-07 09:15:02 +08:00
zhengyuanhua 18e6b49630 modify external api impl for ABI 2021-12-06 15:05:35 +08:00
i-robot c1b1324ca4 !26815 310 ocr model support dynamic hw
Merge pull request !26815 from zhengyuanhua/model_br1
2021-11-26 08:00:09 +00:00
i-robot 9ed9f21077 !26771 [MS][LITE][develop] template DelegateModel and modify c api
Merge pull request !26771 from sunsuodong/delegate_model_and_fix_c_api
2021-11-26 03:51:43 +00:00
zhengyuanhua 9f1c444178 310 ocr suport dynamic hw 2021-11-25 20:49:41 +08:00
sunsuodong ef80c94aac template DelegateModel and fix c api 2021-11-25 00:41:58 -08:00
zhengyuanhua c0332b4fc7 310 support image size 2021-11-24 14:15:43 +08:00
sunsuodong 1615edc359 add c api 2021-11-23 05:11:45 -08:00
i-robot f5865d0ea1 !26333 [MSLITE] add get rank id in tensorrt delegate
Merge pull request !26333 from Liu_Xuu/trt_1112_rankid
2021-11-17 01:39:13 +00:00
sunsuodong 4c5732c642 fix vs run bug 2021-11-15 22:49:49 -08:00
Liu_Xuu db5f132127 [MSLITE] add get rank id in tensorrt delegate 2021-11-16 14:20:07 +08:00
ling 022f10e639 [MSLITE] runtime convert support input buffer 2021-11-12 14:25:40 +08:00
ling aaca4be28b [MSLITE] model Type 2021-11-08 16:12:57 +08:00
i-robot f029f8de1a !25912 【MS】【LITE】support get attr and config from kernel
Merge pull request !25912 from chenjianping/code_check
2021-11-05 08:23:43 +00:00
chenjianping 8acc951a47 support get config and attr from kernel 2021-11-05 11:14:24 +08:00
Emir Haleva 8433b1be54 API to change TensorsWeights for Site AI 2021-11-03 16:02:09 +02:00
yangruoqi713 b85ffa11f4 [MSLITE][DEVELOP] include stdint.h for data_type, elementNum & Size overflow check 2021-11-01 11:21:15 +08:00