Commit Graph

288 Commits

Author SHA1 Message Date
guohongzilong 585f29a1f7 fix train mode in package_lite.cmake 2020-11-11 15:50:41 +08:00
mindspore-ci-bot d286bfe7e3 !8199 update dnnl version
Merge pull request !8199 from baihuawei/updatednnl
2020-11-05 15:09:53 +08:00
baihuawei 3f923da39d update onednnl version 2020-11-04 15:30:38 +08:00
zhoufeng 183742009f mindspore cxx api for 310 inference
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
2020-11-04 13:59:33 +08:00
mindspore-ci-bot 7b967a33a7 !7468 [MemOpt]Safe Optimized Memory Allocation Solver
Merge pull request !7468 from laiyongqiang/somas_online_commit
2020-10-31 16:23:15 +08:00
mindspore-ci-bot 7f1a9d1b61 !8014 support windows benchmark dynalic link
Merge pull request !8014 from lyvette/win2
2020-10-31 15:52:55 +08:00
laiyongqiang 5452e711b5 [MemOpt]Safe Optimized Memory Allocation Solver 2020-10-31 11:51:30 +08:00
liuyu 73718f2681 support windows benchmark dynalic link 2020-10-30 16:46:05 +08:00
mindspore-ci-bot cb5b269862 !7888 master version update to 1.1.0
Merge pull request !7888 from lilei/modify_version
2020-10-28 16:58:53 +08:00
lilei fbb1662a38 modify_mindspore_version 2020-10-28 14:26:42 +08:00
xulei2020 9a1d3b09b6 fix dataset lite build with convert tool 2020-10-28 10:57:20 +08:00
Eric 5c37b95992 Added Crop, need decode.
Added decode for source operators

Partial lite build fix

Only crop op enabled

Removed opencv from mdlite "full" build

Adding tests

disabling tests for now, compiling

Halfway done adding normalize

Log linking failed for lite

Added normalize, and resize

Addressing comments part 1

Added CI fix part 1

Added CI fix part 2

added CI fix part 3

Added CI fix part 4

can't remove long

Removed open cv build completely

Removed packaging code for open cv

Disable lint check for C type

Fix CI issues part five
2020-10-26 17:17:33 -04:00
mindspore-ci-bot b7dacfa36e !7762 Include `mindspore.explainer` in cmake to make `mindspore.explainer` packed to whl
Merge pull request !7762 from lixiaohui33/feature_explain_core
2020-10-26 17:06:52 +08:00
lixiaohui c8b62074c9 include explainer in cmake and modify __init__ in explanation classes. 2020-10-26 15:49:03 +08:00
ZPaC adc48d0c9a update nccl cmake version 2020-10-26 15:24:47 +08:00
xulei2020 7cc84cf879 fix dataset was't packed together with mindspore-lite train problem 2020-10-23 11:43:48 +08:00
mindspore-ci-bot 74428a4f0b !7582 [MD]Add gitee repo for thirdparty donwload
Merge pull request !7582 from xulei/lite_test0905
2020-10-22 09:08:16 +08:00
xulei2020 ea29febdde add gitee repo for thirdparty donwload 2020-10-21 19:16:22 +08:00
zhoufeng 8709b4fa00 fix cannot find python-dev
signed-off-by: zhoufeng <zhoufeng54@huawei.com>
2020-10-21 17:20:57 +08:00
mindspore-ci-bot 5fe2164a70 !7543 modify_cmake
Merge pull request !7543 from lilei/modify_cmake
2020-10-21 11:31:05 +08:00
lilei ac11c32f4d modify_cmake 2020-10-21 09:47:33 +08:00
mindspore-ci-bot 89057c52cb !7522 [Data]add gitee repo for third_party download
Merge pull request !7522 from xulei/cmake
2020-10-21 09:07:41 +08:00
ZPaC d07c6151ea download nccl and pslite from gitee 2020-10-20 19:23:27 +08:00
xulei2020 9c1a0c796b add gitee repo for third_party download 2020-10-20 19:07:31 +08:00
mindspore-ci-bot cd8c4f47f2 !7503 enable download glog from gitee
Merge pull request !7503 from liubuyu/bug_fix
2020-10-20 16:13:45 +08:00
liubuyu e6303ec1b0 enable download glog from gitee 2020-10-20 14:58:59 +08:00
lyvette 6655b89fcf fix windows compile bug 2020-10-20 10:54:46 +08:00
mindspore-ci-bot 712d02a2fa !7409 fix dir error when enable download json from gitee
Merge pull request !7409 from liubuyu/bug_fix
2020-10-19 10:34:12 +08:00
mindspore-ci-bot 88cb8f250d !7389 Download ompi from gitee
Merge pull request !7389 from ZPaC/master-download-from-gitee
2020-10-19 10:16:03 +08:00
mindspore-ci-bot 143484394f !7387 add gitee download
Merge pull request !7387 from hexia/master
2020-10-19 09:21:14 +08:00
mindspore-ci-bot c3d1f54c7f !7403 modify_cmake
Merge pull request !7403 from lilei/modify_cmake_test
2020-10-18 11:13:56 +08:00
mindspore-ci-bot 6207210c22 !7420 [MS][LITE][Develop]support benchmark running on windows10
Merge pull request !7420 from chenjianping/lite_windows
2020-10-17 15:29:29 +08:00
mindspore-ci-bot 2b58af0e9d !7372 [quant] add QuantDtype and Observer
Merge pull request !7372 from yuchaojie/quant2
2020-10-17 11:27:10 +08:00
chenjianping 57cac9d396 support benchmark running on windows 2020-10-17 11:03:27 +08:00
liubuyu 05feb82012 bug fix when enable download json from gitee 2020-10-16 19:11:02 +08:00
lilei e7fefb4817 modify_cmake 2020-10-16 17:57:17 +08:00
yuchaojie 025ea2f392 add QuantDtype and Observer 2020-10-16 15:51:24 +08:00
ZPaC 07f77eb4b6 download ompi from gitee 2020-10-16 14:31:47 +08:00
anancds 28c9e9d9a5 Added http server based on libevent 2020-10-16 14:26:42 +08:00
hexia a16b04b651 add gitee download 2020-10-16 14:07:50 +08:00
mindspore-ci-bot f68d7b01d3 !7331 bug fix for profiling register twice
Merge pull request !7331 from liubuyu/bug_fix2
2020-10-16 10:27:04 +08:00
mindspore-ci-bot d020ed1eec !7334 [Data]add gitee repo for thirdpary lib download
Merge pull request !7334 from xulei/cmake
2020-10-15 17:22:30 +08:00
mindspore-ci-bot f69061c181 !7315 enable download from gitee
Merge pull request !7315 from liubuyu/bug_fix
2020-10-15 17:03:33 +08:00
xulei2020 55e386567a add gitee repo for thirdpary lib download 2020-10-15 15:27:02 +08:00
liubuyu adee3daf4d bug fix for profiling register twice 2020-10-15 10:53:47 +08:00
liubuyu f47dcd2bce easy use for speed up download third_party 2020-10-15 09:44:49 +08:00
mindspore-ci-bot b8b669f0ee !7207 Upgrade ompi to v4.0.3
Merge pull request !7207 from ZPaC/master-upgrade-ompi
2020-10-15 09:15:28 +08:00
hangq 94132b1aeb fix compile bug in testcase and package 2020-10-12 19:22:00 +08:00
ZPaC 0ae99c8479 Upgrade ompi to v4.0.3 2020-10-12 19:15:47 +08:00
hangq 16e1653c14 use .cmake to compile protobuf and flatbuffers 2020-10-11 13:27:30 +08:00
mindspore-ci-bot 27bbe35707 !6854 [MD][lite]Build minddata wthe mindspore-lite
Merge pull request !6854 from xulei/lite_test0905
2020-09-25 10:22:23 +08:00
mindspore-ci-bot e88e114a50 !5930 Cache server phase 2 single node
Merge pull request !5930 from Jamie/CacheOp_dev
2020-09-25 03:54:55 +08:00
Lixia Chen 983827ec5c Rebase up to 88ded11f59 2020-09-24 14:09:08 -04:00
yeyunpeng 89c05d956e change log_adapter 2020-09-24 21:03:47 +08:00
xulei2020 8abe727f49 build minddata wthe mindspore-lite 2020-09-24 20:27:32 +08:00
mayang 094bdbe253 MD5 value update in icu4c.cmake 2020-09-17 20:15:50 +08:00
mindspore-ci-bot 43770c9fda !6324 [MSLITE][Develop] modify optimize.so to sdot and fp16 so
Merge pull request !6324 from ling/bug
2020-09-17 14:11:40 +08:00
ling a19e6251bc [MSLITE][Develop] modify optimize.so to sdot and fp16 so 2020-09-17 11:59:42 +08:00
yanghaoran 416c6e1ba8 fix securec compile options, remove unused libraries from output package 2020-09-16 18:47:12 +08:00
mindspore-ci-bot 9c3a494ea7 !6318 fix cmake compile options
Merge pull request !6318 from hexia/master
2020-09-16 15:44:53 +08:00
hexia 23641e618a fix cmake compile options 2020-09-16 11:31:02 +08:00
qianlong 4c49d557d2 fix icu4c compile 2020-09-16 11:03:18 +08:00
xiefangqi c722c5ac17 add security compile options 2020-09-15 23:03:07 +08:00
mindspore-ci-bot 32361ae2ed !6128 build static lib for mindspore lite
Merge pull request !6128 from zhanghaibo/master
2020-09-14 14:04:37 +08:00
caifubi 372c2e7951 Combine Async Dump and E2E Dump 2020-09-14 10:57:46 +08:00
zhanghaibo5@huawei.com 9bdcc0a2dd support building of static lib for mindspore lite 2020-09-14 10:55:18 +08:00
mindspore-ci-bot 88aedd5d71 !6003 Check if required packages exist during compilation of MindSpore
Merge pull request !6003 from yanghaoran/pathfinding
2020-09-11 16:17:59 +08:00
yanghaoran 0bd4c218d4 cmake check if required packages exist 2020-09-11 15:07:17 +08:00
zhoufeng 73c3f20e23 no need to find python-dev while packing
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
2020-09-11 11:39:51 +08:00
mindspore-ci-bot 3c7b668d63 !5955 Cuda and ascend run package version checking && temporary environment variables auto setting
Merge pull request !5955 from zhoufeng/version_check
2020-09-11 11:12:30 +08:00
liubuyu c5f8849d03 version check 2020-09-10 20:33:46 +08:00
xulei2020 b356211413 add init code 2020-09-10 15:35:08 +08:00
xuanyue 99d6d7a07a custom parser tflite 2020-09-02 19:08:18 +08:00
mindspore-ci-bot bbbee68556 !4873 [lite] add option to build full minddata
Merge pull request !4873 from 章一智/TRC-ms-lite
2020-08-29 04:04:10 +08:00
ervinzhang 50cda2f8b1 added build option to build full minddata in ms-lite 2020-08-28 13:29:35 -04:00
mindspore-ci-bot 5c0b0c493a !5358 Fix utest asan
Merge pull request !5358 from zhoufeng/ut-asan
2020-08-28 16:14:03 +08:00
zhoufeng f62067ef83 fix utest asan
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
2020-08-28 14:12:46 +08:00
mindspore-ci-bot 4daabe1d75 !5316 Add head files and third-party files to x86 runtime package.
Merge pull request !5316 from wangshaocong/lite_pkg
2020-08-27 14:36:11 +08:00
wsc 1fe8d71581 Add head files and third-party files to x86 runtime package 2020-08-27 10:47:38 +08:00
liuwenhao4 8b2dc47a64 Add Convertor function for windows enviroment 2020-08-27 09:02:53 +08:00
mindspore-ci-bot 1e0bb2b9af !5043 Add Convertor function for windows enviroment
Merge pull request !5043 from liuwenhao/master
2020-08-25 21:30:48 +08:00
liuwenhao4 df44111d87 Add Convertor function for windows enviroment 2020-08-25 16:26:33 +08:00
wsc acbb23f8a7 Fix bug: the output folders of packages are the same. 2020-08-25 15:03:03 +08:00
wsc 758130924f Modify the '-fvisibility' attribute of mindspore-lite project. 2020-08-22 17:34:07 +08:00
chenjianping d88a98658c move nnacl to lite/ 2020-08-22 16:43:15 +08:00
wsc ba6c1494da Modify structure of tar packages of mindspore-lite 2020-08-20 19:27:48 +08:00
mindspore-ci-bot 0feb98ae8e !4693 Modify CMakeList file of lite to generate packages.
Merge pull request !4693 from wangshaocong/lite_cmake
2020-08-19 17:03:19 +08:00
mindspore-ci-bot 2db4bda219 !4622 serving restful init
Merge pull request !4622 from hexia/http_init
2020-08-19 16:15:58 +08:00
wsc 27ce4515f2 Modify CMakeList file of lite to generate packages. 2020-08-19 16:03:18 +08:00
heleiwang 8ee4d8e92d Gnn data processing supports distributed scenarios 2020-08-19 11:09:01 +08:00
hexia 75d116b5db serving http init 2020-08-18 20:15:47 +08:00
mindspore-ci-bot c6acafcbc6 !4268 fix glog level dont work
Merge pull request !4268 from liubuyu/master
2020-08-11 20:05:03 +08:00
liubuyu 25a67602b7 bug fix for glog level don't work 2020-08-11 16:44:50 +08:00
qianlong e9c4378ed8 add support of soft dvpp op 2020-08-11 15:46:07 +08:00
mindspore-ci-bot 234a3fd431 !4170 dlopen cpu mpi adapter
Merge pull request !4170 from kisnwang/disable-host-mpi
2020-08-10 16:39:56 +08:00
kswang 69c096c2a6 dlopen cpu mpi adapter 2020-08-09 14:29:23 +08:00
liubuyu 195f04e50e compile the core directory into a separate static library 2020-08-08 21:31:41 +08:00
mindspore-ci-bot 2b6ac46a03 !3869 remove redundant compilation of libtvm.so and mindspore/_akg directory
Merge pull request !3869 from looop5/remove_redundant_code_in_gpu
2020-08-07 17:19:39 +08:00
looop5 c2b4bad040 remove redundant compilation of libtvm.so and mindspore/_akg directory 2020-08-07 10:27:57 +08:00
kswang 51e9fbf973 format ompi 2020-08-05 22:07:45 +08:00
mindspore-ci-bot 64b0cb4f95 !3972 upgrade dnnl to v1.5
Merge pull request !3972 from kisnwang/update-dnnl-to-v1.5
2020-08-05 11:44:53 +08:00
mindspore-ci-bot 98c415a1d5 !3807 serving support acl dvpp process
Merge pull request !3807 from 徐永飞/master
2020-08-05 11:00:21 +08:00
kswang 13df76c984 upgrade dnnl to v1.5 2020-08-04 22:03:51 +08:00
xuyongfei c0b8df4f7c serving add acl dvpp support, ut tests, return input status string message 2020-08-04 21:40:21 +08:00
mindspore-ci-bot 1354cf098b !3642 use akg to compile gpu ops rather than _akg
Merge pull request !3642 from lingyunli63/use_full_akg_to_support_gpu
2020-08-03 11:53:40 +08:00
lingyunli63 b38d8ee837 use akg.ms instead of _akg 2020-08-03 10:48:11 +08:00
hexia a113a6b50a fix python proto 2020-07-31 15:24:29 +08:00
shenwei41 051c290d8b Modify patches and alerts 2020-07-29 19:26:06 +08:00
xsmq 5087945479 回退 'Pull Request !3236 : use akg to compile gpu ops rather than _akg' 2020-07-28 22:41:33 +08:00
mindspore-ci-bot d469a347f8 !3236 use akg to compile gpu ops rather than _akg
Merge pull request !3236 from lingyunli63/use_full_akg_to_support_gpu
2020-07-28 15:29:26 +08:00
lingyunli63 42017a19e6 enable compile gpu in akg 2020-07-27 19:20:29 +08:00
hexia 0792ceeeef fix python import 2020-07-27 14:12:13 +08:00
ZPaC 8ff1a9ab47 Use white list to control pslite compilation 2020-07-21 20:29:22 +08:00
xulei2020 18b519ae0f add sentence piece 2020-07-20 15:50:35 +08:00
mindspore-ci-bot be2cfa9ed6 !3075 Add profiler module.
Merge pull request !3075 from yuximiao/yuximiao_mindspore_profiler
2020-07-20 11:00:32 +08:00
yanghaoran 859acc6d2a synchronize latest Ascend software suite 18 Jul 2020, and merging branches 2020-07-18 21:09:55 +08:00
liubuyu a42ebf2cbc cmake bug fix 2020-07-18 10:36:53 +08:00
yuximiao ed9cc50551 Add profiler module 2020-07-17 18:20:18 +08:00
mindspore-ci-bot 7233d650f0 !3063 Enable to train in parameter server mode
Merge pull request !3063 from ZPaC/add-ps-training-mode
2020-07-16 22:25:44 +08:00
ZPaC 52022c8013 Enable to train in parameter server mode 2020-07-16 21:39:48 +08:00
changzherui f4cb445ea8 syn code for 0715 2020-07-16 17:18:21 +08:00
caifubi cb8b5dbd76 Remove build option -S 2020-07-16 14:51:48 +08:00
hexia 34c5971960 add ms_serving to whl and uncoupling third_party grpc 2020-07-15 14:27:14 +08:00
mindspore-ci-bot 69ce4bf2b2 !2970 Del mindspore/model_zoo
Merge pull request !2970 from panbingao/master
2020-07-14 08:57:31 +08:00
caifubi c577952c9a Async Data Dump 2020-07-13 09:42:37 +08:00
mindspore-ci-bot 65c6e54e2e !2773 Adding cpp_api
Merge pull request !2773 from 章一智/cpp_api
2020-07-11 18:58:42 +08:00
ZPaC e3316ae9d7 Fix ge compile error. 2020-07-11 11:02:17 +08:00
ervinzhang bd5a777f81 introducing new C++ API 2020-07-10 16:32:38 -04:00
panbingao 45dbc8bf04 Move model_zoo.resnet.py 2020-07-10 17:36:34 +08:00
yanghaoran 9ce5c97204 synchronize Ascend software suite 07 Jul 2020 2020-07-08 21:49:09 +08:00
qianlong 0c35247b58 change icu4c compile way 2020-07-07 14:54:49 +08:00
ZPaC a057639abc Add pslite dependency 2020-07-01 16:26:24 +08:00
mindspore-ci-bot cc2655e599 !2428 building _ms_mpi with mpi_interface
Merge pull request !2428 from chenjianping/host_reduce
2020-06-24 11:53:29 +08:00
chenjianping 343889cdb7 building _ms_mpi with mpi_interface 2020-06-23 22:16:18 +08:00
Shida He 4c056855e0 Implementation for mindspore debugger 2020-06-22 17:15:30 -04:00
gong chen a6dfa281ea Init GraphKernel.
- It provides a unified style to express graph and kernel for user.
- It provides a unified IR to represent graph and kernel for developer.
- It breaks the boundary between graph and kernel.
- It provides more opportunities to do compile optimization.
2020-06-20 22:31:54 +08:00
qianlong c737098017 fix icu complie error 2020-06-18 21:59:18 +08:00
qianlong 4f16f036be Add WhitespaceTokenizer and UnicodeScriptTokenizer for nlp
add CaseFold, NormalizeUTF8

add RegexReplace

add RegexTokenizer

add BasicTokenizer

add WordpieceTokenizer

add BertTokenizer
2020-06-17 15:47:04 +08:00
Yang d7d8688ec4 !2118 update sqlite & patch 2020-06-16 09:31:12 +08:00
zhoufeng 54f1c6e3cb make the commid_id of whl packages to have same length
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
2020-06-14 17:13:07 +08:00
yanghaoran 8da4c1a763 synchronize latest ascend software 04 Jun 2020 2020-06-09 23:34:13 +08:00
chenjianping af8108c9e1 support host reduce scatter and allgather 2020-06-04 17:20:47 +08:00
jonyguo 698c88f306 update sqlite patch 2020-05-25 11:06:57 +08:00
xulei2020 5edadf1542 add jieba c++ code 2020-05-21 14:47:16 +08:00
xulei2020 da8e095bd3 add jieba c++ code 2020-05-21 10:47:02 +08:00
xulei2020 163b6b7ea7 add jieba c++ code 2020-05-20 15:55:12 +08:00
caifubi 7d07e17f5a Support Common Hccl Op
1.Support Broadcast op
2.Support communication op as graph output
3.Optimize Communication op memory alocation
4.support hccl multi-group
2020-05-18 14:48:34 +08:00
xiefangqi c937bad53f minddata support voc 2020-05-15 13:24:03 +08:00
zhoufeng b681cec8f2 cmake refactor 2020-04-26 20:51:18 +08:00
zhoufeng e0c3ec6c79 check gcc version, check patch is found or not 2020-04-26 11:02:20 +08:00