yystopf
/
mindspore
forked from mindspore-Ecosystem/mindspore
0
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
45,876 Commits 23 Branches 0 Tags 3.9 GiB
Commit Graph

2085 Commits

Author SHA1 Message Date
Zirui Wu bde9f18f5a update lookup api to take in a type 
ci

add test case

address some of the review cmts

address review cmts
 2020-09-08 11:59:28 -04:00
wuxuejian bd527a331d update aicpu proto and update module: graphengine 
Support Dynamic Shape Aicpu Run Package

adapt tensorengin modify, fix ub fusion
 2020-09-08 11:38:44 +08:00
mindspore-ci-bot 5c7fa52468 !5673 [performance]cell init opt performance 
Merge pull request !5673 from kingxian/master
 2020-09-05 17:10:08 +08:00
kingxian 92bebe65a9 cell init performance opt 2020-09-04 19:52:56 +08:00
mindspore-ci-bot d0c7b1ba24 !5731 Manifest Dataset check invalid filename string 
Merge pull request !5731 from jiangzhiwen/fix/invalid_filename_string
 2020-09-04 16:36:29 +08:00
mindspore-ci-bot bc4c5afc1a !5667 add kernel select after optimize pass 
Merge pull request !5667 from zyli2020/code_refactor
 2020-09-04 14:24:44 +08:00
mindspore-ci-bot 2f3684d4fa !4872 Add C++ API support for TFRecordDataset 
Merge pull request !4872 from TinaMengtingZhang/cpp-api-tfrecord-dataset
 2020-09-04 11:53:08 +08:00
lizhenyu c3d6918649 add kernel select after optimize pass 2020-09-04 10:52:51 +08:00
jiangzhiwen 294f7b620a check invalid filename string 2020-09-03 22:09:26 +08:00
mindspore-ci-bot 527d7f0afb !5580 [MD] remove finish in FileReader 
Merge pull request !5580 from liyong126/rmv_filereader_finish
 2020-09-03 21:18:35 +08:00
mindspore-ci-bot b961d47d40 !5642 UTest compiling performance optimization 
Merge pull request !5642 from zhoufeng/ut-compile-performance
 2020-09-03 20:21:13 +08:00
liyong ac39c20f41 del finish in FileReader 2020-09-03 20:05:38 +08:00
mindspore-ci-bot 01da7d2c1a !5713 Align num_samples of CSV with other dataset 
Merge pull request !5713 from jiangzhiwen/fix/csv_num_samples
 2020-09-03 19:52:43 +08:00
jiangzhiwen 1a1a8893a4 Align num_samples of CSV with other dataset 2020-09-03 17:30:39 +08:00
zhoufeng 6d500223b2 utest compiling performance optimization 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2020-09-03 16:57:19 +08:00
zhousiyi 301aeaaf1d remove gvar source file from compile as ut_tests will use gvar so 2020-09-03 06:49:30 +00:00
tinazhang e430b4056a add tfrecord dataset to cpp api 
fix to support schema=nullptr
 2020-09-02 08:55:47 -04:00
luoyang 8aba39a71b Modify VOCDataset doc & Fix BuildVocab bug 2020-09-02 16:54:50 +08:00
mindspore-ci-bot 5e3e583b47 !5615 Add check for duplicate column to a-cpi & add voc descriptions for class_index 
Merge pull request !5615 from luoyang/c-api-pyfunc
 2020-09-02 11:59:34 +08:00
mindspore-ci-bot 3048240f16 !5508 Add AdamApplyOneWithDecayAssign fusion pass 
Merge pull request !5508 from YuJianfeng/adam_assign
 2020-09-02 11:23:34 +08:00
luoyang ce419404ce Add check for duplicate column for a-cpi 2020-09-02 10:41:52 +08:00
mindspore-ci-bot 0cb6d29f0c !4998 Shared memory pool clean up 
Merge pull request !4998 from JesseKLee/mem_pool
 2020-09-02 02:01:19 +08:00
mindspore-ci-bot dff02cc282 !5188 rename image files in imagefolder 
Merge pull request !5188 from tony_liu2/alt
 2020-09-01 11:16:30 +08:00
mindspore-ci-bot b99149dc37 !4901 Adding data_helper for minddata 
Merge pull request !4901 from EricZ/md_helper
 2020-09-01 11:14:11 +08:00
mindspore-ci-bot 3be136f6f0 !5354 Fix randomdata issue 
Merge pull request !5354 from xiefangqi/fix_randomdata_columnlist
 2020-09-01 11:03:54 +08:00
mahdi 84efa0b96b Added BucketBatchByLength for C API 2020-08-31 17:06:16 -04:00
Eric 65bf3ecc3e Adding data_helper class 2020-08-31 16:29:14 -04:00
Jesse Lee e89b4648f6 Memory pool clean up 2020-08-30 11:28:24 -04:00
fary86 fcbb3e0edc Refactor ms_context implementation 2020-08-30 22:51:40 +08:00
yujianfeng 4b77f6b53c Add AdamApplyOneWithDecayAssign fusion pass 2020-08-29 17:54:15 +08:00
mindspore-ci-bot d81b30e6a0 !5312 make backend/optimizer free of pybind 
Merge pull request !5312 from xychow/remove-backend-py-dependency-2
 2020-08-29 14:42:33 +08:00
kswang 756bb6d53f async run graph 2020-08-28 18:18:47 +08:00
zhousiyi c25e37e7bf make backend/optimizer pybind free 2020-08-28 08:56:58 +00:00
xiefangqi e2085a9505 fix randomdata issue 2020-08-28 11:55:49 +08:00
tony_liu2 5e4c314130 rename dataset dir and image files 
change references to use path original

revert folder name

revert graphengine
 2020-08-27 16:49:23 -04:00
mindspore-ci-bot 716329df6c !5278 Change default value of sampler in c-api 
Merge pull request !5278 from luoyang/c-api
 2020-08-27 21:33:18 +08:00
YangLuo 419478b410 Change default value of sampler to seperate behaviour of default sampler 
& null sampler, add check for duplicate column name
 2020-08-27 21:24:37 +08:00
mindspore-ci-bot a8317acee8 !5111 Support int64 for cpu sparse optimizers 
Merge pull request !5111 from YuJianfeng/int64
 2020-08-27 17:17:05 +08:00
mindspore-ci-bot e94416be0c !5283 Support setting operator io format in the frontend 
Merge pull request !5283 from liangchenghui/io_format
 2020-08-27 15:48:13 +08:00
yujianfeng e949540062 Support int64 for cpu sparse optimizers 2020-08-27 10:57:53 +08:00
mindspore-ci-bot d1b95ed9bd !5240 Fix remove internal output for unique device target 
Merge pull request !5240 from YuJianfeng/internal_output
 2020-08-27 10:35:37 +08:00
islam_amin 94a4a3f20b changing affine and posterize apis 2020-08-26 10:51:54 -04:00
梁成辉 34d433fd9a Set io format for old backend 2020-08-26 20:49:15 +08:00
yujianfeng e688e1df32 Fix remove internal output for unique device target 2020-08-26 17:31:35 +08:00
Cathy Wong 46e9d79a50 C++ API: Lexicographical order support for CLUE, CSV & TextFile Datasets 2020-08-25 14:11:19 -04:00
luoyang b26f6b3d5e fix bug in c-api: rename, concat, take 2020-08-25 16:25:00 +08:00
mindspore-ci-bot 0bbce9367e !4772 Adding AlbumDataset for device training 
Merge pull request !4772 from EricZ/ms-album
 2020-08-24 08:27:14 +08:00
Eric c79db93c48 Initial commit for album 
Added linter fix for album dataset

Added testDataset

Adding signature

Added JsonDataset example API

Example dataset

Resolving format

More fixing

Refactor

Small fix

Added compiling album dataset

Running tests

Added linter fix #1

Passing UT

Added dataset API

Addressing clang

Clang part 2

Fixing pass

Fixed tree check

lint fix

Added lint fix part 2
 2020-08-22 11:07:10 -04:00
mindspore-ci-bot 9b503e4f38 !4955 Fixes for Dynamic Augmentation Ops 
Merge pull request !4955 from MahdiRahmaniHanzaki/dynamic-ops-fix
 2020-08-22 10:27:50 +08:00
Mahdi a5f9b8f92e Added fix for MixUpBatch and CutMixBatch and for RandomAffine 
updated c color op descriptions
 2020-08-21 17:40:08 -04:00
mindspore-ci-bot 9d7250c483 !4776 Introduce 2 extra ctrl flags to DataBuffer in dataset, address remaining cmts to PR4632 
Merge pull request !4776 from ZiruiWu/map_callback_follow_up
 2020-08-22 03:31:31 +08:00
Zirui Wu 74c1e6da60 introducing pause and quit flags to DataBuffer 
fix review cmts

fix ci

fix Ci

fixci

address ci

ci

- add timeout
- add more test cases

fix CI

address review cmts
 2020-08-21 14:33:26 -04:00
mindspore-ci-bot b2a5440548 !4883 Fix compilation warnings 
Merge pull request !4883 from zhoufeng/xiu-ba-ge
 2020-08-21 12:33:20 +08:00
zhoufeng 22ec976ef7 fix compilation warnings 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2020-08-21 09:44:04 +08:00
mindspore-ci-bot 9a3baf4f6c !4314 [MD] remove defaults used in binding code, and remove bilinear resize op 
Merge pull request !4314 from nhussain/clean_up_bindings
 2020-08-20 22:16:56 +08:00
mindspore-ci-bot bfa3cd900e !4843 remove ccsrc/common.h by explicit dependent header file 
Merge pull request !4843 from xychow/remove-ccsrc-common-h
 2020-08-20 22:02:13 +08:00
zhousiyi d0e58dd765 remove ccsrc/common.h 
replace frontend/operator/ops.h in backend with base/core_ops.h as
backend should not use any frontend-only primitive
 2020-08-20 09:34:07 +00:00
xiefangqi 7dc7990d75 add NumWorkers validate 2020-08-20 17:25:30 +08:00
mindspore-ci-bot 7b0a4e5929 !4796 Fix randomdata ut core dump problem 
Merge pull request !4796 from xiefangqi/fix_randomdata_ut
 2020-08-20 14:11:55 +08:00
xiefangqi c0d18d2517 fix randomdata ut problem 2020-08-20 11:13:02 +08:00
Jesse Lee 8a08d0c37b Phase 2 of CacheOp 2020-08-19 13:45:55 -04:00
Zirui Wu 78c1aa1d96 Implemented Callback for Dataset 
implment pause in MapOp, added more to callback

add ds_callback

- Initial drop of Python DSCallback

- Pybind DSCallback

- Pybind DSCallback

added callback to mapOp

- de_pipeline DSCallback

- de_pipeline DSCallback

add test case, segfault for now

fix seg fault

- de_pipeline DSCallback

remove 1 line

update callback test case, now works

use builder class for mapOp callback

- de_pipeline DSCallback

- de_pipeline DSCallback

- de_pipeline DSCallback

better test case

minor fix

add comments and minor clean ups

get rid of nullptr in MapOp, use other flag instead

fix a bug ParseMapOp only takes 1 callback

- Added WaitedDSCalabck

refactor callback param

fix text case incorrect number

- added testing

fix cpp test case

- added testing

- revert back lenet changes

- cleanup test_callbacks.py

- cleanup test_callbacks.py

fix CI stage I

fix CI stage II

fix CI and update epoch counter

- add validation
- add more testing  test_callbacks.py

use random data op to do tests

adjust when to call EpochBegin/End

- add repeat with callback

- addressing reviewers' comments

- docstring and CI fixes

- docstring and CI fixes

- docstring and CI fixes

- rebase with upstream/master

fix cpp test case

fix review comments

addr review cmts, add test case
 2020-08-19 12:31:04 -04:00
YangLuo b50ae27c72 !4597 [Dataset] C++ API Support for build_vocab 2020-08-19 22:47:47 +08:00
nhussain eb9a611041 remove old defaults 2020-08-19 10:11:19 -04:00
mindspore-ci-bot d541e261a0 !4696 C++ API Support for CSV Dataset 
Merge pull request !4696 from jiangzhiwen/jzw/c_api_csv
 2020-08-19 17:08:33 +08:00
mindspore-ci-bot 2db4bda219 !4622 serving restful init 
Merge pull request !4622 from hexia/http_init
 2020-08-19 16:15:58 +08:00
mindspore-ci-bot 256dccc651 !4498 Gnn data processing supports distributed scenarios 
Merge pull request !4498 from heleiwang/gnn_distributed
 2020-08-19 16:09:05 +08:00
jiangzhiwen 39df25f803 c++ api for CSV Dataset 2020-08-19 16:02:11 +08:00
heleiwang 8ee4d8e92d Gnn data processing supports distributed scenarios 2020-08-19 11:09:01 +08:00
mindspore-ci-bot 6868b9b6fa !4422 Minddata new dataset api ==> RandomData 
Merge pull request !4422 from xiefangqi/xfq_c++api_randomdata
 2020-08-19 10:48:53 +08:00
xiefangqi b91e56375e add randomdataset and schema 2020-08-19 09:13:43 +08:00
nhussain 738ae2c78d change api to use std_vector 
try to display image
 2020-08-18 15:41:21 -04:00
islam_amin 979111d0ef Added Posterize Op 2020-08-18 13:55:47 -04:00
hexia 75d116b5db serving http init 2020-08-18 20:15:47 +08:00
mindspore-ci-bot 4f46c4277a !4614 Code compile performance optimization 
Merge pull request !4614 from zhoufeng/code-compile-performance
 2020-08-18 16:45:15 +08:00
mindspore-ci-bot cc077de9e3 !4425 fix if statement with no return coredump 
Merge pull request !4425 from fary86/fix_if_no_return_coredump
 2020-08-18 16:09:31 +08:00
zhoufeng 663278112f optimize code compile performance 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2020-08-18 14:33:24 +08:00
mindspore-ci-bot 26de4540ef !4639 rename param_value to param_info 
Merge pull request !4639 from vlne-v1/rename_param_value
 2020-08-18 14:16:23 +08:00
fary86 38083e055a Fix coredump missing return statement after while loop 2020-08-18 14:16:21 +08:00
Wei Luning c1c30a44f1 rename param_value -> param_info 2020-08-18 11:16:28 +08:00
jiangzhiwen a88273bd3f c++ api support for Manifest Dataset 2020-08-18 09:48:55 +08:00
mindspore-ci-bot 113ff6ca24 !4367 CutMixBatch Augmentation Op 
Merge pull request !4367 from MahdiRahmaniHanzaki/cutmix
 2020-08-18 03:27:33 +08:00
mahdi 3ecc53fb4e Added CutMix 2020-08-17 13:01:47 -04:00
mindspore-ci-bot dda4c26e7c !4423 add reshape type of tensor 
Merge pull request !4423 from lianliguang/add-reshape-type-to-tensor
 2020-08-17 11:34:11 +08:00
WilliamLian 6760d9976d add reshape type to tensor 2020-08-17 09:34:38 +08:00
mindspore-ci-bot f875bf21bc !2948 fix control flow 
Merge pull request !2948 from amongo/FixControlFlow
 2020-08-17 08:56:22 +08:00
huangdongrun 2a6d346d2f support if by if grad parameter 
add join for ref

adjust env eliminate to eliminate all env ops

add partial app cache

resolve while endless

fix env eliminate

support for "for while" cases

fix join shape error
 2020-08-15 09:47:10 +08:00
Cathy Wong 9c8af0d1cf C++ API: Provide validate param functions 2020-08-14 17:54:38 -04:00
mindspore-ci-bot 7d70fb4dc4 !3769 add RandomColorOp 
Merge pull request !3769 from Alexey_Shevlyakov/ColorOp
 2020-08-14 23:43:08 +08:00
mindspore-ci-bot ebdea65f70 !4402 [Dataset] Fix c_api bugs 
Merge pull request !4402 from luoyang/c-api-pyfunc
 2020-08-14 17:40:32 +08:00
mindspore-ci-bot e9629f95e1 !4418 Add UniqueWithPad cpu kernel 
Merge pull request !4418 from huanghui/unique-with-pad-cpu-kernel
 2020-08-14 09:46:22 +08:00
Alexey Shevlyakov 8526d5414d RandomColor 2020-08-13 16:10:21 -04:00
mindspore-ci-bot 2953720169 !4322 Adding RGBA color conversion 
Merge pull request !4322 from EricZ/bitmap_support
 2020-08-14 01:58:33 +08:00
mindspore-ci-bot 7a10e07fc6 !4383 Add distributedSampler to concatOP 
Merge pull request !4383 from genglishuai/genglshOK
 2020-08-14 00:06:06 +08:00
eric 6a41b44724 Added wrapper around color change function 2020-08-13 11:39:56 -04:00
genglishuai 4d4df68d1e add DistributedSampler for Concat op 2020-08-13 22:52:02 +08:00
luoyang 373adaa553 !4402 [Dataset] Fix c_api bugs 2020-08-13 22:38:55 +08:00
mindspore-ci-bot ed1244558c !4366 Fixing param type in c++ api and fixing python validator for Repeat Op 
Merge pull request !4366 from TinaMengtingZhang/cpp-api-repeat-count
 2020-08-13 22:03:39 +08:00
huanghui 8f70af7300 add unique_with_pad cpu kernel 2020-08-13 21:55:00 +08:00
mindspore-ci-bot 03210ef166 !2557 Add UnsortedSegmentSum fission pass 
Merge pull request !2557 from huanghui/unsorted-segment-sum-fission-pass
 2020-08-13 08:57:01 +08:00
mindspore-ci-bot 265064733b !4340 move cc file that end with py to pybind 
Merge pull request !4340 from liubuyu/master
 2020-08-13 08:56:01 +08:00
tinazhang 0868720eb7 fix parameter type for repeat op in c++ api and added c++/python ut. 2020-08-12 17:23:42 -04:00
tony_liu2 deb1146474 reorganize headers and tests 
remove headers

fix iterator file

fix pr comments

fix new file
 2020-08-12 14:36:01 -04:00
huanghui b8d7f6d77f add UnsortedSegmentSum fission pass 2020-08-12 19:17:19 +08:00
liubuyu 45b6600001 mv cc file that end with py to pybind 2020-08-12 14:50:18 +08:00
mindspore-ci-bot 5adba834d0 !3819 C++ API Support for CLUE Dataset 
Merge pull request !3819 from jiangzhiwen/jzw/c_api_clue
 2020-08-12 14:21:19 +08:00
jiangzhiwen 5842a0212f c++ api support for CLUE Dataset 2020-08-12 09:55:43 +08:00
mindspore-ci-bot e509f87f7f !4219 Add Unique CPU kernel 
Merge pull request !4219 from huanghui/add-op-unique
 2020-08-12 09:39:14 +08:00
mindspore-ci-bot 9276a9d2fb !3771 C++ API Support for TextFile Dataset 
Merge pull request !3771 from cathwong/ckw_c_api_textfile_nosampler
 2020-08-12 04:32:05 +08:00
avakh 477528de7f random sharpness cpp op support 2020-08-11 15:30:40 -04:00
nhussain 7766efd58e add files 2020-08-11 11:54:14 -04:00
Cathy Wong 7f39b5cfd7 C++ API Support for TextFile Dataset and Unit Tests 2020-08-11 11:53:53 -04:00
huanghui fa081092c8 add Unique cpu kernel 2020-08-11 21:36:55 +08:00
mindspore-ci-bot c6acafcbc6 !4268 fix glog level dont work 
Merge pull request !4268 from liubuyu/master
 2020-08-11 20:05:03 +08:00
liubuyu 25a67602b7 bug fix for glog level don't work 2020-08-11 16:44:50 +08:00
WilliamLian 1f5441d73a remove inferfunction to core 2020-08-11 14:22:29 +08:00
mindspore-ci-bot 0115876363 !4197 Add AdamApplyOneAssign fusion pass 
Merge pull request !4197 from YuJianfeng/adam_assign
 2020-08-11 11:26:00 +08:00
mindspore-ci-bot 266df56570 !4220 [MD] add num_samples support in minddataset pk sampler 
Merge pull request !4220 from liyong126/minddataset_pk_num_samples
 2020-08-11 11:22:28 +08:00
mindspore-ci-bot f21ee64fd0 !4247 Add ChannelSwap operation 
Merge pull request !4247 from 章一智/channel_swap_op
 2020-08-11 09:59:55 +08:00
mindspore-ci-bot 2cab58fdbc !3850 Implementing RandomAffine C Op and a CPP UT for AutoContrast & Equalize 
Merge pull request !3850 from islam_amin/randomaffine_op
 2020-08-11 09:29:09 +08:00
mindspore-ci-bot 0bb39830ae !4250 fix cpp api iterator build function 
Merge pull request !4250 from anthonyaje/fix_cpp_api_iterator
 2020-08-11 07:21:27 +08:00
anthonyaje 9774505ecd Fixed dataset cpp api iterator build function 2020-08-10 18:35:59 -04:00
islam_amin e52d85ba9d Added RandomAffine Op 2020-08-10 17:52:50 -04:00
mindspore-ci-bot 612f533d15 !3917 Add c++ ops CreateTupleIterator & Code changes in VOC DatasetOp 
Merge pull request !3917 from luoyang/c-api
 2020-08-11 05:50:21 +08:00
ervinzhang 3a1d8b5f39 added channel swap operation in transforms.h 2020-08-10 17:32:50 -04:00
mindspore-ci-bot 9ad82f79fd !3979 Adding MixUp operation 
Merge pull request !3979 from MahdiRahmaniHanzaki/mixup
 2020-08-10 23:01:26 +08:00
liyong 7341421d3b fix num samples in pk sampler 2020-08-10 19:05:47 +08:00
yujianfeng 8a77751988 Add AdamApplyOneAssign and AdamApplyOneWithDecayAssign fusion pass 2020-08-10 14:46:37 +08:00
YangLuo e6a12946c8 Updata voc build() & add C++ Op CreateTupleIterator 2020-08-10 11:53:58 +08:00
liubuyu 195f04e50e compile the core directory into a separate static library 2020-08-08 21:31:41 +08:00
Mahdi 1896950ae5 Added Mixup 2020-08-07 17:47:16 -04:00
tony_liu2 3a020fe877 split c_api_test 
split into datasets

review fix

fix merge issues

fixed minddata lite build issues
 2020-08-07 11:57:49 -04:00
mindspore-ci-bot a395907182 !3944 Minddata new dataset api ==> CelebA 
Merge pull request !3944 from xiefangqi/md_new_api_CelebA
 2020-08-07 14:26:54 +08:00
panyifeng 34e50e5d6e fix cell bprop 2020-08-07 10:57:01 +08:00
xiefangqi 6276c0f22f new c++ api ==> CelebA 2020-08-07 09:23:20 +08:00
He Wei d310891eca Fix a bug in Tensor::equals() 
1. Check if data_ is null before compare it;
2. Always allocate an array for data_ even if size is zero.
 2020-08-06 21:06:27 +08:00
mindspore-ci-bot fe7141e9e0 !4019 add tensor layout in strategy checkpoint 
Merge pull request !4019 from yao_yf/add_layout_in_stra_ckpt
 2020-08-06 19:00:11 +08:00
yao_yf 60a9fb0001 add_tensor_layout_in_stra_ckpt 2020-08-06 15:57:38 +08:00
kingfo 28dabf0332 fix grad flag update issue in pynative 2020-08-06 15:12:31 +08:00
mindspore-ci-bot 7ec0b5857a !3977 [MD] Refactor Concatenate Op 
Merge pull request !3977 from nhussain/multi_dim_concat_2
 2020-08-06 02:53:06 +08:00
ervinzhang c65670b1a7 changed sampler parameter to support std::move 2020-08-05 13:56:52 -04:00
mindspore-ci-bot 6aa65da5d2 !3860 Minddata new dataset api ==> Coco 
Merge pull request !3860 from xiefangqi/md_new_api_cocodataset
 2020-08-06 00:34:28 +08:00
nhussain 61769b2dd9 fix concat 2020-08-05 11:28:56 -04:00
mindspore-ci-bot b045f47428 !3983 Add ReduceMin fission pass 
Merge pull request !3983 from huanghui/reduce-min-fission-pass
 2020-08-05 19:46:00 +08:00
mindspore-ci-bot 52689a7dcf !3938 decoupling core and context 
Merge pull request !3938 from liubuyu/master
 2020-08-05 14:16:37 +08:00
mindspore-ci-bot 98c415a1d5 !3807 serving support acl dvpp process 
Merge pull request !3807 from 徐永飞/master
 2020-08-05 11:00:21 +08:00
xiefangqi bb7bda1d6b new dataset api -- Coco 2020-08-05 10:54:37 +08:00
huanghui 30000fdb52 add ReduceMin fission pass 2020-08-05 10:46:01 +08:00
liubuyu d81862a916 decoupling core and context 2020-08-05 08:15:14 +08:00
xuyongfei c0b8df4f7c serving add acl dvpp support, ut tests, return input status string message 2020-08-04 21:40:21 +08:00
mindspore-ci-bot 7da26cc0f6 !3928 change type of Shape from int32 to int64 
Merge pull request !3928 from yihuaijie/dev
 2020-08-04 15:50:33 +08:00
mindspore-ci-bot 8b3e6496ac !3127 [pynative]pynative steps infer once 
Merge pull request !3127 from flywind/infer_2
 2020-08-04 14:34:25 +08:00
Yi Huaijie 80bdcab982 temporarily cast between int64 and int32 to wait ME support int64 2020-08-04 12:21:06 +08:00
Yi Huaijie 518cb80133 change type of Shape from int32 to int64 2020-08-04 11:30:23 +08:00
kpy a09565389c optimize infer in pynative mode 2020-08-04 11:22:39 +08:00
suteng 19e45ccdb1 回退 'Pull Request !3103 : change type of Shape from int32 to int64' 2020-08-03 22:06:37 +08:00
mindspore-ci-bot 6f7f376b1c !3821 Decouple ME and TBE by the IPC way. 
Merge pull request !3821 from ZhangQinghua/master1
 2020-08-03 20:34:01 +08:00
mindspore-ci-bot 657b547116 !3103 change type of Shape from int32 to int64 
Merge pull request !3103 from yihuaijie/dev
 2020-08-03 19:40:19 +08:00
mindspore-ci-bot a182a87a6d !3820 support tensor attr shape and dtype in graph mode 
Merge pull request !3820 from zhangbuxue/support_dtype_and_shape_as_attr_in_graph_mode
 2020-08-03 18:57:46 +08:00
buxue b075674cf2 support tensor attr shape and dtype in graph mode 2020-08-03 17:09:31 +08:00
Yi Huaijie 15d5cc396d change type of Shape from int32 to int64 2020-08-03 16:47:19 +08:00
Wei Luning a05c38bb63 make python Parameter inherit from Tensor 2020-08-03 09:12:24 +08:00
Zhang Qinghua 960da5cbed Decouple the backend TBE from binding Python API. 2020-08-01 17:09:08 +08:00
tinazhang e57d849618 add concat op and extend zip support to cpp api 2020-07-31 12:57:50 -04:00
Eric 8c018da468 Fixing issues in distributed sampler 
Added Distributed sampler option

Fix style
 2020-07-31 11:12:26 -04:00
mindspore-ci-bot 634d797ca3 !3549 MapOp refactor for device augmentation (part 1) 
Merge pull request !3549 from anthonyaje/device_augment_mapop_refactor1
 2020-07-31 21:56:16 +08:00
mindspore-ci-bot 953f91cef8 !3739 not eliminate memcpy when nexe node is graph output 
Merge pull request !3739 from laiyongqiang/eliminate_memcpy_bug
 2020-07-31 17:35:11 +08:00
mindspore-ci-bot 4e2b1eec5d !3119 Delete parameter block_reader for MindDataset 
Merge pull request !3119 from dengyutao/remove_blockreader
 2020-07-31 15:46:15 +08:00
dengyutao 388e43f7cb delete parameter block_reader for MindDataset 2020-07-31 11:30:05 +08:00
liubuyu a499d4e47c decoupling core and debug 2020-07-31 10:39:31 +08:00
laiyongqiang 2458431750 not eliminate memcpy when nexe node is graph output 2020-07-30 19:51:57 +08:00
mindspore-ci-bot 4834a6b347 !3574 Rename AnfNode::user_data related functions to follow naming rule 
Merge pull request !3574 from hewei/rename_user_data_func
 2020-07-29 14:26:21 +08:00
mindspore-ci-bot b75943f220 !3620 add mindspore lite 
Merge pull request !3620 from 张学同/to_merge
 2020-07-29 10:54:41 +08:00
anthonyaje a7eaf2736a First drop of MapOp refactor to support device augment. 
Refactored MapOp to in preparation to support device augment

Minor fix
 2020-07-28 15:53:43 -04:00
hangq 174d308cfa add mindspore lite 2020-07-29 03:06:17 +08:00
YangLuo ae99a3a3e4 C++ API support for TakeDatasetOp and VOCDatasetOp 2020-07-28 23:09:57 +08:00
mindspore-ci-bot b6c7273bb6 !3551 [MD] Fix Broken C++ Only Build 
Merge pull request !3551 from nhussain/fix_cpp_only_build
 2020-07-28 20:12:13 +08:00
mindspore-ci-bot 7cb567ebbe !3543 Split unsupport transdata 
Merge pull request !3543 from lianliguang/unify-primitive
 2020-07-28 17:23:44 +08:00
He Wei 4eb81d7934 Rename AnfNode::user_data related functions to follow naming rule 2020-07-28 15:35:48 +08:00
WilliamLian 0179724dcd spilit unspported transdata to two transdata from special format -> defualt -> default -> special 2020-07-28 14:23:31 +08:00
nhussain b65125b0a1 add more ifdef and include statments for pybind 2020-07-27 13:51:11 -04:00
mindspore-ci-bot ee67f70b73 !3449 Cifar100 for C API 
Merge pull request !3449 from MahdiRahmaniHanzaki/cifar100-c-api
 2020-07-28 00:09:41 +08:00
Mahdi 92568248c9 Added Cifar100 for C API 2020-07-27 10:35:24 -04:00
liubuyu f4bc0bc9fe move the dependency of utils to core 2020-07-27 10:28:46 +08:00
chenfei 1f1a07e645 don't insert assign from condition to true branch of while 2020-07-26 14:38:42 +08:00
mindspore-ci-bot 84c8b85ddc !3452 [MD] Gets rid of uncessary print calls 
Merge pull request !3452 from nhussain/refactor_name_function
 2020-07-25 20:59:27 +08:00
mindspore-ci-bot 9c06a564d1 !2983 Dataset Tensor class cleanup 
Merge pull request !2983 from h.farahat/tensor_class
 2020-07-25 20:59:13 +08:00
Eric 465a69a70a Added crop signature, wip 
Added input check

Added SwapRedBlue
 2020-07-24 20:40:45 -04:00
hesham adfbc891d3 - Add checks and testing for empty tensors 
- cleanup work on createTensor and Tensor's constructors
 2020-07-24 17:23:18 -04:00
nhussain a306264030 remove print calls 2020-07-24 17:10:49 -04:00
Mahdi 2b71cbf1bd Added RenameOp 2020-07-23 12:22:55 -04:00
root 1b6f85dec8 split tuple parameter to parameters 
add function trans tuple to maketuple
 2020-07-23 16:46:55 +08:00
mindspore-ci-bot 9fb6576d8c !3338 Op debug feature 
Merge pull request !3338 from zhoufeng/debug-op-overflow
 2020-07-23 14:11:38 +08:00
mindspore-ci-bot 24dd2fc2a6 !3333 Fix internal multiple outputs check 
Merge pull request !3333 from YuJianfeng/master
 2020-07-23 11:38:11 +08:00
zhoufeng 000a6c73a5 op debug 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2020-07-23 11:12:02 +08:00
mindspore-ci-bot a4f447af6c !3289 Move abstract function to core abstract folder. 
Merge pull request !3289 from ZhangQinghua/master
 2020-07-23 09:39:37 +08:00
yujianfeng 4d18e9ec35 Fix internal multiple outputs check 2020-07-23 08:56:42 +08:00
Cathy Wong 8921a6099c C++ API Support for Skip Dataset Op and UTs 2020-07-22 13:21:35 -04:00
mindspore-ci-bot 8f4bab4e75 !2410 Support insert memcpy between two hccl op if the part outputs of prior hccl op linking to next hccl op 
Merge pull request !2410 from huanghui/insert-memcpy-async-pass
 2020-07-22 16:40:10 +08:00
mindspore-ci-bot 174acbec13 !3265 Decouple ir from optimizer 
Merge pull request !3265 from hewei/decouple_ir_optimizer
 2020-07-22 16:08:39 +08:00
huanghui f1563d2d37 insert memcpy async if hccl op cascade 2020-07-22 10:43:38 +08:00
yangzhenzhang e6cef98e95 delete useless code for allreduce 2020-07-22 10:13:19 +08:00
mindspore-ci-bot 568e75fdd3 !3256 Zip C API 
Merge pull request !3256 from MahdiRahmaniHanzaki/zip-c-api
 2020-07-22 04:01:51 +08:00
Mahdi 91b4d90716 Added ZipOp 2020-07-21 10:24:38 -04:00
Zhang Qinghua 7b69565d91 Move abstract function to core abstract folder. 2020-07-21 21:25:32 +08:00
He Wei 60d168adec Decouple ir from optimizer 2020-07-21 14:48:26 +08:00
mindspore-ci-bot a2bf5a322e !3129 Decouple ir from frontend 
Merge pull request !3129 from hewei/decouple_ir_frontend
 2020-07-21 11:35:33 +08:00
mindspore-ci-bot bfc18704d5 !3254 [MD]Add more strict upper bounds to CenterCropOp and RandomCropWithBboxOp 
Merge pull request !3254 from nhussain/padding_upperbound
 2020-07-21 10:18:56 +08:00
He Wei 32379f3e7a Decouple ir from frontend 2020-07-21 08:57:07 +08:00
nhussain b064cbab5d fix upper bound 2020-07-20 15:26:49 -04:00
jiangzhiwen 2f506b7985 CSV dataset loader 2020-07-20 20:22:08 +08:00
xulei2020 18b519ae0f add sentence piece 2020-07-20 15:50:35 +08:00
mindspore-ci-bot 8e4c0a9d93 !3212 GetDatasize feature 
Merge pull request !3212 from anzhengqi/epochs-ready
 2020-07-20 14:18:27 +08:00
mindspore-ci-bot 485ac8384b !3162 split tuple output node to maketuple 
Merge pull request !3162 from lianliguang/split-tuple-node-to-make-tuple
 2020-07-20 14:10:12 +08:00
anzhengqi 008b91b2a1 inject epoch ctrl op in the execution tree and send eos at the end of epoch 2020-07-20 13:02:47 +08:00
mindspore-ci-bot db80643ee2 !3177 Update Arithmetic Simplify to use Pattern Matcher (2) 
Merge pull request !3177 from Giancarlo/pm_arithmetic_simplify
 2020-07-20 10:02:06 +08:00
WilliamLian d10d1a17f0 spilt valuenode & parameter's tuple output to maketuple 2020-07-20 09:48:03 +08:00
mindspore-ci-bot 6f8863b65d !3198 synchronize latest Ascend software suite 18 Jul 2020, and merging branches 
Merge pull request !3198 from yanghaoran/code_sync_0718
 2020-07-19 14:14:45 +08:00
yanghaoran 859acc6d2a synchronize latest Ascend software suite 18 Jul 2020, and merging branches 2020-07-18 21:09:55 +08:00
yujianfeng fa0684d12d Add pack and concat fission pass 2020-07-18 15:39:06 +08:00
mindspore-ci-bot 4a19e6b8cb !3114 add coo_tensor 
Merge pull request !3114 from riemann_penn/coo_tensor
 2020-07-18 10:24:58 +08:00
Giancarlo Colmenares cfbfaddfe1 Updated arithmetic simplify to use Pattern Matcher 2020-07-17 10:05:09 -04:00
panyifeng 5a10383cc3 add coo_tensor 2020-07-17 18:53:03 +08:00
yujianfeng 188d74f15e Remove transdata and cast for internal outputs 2020-07-17 16:55:47 +08:00
mindspore-ci-bot 56f70e910c !3080 [parser]remove redundant phi 
Merge pull request !3080 from vlne-v1/remove-redundant-phi
 2020-07-17 15:19:41 +08:00
mindspore-ci-bot 88c4943abd !2989 bucket reduce sparse gradient 
Merge pull request !2989 from kisnwang/two-step-reduce-sparse-gradient
 2020-07-17 11:50:58 +08:00
Wei Luning acbccea644 remove redundant phi 2020-07-17 11:46:09 +08:00
mindspore-ci-bot 1bcbbb08d6 !2973 [MD] Add implementation of SlidingWindow TensorOp, c++ & python 
Merge pull request !2973 from luoyang/update
 2020-07-17 11:06:35 +08:00
kswang 891b80b9f5 add bucket reduce sparse gradient 2020-07-17 09:11:55 +08:00
mindspore-ci-bot 7f8a753621 !3112 Remove build option -S 
Merge pull request !3112 from caifubi/data-dump-build
 2020-07-16 20:01:02 +08:00
changzherui f4cb445ea8 syn code for 0715 2020-07-16 17:18:21 +08:00
mindspore-ci-bot 6566b38371 !3033 decoupling primitive of compute function 
Merge pull request !3033 from lianliguang/primi-decoupling-v2
 2020-07-16 16:06:07 +08:00
caifubi cb8b5dbd76 Remove build option -S 2020-07-16 14:51:48 +08:00
mindspore-ci-bot 25ee322ba3 !2966 reuse communication op output's memory 
Merge pull request !2966 from laiyongqiang/hcom_memreuse
 2020-07-16 14:51:12 +08:00
WilliamLian 50e2fda52d refactor primitive ComputeFunction function 2020-07-16 14:36:04 +08:00
laiyongqiang 68c78ab6bb reuse communication op output's memory 2020-07-16 12:41:39 +08:00
mindspore-ci-bot a661545d49 !265 Synchronize Ascend software suite 07 Jul 2020 
Merge pull request !265 from yanghaoran/incubator
 2020-07-15 21:04:59 +08:00
YangLuo 4136892a3e add SlidingWindow Op 2020-07-15 19:55:33 +08:00
Zhang Qinghua 18efdc8fe2 Move abstract/base into core, and remove static_analysis including symbols in ir. 2020-07-15 14:04:38 +08:00
mindspore-ci-bot ba0143402c !3067 Cleanup dataset UT: Remove unneeded tf data files and tests 
Merge pull request !3067 from cathwong/ckw_dataset_ut_cleanup6
 2020-07-15 04:44:52 +08:00
Cathy Wong ae1ed327ba Cleanup dataset UT: Remove unneeded data files and tests 2020-07-14 12:24:54 -04:00
He Wei ee1510da41 Eliminate circular dependency between 'ir' and 'device/kernel' 2020-07-14 19:56:22 +08:00
jiangjinsheng 7f9bbfd338 add Conv1d ops 2020-07-14 18:59:45 +08:00
liubuyu 43c79eb853 mindspore path adjust 2020-07-14 18:07:28 +08:00
mindspore-ci-bot 530d46eb47 !3024 Decode + RandomCropAndResize fusion within MapOp 
Merge pull request !3024 from Alexey_Shevlyakov/random_crop_decode_resize_fusion
 2020-07-14 17:27:25 +08:00
mindspore-ci-bot f65586cefa !3035 Refactoring for base and abstract types. 
Merge pull request !3035 from ZhangQinghua/master
 2020-07-14 11:50:06 +08:00
BowenK af36bd7698 Revert PR 2923 2020-07-14 10:01:08 +08:00
Zhang Qinghua 87715ed127 Refactoring for base and abstract types: Moving Base into base folder; Splitting the abstract type and infer&specialize routines; 2020-07-14 09:38:00 +08:00
mindspore-ci-bot 69ce4bf2b2 !2970 Del mindspore/model_zoo 
Merge pull request !2970 from panbingao/master
 2020-07-14 08:57:31 +08:00
Alexey Shevlyakov b930162e79 Decode + RandomCropAndResize = RandomCropDecodeResize 2020-07-13 20:20:27 -04:00
Jesse Lee 7c1bc5192b Initial Drop of CacheOp Phase I 2020-07-13 10:18:53 -04:00
WilliamLian 9682d08d96 refactor primitive hook function 2020-07-13 17:27:39 +08:00
caifubi c577952c9a Async Data Dump 2020-07-13 09:42:37 +08:00
mindspore-ci-bot 65c6e54e2e !2773 Adding cpp_api 
Merge pull request !2773 from 章一智/cpp_api
 2020-07-11 18:58:42 +08:00
ZPaC 8273c2a39c Add ps optimizer info builder. 2020-07-11 16:07:09 +08:00
mindspore-ci-bot 2e45aa6c19 !3014 Add ps optimizer info 
Merge pull request !3014 from ZPaC/add-ps-optim-info
 2020-07-11 14:38:52 +08:00
mindspore-ci-bot 6284c42a76 !2941 MD tokenizer support output offsets 
Merge pull request !2941 from xiefangqi/md_add_offsets_feature
 2020-07-11 14:36:00 +08:00
ZPaC 272e397be7 Add ps optimizer info. 2020-07-11 11:31:58 +08:00
xiefangqi 47060631e5 add offsets feature to tokenizer 2020-07-11 11:20:02 +08:00
ervinzhang bd5a777f81 introducing new C++ API 2020-07-10 16:32:38 -04:00
panbingao 45dbc8bf04 Move model_zoo.resnet.py 2020-07-10 17:36:34 +08:00
heleiwang 7a046a1d70 support get_edge_feature 2020-07-10 17:05:23 +08:00
huanghui 3eaf663545 add tensor scatter update fission pass 2020-07-10 15:41:22 +08:00
mindspore-ci-bot c8d7ac13aa !2976 Add input infos to output for apply op to match the tbe registered info 
Merge pull request !2976 from YuJianfeng/input2output
 2020-07-10 11:56:16 +08:00
mindspore-ci-bot b5e8e2419e !2923 Update arithmetic simplify to use Pattern Matcher 
Merge pull request !2923 from Giancarlo/update_arith_simplify
 2020-07-10 09:36:19 +08:00
mindspore-ci-bot 5f468b65b6 !2798 Decouple ParamValue from python 
Merge pull request !2798 from hewei/decouple_param_value
 2020-07-10 09:33:17 +08:00
mindspore-ci-bot 2c3c204b14 !2982 supporting cpp unit tests for randomresizewithbbox and resizewithbbox 
Merge pull request !2982 from ava/CPP_test3
 2020-07-10 04:56:36 +08:00
mindspore-ci-bot 02e797d130 !2947 CPP UTs for 3 BBoxAugOps + Fix to image_util.cc 
Merge pull request !2947 from danishnxt/AugOps-testing
 2020-07-10 03:31:52 +08:00
avakh b2bfb0342b supporting cpp unit tests for random_resize_with_bbox_op and resize_with_bbox_op. 2020-07-09 14:36:32 -04:00
Danish Farid 506f8f134e fix, cpp ut's 
fix cmakefile

fixed log statments in cpp UT tests
 2020-07-09 11:32:13 -04:00
yujianfeng 24f6b9d77e Add input2output pass 2020-07-09 21:44:43 +08:00
mindspore-ci-bot b23fc4e492 !2938 Decouple the exception routines from Python. 
Merge pull request !2938 from ZhangQinghua/master
 2020-07-09 21:10:02 +08:00
He Wei f337c6bc14 Decouple ParamValue from python 2020-07-09 16:16:22 +08:00
ZPaC 4645a43e08 Add ps module in batches 2020-07-09 15:45:56 +08:00
wuyongkang 4b2b46679a Revert "Optimization for ApplyTransform function" 
This reverts commit 02dd305bb0.
 2020-07-09 11:27:30 +08:00
Zhang Qinghua bde889ffdf Decouple the exception routines from Python. 2020-07-09 11:19:16 +08:00
mindspore-ci-bot 5355deca04 !2946 Added empty tensor support 
Merge pull request !2946 from EricZ/emtpy-tensor
 2020-07-09 09:38:32 +08:00
mindspore-ci-bot 3cc9217f06 !2926 [Dataset C++ UT] Implement C++ UTs for RandomHorizontalFlipWithBBox and BoundingBoxAugment 
Merge pull request !2926 from islam_amin/object_ops_cc_ut_floats
 2020-07-09 05:56:46 +08:00
Eric 79445012bd Tensor ut works 
new test case

Name change for empty check
 2020-07-08 17:28:59 -04:00
Giancarlo Colmenares 7f759c2a4c Updated arithmetic simplify to use Pattern Matcher 2020-07-08 16:01:04 -04:00
mindspore-ci-bot 915ddd25dd !2892 gnn random walk pr 1977 comment follow up 
Merge pull request !2892 from tony_liu2/master
 2020-07-09 03:35:55 +08:00
islam_amin 284cc910d5 C++ UTs for RandomHorizontalFlipWithBBox and Bounding Box Augment 2020-07-08 14:36:27 -04:00
yanghaoran 9ce5c97204 synchronize Ascend software suite 07 Jul 2020 2020-07-08 21:49:09 +08:00
mindspore-ci-bot e26746ad18 !2816 Optimization for ApplyTransform function 
Merge pull request !2816 from Kang/optimization
 2020-07-08 09:10:36 +08:00
tony_liu2 14899a1410 fix gnn random walk pr 1977 comments 
add fix to random resize decode crop test case

fix pylint issues
 2020-07-07 17:32:08 -04:00
mindspore-ci-bot 9ba937b1af !2920 Updating 3 BBox AugOps for Float + Common Files for BBox Float Support - (VertFlip/RandomCrop/RandomResizeCrop) 
Merge pull request !2920 from danishnxt/AugOps-M1-Python
 2020-07-08 05:18:58 +08:00
mindspore-ci-bot 6d946b6a19 !2890 Fix for Alexey's testcase 
Merge pull request !2890 from JesseKLee/queue_perf
 2020-07-08 03:21:50 +08:00
Danish Farid 78c370f72a First Commit - New Infrastructure - Python UT tests + Common Aug Files 
fix accidental change overwrite

fix 2

updated inits from 0 to 0.0 for float

improvd python ut comments

updated macro
 2020-07-07 14:50:34 -04:00
wuyongkang 02dd305bb0 Optimization for ApplyTransform function 2020-07-07 21:15:59 +08:00
kswang a719a9fe3a add two level reduce sparse gradient 2020-07-07 15:40:45 +08:00
Jesse Lee e0ef91a676 Fix Queue::Reset 2020-07-06 11:36:14 -04:00
mindspore-ci-bot f42e36b629 !2845 Fix empty graph dump ir failed 
Merge pull request !2845 from zhoufeng/empty-graph-dump-ir
 2020-07-04 15:49:57 +08:00
zhoufeng 1f8b00dff2 Fix empty graph dump ir 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2020-07-04 14:26:52 +08:00
mindspore-ci-bot 34fadfad31 !2774 fix perf_data test 
Merge pull request !2774 from Alexey_Shevlyakov/fix_perf_data_test
 2020-07-04 03:20:26 +08:00
zhousiyi b29d260be3 reuse AddN primitive in opt as AddN will replicated by program_specialize 2020-07-03 03:18:25 +00:00
ale 383564c417 fix perf_data test 2020-07-02 13:24:45 -04:00
mindspore-ci-bot 709dfd7e81 !2738 [Dataset C++ UT] Implement C++ UT common class for object detection tests. 
Merge pull request !2738 from islam_amin/object_ops_ut_cc
 2020-07-03 01:23:50 +08:00
islam_amin 593ee1eb34 C++ UT common files for object detection tests 2020-06-30 17:54:35 -04:00
panyifeng d6635bbbe2 Add IndexedSlices 2020-06-30 17:38:24 +08:00
Eric 88bb65768e Clean up part 1 
Removed extra fields in schema

Fixed test cases

Fixing CI
 2020-06-29 15:57:53 -04:00
Alexey Shevlyakov 71cede8173 remove de_error.h 2020-06-29 14:01:50 -04:00
mindspore-ci-bot 9b4399480a !2321 Connector throughput performance metric 
Merge pull request !2321 from Alexey_Shevlyakov/connector_throughput_dev
 2020-06-29 23:54:42 +08:00
jonyguo 41d16a3c77 enhance: 1. fix api comment, 2. del dead code 2020-06-29 17:15:44 +08:00
mindspore-ci-bot 1a78794947 !2680 Add ut for cpu kernel implement of sparse optimizer 
Merge pull request !2680 from YuJianfeng/ut
 2020-06-29 11:36:00 +08:00
yujianfeng 91306cbd34 Add ut for cpu kernel of sparse optimizer 2020-06-28 21:12:08 +08:00
wuyongkang e606068585 cache bprop instead of fprop 2020-06-28 14:57:54 +08:00
mindspore-ci-bot 262e4fc041 !2585 Replace TransformFuncType with OptimizerCaller 
Merge pull request !2585 from Giancarlo/remove_transformfunc
 2020-06-28 10:12:18 +08:00
Ziyan 0925e35252 enable optimizer parallel with broadcast 2020-06-27 14:36:17 +08:00
Alexey Shevlyakov 698abf75fc Connector throughput + PerfData + CyclicArray 2020-06-26 14:45:01 -04:00
Jesse Lee 81bf4bde1d AutoIndexObj primary should start with 0 2020-06-26 12:22:44 -04:00
Jamie Nisbet c22eac743d subtree creation in python apis 
updates

fix

fix cpplint

fix
 2020-06-24 17:17:05 -04:00
Giancarlo Colmenares aabec55c79 Removing TransformFuncType 2020-06-24 13:48:57 -04:00
mindspore-ci-bot d9b1825552 !2374 C++ UT for CutOut and Pad 
Merge pull request !2374 from MahdiRahmaniHanzaki/I1L892-pad-cutout-ut
 2020-06-24 22:56:17 +08:00
mindspore-ci-bot 044b214636 !2490 assign hcom op to one stream 
Merge pull request !2490 from gukecai/new-stream-for-commit
 2020-06-24 17:44:34 +08:00
ms_yan e829535a86 change GetTensor into GetRow to avoid NullPtr 2020-06-24 15:07:32 +08:00
He Wei 43e0967024 Decouple ir::Tensor class from python 2020-06-24 10:28:59 +08:00
mindspore-ci-bot ea4800050b !2503 fix misspell and check parameters on graphdata 
Merge pull request !2503 from heleiwang/fix_misspell
 2020-06-24 09:15:33 +08:00
gukecai c703c4d7c8 hcom one stream 2020-06-24 08:59:36 +08:00
heleiwang 0d52888fc5 fix misspell and check parameters 2020-06-23 22:01:36 +08:00
Mahdi bca037e1be added cpp test cases for pad and cut out 2020-06-23 09:55:01 -04:00
zhousiyi b2ec296f99 add opt pass for tuple_getitem with constant input 2020-06-23 07:41:21 +00:00
Shida He 4c056855e0 Implementation for mindspore debugger 2020-06-22 17:15:30 -04:00
gong chen a6dfa281ea Init GraphKernel. 
- It provides a unified style to express graph and kernel for user.
- It provides a unified IR to represent graph and kernel for developer.
- It breaks the boundary between graph and kernel.
- It provides more opportunities to do compile optimization.
 2020-06-20 22:31:54 +08:00
mindspore-ci-bot a3e7b30457 !2384 Add split fission pass 
Merge pull request !2384 from YuJianfeng/split
 2020-06-20 18:11:02 +08:00
mindspore-ci-bot 616cc80d78 !2378 fix tensor id bug and some yolov3 bug 
Merge pull request !2378 from flywind/fix_yolov3_bug
 2020-06-20 17:46:47 +08:00
mindspore-ci-bot 53654f94f2 !2056 Enable new control sink 
Merge pull request !2056 from zhoufeng/enable-new-control-sink
 2020-06-20 17:41:30 +08:00
kpy b79523a994 fix yolov3 multi getitem bug and tensor ptr not unique bug 2020-06-20 17:35:15 +08:00
mindspore-ci-bot 8a913d7586 !2157 mindspore server inference 
Merge pull request !2157 from hangq/master
 2020-06-20 16:22:15 +08:00
zhoufeng bbbfaa2441 enable new control sink 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2020-06-20 14:48:21 +08:00
yujianfeng 7ad877a948 Add Split fission pass 2020-06-20 14:28:25 +08:00
hangangqiang dfbb232468 mindspore server inference 2020-06-20 14:12:56 +08:00
ms_yan cf82aa9035 init remove storage op in c++ 
init remove storage op test case c++

remove source c++ files
 2020-06-20 13:52:07 +08:00
mindspore-ci-bot 182215e060 !2284 Add Pass to Eliminate Redundant Depend 
Merge pull request !2284 from BowenK/fix_depend
 2020-06-19 16:39:55 +08:00
mindspore-ci-bot b6ff27245f !1990 fix profiling stream id 
Merge pull request !1990 from caifubi/fix-profiling-stream-id
 2020-06-19 16:36:34 +08:00
BowenK 8f29e7242f add pass to eliminate depend value 2020-06-19 14:52:52 +08:00
caifubi a49c6f0b13 Fix profiling stream id bug 2020-06-19 14:34:20 +08:00
huanghui c7bda5363d fix ConfusionSoftmaxGrad fusion pass work if the ReduceSum's attr of keep_dims set False 2020-06-19 10:37:15 +08:00
hesham 11826fb256 DuplicateOp 2020-06-18 19:47:27 -04:00
nhussain 5515016dba remove graphengine changes 
remove graphengine changes

concat op

Truncate Pair

concat_op

remove graph engine changes
 2020-06-18 17:17:50 -04:00
mindspore-ci-bot ffc8a3c362 !2274 add PadEndOp 
Merge pull request !2274 from xunxue/padend
 2020-06-19 05:05:14 +08:00
mindspore-ci-bot e4322baece !2316 [Dataset] Move python tree transformation into cpp pass 
Merge pull request !2316 from JunhanHu/alter_node_cpp
 2020-06-19 05:02:03 +08:00
xunxue 87aa9c8f7a PadEndOp 2020-06-18 16:07:34 -04:00
Junhan Hu 57f3732ac3 Move python tree transformation into cpp pass. 2020-06-18 15:52:38 -04:00
mindspore-ci-bot 5850b99161 !2211 Add TruncatePair Op to dataset 
Merge pull request !2211 from h.farahat/pair_truncate
 2020-06-18 20:58:40 +08:00
hesham b9495a9ccc Truncate Pair 2020-06-17 23:11:27 -04:00
mindspore-ci-bot 9ba6f61d01 !2148 fix hook and bprop debug issue in pynative 
Merge pull request !2148 from wangqiuliang/fix-hook-bprop-issue
 2020-06-18 10:44:45 +08:00
mindspore-ci-bot 294449697a !2179 Add sort by index for each group of AllReduce 
Merge pull request !2179 from YuJianfeng/all_reduce_index
 2020-06-18 10:35:48 +08:00
kingfo 358982a98f fix hook and bprop debug issue 2020-06-18 09:50:30 +08:00
yujianfeng f15cb6b7c9 Add sort by index for each group of AllReduce 2020-06-18 09:18:01 +08:00
mindspore-ci-bot a4048e192c !2256 Rename Sampler::Reset() to Sampler::ResetSampler() 
Merge pull request !2256 from JesseKLee/sampler
 2020-06-18 03:33:53 +08:00
mindspore-ci-bot ea829e89c3 !2198 Add MaskOp to dataset 
Merge pull request !2198 from h.farahat/mask_op
 2020-06-18 02:50:16 +08:00
Jesse Lee dcfdff6021 Rename Sampler Reset 2020-06-17 14:43:45 -04:00
mindspore-ci-bot 2865436fee !2092 Tokenizers 
Merge pull request !2092 from qianlong21st/june_third
 2020-06-17 21:40:32 +08:00
mindspore-ci-bot 4b5cbe5d4a !2186 Optimization for opt 
Merge pull request !2186 from Kang/opt
 2020-06-17 17:29:38 +08:00
mindspore-ci-bot 65f2212fd3 !2215 Support hccl profiling 
Merge pull request !2215 from caifubi/support-hccl-profiling
 2020-06-17 17:01:10 +08:00
Kang 2974b906d3 Optimization for opt 2020-06-17 16:04:54 +08:00
qianlong 4f16f036be Add WhitespaceTokenizer and UnicodeScriptTokenizer for nlp 
add CaseFold, NormalizeUTF8

add RegexReplace

add RegexTokenizer

add BasicTokenizer

add WordpieceTokenizer

add BertTokenizer
 2020-06-17 15:47:04 +08:00
caifubi 5db0d8129c Support hccl profiling 2020-06-17 15:14:30 +08:00
hesham f2462bb00d Mask Op 2020-06-16 23:51:46 -04:00
mindspore-ci-bot 625f2421b5 !1977 random walk in gnn node2vec 
Merge pull request !1977 from JonathanY/randomwalk
 2020-06-17 03:22:21 +08:00
mindspore-ci-bot a1f194c971 !2188 Remove B+ tree deadcode and add an additional output to Search function 
Merge pull request !2188 from JesseKLee/deadcode
 2020-06-17 01:53:01 +08:00
Jesse Lee 287ca71260 Remove dead code 2020-06-16 11:46:30 -04:00
hesham e2012a1de9 Slice Op 2020-06-16 02:32:40 -04:00
mindspore-ci-bot cb706951c1 !2126 Refactoring the func graph manager module. 
Merge pull request !2126 from ZhangQinghua/master
 2020-06-16 09:17:15 +08:00
mindspore-ci-bot dceb3c2be4 !2026 Change C++ behavior in RandomCropAndResize 
Merge pull request !2026 from MahdiRahmaniHanzaki/I1K3FL-random-resized-crop
 2020-06-16 05:27:36 +08:00
Mahdi add29f95f5 resolved issues in the comments 2020-06-15 16:45:18 -04:00
mindspore-ci-bot 2cab44a637 !2028 FillOp for BERT 
Merge pull request !2028 from nhussain/fillOp_learning
 2020-06-16 02:45:45 +08:00
nhussain dd9bf09f0a added FillOp for #119 - special Ops 2020-06-15 11:30:43 -04:00
Jonathan Yan 87d2c27c7f random walk v1 2020-06-15 08:54:10 -04:00
mindspore-ci-bot 971f10d222 !1790 remove transdata only connected with control depend 
Merge pull request !1790 from lianliguang/remove-the-useless-transdata-connected-with-the-control-depend
 2020-06-15 16:59:33 +08:00
mindspore-ci-bot 928c25ebea !2047 [Code review] check code files in pre_activate/ascend/buffer_fusion 
Merge pull request !2047 from huanghui/code-review
 2020-06-15 16:23:24 +08:00
Zhang Qinghua 923d3fee04 Refactoring the fg manager module. 2020-06-15 15:47:39 +08:00
WilliamLian b86016a26f remove the useless transdata and cast of control depend node 2020-06-15 14:54:47 +08:00
mindspore-ci-bot a8cf83acf2 !1932 Add CLUE dataset 
Merge pull request !1932 from jiangzhiwen/dataset/clue
 2020-06-15 11:48:35 +08:00
jiangzhiwen e0e167a000 add CLUE dataset 2020-06-15 10:40:46 +08:00
huanghui 4acb61d59d code review fix for buffer fusion 2020-06-15 09:35:16 +08:00
mindspore-ci-bot c661087b99 !2029 Create TensorRow class that supports a row id 
Merge pull request !2029 from lixiachen/lixia/tensorrow
 2020-06-13 09:43:58 +08:00
Lixia Chen 6ae88c3987 Create TensorRow class that supports a row id. 2020-06-12 15:06:56 -04:00
mindspore-ci-bot 3b809f2b0b !1996 Fix single BatchNorm fission && SoftmaxGradExt fusion pass 
Merge pull request !1996 from huanghui/single-batchnorm-fission-pass
 2020-06-12 15:38:05 +08:00
huanghui 88eec2b894 fix single-batchnorm-fission && softmax-grad-ext-fusion pass 2020-06-12 14:53:22 +08:00
leopz c45f4d225d dump binary ir 2020-06-12 13:19:41 +08:00
hesham 0c5e47111b - Move MutableBuffer to be protected 
- Add new CreateTensors
 2020-06-11 17:32:03 -04:00
mindspore-ci-bot beefb20c01 !1983 Remove inheritance of Sampler from DatasetOp 
Merge pull request !1983 from JesseKLee/sampler
 2020-06-11 23:14:56 +08:00
huangdongrun 9522f59b87 support for tensor indexing in pynative 
support tensor slice using constexpr

remove tensorslice metagraph

add pynative testcases
 2020-06-11 19:14:22 +08:00
mindspore-ci-bot b3da41bd7a !1913 CocoDataset implementation 
Merge pull request !1913 from xiefangqi/xfq_support_coco
 2020-06-11 14:37:44 +08:00
xiefangqi 097cbcc0cb CocoDataset implementation 2020-06-11 11:52:17 +08:00
mindspore-ci-bot 81ba3b1b99 !1868 Enhance insert memcpy for hccl op 
Merge pull request !1868 from huanghui/insert-memcpy-async-pass
 2020-06-11 09:55:32 +08:00
mindspore-ci-bot 7b7932ced9 !1944 move hook function to PrimitivePy class 
Merge pull request !1944 from wangqiuliang/move-hook-function-to-primitivepy
 2020-06-11 09:29:00 +08:00
Jesse Lee 255adf7c6e Remove inheritance of Sampler from DatasetOp 2020-06-10 18:10:51 -04:00
mindspore-ci-bot 9e1dea1ff9 !1928 delete redundant reshape op 
Merge pull request !1928 from yoonlee666/deletereshape
 2020-06-10 20:11:22 +08:00
yoonlee666 881af56ec3 optimize redundant reshape op 2020-06-10 18:21:00 +08:00
huanghui 118496b3ec enhance insert memcpy 2020-06-10 18:00:08 +08:00
heleiwang 3ece8dd090 1. support get_all_edges, get_nodes_from_edge, get_sampled_neighbors, get_neg_sampled_neighbors and graph_info API 
2. mod cora and citeseer conversion script
 2020-06-10 15:52:26 +08:00
kingfo 38436f929f move hook function to primtivePy class 2020-06-10 15:33:46 +08:00
mindspore-ci-bot 38109a386b !1957 fix cmakelists 
Merge pull request !1957 from jiangjinsheng/issue_merge
 2020-06-10 11:45:23 +08:00
jiangjinsheng 709704d339 fixed CMakeLists.txt 2020-06-10 10:58:26 +08:00
mindspore-ci-bot bfc18f3adc !1873 synchronize latest ascend software 04 Jun 2020 
Merge pull request !1873 from yanghaoran/master
 2020-06-10 01:27:43 +08:00
mindspore-ci-bot 5eb95599f6 !1874 Updates to string tensor 
Merge pull request !1874 from h.farahat/string_tensor_updates
 2020-06-10 00:59:17 +08:00
yanghaoran 8da4c1a763 synchronize latest ascend software 04 Jun 2020 2020-06-09 23:34:13 +08:00
hesham f837ddc956 - Bug when empty strings sent to Python 
- Support accepting Numpy of str as input
- Support batching strings
- Core logic of batch&pad is static
- Make Pad a utility function
 2020-06-09 10:34:38 -04:00
zhaoting b16a552d41 Revert "Revert "add pattern AdjustAllReduceMulAdduse the old opadd test case for bugtemp fix try"" 
This reverts commit 705c71a257.
 2020-06-09 20:56:36 +08:00
mindspore-ci-bot beb714d2d0 !1911 add a function to charge the node input and output is a scalar 
Merge pull request !1911 from lianliguang/add-a-function-to-charge-the-node-input-or-output-if-is-a-scalar
 2020-06-09 19:57:01 +08:00
yujianfeng 2ff9e74d07 Add unique process for duplicated indices 2020-06-09 10:12:39 +08:00
WilliamLian 9808e47663 change checkAicpu to CheckAICPU & add charge Scalar function to charge the input or output is scalar 2020-06-09 09:31:43 +08:00
huanghui b4c0ed4b36 add signle batchnorm fission pass 2020-06-08 10:08:23 +08:00
chujinjin 7465abc798 optimize transdata for pynative 2020-06-05 14:10:55 +08:00
mindspore-ci-bot 1973594bd1 !1774 [MD] minddataset support padding samples 
Merge pull request !1774 from liyong126/mindrecord_padded_sample
 2020-06-05 11:27:25 +08:00
mindspore-ci-bot b236beae28 !1615 convert constant bool tensor to bool 
Merge pull request !1615 from amongo/GetBoolValueFromConstantTensor
 2020-06-05 09:46:44 +08:00
liyong feff8899ac support padding samples 2020-06-05 09:14:42 +08:00
mindspore-ci-bot c51d90d84e !1767 Move LayerNormGrad split pass ahead of kernel select 
Merge pull request !1767 from huanghui/LayerNormGrad-split-pass
 2020-06-05 09:13:24 +08:00
mindspore-ci-bot 769ae609b4 !1808 consistent design for num_samples 
Merge pull request !1808 from Jamie/numsamples
 2020-06-04 22:12:55 +08:00
huangdongrun beacc26077 * add isconstant primitive 
* add infer_value for common math ops
* convert constant bool tensor to bool value

* do not infer value when encounter 0 as division

for while condition, do not unrool if condition is a tensor
 2020-06-04 21:51:44 +08:00
yujianfeng e87ac6525e Add batch norm fusion pattern for mix precision 2020-06-04 20:31:15 +08:00
huanghui cf87218fb7 place layernormgrad split pass before kernel select 2020-06-04 19:39:40 +08:00
Jamie Nisbet 51bc0c0460 consistent design for num_samples 
updates

more update

more work

more fixin

post rebase updates

clang formatting

code review recovery

ci fixes

updates

update

update

update
 2020-06-03 15:01:18 -04:00
mindspore-ci-bot 0426ed057b !1777 Remove ZerosLikeTensor and sub with ZerosTensor 
Merge pull request !1777 from BowenK/master
 2020-06-02 10:41:58 +08:00
BowenK 96379faa3a Remove ZerosLikeTensor and sub with ZerosLike 2020-06-02 09:52:12 +08:00
huanghui d1cec14a0c add 2 pattern for softmaxgradext fusion pass 2020-06-01 18:48:41 +08:00
kswang c63729b8e6 support mix target 2020-06-01 14:33:56 +08:00
mindspore-ci-bot cc9c004bc1 !1696 Enable ConfusionMulGrad fusion pass 
Merge pull request !1696 from huanghui/TMP
 2020-05-30 14:44:29 +08:00
mindspore-ci-bot 692f38ded2 !1532 clean pylint warning in test dir 
Merge pull request !1532 from jinyaohui/pylint1
 2020-05-30 10:13:45 +08:00
mindspore-ci-bot 59683a1d90 !1692 Fix topk bug for fasterrcnn 
Merge pull request !1692 from meixiaowei/master
 2020-05-30 09:56:40 +08:00
huanghui 71acaa5300 enable ConfusionMulGrad fusion pass in bert only 2020-05-30 09:46:21 +08:00
mindspore-ci-bot 387bcece9e !1666 Add 5 patterns for AdamApplyOneWithDecay fusion pass 
Merge pull request !1666 from huanghui/AdamApplyOneWithDecay-fusion-pass
 2020-05-30 09:43:07 +08:00
jinyaohui 86d197dfeb clean pylint 2020-05-29 23:00:00 +08:00
huanghui ff05aa1faa add newly 5 patterns for AdamApplyOneWithDecayRule fusion pass 2020-05-29 19:49:44 +08:00
yujianfeng e6f1cfa581 Check the input size of BatchNorm before fission in bert 2020-05-29 19:34:58 +08:00
meixiaowei 1778ec0135 fix topk bug 2020-05-29 19:04:18 +08:00
huanghui 99ca6b3e80 add SoftmaxGradExt fusion pass 2020-05-29 14:30:52 +08:00
mindspore-ci-bot 8556eee3fc !1578 recitify pretrained path and revert AdjustAllReduceMulAdduse 
Merge pull request !1578 from gengdongjie/master
 2020-05-28 20:25:50 +08:00
mindspore-ci-bot 9c858444b0 !1568 Fix pylint warning for test cases of optimizer, infer, parse and pynative. 
Merge pull request !1568 from seatea/fix-pylint-warning
 2020-05-28 16:59:57 +08:00
mindspore-ci-bot 04398cf88e !1433 add tensor_minnie and separate py from ir 
Merge pull request !1433 from leopz/tensor_base
 2020-05-28 16:00:56 +08:00
gengdongjie 705c71a257 Revert "add pattern AdjustAllReduceMulAdduse the old opadd test case for bugtemp fix try" 
This reverts commit 3db8cfa54f.
 2020-05-28 15:21:15 +08:00
leopz 4508134ceb add tensor_minnie and separate py from ir 2020-05-28 14:26:26 +08:00
mindspore-ci-bot c086d91aaf !1505 Add some checks in ConstToAttr[StridedSliceGrad] pass 
Merge pull request !1505 from huanghui/stride-slice
 2020-05-28 11:46:18 +08:00
seatea 7398526abc Fix pylint warning for test cases of optimizer, infer, parse and 
pynative.
 2020-05-28 11:35:33 +08:00
yujianfeng ee087bdf60 Check the size of topk input names before converting input to attr 2020-05-28 10:29:21 +08:00
Jesse Lee 3b80c10b1e Fix some timing hole in these two testcases 2020-05-27 14:22:37 -04:00
mindspore-ci-bot e311473401 !1453 Raise mse threshold in RandomCropDecodeResizeOp 
Merge pull request !1453 from Alexey_Shevlyakov/fix_random_crop_decode_resize_ut
 2020-05-27 23:58:58 +08:00
huanghui 1d65ae598a extract const_to_attr_strided_slice_grad pass 2020-05-27 17:30:17 +08:00
mindspore-ci-bot 5b9c145ff8 !1383 keep different attributes for cnode evaluation 
Merge pull request !1383 from amongo/KeepPrimAttrInCNode
 2020-05-27 13:02:34 +08:00
mindspore-ci-bot 5e2f440eed !1271 refactor of memreuse allocator to adapt the control stream 
Merge pull request !1271 from yangjie159/refactor_memreuse_allocator
 2020-05-27 10:24:16 +08:00
mindspore-ci-bot 650a45b233 !1490 Fix pylint warning 
Merge pull request !1490 from seatea/fix-pylint-warning
 2020-05-27 09:41:31 +08:00
seatea c6d8a4dc98 Fix pylint warning. 2020-05-26 21:23:06 +08:00
yujianfeng 94818cf255 Fix fusion condition of transpose and reshape 2020-05-26 17:30:38 +08:00
yangjie159 cbf5390b34 refactor memreuse allocator 
remove stream id from membuf
add kernel dependence to determine whether is usable
 2020-05-26 17:27:33 +08:00
huangdongrun 1159f2b11e add prim infer attr cache 
modify infer to get abstract value and attr value map together

support get attr in specialize

clone primitive when specialize if attribute is not the same with
infered attribute
 2020-05-26 16:19:58 +08:00
mindspore-ci-bot 2215e3267f !1419 remove old buffer fusion pass 
Merge pull request !1419 from Etone.Chan/Resnet50
 2020-05-26 09:16:06 +08:00
Jesse Lee a8fa847556 Allow join_all to be blocking 2020-05-25 15:24:36 -04:00
Alexey Shevlyakov 7a807cbff9 fix ut 2020-05-25 14:56:58 -04:00
etone-chan 42d724d8b4 remove old buffer fusion pass 2020-05-25 21:25:45 +08:00
mindspore-ci-bot e8980ed298 !1406 Simplify CondVar class 
Merge pull request !1406 from JesseKLee/CondVar
 2020-05-25 21:04:05 +08:00
huanghui a42dd21430 add 3 pattern for lamb_next_mv_rule fusion pass 2020-05-25 14:18:22 +08:00
mindspore-ci-bot 848d19207f !1359 Optimize the IR modules. 
Merge pull request !1359 from ZhangQinghua/master
 2020-05-25 14:14:44 +08:00
Zhang Qinghua dbb86cb1be Adjust some routines of FG and FGM, about the nodes info. IF. 2020-05-25 10:06:27 +08:00
Zhang Qinghua f31564ce98 Remove the useless collectors in manager. 2020-05-25 09:56:28 +08:00
Jesse Lee 641112a40c Initial Drop 2020-05-24 16:57:40 -04:00
mindspore-ci-bot daccfef738 !1361 Refactor multiple output pass 
Merge pull request !1361 from huanghui/LambNextMVRule-fusion-pass
 2020-05-23 17:21:27 +08:00
lizhenyu c5ac2cc38c add memory copy module 2020-05-23 13:04:50 +08:00
huanghui f16ff539ba refactor multiple patterns pass 2020-05-23 09:40:21 +08:00
mindspore-ci-bot 964a757db2 !1378 Just want to debug this case in Jenkin environment 
Merge pull request !1378 from JesseKLee/cond_var_debug
 2020-05-23 05:26:12 +08:00
Jesse Lee 06ae724261 Again 2020-05-22 16:38:03 -04:00
mindspore-ci-bot 458436186c !1365 Clean up work for text python sub-package 
Merge pull request !1365 from h.farahat/text_namespace
 2020-05-22 23:16:31 +08:00
mindspore-ci-bot 6f733ec113 !1308 Stage 2 of adding support for string Tensor 
Merge pull request !1308 from h.farahat/string_tensor2
 2020-05-22 21:17:53 +08:00
mindspore-ci-bot f967700ef4 !1215 [Auto parallel] Changing succive edges orders and add some strategy checkings 
Merge pull request !1215 from Xiaoda/change-succive-edges-order-and-add-checking
 2020-05-22 18:56:35 +08:00
mindspore-ci-bot 3363d4e834 !1249 Add GNN dataset processing API 
Merge pull request !1249 from heleiwang/hlw_gnn_data
 2020-05-22 18:49:36 +08:00
hesham 6c21e556c4 Clean up work for text python package 2020-05-22 04:35:58 -04:00
mindspore-ci-bot 4bdfddedb2 !1358 Link child graphs 
Merge pull request !1358 from zhoufeng/link-child-graph-2
 2020-05-22 16:10:52 +08:00
zhoufeng af5019b94f link child graphs 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2020-05-22 15:37:19 +08:00
heleiwang 599a449e0b Support processing GNN data 2020-05-22 14:15:25 +08:00
jinyaohui fbdba6e4da clean pylint 2020-05-22 13:23:13 +08:00
hesham df361d1d26 Change mem layout of string tensor 
add support for MindRecord and TFRecord
----
optimize tensorshape

optimize tensorshape and FlatIndex

TFRecord and MindRecord support for string tensor

Modify mem layout
Add new constructor
Add method Allocate

Change some GetMutableBuffer usages to AllocateBuffer
 2020-05-22 01:22:29 -04:00
Xiaoda Zhang 9f4b8a3cd1 changing the succive edges order in GetAliveSuccEdges() so that Triangle and Star Elimination can be merged into particular node; adding some check information 2020-05-22 10:57:02 +08:00
mindspore-ci-bot d9c74e0acd !1328 Add 3 patterns support for LambNextMVWithDecay fusion pass 
Merge pull request !1328 from huanghui/LambNextMvWithDecayRuleConds-fusion-pass
 2020-05-22 10:35:17 +08:00
mindspore-ci-bot 2e3d55ed87 !1281 Implementation of SplitOp 
Merge pull request !1281 from Peilin/splitOp
 2020-05-22 09:29:03 +08:00
Peilin Wang 71e8bb1960 general split case done, chaining sampler (basic case) is working 
implementation 99% complete

everything and tested except for repeatable shuffling

tested most basic/typical split usecases

cleanup

some more cleanup

fix CI

more ci fix

more ci fixes

more ci fix

more ci fix

more ci fix

added more tests, fixed some bugs

some more clean up and test cases

added shard/shuffle before split warning/error

addressed code review comments and ci

fixed ci
 2020-05-21 20:42:51 -04:00
mindspore-ci-bot 07b14f32b9 !1296 move signature to primitivepy and bprop_func to utils 
Merge pull request !1296 from leopz/fix_primitive
 2020-05-21 20:44:59 +08:00
huanghui eaff850f11 add 3 patterns for lamb_next_mv_with_decay_rule pass 2020-05-21 17:00:15 +08:00
mindspore-ci-bot e4795974be !1266 Refactor LambNextMVWithDecayRule fusion pass 
Merge pull request !1266 from huanghui/LambNextMvWithDecayRuleConds-fusion-pass
 2020-05-21 11:43:49 +08:00
huanghui 5a68eba585 Refactor LambNextMVWithDecayRule fusion pass 2020-05-21 10:08:50 +08:00
qianlong 451c20a6f5 Add UnicodeCharTokenizer for nlp 2020-05-21 09:22:45 +08:00
leopz 04763b8b76 move signature to primitivepy and bprop_func to utils 2020-05-20 18:06:36 +08:00
xulei2020 163b6b7ea7 add jieba c++ code 2020-05-20 15:55:12 +08:00
mindspore-ci-bot 97ba539e7b !1269 fix issue of loadding control input tensors failed in control sink mode 
Merge pull request !1269 from wenchunjiang/fix_task_sink_bug
 2020-05-20 11:33:12 +08:00
wenchunjiang 729ea8cc55 fix bug of loadding ctrl input tensors failed in control sink mode 2020-05-20 10:45:28 +08:00
mindspore-ci-bot 04ac611fe8 !1189 Decoupling py default param from Parameter 
Merge pull request !1189 from leopz/master
 2020-05-20 10:02:01 +08:00
leopz 40e15996b0 move default_param out of parameter and remove pybind11 in anf define 2020-05-19 19:11:12 +08:00
Wei Luning 3db8cfa54f add pattern AdjustAllReduceMulAdduse the old opadd test case for bugtemp fix try 2020-05-19 18:46:11 +08:00
mindspore-ci-bot c793540cc9 !1231 Assign label resource for new control sink 
Merge pull request !1231 from zhoufeng/label-assign
 2020-05-19 10:48:35 +08:00
zhoufeng c99f904276 assign label resource for new control sink 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2020-05-18 21:44:52 +08:00
mindspore-ci-bot 828d0b124e !1209 add format trans function 
Merge pull request !1209 from liubuyu/master
 2020-05-18 20:59:43 +08:00
mindspore-ci-bot 1b7cdc4c61 !1218 clean pylint warning in test about import 
Merge pull request !1218 from jinyaohui/pylint1
 2020-05-18 19:54:04 +08:00
liubuyu f70429d671 add format transfer 2020-05-18 19:45:04 +08:00
yujianfeng c8d33568f2 Add an new output to FusedMulApplyMomentum 2020-05-18 17:03:21 +08:00
jinyaohui 5a914994ba clean pylint 2020-05-18 16:42:35 +08:00
huanghui c4af71e236 add LarsV2 fission pass 2020-05-18 11:30:45 +08:00
jinyaohui bcfaff97f9 clean pylint 2020-05-18 10:31:46 +08:00
hesham e8ca243364 -Add DE_STRING 
-replace switch'case by indexing

- Add test case
- Add constructors
- Add getItem string

- Fix bugs
- Add more tests

- Tensor iterator
- asNumpy
- TextFileDataset

- Tensor(Numpy)

- Super > 2D
- Add more test cases for GeneratorDataset

- Change StartAddr to GetBuffer and GetMutableNuffer

- Raise an error if batch is used with strings

Clean-up work
 2020-05-15 20:33:28 -04:00
mindspore-ci-bot ca64bfdbab !1120 Code refactoring ：modify Infer to Eval 
Merge pull request !1120 from Kang/master
 2020-05-15 17:44:29 +08:00
mindspore-ci-bot 889d7b6eea !1180 [pre_activate]Fix pylint warning 
Merge pull request !1180 from YuJianfeng/master
 2020-05-15 17:25:34 +08:00
mindspore-ci-bot efb9672849 !1118 Add BatchNormGrad2BNInferGrad pass 
Merge pull request !1118 from huanghui/batchnormgrad-to-bninfergrad-pass
 2020-05-15 17:15:38 +08:00
mindspore-ci-bot c680cfbf27 !1157 dataset: add concat operation for dataset 
Merge pull request !1157 from ms_yan/concat_dataset
 2020-05-15 16:07:19 +08:00
mindspore-ci-bot ab031ee9ea !1126 VOCDataset support object detection function 
Merge pull request !1126 from xiefangqi/voc_support_detection
 2020-05-15 15:56:39 +08:00
yujianfeng 0f42fdbb80 Fix pylint warning 2020-05-15 15:29:22 +08:00
huanghui 709828a98b add BatchNormGrad2BNInferGrad pass 2020-05-15 14:37:50 +08:00
mindspore-ci-bot 42ba885e58 !1098 Add BatchNorm2BNInfer pass 
Merge pull request !1098 from huanghui/add-batchnorm-bninfer-pass
 2020-05-15 14:33:09 +08:00
xiefangqi c937bad53f minddata support voc 2020-05-15 13:24:03 +08:00
ms_yan c0fa7b4b19 init commit of concat dataset 
change to use __add__ operation instead ds.concat
 2020-05-15 13:14:13 +08:00
Kang be60bd3d79 Code refactoring for the static_analysis : modified Infer to Eval. 2020-05-15 09:56:41 +08:00
huanghui 6db71e6576 add batchnorm2bninfer pass 2020-05-15 09:56:38 +08:00
yujianfeng 2b061c84c7 Add batch_norm_grad infer fisson 2020-05-15 09:44:40 +08:00
mindspore-ci-bot 597933b04b !1113 rename kernel/mng to kernel/rts 
Merge pull request !1113 from dengwentao/rts
 2020-05-15 09:39:18 +08:00
yujianfeng 6e89ebe6f0 Add BatchNorm fusion pattern with mix precision 2020-05-14 21:28:08 +08:00
mindspore-ci-bot 4bb46606db !1149 fix pylint in tests 
Merge pull request !1149 from panyifeng/fix_pylint
 2020-05-14 15:15:52 +08:00
panyifeng 755ba75deb fix pylint 2020-05-14 14:22:52 +08:00
etone-chan c4a5bfb787 add matmul eltwise buffer fusion pass 2020-05-14 10:36:23 +08:00
mindspore-ci-bot 9e116e15fb !1139 Change Thread::Join to async call with time out 
Merge pull request !1139 from JesseKLee/timing_hole
 2020-05-14 09:07:06 +08:00
mindspore-ci-bot 1a052f7155 !1131 [Data]fix cmake build format 
Merge pull request !1131 from xulei/filter_op
 2020-05-14 08:24:35 +08:00
Jesse Lee f2be49d85e Fix a racing condition 2020-05-13 14:59:25 -04:00
xulei2020 903b64daa2 fix cmake build format 2020-05-13 17:00:35 +08:00
mindspore-ci-bot 8b98f921cc !1124 Add broadcast fusion pass 
Merge pull request !1124 from YuJianfeng/master
 2020-05-13 16:29:33 +08:00
dengwentao fa83fc3e02 rename kernel/mng to kernel/rts 2020-05-13 16:26:17 +08:00
mindspore-ci-bot 1a98c6b459 !999 [MD] mindrecord support reading file list 
Merge pull request !999 from liyong126/mindrecord_file_list
 2020-05-13 15:53:26 +08:00
yujianfeng 31d8db9fc6 Add broadcast fusion pass 2020-05-13 15:30:38 +08:00
mindspore-ci-bot 86d4797399 !1079 Convert AiCpu kernel when aicore not supported 
Merge pull request !1079 from lianliguang/convert-to-AICPU-when-AiCore-not-supported-kernel
 2020-05-13 15:15:00 +08:00
liyong aa3f89e74f mindrecord support read file list 2020-05-13 14:11:59 +08:00
WilliamLian 691b0648e3 convert unsupported kernel in aicore to aicpu 2020-05-13 11:52:26 +08:00
yujianfeng 85ff90c237 Add input shape condition for transpose_reshape fusion pass 2020-05-12 22:54:21 +08:00
Jesse Lee 3c643e7298 Move from dataset_dev branch to here 2020-05-11 15:11:53 -04:00
fary86 3f323e48e2 Add submodule id for log interface 2020-05-11 19:17:45 +08:00
yao_yf f0bf438a55 reshape strategy search 2020-05-09 17:00:37 +08:00
mindspore-ci-bot 9433ca6468 !998 format the func name 
Merge pull request !998 from guozhijian/enhance_format_func_name
 2020-05-08 20:18:35 +08:00
jonyguo cf352d190f format func name for mindrecord 2020-05-08 18:33:13 +08:00
huanghui 12eaaf710b mul_add_fusion pass supports when add's 2nd is mul 2020-05-08 14:28:39 +08:00
Zirui Wu c2d364a573 batch with padding implemented 
support for 1 specific dimension to be None, added validator

fix various CI complains

another round of CI fixes

ci

refactor parts of the code

code refactor

ci fix

comments added, fix bugs

address review comments

address review comments

review cmts

added simple perf test script

update pad code

perf imprv
 2020-05-07 11:18:42 -04:00
Xiaoda Zhang def8573275 implementing-searching-strategy-for-inference 2020-05-07 14:53:50 +08:00
YuJianfeng aa6f808616 Add batch norm bert fission pass 2020-05-06 16:33:46 +08:00
xiefangqi 9a2daae84c del unused change_mode_op 2020-05-06 11:54:05 +08:00
changzherui 99c9b48a4d delete TestHWBatchNormGradSplit 2020-05-04 19:39:17 +08:00
changzherui b323199dc1 syn code 430 2020-04-30 17:55:12 +08:00
YuJianfeng 7185961e89 Enable BatchNorm fusion pass 2020-04-30 15:29:23 +08:00
mindspore-ci-bot db3dd02838 !847 Optimize the collectors in manager which listen to the graphs and nodes changes. 
Merge pull request !847 from ZhangQinghua/opt
 2020-04-30 11:12:40 +08:00
mindspore-ci-bot 2303453753 !869 Random data op 
Merge pull request !869 from JesseKLee/random_data_op
 2020-04-30 02:56:39 +08:00
mindspore-ci-bot 732c7f8266 !794 fix issues image gradients 4d check 
Merge pull request !794 from zhaozhenlong/fix-issues-image-gradients-complement-check
 2020-04-29 22:26:53 +08:00
Jesse Lee 270bf831a9 Random Data Op 2020-04-29 10:26:00 -04:00
mindspore-ci-bot 98939d839c !856 Fix skip op bug 
Merge pull request !856 from jiangzhiwen/dataset/skip_thread
 2020-04-29 21:47:50 +08:00
zhaozhenlong 66e7a36846 ImageGradients check 4d 
fix DiagPart constant folding issue

fix argmin output type check

fix atan2 doc error

fix remove FusedBatchNorm and its grad
 2020-04-29 21:47:33 +08:00
jiangzhiwen 34bfa2f7c9 fix skip 2020-04-29 20:12:37 +08:00
Zhang Qinghua a22a4a57c2 Modify UT case after adjust the collectors of manager. 2020-04-29 15:36:21 +08:00
huanghui 0de0aee54e Add BatchNormGrad split pass 2020-04-29 15:28:23 +08:00
Jesse Lee 332398d20a Check return code from WaitPost::Register 2020-04-28 15:19:03 -04:00
yao_yf 6cde5f6d91 auto parallel strategy checkpoint 2020-04-28 15:48:41 +08:00
kswang e6f36e050f change cpu kernel dir 2020-04-27 21:14:03 +08:00
mindspore-ci-bot e537a70808 !657 Fix confusionmulgrad fusion pass cannot work 
Merge pull request !657 from huanghui/fix-confusionmulgrad-fusion-pass
 2020-04-27 11:10:25 +08:00
mindspore-ci-bot 3d9f1087c6 !695 Check topk supported before converting input to attr 
Merge pull request !695 from YuJianfeng/master
 2020-04-26 21:38:43 +08:00
YuJianfeng ce2a13fcda Check topk supported before converting input to attr 2020-04-26 18:40:17 +08:00
mindspore-ci-bot fb5cfe31d5 !430 add buffer fusion bnupdate eltwise pass 
Merge pull request !430 from Etone.Chan/bufferfusion
 2020-04-26 17:40:20 +08:00
Etone.Chan d2727d0504 add buffer fusion bnupdate eltwise pass 2020-04-26 17:17:42 +08:00
huanghui 230e77f923 fix confusionmulgrad fusion pass cannot work 2020-04-26 15:35:25 +08:00
huanghui 9e29224af9 move add_memcpy_async pass and transdata_split pass 2020-04-26 10:48:44 +08:00
Wei Luning f305d6f8a7 Revert "add pattern AdjustAllReduceMulAdd" 
This reverts commit ea6958c50a.
 2020-04-25 19:50:50 +08:00
zhaozhenlong 89f82e1a37 fix cpp ut test TestConvertConvBackpropFilter 2020-04-24 19:04:40 +08:00
mindspore-ci-bot 53d2da5fe4 !264 static_analysis: remove useless cache in TrivialPrimEvaluator and add cache for PythonPrimEvaluator 
Merge pull request !264 from xychow/remove-unnecessary-cache-and-add-cache
 2020-04-24 09:22:33 +08:00
mindspore-ci-bot 2440cea732 !621 [MD] adjust mindrecord ut 
Merge pull request !621 from liyong126/mindrecord_ut
 2020-04-24 09:12:32 +08:00
mindspore-ci-bot 928dcf4ec4 !554 Fix derelu fusion pass 
Merge pull request !554 from huanghui/fix_derelu_fusion_pass
 2020-04-23 21:52:55 +08:00
liyong 1f222ddb9e fix mindrecord c ut 2020-04-23 21:48:58 +08:00
huanghui cd6e8d6542 fix ReluV2's mask shape in derelu fusion pass 2020-04-23 21:25:18 +08:00
mindspore-ci-bot 4a3e5cb944 !492 Add AllGather fusion pass 
Merge pull request !492 from YuJianfeng/allgather
 2020-04-23 20:31:12 +08:00
mindspore-ci-bot 54e0fa5c09 !556 [Auto Parallel] use DeviceMemory instead of fixed-size memory check 
Merge pull request !556 from Chong/partition
 2020-04-23 20:03:36 +08:00
YuJianfeng 39945d0f79 Add AllGather fusion pass 2020-04-23 19:05:10 +08:00
ch-l f806b72447 use DeviceMemory for memory control 2020-04-23 17:55:17 +08:00
zhousiyi f6a4f3d155 [static_analysis]: remove the TrivialPrimEvaluator cache. 
add cache for PythonPrimEvaluator. Be careful that
 the infer function of PythonPrimitive in python code should
 be idempotent.
 2020-04-23 09:13:57 +00:00
huanghui 14df771175 fix confusion_softmax_grad_rule pass 2020-04-23 16:45:06 +08:00
chang zherui 3c1785a121 syn code 2020-04-23 14:49:29 +08:00
liubuyu 672244e0ac add keep_bn_fp32 parameter 2020-04-23 11:04:18 +08:00
mindspore-ci-bot 2dabcb9e59 !41 Synchronization code to ms-incubator 
Merge pull request !41 from changzherui/syn-code
 2020-04-23 10:46:02 +08:00
Wei Luning ac25cbae0e Revert "add pattern AdjustAllReduceMulAdd" 
This reverts commit d447364417.
 2020-04-23 10:05:33 +08:00
mindspore-ci-bot d99dfbd83d !390 getnext parallel optimization part III & IV: Loop Control & Stream Dispatch adaptation 
Merge pull request !390 from gukecai/master
 2020-04-21 15:36:44 +08:00
gukecai f8208c7c52 Support GetNext Parallel 2020-04-21 11:39:07 +08:00
liyong f1542a90a3 add pk sampler 2020-04-21 10:08:38 +08:00
mindspore-ci-bot 6369cf27bd !406 added first row crc check for when reading tfrecord files 
Merge pull request !406 from Peilin/first-row-crc-check
 2020-04-21 00:10:18 +08:00
xulei2020 c705ea5e5b add filterOp code 2020-04-20 22:32:19 +08:00
Peilin Wang 9bc2134cb7 added checking of first row crc to find invalid tfrecord files 
addressed code review comments. added check in python layer to exclude directories and to raise an error if a pattern does not match any file

fixed clang format

fixed cppcheck

fixed cppcheck (used std::accumulate and std::copy_if). regenerated tfrecord file to contain correct header, it was a dummy header before

fixed cppcheck: added const reference for string parameter for lambdas, fixed clang format: whitespace adjustments

more clang whitespace fixes...

changed print to logger.info
 2020-04-20 10:25:26 -04:00
mindspore-ci-bot d8176a77f4 !425 New api "TextFileDataset" 
Merge pull request !425 from yanghaitao/yht_textfiledatasetv2
 2020-04-20 22:14:26 +08:00
mindspore-ci-bot 11a4b35caa !472 Fix inputs size and attr for AddN fission pass 
Merge pull request !472 from YuJianfeng/master
 2020-04-20 21:30:52 +08:00
ms_yan c5cfb09e66 Repair some MS_LOG problem 2020-04-20 19:45:46 +08:00
mindspore-ci-bot 679dbd27b3 !478 fix save_graphs_path and log file mode related issues 
Merge pull request !478 from fary86/fix_log_and_ir_issues
 2020-04-20 19:07:38 +08:00
fary86 7e23a1a475 Fix issues of save_graphs_path, Type/Value error message and log file mode 2020-04-20 16:23:40 +08:00
YuJianfeng bc2df2c913 Fix inputs size and attr for AddN fission pass 2020-04-20 15:48:27 +08:00
yanghaitao 2795e492ff TextFileDataset 2020-04-20 11:18:55 +08:00
mindspore-ci-bot 3822b4837f !340 Add a HistogramSummary ops to record tensor value 
Merge pull request !340 from ougongchang/master
 2020-04-20 10:54:04 +08:00
Wei Luning d447364417 add pattern AdjustAllReduceMulAdd 2020-04-18 21:20:15 +08:00
ms_yan f0c07c3fa6 Realize take op and add ut 2020-04-18 18:33:57 +08:00
mindspore-ci-bot 71b63c3fcf !246 [opt pass] AdjustAllReduceMulAdd 
Merge pull request !246 from vlne-v1/I1E3PI-opt-pass-adjust-allreduce-apply-weight-decy-seq
 2020-04-18 18:17:01 +08:00
Wei Luning ea6958c50a add pattern AdjustAllReduceMulAdd 2020-04-18 17:00:55 +08:00
YuJianfeng 5eb5379889 Add AdamApplyOne fusion pass 2020-04-18 10:54:09 +08:00
ougongchang 0ed6d9178e add Histogram summary operator 
clean clang format errors and cpplint errors

add some test cases for histogram summary operator
 2020-04-18 09:56:45 +08:00
jzw 3f7054dccb add skip dataset op 2020-04-17 19:48:25 +08:00
mindspore-ci-bot f69a668d98 !350 change tuple output to make tuple 
Merge pull request !350 from lianliguang/chang-tuple-output-to-make-tuple
 2020-04-17 19:22:41 +08:00
lianliguang 00e4306518 convert all tuple output to maketuple 2020-04-17 17:31:42 +08:00
mindspore-ci-bot f98efafa16 !317 [IRFusion] add derelu_fusion pass 
Merge pull request !317 from huanghui/derelu_fusion_pass
 2020-04-17 16:42:06 +08:00
mindspore-ci-bot cf026096a6 !183 Mindspore.dataset CPP sampler for GeneratorDataset 
Merge pull request !183 from JunhanHu/cpp_sampler
 2020-04-16 22:30:59 +08:00
wenchunjiang ee5f3fa240 add pass to insert memcpy_async for get_next outputs 2020-04-16 14:30:24 +08:00
mindspore-ci-bot 58a70b5f82 !346 getnext parallel optimization part II: Eliminate Memcpy in specify scenario 
Merge pull request !346 from laiyongqiang/develop
 2020-04-15 20:38:42 +08:00
laiyongqiang 3e05f50f5f getnext_memcpy_elimination 2020-04-15 19:38:10 +08:00
yangzhenzhang 6d522f0a4f add parallel op for layernorm 2020-04-15 19:30:07 +08:00
huanghui b02e871c1a [IRFusion] add derelu_fusion pass 2020-04-15 10:20:35 +08:00
Junhan Hu 9739d3b048 Add CPP sampler support for GeneratorDataset 2020-04-14 12:09:03 -04:00
mindspore-ci-bot 30de261c3c !243 Support nested repeat 
Merge pull request !243 from h.farahat/nested_repeat
 2020-04-14 23:07:32 +08:00
hesham 0fc23eee0f Support nested repeat 2020-04-14 10:13:18 -04:00
mindspore-ci-bot b571fabd77 !289 Add cnode mapping after graph match 
Merge pull request !289 from YuJianfeng/find_op
 2020-04-14 18:51:28 +08:00
YuJianfeng e5c67b9088 Add cnode to equal map when opt matching 2020-04-14 17:29:47 +08:00
mindspore-ci-bot 9bda080bb5 !260 refactor padding strategy 
Merge pull request !260 from lianliguang/refactor-padding-strategy
 2020-04-14 15:44:46 +08:00
mindspore-ci-bot 1ab430072e !232 [Auto parallel] Model the memory_cost in cost model 
Merge pull request !232 from Xiaoda/model-memory-cost-in-auto-parallel
 2020-04-14 15:29:04 +08:00
mindspore-ci-bot 94589ce611 !226 expend conv stride and dilation to 2d 
Merge pull request !226 from wangnan39/expend_conv_stride_to_2d
 2020-04-14 14:58:22 +08:00
wangnan39@huawei.com 2604acedcb extend conv stride and dilation to 2d 2020-04-14 13:16:27 +08:00
lianliguang 5d225f934f change the padding strategy & refactor insert transdata 2020-04-14 12:57:40 +08:00
Xiaoda Zhang 0ac50a19f5 Model the memory cost in auto-parallel. It is calculated by the output of operators, plus the parameters. Additionally, modify the graph-operations in auto_parallel to include memory_cost. 2020-04-14 11:39:31 +08:00
mindspore-ci-bot f1fa2a9941 !273 [MD] update subset random sampler in minddataset 
Merge pull request !273 from liyong126/mindrecord_subset_sampler_python
 2020-04-14 11:18:36 +08:00
mindspore-ci-bot 298a32f1e2 !132 Add confusion_mul_grad_fusion pass 
Merge pull request !132 from huanghui/master
 2020-04-13 21:49:06 +08:00
liyong 0ce83e39e1 fix TestShardSampleWrongNumber 
adjust internal api
 2020-04-13 21:31:45 +08:00
mindspore-ci-bot 57f953ca38 !216 Implement addn fusion pass 
Merge pull request !216 from YuJianfeng/master
 2020-04-13 20:49:32 +08:00
huanghui 19ee376cd3 add confusion_mul_grad fusion pass 2020-04-13 19:08:15 +08:00
c00425699 d62f560b50 add_bool_type_check_in_comm_op 2020-04-13 17:34:29 +08:00
YuJianfeng 7307c81f31 implement AddN fission pass 2020-04-13 16:05:45 +08:00
panfengfeng 6a79fc1735 skip mindrecord ut test case 2020-04-13 10:38:54 +08:00
buxue 5841fe010e Support pow's second input could be tensor and fix bug in bprop of pow 2020-04-11 16:16:58 +08:00
yangzhenzhang b34c0e7a17 add parallel op for dropoutdomask 2020-04-11 12:11:22 +08:00
jonyguo a9443635b7 fix: mindpage enhance parameter check and search by filename failed 2020-04-11 10:19:14 +08:00
panfengfeng 53a98210af skip ut test cases temporarily 2020-04-11 09:28:09 +08:00
c00425699 406475160f refactor OperatorCostPtr in OperatorInfo 2020-04-10 19:11:58 +08:00
biffex cc1416bfc2 constant duplicate mul for momentum 2020-04-10 19:11:58 +08:00
kswang a6747c522f add ascend mem pool 2020-04-10 19:10:45 +08:00
yao_yf 513f384c43 fix auto parallel prelu 2020-04-10 19:10:45 +08:00
kswang d84cfb0108 add mem manager 2020-04-10 19:10:45 +08:00
Alexey Shevlyakov 6d1ea7af8e remove make_unique.h 2020-04-10 19:10:45 +08:00
jonyguo 6690a7fd7a fix: error info is not exactly when column list invalid 2020-04-10 19:09:54 +08:00
jojobugfree 89f0b3b1bb profiling feature enhancement 2020-04-10 19:08:25 +08:00
Xiaoda Zhang 7798c85e70 This commit is to separate the computation cost and memory cost in auto_parallel. Some related memory correction is removed. 2020-04-10 19:08:25 +08:00
Jonathan Yan f01098bc12 remove ENABLE_MINDRECORD flag 2020-04-10 19:08:25 +08:00
Alexey Shevlyakov b9701db887 fix RandomCropDecodeResize test 2020-04-10 19:08:25 +08:00
mindspore-ci-bot 268d358a1d !187 refactor OperatorCostPtr in OperatorInfo 
Merge pull request !187 from chentingting/refactor_OperatorCostPtr_in_OperatorInfo
 2020-04-10 09:21:25 +08:00
mindspore-ci-bot 1b3b3b1a1c !198 [opt] momentum duplicate mul constant 
Merge pull request !198 from biffex/momentum-duplicate-mul-constant
 2020-04-10 08:37:41 +08:00
biffex 62bbf560c6 constant duplicate mul for momentum 2020-04-09 22:28:00 +08:00
c00425699 b413638f23 refactor OperatorCostPtr in OperatorInfo 2020-04-09 20:37:52 +08:00
kswang bef62db128 add ascend mem pool 2020-04-09 16:04:59 +08:00
mindspore-ci-bot 2e6e94b2b6 !177 prelu operator support parallel on the channel 
Merge pull request !177 from yao_yf/fix_auto_parallel_prelu
 2020-04-09 14:08:41 +08:00
mindspore-ci-bot 31efc8b088 !172 add mem manager 
Merge pull request !172 from kisnwang/add-resource-manager
 2020-04-09 11:36:33 +08:00
kswang fb343bd607 add mem manager 2020-04-09 10:05:45 +08:00
buxue 1d3bb0b731 Develop op MaxPoolWithArgMax 2020-04-09 09:26:56 +08:00
mindspore-ci-bot cc75cb357c !168 remove mindspore::make_unique and make_unique.h 
Merge pull request !168 from Alexey_Shevlyakov/remove_mindspore_make_unique
 2020-04-09 05:32:52 +08:00
mindspore-ci-bot 3e36982314 !99 Develop op MaxPoolWithArgMax 
Merge pull request !99 from zhangbuxue/Dock_MaxPoolWithArgMax
 2020-04-08 22:40:00 +08:00
mindspore-ci-bot 68f804255f !174 enhance: the error info is not detail when the column list is invalid by MindDataset 
Merge pull request !174 from guozhijian/fix_false_error_info
 2020-04-08 21:52:00 +08:00
buxue 7541d3b067 Develop op MaxPoolWithArgMax 2020-04-08 20:47:49 +08:00
yao_yf b5e3fa9593 fix auto parallel prelu 2020-04-08 20:45:08 +08:00
kingfo cdbef85e5e refactor callback for ge backend 2020-04-08 20:00:06 +08:00
huangdongrun d12a720fc5 add comparison ops 
fix pylint

use scalar_lt primitive directly

fix review
 2020-04-08 20:00:06 +08:00
YuJianfeng 024706f951 Optimize depend edge with make tuple input 2020-04-08 20:00:06 +08:00
Wei Luning b18f634912 remove ge depend in cpu 2020-04-08 20:00:06 +08:00
fary86 73e0bdcd43 Dump graph with type info when static analysis failed 2020-04-08 19:58:13 +08:00
c00425699 c4b03e854c use std::vector instead of std::list to promote performance for parallel module 2020-04-08 19:58:13 +08:00
GinFung 2fd7f67108 Add matmul biasadd fusion pass 2020-04-08 19:58:13 +08:00
Jonathan Yan 295c00ac39 Replace std::cout with MS_LOG in dataset unit test 
Signed-off-by: Jonathan Yan <jonathan.yan1@huawei.com>
 2020-04-08 19:58:13 +08:00
mindspore-ci-bot 2eb71103f9 !82 profiling feature enhancement 
Merge pull request !82 from caifubi/dev-profiling
 2020-04-08 16:22:35 +08:00
jonyguo 20d1b64443 fix: error info is not exactly when column list invalid 2020-04-08 16:11:13 +08:00
jojobugfree effdb483d6 profiling feature enhancement 2020-04-08 15:12:06 +08:00
Xiaoda Zhang a153fad874 This commit is to separate the computation cost and memory cost in auto_parallel. Some related memory correction is removed. 2020-04-08 11:52:19 +08:00
Jonathan Yan 9d0fde29f4 remove ENABLE_MINDRECORD flag 2020-04-07 14:55:45 -04:00
Alexey Shevlyakov 84d780c1a4 remove make_unique.h 2020-04-07 14:00:09 -04:00
mindspore-ci-bot a4b9f8a728 !120 Fix test for RandomCropDecodeResizeOp. 
Merge pull request !120 from Alexey_Shevlyakov/master
 2020-04-07 20:52:45 +08:00
kingfo 3202fc0df9 refactor callback for ge backend 2020-04-07 09:32:54 +08:00
Alexey Shevlyakov d37b8c4f2d fix RandomCropDecodeResize test 2020-04-03 11:13:57 -04:00
mindspore-ci-bot a5d95e472e !106 support comparison ops for python 
Merge pull request !106 from amongo/SupportPythonOperators
 2020-04-03 15:52:08 +08:00
huangdongrun 461d8e3a08 add comparison ops 
fix pylint

use scalar_lt primitive directly

fix review
 2020-04-03 09:58:41 +08:00
mindspore-ci-bot 9be1a01db6 !85 Optimize depend edge with make tuple input 
Merge pull request !85 from YuJianfeng/master
 2020-04-02 22:00:18 +08:00
Wei Luning 73ba399364 remove ge depend in cpu 2020-04-02 19:38:42 +08:00
YuJianfeng 7f53bb062d Optimize depend edge with make tuple input 2020-04-02 11:33:34 +08:00
mindspore-ci-bot 52166a85cf !43 dump graph with type info when analysis failed 
Merge pull request !43 from fary86/dump-typed-graph-when-analyze-fail
 2020-03-31 22:23:02 +08:00
fary86 816b60491d Dump graph with type info when static analysis failed 2020-03-31 21:08:48 +08:00
mindspore-ci-bot da447b8d4d !45 use std::vector instead of std::list to promote performance for parallel module 
Merge pull request !45 from chentingting/permote_auto_prallel_performance
 2020-03-31 18:25:59 +08:00
c00425699 3bb48ffee1 use std::vector instead of std::list to promote performance for parallel module 2020-03-31 15:16:00 +08:00
mindspore-ci-bot 976226f9ac !10 Add matmul biasadd fusion pass 
Merge pull request !10 from YuJianfeng/master
 2020-03-31 14:52:47 +08:00
Jonathan Yan 080bcda021 Replace std::cout with MS_LOG in dataset unit test 
Signed-off-by: Jonathan Yan <jonathan.yan1@huawei.com>
 2020-03-30 11:02:32 -04:00
GinFung 468dbc3557 Add matmul biasadd fusion pass 2020-03-30 10:12:50 +08:00
zhunaipan 930a1fb0a8 initial version 
Signed-off-by: leonwanghui <leon.wanghui@huawei.com>
 2020-03-27 22:54:54 +08:00