Nigel
/
mindspore
forked from mindspore-Ecosystem/mindspore
0
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
42,838 Commits 24 Branches 0 Tags 3.9 GiB
Commit Graph

3732 Commits

Author SHA1 Message Date
mindspore-ci-bot a606c2e4da !872 [Dataset] Add schema support for GeneratorDataset 
Merge pull request !872 from JunhanHu/generator_schema
 2020-04-30 02:58:29 +08:00
mindspore-ci-bot 2303453753 !869 Random data op 
Merge pull request !869 from JesseKLee/random_data_op
 2020-04-30 02:56:39 +08:00
Junhan Hu c5a8ffe4f4 Add schema support for GeneratorDataset 2020-04-29 13:50:51 -04:00
Jesse Lee 5236d0c3c0 Replace print with logger.info 2020-04-29 12:44:04 -04:00
mindspore-ci-bot 8d3695f666 !672 Added UT for uniform augmentation C++ OP 
Merge pull request !672 from AdelShafiei/ua_ut
 2020-04-29 23:56:09 +08:00
mindspore-ci-bot 732c7f8266 !794 fix issues image gradients 4d check 
Merge pull request !794 from zhaozhenlong/fix-issues-image-gradients-complement-check
 2020-04-29 22:26:53 +08:00
Jesse Lee 270bf831a9 Random Data Op 2020-04-29 10:26:00 -04:00
mindspore-ci-bot 98939d839c !856 Fix skip op bug 
Merge pull request !856 from jiangzhiwen/dataset/skip_thread
 2020-04-29 21:47:50 +08:00
zhaozhenlong 66e7a36846 ImageGradients check 4d 
fix DiagPart constant folding issue

fix argmin output type check

fix atan2 doc error

fix remove FusedBatchNorm and its grad
 2020-04-29 21:47:33 +08:00
jiangzhiwen 34bfa2f7c9 fix skip 2020-04-29 20:12:37 +08:00
mindspore-ci-bot 8ab5e0118f !829 Add parser of case which parameter in tuple in run_op function 
Merge pull request !829 from ghzl/parser-parameter-in-tuple-in-run_op
 2020-04-29 19:47:46 +08:00
guohongzilong b96df362f8 add parser of case which parameter in tuple in run_op function 2020-04-29 17:55:12 +08:00
mindspore-ci-bot 883fde0494 !839 add parameter verification for RMSprop 
Merge pull request !839 from wangnan39/add_parameter_verification_for_rmsprop
 2020-04-29 17:20:21 +08:00
mindspore-ci-bot 728345fdd0 !841 fix bugs of Acosh bprop and Elu bprop 
Merge pull request !841 from zhangbuxue/adapt_ExtractImagePatches_and_fix_EluGrad
 2020-04-29 17:17:30 +08:00
buxue 064d370a61 fix bug of Acosh bprop and Elu bprop 2020-04-29 16:50:08 +08:00
mindspore-ci-bot 33e427e1c5 !721 Tensor assign by ellipsis 
Merge pull request !721 from candanzg/tensor_assgin_ellipsis
 2020-04-29 16:31:05 +08:00
wangnan39@huawei.com 7f602016f4 add parameter verification for rmsprop, and modify default value in annotation 2020-04-29 16:12:58 +08:00
mindspore-ci-bot 6241814320 !749 fix np.histogram sometimes calc very large bucket number 
Merge pull request !749 from wenkai/wkmaster
 2020-04-29 11:36:11 +08:00
candanzg e886a3182c tensor assign with ellpsis 
Signed-off-by: candanzg <zhangshucheng@huawei.com>
 2020-04-29 11:05:44 +08:00
Adel Shafiei 3322e65da9 added ut for uniform augment C++ op 2020-04-28 21:07:29 -04:00
zhaozhenlong 243cd33203 adapt SparseApplyAdagradD adding output accum 2020-04-28 21:48:04 +08:00
mindspore-ci-bot 9ffb3993e8 !732 dock AcoshGrad for GE and AvgPool AvgPoolGrad for VM 
Merge pull request !732 from zhangbuxue/dock_AcoshGrad_AvgPool_AvgPoolGrad_for_vm
 2020-04-28 20:22:04 +08:00
mindspore-ci-bot 21d936e656 !728 auto parallel strategy checkpoint full 
Merge pull request !728 from yao_yf/strategy_checkpoint_extend
 2020-04-28 19:51:15 +08:00
mindspore-ci-bot 4fff5f442c !791 onnx adapter for MaxPoolWithArgmax 
Merge pull request !791 from 梅晓蔚/master
 2020-04-28 19:24:13 +08:00
buxue 0f89cc1da4 dock AcoshGrad for GE and AvgPool AvgPoolGrad for Vm 2020-04-28 18:52:23 +08:00
meixiaowei cd899fba0a ONNX adapter for the MaxPoolWithArgmax 2020-04-28 16:43:15 +08:00
yao_yf 6cde5f6d91 auto parallel strategy checkpoint 2020-04-28 15:48:41 +08:00
mindspore-ci-bot 9399dffe0e !751 Remove enable hccl 
Merge pull request !751 from zjun/remove_enable_hccl
 2020-04-28 14:23:40 +08:00
mindspore-ci-bot 5b3327d103 !746 reducescatter backforward operator 
Merge pull request !746 from lirongzhen1/bp_reducescatter
 2020-04-28 14:11:53 +08:00
mindspore-ci-bot c1813671db !694 Refactor vm module for multigraph sink. 
Merge pull request !694 from rick_sanchez/master
 2020-04-28 10:42:26 +08:00
mindspore-ci-bot 8bf35b2b0c !700 validate bprop rules 
Merge pull request !700 from penn/validate_bprop_rules
 2020-04-28 10:40:41 +08:00
zjun c538b83712 remove enbale hccl 2020-04-28 10:37:08 +08:00
lirongzhen1 0b4648881b add reducescatter bprop 2020-04-28 09:58:34 +08:00
rick_sanchez 6ae8345cad refactor vm module for multigraph sink 2020-04-28 09:53:43 +08:00
mindspore-ci-bot b37db1edf5 !603 [MD] update pk sampler in minddataset 
Merge pull request !603 from liyong126/update_pk_sampler
 2020-04-27 23:17:38 +08:00
mindspore-ci-bot f82e63fecc !671 Added testcase for sync_wait 
Merge pull request !671 from EricZ/master
 2020-04-27 22:14:10 +08:00
mindspore-ci-bot 0e3054d527 !466 Deepcopy problem when pyfunc cannot be pickled 
Merge pull request !466 from h.farahat/deepcopy
 2020-04-27 22:07:55 +08:00
liyong bfba630aa2 update pK_sampler 2020-04-27 21:40:49 +08:00
mindspore-ci-bot c47ef8ee4e !711 Address first epoch always shuffle with same seed init of random sampler 
Merge pull request !711 from ZiruiWu/mindspore_master_only
 2020-04-27 21:39:12 +08:00
mindspore-ci-bot afbd24cb78 !718 Fix dtype judge sentence in infer_dtype function of hcom operations 
Merge pull request !718 from zhouyuanshen/master
 2020-04-27 21:23:25 +08:00
zhouyuanshen c046874b03 fix bug in infer_dtype function of hcom operations 2020-04-27 18:49:21 +08:00
wenkai ab04b3dc4b fix np.histograms(bins='auto') sometimes calc very small width and very large bucket number, which lead to error/long compute time. 2020-04-27 18:08:17 +08:00
panyifeng 9e633b6c12 validate bprop rules 2020-04-27 11:57:22 +08:00
mindspore-ci-bot ef71ae941f !698 [Auto parallel] Support multi-subgraphs in auto-parallel 
Merge pull request !698 from Xiaoda/support-wide-deep-in-auto-parallel
 2020-04-27 11:15:40 +08:00
mindspore-ci-bot e213f2a435 !687 Fix bug: Summary tage type checking and exception throwing 
Merge pull request !687 from candanzg/summary_tag_check
 2020-04-27 09:57:33 +08:00
Xiaoda Zhang e227415673 support-the-multiple-subgraphs-in-the-ANF 2020-04-27 09:34:41 +08:00
Zirui Wu 8c3931cf1d fix first epoch always shuffle with default seed in random sampler 
fix ut
 2020-04-26 10:58:59 -04:00
mindspore-ci-bot efdcd4c258 !682 fix api comments of some ops 
Merge pull request !682 from liuxiao/fix-bug
 2020-04-26 19:29:40 +08:00
mindspore-ci-bot da5b10b699 !681 add psnr inputs shape and dtype check 
Merge pull request !681 from zhaozhenlong/psnr-check-same-shape
 2020-04-26 17:49:05 +08:00
zhaozhenlong c88edfb31d psnr check two input same shape and type 2020-04-26 17:16:58 +08:00
yangzhenzhang 4750861054 fix layernorm bug 2020-04-26 16:39:32 +08:00
mindspore-ci-bot 348b0ef53c !344 add prim name to error message for operators in array_ops.py 
Merge pull request !344 from fary86/add_prim_name_to_error_message_for_array_ops
 2020-04-26 16:23:33 +08:00
candanzg b84deeeb5c fix summary tage check error 
Signed-off-by: candanzg <zhangshucheng@huawei.com>
 2020-04-26 15:43:57 +08:00
fary86 2078229436 Add prim name to error message for array_ops 2020-04-26 15:23:04 +08:00
yangzhenzhang 36a62576e8 support forward graph 2020-04-26 14:44:23 +08:00
liuxiao 5e877a7715 modify api and add example 2020-04-26 11:07:18 +08:00
mindspore-ci-bot ad2a5dcad2 !676 [Auto parallel] Add the resnet50 testcase 
Merge pull request !676 from Xiaoda/add-the-resnet50-testcase
 2020-04-26 11:06:29 +08:00
buxue aff6777ecc fix reviewboot and example of TruncatedNormal and add type mapping 2020-04-26 10:01:20 +08:00
Xiaoda Zhang 3ff9e54734 add the resnet50 32k-8p testcase 2020-04-26 09:07:37 +08:00
eric 2d115cd04e Added example for multiple iterator 
Added new testcase for multi iterator

Addressing review

Fixed typo
 2020-04-24 17:28:40 -04:00
lirongzhen1 56f785f7e6 add context configration 2020-04-24 19:35:14 +08:00
mindspore-ci-bot 6844ea633d !56 Synchronization code423 to ms-incubator 
Merge pull request !56 from changzherui/syn-code423
 2020-04-24 19:30:37 +08:00
mindspore-ci-bot a02eb240e9 !595 Tensor assign with int or tuple(int) index 
Merge pull request !595 from candanzg/tensor_assign_with_integer
 2020-04-24 17:35:58 +08:00
mindspore-ci-bot ce71c17933 !645 auto parallel prelu operator support broadcast 
Merge pull request !645 from yao_yf/auto_parallel_prelu_support_broadcast
 2020-04-24 17:32:37 +08:00
mindspore-ci-bot 84d5e4f923 !643 [AutoParallel]Support reshape parameter 
Merge pull request !643 from lichen/support_reshape_parameter
 2020-04-24 16:43:29 +08:00
candanzg 31aae36106 Tensor assign with integer 
Signed-off-by: candanzg <zhangshucheng@huawei.com>
 2020-04-24 16:28:23 +08:00
mindspore-ci-bot 43a8f829a2 !628 fix the infer of TruncatedNormal and a bug of structure output 
Merge pull request !628 from zhangbuxue/fix_example_for_TruncatedNormal
 2020-04-24 16:12:05 +08:00
mindspore-ci-bot 00859ae119 !586 enable/disable allreduce_fusion 
Merge pull request !586 from lirongzhen1/allreduce_fusion
 2020-04-24 16:02:53 +08:00
lichenever 2ab211ae04 support reshape parameter 2020-04-24 15:59:09 +08:00
buxue c8a1a24ce3 fix the infer of TruncatedNormal and a bug of structure output and a bug of tensorslice ellipsis 2020-04-24 15:42:58 +08:00
yao_yf 425276d43d auto parallel prelu support prelu 2020-04-24 14:10:57 +08:00
Xiaoda Zhang dfde76af88 delete the 'simplify_cal' attribute in 'set_algo_parameters' and 'get_algo_parameters' interface 2020-04-24 10:46:38 +08:00
lirongzhen 4ff418084c enable/disable allreduce_fusion 2020-04-24 10:34:59 +08:00
zhaojichen d1add07b5a change error type 2020-04-23 09:49:56 -04:00
zhaojichen 1af894e25f change error type 2020-04-23 09:21:05 -04:00
zhaojichen 57bc30505c change error type 2020-04-23 07:58:44 -04:00
mindspore-ci-bot ad75618ca6 !611 change error message type 
Merge pull request !611 from JichenZhao/errormsg
 2020-04-23 19:49:59 +08:00
chang zherui bd13f9ba33 modify ResizeNearestNeighborV2D 2020-04-23 18:56:03 +08:00
zhaojichen 8963e39516 change error type 2020-04-23 05:29:26 -04:00
mindspore-ci-bot 5ac07bb695 !504 Support Tensor assign A[slice] = u 
Merge pull request !504 from candanzg/tensor_assign_with_slice
 2020-04-23 16:24:10 +08:00
candanzg 663d597330 tensor assign with slice index 
Signed-off-by: candanzg <zhangshucheng@huawei.com>
 2020-04-23 13:07:04 +08:00
mindspore-ci-bot 0bf6717e9a !454 Fix the check of bool type in auto cast 
Merge pull request !454 from candanzg/bug_cast_op
 2020-04-23 10:54:40 +08:00
mindspore-ci-bot 5cf09405e2 !532 [AutoParallel]support multiple subgraphs 
Merge pull request !532 from lichen/support_multiple_subgraphs_in_auto_parallel
 2020-04-23 09:04:09 +08:00
hesham a9e9266149 Deepcopy problem when pyfunc cannot be pickled 2020-04-22 11:55:27 -04:00
liuxiao b6e77e5178 Add ReluV2/ReluGradV2/ConfusionMulGrad for VM 2020-04-22 21:09:37 +08:00
mindspore-ci-bot 1a0d2666b7 !559 Add Fill/Erf op for VM. 
Merge pull request !559 from liuxiao/fill-op
 2020-04-22 19:22:04 +08:00
mindspore-ci-bot 818acd46d4 !569 fix bug in checkpoint when save scaler 
Merge pull request !569 from wangnan39/master
 2020-04-22 18:55:02 +08:00
lichenever c78630d737 support multiple subgraphs 2020-04-22 17:40:56 +08:00
wangnan39@huawei.com f38d18c665 fix bug in checkpoint when save scaler 2020-04-22 16:04:55 +08:00
mindspore-ci-bot 24a9f4974c !536 support ellipsis and bool for tensor slice 
Merge pull request !536 from zhangbuxue/support_elipis_for_tensor_slice
 2020-04-22 15:49:33 +08:00
liuxiao 5b6c8fade8 Add Erf\FillD operator for VM 2020-04-22 15:32:42 +08:00
buxue 437bb8c27c support ellipsis and bool for tensor slice 2020-04-22 15:00:04 +08:00
mindspore-ci-bot 67057d1309 !541 add average pooling 1D 
Merge pull request !541 from JichenZhao/avgpooling
 2020-04-22 14:13:04 +08:00
mindspore-ci-bot 4516b8feff !437 Add L2Loss op for VM. 
Merge pull request !437 from liuxiao/add-l2-loss
 2020-04-22 10:27:04 +08:00
mindspore-ci-bot 3b083d07bb !550 support one node communication group 
Merge pull request !550 from yao_yf/support_one_node_communication_group
 2020-04-22 10:17:01 +08:00
liuxiao c874e2d484 Add L2Loss op for VM 2020-04-22 09:31:14 +08:00
mindspore-ci-bot aad5771a62 !524 Added support for UA augmentation ops with tests 
Merge pull request !524 from alashkari/ua-ops
 2020-04-22 08:28:47 +08:00
Amir Lashkari 56e7a7deb5 Added UniformAugment + Python Augmentation Ops 2020-04-21 19:54:32 -04:00
mindspore-ci-bot dc0491caf9 !508 [Dataset] Adding sync_wait operator for dataset 
Merge pull request !508 from EricZ/master
 2020-04-22 06:15:24 +08:00
eric cd94518769 X# This is a combination of 2 commits. 
Initial commit for dataset op python

Added signature to barrier

Adde compiling barrier code

Rebasing, fixed new compile errors

Final fix for make_unique

Added pybind API for barrier

Fixed pyfunc invocation

python interface - sync_wait

!1 sync_wait python interface
* python interface - sync_wait

fix test

update test

update test

Added new test case

add test case

test for shuffle + batch

Added two-sync test case

Restrited that no shuffle after sync

Added sync to pipeline info

block first databuffer as well

Intelligently get batch size

Fix default case

Lock Pair shares among all iterators

Added fix for empty character

Fixed up test case formatting

Fix end of epoch in sync_wait

Fixing CI
 2020-04-21 17:42:13 -04:00
Junhan Hu 78001ac9e6 Add multiprocessing support for Mindspore.Dataset.GeneratorDataset 2020-04-21 16:03:43 -04:00
mindspore-ci-bot fb18671b28 !506 [Dataset] Multiprocessing support for Pyfunc 
Merge pull request !506 from JunhanHu/multiprocess_pyfunc
 2020-04-22 03:57:26 +08:00
Junhan Hu b13e7bc31a Add python multiprocessing support for Mindspore.dataset 2020-04-21 14:56:25 -04:00
yao_yf 371b3338b6 support one node communication group 2020-04-21 21:16:22 +08:00
mindspore-ci-bot 72f42fc37c !170 Add prim name to error message for operators in nn_ops.py 
Merge pull request !170 from fary86/add_prim_name_to_error_message_for_nn_ops
 2020-04-21 21:14:44 +08:00
wangnan39@huawei.com b812b18c02 support update parameter for vm 2020-04-21 20:19:46 +08:00
fary86 6dd72f654a Add prim name to error message for nn_ops.py 2020-04-21 19:25:30 +08:00
qianlong db80f4ff92 The num_samples and numRows in schema for TFRecordDataset are conflict 2020-04-21 17:08:59 +08:00
zhaojichen 94c99998ae add AvgPooling layer 2020-04-21 03:17:24 -04:00
mindspore-ci-bot d9e4dcc33b !483 Optimize skip dataset op 
Merge pull request !483 from jiangzhiwen/dataset/skip_opt
 2020-04-21 15:10:23 +08:00
mindspore-ci-bot 862d23fe90 !481 Move args_type_check function to _checkparam.py 
Merge pull request !481 from leonwanghui/rm-code
 2020-04-21 11:23:05 +08:00
mindspore-ci-bot 7aac50804a !514 [MD] add Pk Sampler in minddataset 
Merge pull request !514 from liyong126/mindrecord_pk_sampler_lee
 2020-04-21 11:10:19 +08:00
leonwanghui 24b26ee1a8 Move args_type_check function to _checkparam.py 2020-04-21 10:20:09 +08:00
liyong f1542a90a3 add pk sampler 2020-04-21 10:08:38 +08:00
candanzg 0de05b3949 [bug] fixed bool check for cast op 
Signed-off-by: candanzg <zhangshucheng@huawei.com>
 2020-04-21 09:48:34 +08:00
mindspore-ci-bot 27a88a6bc3 !456 Auto cast case for NotEqual op 
Merge pull request !456 from candanzg/not_equal_auto_cast
 2020-04-21 09:20:40 +08:00
jiangzhiwen e1b109e8b8 optimize skip dataset op 2020-04-21 09:16:37 +08:00
Cathy Wong 60df369100 Fixup py Normalize doc: takes input CHW 2020-04-20 15:17:30 -04:00
mindspore-ci-bot 6369cf27bd !406 added first row crc check for when reading tfrecord files 
Merge pull request !406 from Peilin/first-row-crc-check
 2020-04-21 00:10:18 +08:00
mindspore-ci-bot 98fbd30a5b !460 [Data]Add filter operation 
Merge pull request !460 from xulei/filter_master
 2020-04-20 23:33:44 +08:00
mindspore-ci-bot 822a3160e4 !404 [Dataset] Add Python Sampler support for CPP dataset 
Merge pull request !404 from JunhanHu/python_sampler_for_cpp_dataset
 2020-04-20 22:45:51 +08:00
xulei2020 c705ea5e5b add filterOp code 2020-04-20 22:32:19 +08:00
Peilin Wang 9bc2134cb7 added checking of first row crc to find invalid tfrecord files 
addressed code review comments. added check in python layer to exclude directories and to raise an error if a pattern does not match any file

fixed clang format

fixed cppcheck

fixed cppcheck (used std::accumulate and std::copy_if). regenerated tfrecord file to contain correct header, it was a dummy header before

fixed cppcheck: added const reference for string parameter for lambdas, fixed clang format: whitespace adjustments

more clang whitespace fixes...

changed print to logger.info
 2020-04-20 10:25:26 -04:00
mindspore-ci-bot d8176a77f4 !425 New api "TextFileDataset" 
Merge pull request !425 from yanghaitao/yht_textfiledatasetv2
 2020-04-20 22:14:26 +08:00
mindspore-ci-bot 5434a96d85 !493 support python func print and != for list with none 
Merge pull request !493 from zhangbuxue/support_python_func_print
 2020-04-20 20:32:18 +08:00
mindspore-ci-bot 0cdb1171d5 !87 Take AllToAll as a virtual operator in cost model 
Merge pull request !87 from gziyan/dev_alltoall
 2020-04-20 20:13:15 +08:00
mindspore-ci-bot c3ec9712e0 !403 add cell class name to error message 
Merge pull request !403 from fary86/add_cell_name_to_error_message_for_nn_layer
 2020-04-20 20:06:12 +08:00
buxue 7c233a57fa support python func print and != for list with none 2020-04-20 19:55:50 +08:00
mindspore-ci-bot 679dbd27b3 !478 fix save_graphs_path and log file mode related issues 
Merge pull request !478 from fary86/fix_log_and_ir_issues
 2020-04-20 19:07:38 +08:00
fary86 7e23a1a475 Fix issues of save_graphs_path, Type/Value error message and log file mode 2020-04-20 16:23:40 +08:00
mindspore-ci-bot 3ba31ec15a !419 Tensor assign with bool Tensor 
Merge pull request !419 from candanzg/tensor_assign_bool_index
 2020-04-20 15:00:55 +08:00
yanghaitao 2795e492ff TextFileDataset 2020-04-20 11:18:55 +08:00
mindspore-ci-bot 18580a7867 !261 Add summary module python code to extract histogram info from tensor 
Merge pull request !261 from wenkai/histogram_dev3cp
 2020-04-20 11:08:34 +08:00
mindspore-ci-bot 3822b4837f !340 Add a HistogramSummary ops to record tensor value 
Merge pull request !340 from ougongchang/master
 2020-04-20 10:54:04 +08:00
Ziyan 0d208e00bd Model ALLTOALL as a single operator in cost model; scale the ALLTOALL, 
ALLGATHER, and REDUCESCATTER with different factors; change the BETA and
GAMMA value in cost model.
 2020-04-20 09:11:03 +08:00
candanzg 3f087dba1a Tensor assign syntax: 
1) A[B]=U
2) A[A>n]=U
    A.shape == B.shape
    U is a scalar or Tensor(size==1)
    B is Tensor(dtype=bool)
    n is a Number

Signed-off-by: candanzg <zhangshucheng@huawei.com>
 2020-04-20 08:44:34 +08:00
Junhan Hu 43a2e99833 Add python sampler support for CPP dataset 2020-04-19 20:36:37 -04:00
candanzg 79c4312e89 NotEqual op auto cast 
Signed-off-by: candanzg <zhangshucheng@huawei.com>
 2020-04-19 11:41:47 +08:00
ms_yan f0c07c3fa6 Realize take op and add ut 2020-04-18 18:33:57 +08:00
mindspore-ci-bot cc08fdfd9a !420 Fix mixed precision usage when const value passed as argument 
Merge pull request !420 from amongo/FixMixedPrecisionForConstParam
 2020-04-18 10:31:33 +08:00
ougongchang 0ed6d9178e add Histogram summary operator 
clean clang format errors and cpplint errors

add some test cases for histogram summary operator
 2020-04-18 09:56:45 +08:00
mindspore-ci-bot 80333e9f55 !435 Fix dataset serialize and deserialize for MindDataset 
Merge pull request !435 from anthonyaje/fix_serdes_dataset
 2020-04-18 09:37:22 +08:00
mindspore-ci-bot d34afbd61b !400 Support math operation between float and int for scalar 
Merge pull request !400 from amongo/FixMathOps
 2020-04-18 09:34:42 +08:00
mindspore-ci-bot 40f0a4a4f4 !333 Add skip op to Dataset 
Merge pull request !333 from jiangzhiwen/dataset/skip
 2020-04-18 09:19:07 +08:00
mindspore-ci-bot 9e1b5efd1d !434 Bug in cleaning dataset iterators 
Merge pull request !434 from h.farahat/multi_itr_bug
 2020-04-18 05:17:31 +08:00
anthonyaje ea297c0889 Fix dataset serdes for MindDataset 2020-04-17 13:24:02 -04:00
hesham 3c02c82771 Bug in weak reference. 
Add new test cases
 2020-04-17 11:36:32 -04:00
jzw 3f7054dccb add skip dataset op 2020-04-17 19:48:25 +08:00
huangdongrun 7fae76d10d add support for calculation between float and int 
format code

remove test case for fp64

add back scalar manipulation

remove save graph
 2020-04-17 19:13:52 +08:00
huangdongrun 9cb665e634 add suport for parameter of const value pass as mixed precision args 
fix pylint
 2020-04-17 16:27:46 +08:00
mindspore-ci-bot 7214c04114 !402 Add parallel op for Square 
Merge pull request !402 from yangzhenzhang/square
 2020-04-17 15:06:40 +08:00
fary86 8cbbbd950e Add cell name to error message 2020-04-17 12:58:11 +08:00
yangzhenzhang 36ffb66782 add parallel op for square 2020-04-17 10:42:52 +08:00
mindspore-ci-bot 2d31ae97e8 !383 add cell psnr 
Merge pull request !383 from zhaozhenlong/cell/psnr
 2020-04-17 10:23:30 +08:00
mindspore-ci-bot 08985a1e56 !286 resolve pynative operator unsupport issue 
Merge pull request !286 from wangqiuliang/resolve-pynative-operator-issue
 2020-04-17 10:04:54 +08:00
wenkai cce61d462c histogram python dev 2020-04-17 09:42:02 +08:00
zhaozhenlong aa8fbcc06e add cell psnr 2020-04-17 09:15:51 +08:00
mindspore-ci-bot cf026096a6 !183 Mindspore.dataset CPP sampler for GeneratorDataset 
Merge pull request !183 from JunhanHu/cpp_sampler
 2020-04-16 22:30:59 +08:00
kingfo 75fec82b52 resolve pynative operator issue 2020-04-16 21:02:22 +08:00
mindspore-ci-bot d3e4dd06b0 !386 modify test_cell_bprop.py ut test_with_param 
Merge pull request !386 from changzherui/modify-ut
 2020-04-16 20:15:15 +08:00
mindspore-ci-bot 549bfb97ad !343 Fix usage of variable arguments in test framework 
Merge pull request !343 from amongo/FixGradUsingInterfaceExtend
 2020-04-16 19:42:07 +08:00
mindspore-ci-bot 31621467a4 !217 support operator ** // % for scalar and tensor, and "in" "not in" key word, and string concat 
Merge pull request !217 from zhangbuxue/support_pow_operator
 2020-04-16 18:53:47 +08:00
mindspore-ci-bot 0d0517c22d !379 Add Group normalization 
Merge pull request !379 from JichenZhao/groupnorm
 2020-04-16 17:30:12 +08:00
buxue 80978cf3cc support operator ** // % for scalar and tensor, and in not in for dict, ang str concat 2020-04-16 17:03:31 +08:00
huangdongrun efedcfb530 add test case of Bprop and tester 
add test case for grad concat

fix usage in test framework

fix testcase

format code
 2020-04-16 16:59:18 +08:00
chang zherui 8bdcd8c267 modify test_cell_bprop.py ut 2020-04-16 16:20:24 +08:00
yangzhenzhang 57cd9f8188 add parallel op for sigmoidloss 2020-04-16 14:33:24 +08:00
zhaojichen 04c522d0c6 Add Group Normalization 2020-04-16 01:59:32 -04:00
zhaojichen 0b7de6968f Add Group Normalization 2020-04-16 01:56:12 -04:00
zhaojichen ebe6efff71 Add Group Normalization 2020-04-16 01:42:32 -04:00
yangzhenzhang 6d522f0a4f add parallel op for layernorm 2020-04-15 19:30:07 +08:00
mindspore-ci-bot ba55a8ed0b !304 [Auto parallel] Change 'NOT_FULLY_USE_DEVICES' to 'FULLY_USE_DEVICES' and make ALL-1 user-specified-strategy valid in auto-parallel 
Merge pull request !304 from Xiaoda/modify-not-fully-use-devices-and-strategy-checking
 2020-04-15 17:21:45 +08:00
buxue 62807da0c4 Develop operator Unfold，take the ge backend，dock with tbe's ExtractImagePatches operator 2020-04-15 15:26:44 +08:00
Xiaoda Zhang ffb2cb03a4 Change 'NOT_FULLY_USE_DEVICES' to 'FULLY_USE_DEVICES' and make ALL-1 user-specified-strategy valid in auto-parallel 2020-04-15 10:14:46 +08:00
Junhan Hu 9739d3b048 Add CPP sampler support for GeneratorDataset 2020-04-14 12:09:03 -04:00
mindspore-ci-bot 30de261c3c !243 Support nested repeat 
Merge pull request !243 from h.farahat/nested_repeat
 2020-04-14 23:07:32 +08:00
mindspore-ci-bot fe4cde6b1e !294 Add cell ssim 
Merge pull request !294 from zhaozhenlong/cell/ssim
 2020-04-14 22:34:03 +08:00
mindspore-ci-bot 150024f089 !312 Implemention of new dataset ops: apply 
Merge pull request !312 from xiefangqi/xfq_apply_branch
 2020-04-14 22:29:07 +08:00
hesham 0fc23eee0f Support nested repeat 2020-04-14 10:13:18 -04:00
zhaozhenlong 6a2cf4b6e6 ssim impl code 2020-04-14 21:53:29 +08:00
xiefangqi 1a1cbc6814 implemention of new api: apply 2020-04-14 21:43:53 +08:00
Wei Luning e1c8f248e0 Fix the output is not tuple, when eval 2020-04-14 16:14:41 +08:00
mindspore-ci-bot f1fa2a9941 !273 [MD] update subset random sampler in minddataset 
Merge pull request !273 from liyong126/mindrecord_subset_sampler_python
 2020-04-14 11:18:36 +08:00
mindspore-ci-bot 7ffb8bb19f !250 Add nn.pad to support three modes 
Merge pull request !250 from casgj/gaojing_new4
 2020-04-14 10:56:05 +08:00
mindspore-ci-bot 60958d6b25 !239 Add dynamic learning rate decay and review optimizer code 
Merge pull request !239 from fanglei/master
 2020-04-14 09:24:25 +08:00
gaojing 2db3e64ff2 add operation 2020-04-13 10:38:03 -04:00
root 7d700295f8 add dynamic lr and enhance optim 2020-04-13 13:48:01 +00:00
liyong 0ce83e39e1 fix TestShardSampleWrongNumber 
adjust internal api
 2020-04-13 21:31:45 +08:00
mindspore-ci-bot 39a46b9342 !245 Add bool type check in communication operator 
Merge pull request !245 from chentingting/add_bool_type_check_in_comm_op
 2020-04-13 20:19:47 +08:00
mindspore-ci-bot 77725e81a4 !258 add_minimum_distributed_op 
Merge pull request !258 from lichen/add_minimum_distributed_op
 2020-04-13 20:16:08 +08:00
Wei Luning 37c94a5f76 add pass replace_old_param_ 2020-04-13 17:52:55 +08:00
c00425699 d62f560b50 add_bool_type_check_in_comm_op 2020-04-13 17:34:29 +08:00
lichenever b81cc6ea4f add minimum distributed op 2020-04-13 17:26:31 +08:00
chenzomi d64f662c76 quantization aware training frontend operators define. 2020-04-13 12:02:49 +08:00
mindspore-ci-bot 98e69fc639 !215 fix bprop cache caused error with variable params 
Merge pull request !215 from penn/fix_print_bprop_error
 2020-04-13 10:10:49 +08:00
mindspore-ci-bot 7bc2cee318 !167 add_squeeze_distributed_op 
Merge pull request !167 from lichen/add_squeeze_distributed_op
 2020-04-13 10:03:25 +08:00
c00425699 c8cdb6b331 support distributed GatherV2 operator 2020-04-12 16:00:47 +08:00
liyong 11403492ae add mindrecord subset random sampler 2020-04-11 18:48:23 +08:00
buxue 5841fe010e Support pow's second input could be tensor and fix bug in bprop of pow 2020-04-11 16:16:58 +08:00
lichenever 32cd280c1a add squeeze distributed op 2020-04-11 16:03:08 +08:00
mindspore-ci-bot 5141054ecd !220 Add parallel operator for DropoutDoMask 
Merge pull request !220 from yangzhenzhang/dropoutdomask
 2020-04-11 15:01:43 +08:00
mindspore-ci-bot 066f20e791 !169 fix the method to calculate the children graph 
Merge pull request !169 from xychow/fix-manager-children-issue
 2020-04-11 14:07:45 +08:00
yangzhenzhang b34c0e7a17 add parallel op for dropoutdomask 2020-04-11 12:11:22 +08:00
jonyguo a9443635b7 fix: mindpage enhance parameter check and search by filename failed 2020-04-11 10:19:14 +08:00
义峰潘 2bef22d8a3 fix bprop cache caused error with variable params 2020-04-10 12:21:40 +08:00
Cathy Wong 59a714c654 Correct shuffle UT buffer_size > #dataset-row as valid 2020-04-09 15:22:33 -04:00
liuxiao 0f0f83e292 modified api name Stack -> Pack, Unstack -> Unpack 2020-04-09 19:02:59 +08:00
mindspore-ci-bot 0565e4641e !185 modify comment about normal mode 
Merge pull request !185 from jinyaohui/master
 2020-04-09 14:24:28 +08:00
mindspore-ci-bot 2e6e94b2b6 !177 prelu operator support parallel on the channel 
Merge pull request !177 from yao_yf/fix_auto_parallel_prelu
 2020-04-09 14:08:41 +08:00
zhousiyi 99f22c5b85 fix children issue: missing users of the children's direct users. 2020-04-09 02:18:55 +00:00
jinyaohui 0790ef8a85 modify comment 2020-04-09 09:23:39 +08:00
mindspore-ci-bot 3e36982314 !99 Develop op MaxPoolWithArgMax 
Merge pull request !99 from zhangbuxue/Dock_MaxPoolWithArgMax
 2020-04-08 22:40:00 +08:00
mindspore-ci-bot 40d4a4baa3 !20 modify _set_dataset_mode_config api param 
Merge pull request !20 from jinyaohui/master
 2020-04-08 20:58:26 +08:00
buxue 7541d3b067 Develop op MaxPoolWithArgMax 2020-04-08 20:47:49 +08:00
yao_yf b5e3fa9593 fix auto parallel prelu 2020-04-08 20:45:08 +08:00
jinyaohui ac62faa388 modify set_dataset_mode_config api param 2020-04-08 18:30:36 +08:00
liuxiao 47d903ff57 Add pack and unpack 2020-04-08 16:58:53 +08:00
mindspore-ci-bot e6ea09082c !153 add api image_gradients 
Merge pull request !153 from zhaozhenlong/cell/image_gradients
 2020-04-08 14:55:48 +08:00
zhaozhenlong f9d180d413 add api image gradients 2020-04-08 11:50:22 +08:00
mindspore-ci-bot a24297f547 !122 Support to config whether to save integeated checkpoint, in auto model parallel scene 
Merge pull request !122 from WeibiaoYu/master
 2020-04-08 09:42:59 +08:00
WeibiaoYu 22c6baeea2 Support to config whether to save integeated checkpoint, in auto model parallel scene 2020-04-07 08:25:27 -04:00
jonyguo c688265671 fix: when use MindDataset block_reade=True hung 2020-04-07 17:53:23 +08:00
chang zherui 7696c21e65 fix runtest.sh for python ut 2020-04-07 13:10:33 +08:00
mindspore-ci-bot 5add5979e8 !92 add prim name to param check error message for math_ops.py 
Merge pull request !92 from fary86/add-prim-name-for-param-validator
 2020-04-07 10:48:10 +08:00
Wei Luning 113c0d8cd2 fix InsertGradientOf with class method 2020-04-07 02:11:35 +00:00
fary86 69ed72f10d Add primitive name to param error message for math_ops.py 2020-04-07 10:08:04 +08:00
mindspore-ci-bot 7a367af9c6 !135 fix grad missing due to indirect dependent free morphism 
Merge pull request !135 from penn/fix_free_morphism_error
 2020-04-06 10:17:13 +08:00
panyifeng 1fb776fe09 fix grad missing due to indirect dependent free morphism 2020-04-03 18:22:53 +08:00
mindspore-ci-bot 9e529f9dd0 !54 Interface change :`_Constant` to `Constant` 
Merge pull request !54 from ghzl/initializer-change-_Constant-to-Constant
 2020-04-03 17:53:51 +08:00
guohongzilong bb5320be13 iterfaces change: _Constant to Constant 2020-04-03 16:19:29 +08:00
mindspore-ci-bot 2c3c1577b1 !115 Add parallel operator for ExpandDims 
Merge pull request !115 from yangzhenzhang/expand-dim
 2020-04-03 15:54:33 +08:00
mindspore-ci-bot a5d95e472e !106 support comparison ops for python 
Merge pull request !106 from amongo/SupportPythonOperators
 2020-04-03 15:52:08 +08:00
mindspore-ci-bot acb99f6e8c !123 modify runtest.sh for python ut exec form 
Merge pull request !123 from changzherui/modify_runtest_python_ut
 2020-04-03 15:35:43 +08:00
yangzhenzhang dd0d4e6b84 add parallel ops for expand dims 2020-04-03 15:17:07 +08:00
huangdongrun 461d8e3a08 add comparison ops 
fix pylint

use scalar_lt primitive directly

fix review
 2020-04-03 09:58:41 +08:00
chang zherui 86a3398547 modify runtest py ut for parallel exec 2020-04-03 09:38:04 +08:00
xiefangqi bc4602b58e fix and remove useless import of example, st, ut 2020-04-02 22:13:36 +08:00
mindspore-ci-bot d245792842 !94 enhance: reduce execution time for mindrecord test case 
Merge pull request !94 from yanzhenxiang2020/fix_mindrecord_ut_long_time
 2020-04-02 21:50:43 +08:00
mindspore-ci-bot a5a904fbdf !91 fix bug for allreduce fusion and add resnet unit test 
Merge pull request !91 from chentingting/allreduce_fusion_resnet
 2020-04-02 21:35:35 +08:00
mindspore-ci-bot cb323eccf0 !71 Add operator adapting in ME for FloorMod, Acosh and SparseApplyFtrlD 【CR】，并主动Acosh and FloorMod operator adapting 
Merge pull request !71 from zhangzheng/sparse_acosh_floormod
 2020-04-02 21:33:33 +08:00
mindspore-ci-bot 55916351ee !52 remove ge depend 
Merge pull request !52 from flywind/remove-ge-depend
 2020-04-02 20:59:06 +08:00
zhangz0911gm 6f1747045c Add FloorMod, Acosh in ME 2020-04-02 08:50:39 -04:00
Wei Luning 73ba399364 remove ge depend in cpu 2020-04-02 19:38:42 +08:00
yanzhenxiang2020 5a4f17bfb6 fix mindrecord ut long time 2020-04-02 19:18:49 +08:00
c00425699 ab917a734d fix bug for allreduce fusion and add resnet unit test 2020-04-02 18:55:04 +08:00
mindspore-ci-bot d8b460c780 !96 fix refkey bug for auto parallel 
Merge pull request !96 from lichen/fix_ref_key_bug_for_auto_parallel
 2020-04-02 17:26:58 +08:00
lichenever 5240b1f603 fix refkey bug for auto parallel 2020-04-02 16:14:29 +08:00
mindspore-ci-bot cf54ecfe6e !62 support grad on python function with variable arguments 
Merge pull request !62 from amongo/SupportGradOnVarArgs
 2020-04-02 11:21:06 +08:00
zhaoting ed3c2d7229 add RMSProp optimizer 2020-04-02 09:10:58 +08:00
mindspore-ci-bot 5c22c088bb !69 Enable skipped dataset zip operator python unit tests 
Merge pull request !69 from cathwong/ckw_dataset_py_ut1
 2020-04-01 22:20:37 +08:00
huangdongrun d3f733fa25 support grad on graph with variable arguments 
use unpack graph primitive instead

add testcases for all grad interface

remove debug log

format code

remove dumpfuncgraph

resolve clang-format

resolve reviews

resolve cpplint

fix review
 2020-04-01 20:24:04 +08:00
mindspore-ci-bot 37dba2ddcf !74 delete longtime python ut 
Merge pull request !74 from changzherui/master
 2020-04-01 18:29:58 +08:00
mindspore-ci-bot 69d5403319 !14 add adapter for ge atan2 
Merge pull request !14 from zhaozhenlong/op/atan2
 2020-04-01 18:24:55 +08:00
mindspore-ci-bot a47046652a !76 [Auto parallel] Refining the strategy_checking for resnset50 
Merge pull request !76 from Xiaoda/modify-resnet50-strategy-checking
 2020-04-01 16:36:13 +08:00
zhaozhenlong bed5997a14 add atan2 operator 2020-04-01 16:27:35 +08:00
mindspore-ci-bot f0bcf90b5b !64 fix error while num_samples equal 0 
Merge pull request !64 from anzhengqi/fix-check-num-samples
 2020-04-01 15:48:38 +08:00
mindspore-ci-bot 22a9c00bcd !57 Add parallel operators for Neg and BatchMatMul 
Merge pull request !57 from yangzhenzhang/master
 2020-04-01 15:23:46 +08:00
Xiaoda Zhang fb6eed23ae refining strategy-checking for resnet50 2020-04-01 14:58:58 +08:00
anzhengqi 6a1b865c91 check num_samples 2020-04-01 14:39:23 +08:00
chang zherui 1de7011bc8 delete longtime python ut 2020-04-01 11:53:35 +08:00
mindspore-ci-bot 87040483ee !58 fix two cast bug in auto parallel 
Merge pull request !58 from lichen/fix_two_cast_bug_in_auto_parallel
 2020-04-01 09:54:10 +08:00
yangzhenzhang 110640e2ad add parallel ops for neg and batchmatmul 2020-04-01 09:36:38 +08:00
Cathy Wong 2e881276ab Enable skipped dataset zip python unit tests 
Signed-off-by: Cathy Wong <cathy.wong@huawei.com>
 2020-03-31 16:47:13 -04:00
mindspore-ci-bot 045a1c356c !51 add op SpaceToBatch and BatchToSpace for ge 
Merge pull request !51 from zhaozhenlong/op/space-to-batch
 2020-03-31 21:59:03 +08:00
mindspore-ci-bot e2df848597 !55 modify long time python ut 
Merge pull request !55 from changzherui/master
 2020-03-31 21:01:40 +08:00
zhaozhenlong cf40305bf0 add operator SpaceToBatch and BatchToSpace for ge 2020-03-31 20:21:47 +08:00
mindspore-ci-bot 352c6faf85 !18 enable use float type learning rate in lars optimizer 
Merge pull request !18 from gziyan/master
 2020-03-31 18:54:55 +08:00
lichenever 2da38ad401 fix two cast bug in auto parallel 2020-03-31 18:54:21 +08:00
chang zherui eaf7146d46 modify longtime python ut 2020-03-31 16:18:04 +08:00
lichenever f946aea10d fix grpah mode loop sink bug in auto parallel 2020-03-31 16:16:53 +08:00
mindspore-ci-bot 6f03881b04 !39 add op Diag and DiagPart 
Merge pull request !39 from zhaozhenlong/op/diag
 2020-03-31 14:45:44 +08:00
leonwanghui 976af212e9 回退 'Pull Request !17 : [AutoParallel]Fix bug in the case of two cast' 2020-03-31 10:27:40 +08:00
mindspore-ci-bot 140a15924c !17 [AutoParallel]Fix bug in the case of two cast 
Merge pull request !17 from lichen/fix_cast_bug
 2020-03-31 10:25:04 +08:00
mindspore-ci-bot e9be3483fe !33 Optimize the execution time of test case test_rgb_hsv.py 
Merge pull request !33 from qianlong21st/ql/fix_test_rgb_hsv
 2020-03-31 09:53:01 +08:00
zhaozhenlong b12e6ff780 add operator diag and diag_part 2020-03-31 09:44:56 +08:00
mindspore-ci-bot c1c8fef9ca !24 Change strategy for structure output 
Merge pull request !24 from 步学/structure-output
 2020-03-31 09:38:44 +08:00
qianlong 8c88b39da1 Optimize the execution time of test case test_rgb_hsv.py 2020-03-31 09:23:20 +08:00
lichenever b4d34973bc fix_cast_bug 2020-03-30 21:13:45 +08:00
buxue 0da0bdcf40 Fix bug structure output when there is depend whose first input is constant in outputs 2020-03-30 19:49:46 +08:00
Ziyan 4cbcd8e907 enable use float type learning rate in lars optimizer 2020-03-30 19:05:33 +08:00
jonyguo 34e42bd6f9 1. add more log info for dataset & mindrecord, 2. add two new testcase for MindDataset 2020-03-30 17:24:24 +08:00
zhunaipan 930a1fb0a8 initial version 
Signed-off-by: leonwanghui <leon.wanghui@huawei.com>
 2020-03-27 22:54:54 +08:00