Commit Graph

2263 Commits

Author SHA1 Message Date
xiefangqi a6360cb2e4 add output_numpy validation to iterator 2020-09-19 11:56:24 +08:00
yanghaitao1 dd0d9fe9ab fix ci error 2020-09-18 23:49:20 -04:00
kpy 44c01e27c0 do mixprecision in c++ for pynative 2020-09-19 10:38:09 +08:00
mindspore-ci-bot 1cfad93704 !6479 fix bucket_batch_by_length show pyfunc timeout
Merge pull request !6479 from yanghaitao/yht_bucket_batch_ci
2020-09-19 09:30:43 +08:00
lichenever d4bba3f1d2 fix_auto_parallel_find_loss_bug 2020-09-18 20:27:33 +08:00
yanghaitao1 da15495d7b fix bucket_batch ci error 2020-09-18 08:16:14 -04:00
mindspore-ci-bot 4d54de100b !6411 [Auto parallel] Add a flag to control whether to overwrite the right-node in triangle-elimination of DP algorithm
Merge pull request !6411 from Xiaoda/23-fix-the-triangle-elimination-problem
2020-09-18 19:32:37 +08:00
Xiaoda Zhang 970490a6f0 add a flag to control whether overwrite the right-node in triangle elimination of DP algorithm 2020-09-18 15:37:18 +08:00
mindspore-ci-bot 8346da267b !6400 add overflow check for make_range and optimize isinstance processing
Merge pull request !6400 from zhangbuxue/add_overflow_check_for_make_range_and_optimize_isinstance_processing
2020-09-18 11:07:12 +08:00
mindspore-ci-bot d8d2a70cb3 !6344 [AutoParallel]fix auto parallel multigraph bug
Merge pull request !6344 from lichen/fix_auto_parallel_mutigraph_bug
2020-09-17 20:30:32 +08:00
buxue 14f6c95c28 add overflow check for make_range and optimize isinstance processing 2020-09-17 19:47:10 +08:00
lichenever 6b2a9de09f fix auto parallel mutigrpah bug 2020-09-17 14:51:14 +08:00
mindspore-ci-bot c57a472748 !5918 optimizer pynative memory
Merge pull request !5918 from flywind/optimizer_pynative_memory
2020-09-17 09:44:36 +08:00
mindspore-ci-bot 5e43308613 !6365 Refactoring Laplace random operator.
Merge pull request !6365 from jxlang910/push-to-opensource
2020-09-17 09:16:36 +08:00
mindspore-ci-bot 72d5256d1c !6332 check wether full_batch valid
Merge pull request !6332 from yihuaijie/master
2020-09-17 09:09:32 +08:00
jin-xiulang 5873614b86 Refactoring laplace random operator. 2020-09-16 18:40:31 +08:00
buxue 458498900c support not in and add check for grad_with_sens with no sense provide. 2020-09-16 17:28:17 +08:00
kpy 4338dd266e optimizer pynative graph memory 2020-09-16 16:14:05 +08:00
mindspore-ci-bot 111efc7538 !6248 change the API interface of op ConfusionMulGrad
Merge pull request !6248 from lihongkang/v2_master
2020-09-16 14:55:05 +08:00
Yi Huaijie e4cd67596f raise RuntimeError when using full_batch neither under semi_auto_parallel nor auto_parallel 2020-09-16 14:51:09 +08:00
mindspore-ci-bot 3fe8916afa !6241 [bug]add doc for some Parameter property & fix bug for `Isinstance`
Merge pull request !6241 from vlne-v1/I1V5VO-fix-isinstance
2020-09-16 10:13:30 +08:00
mindspore-ci-bot bef2118253 !6300 [MD] fix get_dataset_size bug when set num_samples in DistributedSampler
Merge pull request !6300 from liyong126/fix_md_num_samples
2020-09-16 09:56:53 +08:00
mindspore-ci-bot 0d486adef1 !3974 Eliminate the pause for each cycle of the Repeat
Merge pull request !3974 from lixiachen/repeat_task2
2020-09-16 09:35:39 +08:00
mindspore-ci-bot 14b4763b15 !6224 Move pp test cases to probability folder
Merge pull request !6224 from XunDeng/pp_tests_folder_update
2020-09-16 08:57:01 +08:00
liyong 930e85ed5c fix get_dataset_size in distributedSampler & num_samples 2020-09-15 22:53:57 +08:00
Wei Luning 8d17a2b8af * add doc for some Parameter property.* add export in quant __all__* fix bug for isinstance & add ut for it 2020-09-15 18:25:12 +08:00
lihongkang 74e3adebb8 change api interface 2020-09-15 15:25:28 +08:00
buxue c3c06514d7 perfect annotation of ops and context and support bool equal 2020-09-15 14:32:02 +08:00
mindspore-ci-bot b83d921735 !3317 add check for stridedslice when choose aicpu or aicore
Merge pull request !3317 from zhangbuxue/add_check_for_stridedslice_when_choose_aicpu_or_aicore
2020-09-15 10:37:09 +08:00
mindspore-ci-bot 7a5ef7894d !6227 dataset API docstring: Update datasets and text desc and examples
Merge pull request !6227 from cathwong/ckw_api_engine
2020-09-15 10:29:11 +08:00
mindspore-ci-bot 2b05208a6f !6153 [AutoParallel]Check device target in init
Merge pull request !6153 from lichen/add_checks_for_init
2020-09-15 09:34:56 +08:00
Cathy Wong f7adf648e9 dataset API docstring: Update datasets, samplers, graphdata and text 2020-09-14 18:10:44 -04:00
Xun Deng c64f6a0a2a move pp related tests cases to probability folder 2020-09-14 13:29:43 -04:00
mindspore-ci-bot d0e49c5cf8 !6192 Improve the functions of class SequentialCell and add examples
Merge pull request !6192 from lijiaqi/sequentialcell
2020-09-14 23:24:04 +08:00
mindspore-ci-bot 1b956c77e0 !6155 modify path of ut and st of mdp
Merge pull request !6155 from byweng/master
2020-09-14 22:30:52 +08:00
Lixia Chen b5b333726f Leaf ops do self-reset. 2020-09-14 09:48:14 -04:00
Jiaqi 76cec24098 modify sequentialcell 2020-09-14 17:13:47 +08:00
mindspore-ci-bot 9824d0b20f !6142 MindData fix batch ops issue
Merge pull request !6142 from xiefangqi/md_fix_map_issue
2020-09-14 16:00:23 +08:00
lichenever aaf7045cdf add checks for init 2020-09-14 14:40:41 +08:00
bingyaweng 866a8a1178 modify path of ut and st of mdp 2020-09-14 11:23:55 +08:00
mindspore-ci-bot 37e3b6082f !6002 Reduce inline passes traversal by skipping inline action if no pre-ad python pass exists
Merge pull request !6002 from BowenK/pre_ad
2020-09-14 10:16:56 +08:00
xiefangqi 653c79b4af md fix per_batch_map issue 2020-09-14 09:55:51 +08:00
mindspore-ci-bot a9a3d5a1f5 !5753 remove sens parameter
Merge pull request !5753 from lijiaqi/loss_scale_sens
2020-09-13 17:27:27 +08:00
mindspore-ci-bot c10341dfb7 !6020 Add common check_param_type and set_param_type in distribution
Merge pull request !6020 from XunDeng/new_check_param
2020-09-13 13:54:39 +08:00
Jiaqi 94d63b90f4 remove sens parameter 2020-09-13 11:34:56 +08:00
mindspore-ci-bot 02c6852699 !6108 add model with loss test case
Merge pull request !6108 from hanyang/master
2020-09-12 16:58:23 +08:00
mindspore-ci-bot 8bf5ac1c15 !6032 [bug]add import for ops in ops.py in __init__
Merge pull request !6032 from vlne-v1/change_ops_import
2020-09-12 16:57:15 +08:00
Wei Luning 7b6899fdc0 add import of ops in in ops __init__ 2020-09-12 15:29:43 +08:00
liyong 16147669a6 fix num_samples in concatDataset 2020-09-12 15:06:18 +08:00
Wan Hanyang 0b7570eb53 add model with loss, without loso and o2 test case 2020-09-12 14:26:40 +08:00
mindspore-ci-bot 3c0aa0a6e4 !6069 support function as condition of if
Merge pull request !6069 from zhangbuxue/support_function_as_condition_of_if
2020-09-12 12:39:15 +08:00
mindspore-ci-bot eb049b0e93 !5842 [Dataset] dataset op log changes
Merge pull request !5842 from luoyang/pylint
2020-09-12 09:42:42 +08:00
mindspore-ci-bot 28e2b0253e !6086 Order dict by column_id in create_dict_iterator()
Merge pull request !6086 from ZiruiWu/order_dict_in_create_dict_iterator
2020-09-12 08:41:46 +08:00
Xun Deng 67325d63b0 edited common_dtype and check_param dtype logic 2020-09-11 16:51:19 -04:00
Zirui Wu d54ba374b9 order dict by column_id in create_dict_iterator()
fix CI
2020-09-11 15:33:47 -04:00
YangLuo f5a85510f2 [MD] dataset op log changes 2020-09-12 00:43:36 +08:00
nhussain 96de2ffdb6 fix errors from old compose call in Python 2020-09-11 10:30:23 -04:00
mindspore-ci-bot d8c09067ce !5801 [MD][Feature] minddata iterator output ms_tensor
Merge pull request !5801 from xiefangqi/md_modify_output_tensor
2020-09-11 20:19:06 +08:00
buxue b9c9046b93 support function as condition of if 2020-09-11 17:43:07 +08:00
Wan Hanyang 2ceea1e59d add a self attention test case 2020-09-11 16:30:28 +08:00
mindspore-ci-bot 5b4642d10a !4950 Fixing Minddata profiling monitor
Merge pull request !4950 from anthonyaje/monitor_fix
2020-09-11 14:34:27 +08:00
mindspore-ci-bot 48b337f206 !6026 fix some test case
Merge pull request !6026 from suteng/master
2020-09-11 14:09:11 +08:00
xiefangqi 9b3c33e157 minddata iterator output ms_tensor 2020-09-11 11:35:50 +08:00
mindspore-ci-bot cf7d6eddc4 !6019 [MD] Move Random(Choice/Apply/Order) from vision to transforms module
Merge pull request !6019 from nhussain/move_random_choice_apply
2020-09-11 10:37:21 +08:00
Su Teng 7b46f46a65 remove unuse test 2020-09-11 10:16:56 +08:00
buxue 08059f5c61 add check for stridedslice when choose aicpu or aicore 2020-09-11 10:11:14 +08:00
mindspore-ci-bot dd215f4080 !5735 delete seed0 and seed1
Merge pull request !5735 from caozhou/delete_seed
2020-09-11 09:58:56 +08:00
mindspore-ci-bot f1979f8fe5 !5998 change internal API _get_strategy() to _get_shard_strategy()
Merge pull request !5998 from yihuaijie/master
2020-09-11 09:15:18 +08:00
mindspore-ci-bot a778868a5a !5929 BucketBatchByLength column issue
Merge pull request !5929 from MahdiRahmaniHanzaki/bucket_batch_by_length_fix
2020-09-11 05:53:48 +08:00
nhussain f42f9ef9d7 move random apply order and choice ops 2020-09-10 15:39:56 -04:00
nhussain 92e99ff224 change map calls 2020-09-10 10:25:05 -04:00
mindspore-ci-bot eedbbb3649 !5958 Modify interface for function and remove duplicated def
Merge pull request !5958 from lilei/modify_bug
2020-09-10 21:22:32 +08:00
BowenK e482e4e8bf reduce pass traversals if no pre-ad python pass exists 2020-09-10 20:00:10 +08:00
mindspore-ci-bot 2f529c149a !5991 Change API set_strategy() to shard()
Merge pull request !5991 from yihuaijie/master
2020-09-10 19:17:32 +08:00
Yi Huaijie eb83ea9607 change internal API _get_strategy() to _get_shard_strategy() 2020-09-10 17:46:53 +08:00
Yi Huaijie a836d25c64 change API set_strategy() to shard() 2020-09-10 15:30:19 +08:00
anthonyaje 2d08d83247 Fixed connector_size and monitor. 2020-09-09 17:54:59 -04:00
Zirui Wu 1bb93580dd Add usage flag to MNIST/CIFAR
ci fix 1

fix ci 2

fix ci 3

fix ci 4

fix ci 5

fix ci 6

fix ci 7

change var name in CelebA from dataset_type to usage

address review cmts

fix cpp ut fail

change mode to usage in VOCDataset

fix cmts

fix ci test case fail
2020-09-09 09:59:55 -04:00
lilei 71adabd944 modify_bug 2020-09-09 18:20:32 +08:00
Wei Luning 249382899b fix bug in cell pickle and copy 2020-09-09 15:33:56 +08:00
mindspore-ci-bot 2350a5990b !5885 [doc]add some document for composite op
Merge pull request !5885 from vlne-v1/add-doc-for-composite-op
2020-09-09 14:13:23 +08:00
mindspore-ci-bot eff187d83d !5806 [MD] minddata delete set_dataset_size interface
Merge pull request !5806 from xiefangqi/md_delete_setdatasetsize
2020-09-09 11:50:52 +08:00
mindspore-ci-bot 0aa9f900dd !5749 Support multi grad
Merge pull request !5749 from amongo/SupportPyantiveMultiGrad
2020-09-09 10:31:35 +08:00
Wei Luning 8c6475fd0b add composite op doc 2020-09-09 10:18:49 +08:00
xiefangqi d0410d6191 md delete set_dataset_size interface 2020-09-09 09:56:03 +08:00
mindspore-ci-bot c45f79d36b !5384 [MD]-Api changes
Merge pull request !5384 from nhussain/api_changes
2020-09-09 09:49:05 +08:00
mindspore-ci-bot 88f5cbe5db !5692 Add requires_grad option for python pass
Merge pull request !5692 from BowenK/pre_ad
2020-09-09 09:28:52 +08:00
mahdi a152a65227 Fixed the column problem in BucketBatchByLength 2020-09-08 17:48:42 -04:00
Zirui Wu bde9f18f5a update lookup api to take in a type
ci

add test case

address some of the review cmts

address review cmts
2020-09-08 11:59:28 -04:00
nhussain 3bac9d3713 switch input columns and operation
change ImagefolderDV2 name

change ds.transforms.vision to ds.vision

change batch api to match map api more closely

compose op changes

test_pylint

remove compose op from vision, move to transform module, refactor map and batch to use column_order
2020-09-08 10:26:20 -04:00
huangdongrun 341b8468eb add support for pynative multicases
clear df builder

add testcases
2020-09-08 16:09:48 +08:00
mindspore-ci-bot f984518150 !5872 remove timeout exception test case
Merge pull request !5872 from zhangbuxue/remove_timeout_exception_test_case
2020-09-08 14:11:06 +08:00
mindspore-ci-bot b40677002f !5714 [refine]change top graph and add cell class
Merge pull request !5714 from vlne-v1/change-top-graph
2020-09-08 11:56:36 +08:00
caozhou 6509fa9023 delete seed0 and seed1 in Dropout 2020-09-08 10:51:12 +08:00
buxue 1ae9da85e0 remove timeout exception test case 2020-09-08 10:34:22 +08:00
mindspore-ci-bot ad186e79d8 !5599 Collect input data when `dataset_sink_mode` set on GPU
Merge pull request !5599 from LiHongzhang/dataset_sink_mode
2020-09-08 10:21:33 +08:00
Wei Luning e6f82af849 add cell class to c++ 2020-09-07 21:06:07 +08:00
Li Hongzhang 066950f69e GPU dataset_sink_mode collect inputs 2020-09-07 17:12:36 +08:00
lichenever f2d3fd34ce rectification_allreduce_fusion_api 2020-09-07 16:38:58 +08:00
mindspore-ci-bot 77dd91a646 !5669 Fix get_py_obj_dtype() for mindspore type
Merge pull request !5669 from hewei/fix_get_py_obj_dtype
2020-09-07 08:59:01 +08:00
mindspore-ci-bot 5c7fa52468 !5673 [performance]cell init opt performance
Merge pull request !5673 from kingxian/master
2020-09-05 17:10:08 +08:00
kingxian 92bebe65a9 cell init performance opt 2020-09-04 19:52:56 +08:00
yao_yf d4cfe55c04 rename mirror_mean to gradients_mean 2020-09-04 14:47:36 +08:00
BowenK 1bdb26f9e8 Warming up python pass by adding inline passes before it 2020-09-04 14:26:17 +08:00
mindspore-ci-bot 9018737e99 !5696 [Auto parallel] Move 'multi-subgraphs' interface to internal
Merge pull request !5696 from Xiaoda/20-moving-multi-graph-interface-internal
2020-09-04 11:17:28 +08:00
mindspore-ci-bot c064c01b6b !5729 [AutoParallel]Add FuseBatchNormEx op
Merge pull request !5729 from lichen/add_batchnormex_op
2020-09-04 11:17:22 +08:00
mindspore-ci-bot 7786adc3aa !5722 fix semi auto parallel parameter of reshape has another user
Merge pull request !5722 from yao_yf/semi_auto_parallel_reshape_parameter_has_another_user
2020-09-04 09:45:41 +08:00
mindspore-ci-bot d76ac7c6e8 !5648 GetColumnNames for Python
Merge pull request !5648 from MahdiRahmaniHanzaki/get-col-name
2020-09-03 22:37:42 +08:00
lichenever d22f506431 add BatchNormEx op 2020-09-03 22:22:19 +08:00
mindspore-ci-bot 527d7f0afb !5580 [MD] remove finish in FileReader
Merge pull request !5580 from liyong126/rmv_filereader_finish
2020-09-03 21:18:35 +08:00
yao_yf 05c003ae6b origin/semi_auto_parallel_reshape_parameter_has_another_user 2020-09-03 20:27:46 +08:00
mindspore-ci-bot fc79997de5 !5502 Mod SoftmaxCrossEntropyWithlogits
Merge pull request !5502 from wanyiming/mod_SoftmaxCrossEntropyWithlogits
2020-09-03 20:24:43 +08:00
liyong ac39c20f41 del finish in FileReader 2020-09-03 20:05:38 +08:00
Xiaoda Zhang 42f1241270 remove 'multi-subgraphs' to internal 2020-09-03 19:07:08 +08:00
wanyiming 0ec70068ae mod_SoftmaxCrossEntropyWithLogits 2020-09-03 17:33:20 +08:00
mindspore-ci-bot 290979853e !5663 add check for mod when y in (-1, 0)
Merge pull request !5663 from zhangbuxue/add_check_for_mod_for_y
2020-09-03 09:16:45 +08:00
mindspore-ci-bot 021ba724cf !5645 [bug][api]updata signature
Merge pull request !5645 from vlne-v1/ref_demo
2020-09-03 09:11:50 +08:00
Mahdi 6e7aab8c4f Added GetColumnNames for Datasets 2020-09-02 17:12:48 -04:00
Cathy Wong 4d4c11b133 dataset API docstring cleanup: Standard product terms NumPy, Python 2020-09-02 10:42:12 -04:00
mindspore-ci-bot 35e6cca1a3 !5634 wrap numpy random seed into an api
Merge pull request !5634 from yihuaijie/master
2020-09-02 19:28:33 +08:00
buxue 4d59fe9ee1 add check for mod when y in (-1, 0) 2020-09-02 18:10:00 +08:00
Wei Luning 879a519136 updata signature 2020-09-02 17:29:29 +08:00
Yi Huaijie 4a5d115a66 add get_seed() and set_seed() 2020-09-02 17:17:04 +08:00
He Wei c1469d61ce Fix get_py_obj_dtype() for mindspore type
Return mstype.type_type if input is mindspore type object,
for example:
```
get_py_obj_dtype(mstype.float32) ---> mstype.type_type
```
2020-09-02 16:14:25 +08:00
mindspore-ci-bot ccc0ea60ee !5661 fix auto parallel reshape strategy set when it is first operator
Merge pull request !5661 from yao_yf/auto_parallel_reshape_fix
2020-09-02 15:42:47 +08:00
mindspore-ci-bot 847fadc8b9 !5516 auto parallel context modify
Merge pull request !5516 from yao_yf/auto_parallel_context_collation
2020-09-02 15:41:05 +08:00
mindspore-ci-bot bb84f50407 !5473 optim pylint
Merge pull request !5473 from jinyaohui/master
2020-09-02 15:25:30 +08:00
mindspore-ci-bot 4ec343961e !5482 modify save_checkpoint
Merge pull request !5482 from liuyang/md_save_checkpoint
2020-09-02 14:20:48 +08:00
yao_yf 755f381406 fix auto parallel reshape strategy set when it is first operator 2020-09-02 14:15:54 +08:00
mindspore-ci-bot 03093778df !5387 Set num_epochs=1 for MindData python testcases
Merge pull request !5387 from lixiachen/testcase_epoch
2020-09-02 09:45:13 +08:00
mindspore-ci-bot be3d79cb6b !4204 add dynamic shape support for GatherV2 and others
Merge pull request !4204 from fary86/adapt_primitive_dynamic_shape
2020-09-02 09:31:14 +08:00
Lixia Chen 27d5281641 Change epoch count to 1 for python testcases 2020-09-01 11:24:26 -04:00
buxue 359e1f236e check user define bprop when there is parameter in nested network 2020-09-01 21:24:27 +08:00
fary86 144a35b17e Adapt GatherV2 for dynamic shape 2020-09-01 19:24:21 +08:00
mindspore-ci-bot 8f3ebfd469 !5624 Optimize the performance of GraphData.get_neg_sampled_neighbors
Merge pull request !5624 from heleiwang/gnn_perf
2020-09-01 19:22:53 +08:00
heleiwang 857cf2f77f Optimize the negative sampling process 2020-09-01 16:29:59 +08:00
mindspore-ci-bot c2fddb56c8 !4922 Transform tuple parameter to multiple parameters
Merge pull request !4922 from amongo/TupleTransform
2020-09-01 15:15:56 +08:00
huangdongrun 0099da2c99 add support for tuple parameter transform
add support for pynative pass

add testcases
2020-09-01 14:17:52 +08:00
mindspore-ci-bot 5453b40311 !4477 add dataset compare function to utils
Merge pull request !4477 from tony_liu2/staging
2020-09-01 11:15:18 +08:00
mindspore-ci-bot ab29dbf98b !5385 dataset fixes: Update OneHot API doc; fixup UTs
Merge pull request !5385 from cathwong/ckw_dataset_ut_cleanup8
2020-09-01 11:11:49 +08:00
mindspore-ci-bot 8ebc8ce9c6 !5438 support parameter tuple input in pynative mode
Merge pull request !5438 from wangqiuliang/support-parameter-tuple-input
2020-09-01 11:04:03 +08:00
mindspore-ci-bot 1a4d3e351e !5586 Boost python pass compile and train performance
Merge pull request !5586 from BowenK/performance
2020-09-01 09:19:02 +08:00
Cathy Wong 7f6782be2a dataset fixes: Update OneHot API docs; fixup Python UTs 2020-08-31 15:04:26 -04:00
mindspore-ci-bot 65819fb50c !5488 heck arg is tensor when graph output is a const or parameter
Merge pull request !5488 from zhangbuxue/add_check_tensor_before_compile_graph
2020-08-31 21:36:04 +08:00
yao_yf 8f7aa5bd5a auto parallel context modify 2020-08-31 21:19:49 +08:00
kingfo 7765d44b76 support parameter tuple input in pynative mode 2020-08-31 20:38:43 +08:00
BowenK d6fb7d2db1 Remove debug drawing and printing to boost compile performance; re-opt after python pass to boost training; fix NewParameter tensor clone 2020-08-31 17:42:00 +08:00
buxue 4168c51f0d add check tensor when graph output is a const or parameter 2020-08-31 17:17:24 +08:00
liuyang_655 4683de3443 modify save_checkpoint 2020-08-31 16:24:57 +08:00
jinyaohui a9972a7def optim pylint 2020-08-31 14:49:57 +08:00
mindspore-ci-bot 4d963d96f4 !5534 Fix Tensor.from_numpy() returns wrong type
Merge pull request !5534 from hewei/fix_tensor_from_numpy
2020-08-31 09:15:48 +08:00
He Wei 27721ff4ea Fix Tensor.from_numpy() returns wrong type
Tensor.from_numpy() should return mindspore.Tensor not _c_expression.Tensor.
2020-08-29 19:05:44 +08:00
mindspore-ci-bot e6a4d932b4 !5350 [AutoParallel]Rectification distributed init
Merge pull request !5350 from lichen/rectification_init
2020-08-29 14:55:18 +08:00
mindspore-ci-bot be606ba8f5 !5432 Mindspore parallel supports all elementary-wise operators
Merge pull request !5432 from yihuaijie/master
2020-08-29 14:16:48 +08:00
lichenever d3e55b543e rectification init 2020-08-29 09:34:58 +08:00
Yi Huaijie 84948ca730 parallel supports more elementary-wise operators 2020-08-28 18:19:06 +08:00
mindspore-ci-bot 414184c184 !5367 Check the parameter's split strategies if it has multiple users
Merge pull request !5367 from yangzhenzhang/check-parameter-split
2020-08-28 16:26:46 +08:00
mindspore-ci-bot 820f2cb4eb !5351 move ParalleMode to Context
Merge pull request !5351 from yao_yf/parallel_context_collation
2020-08-28 16:13:01 +08:00
yao_yf 07117e4dd4 mv ParallelMode to context 2020-08-28 19:13:55 +08:00
He Wei d7cdda1cb0 Provide Tensor.from_numpy() to avoid copy 2020-08-28 11:03:14 +08:00
yangzhenzhang fbda03bbcc check parameter split 2020-08-28 10:49:27 +08:00
tony_liu2 70bfd506a1 add function
pr comment fix

revert graphengine
2020-08-27 16:50:19 -04:00
mindspore-ci-bot 7aaf4118bf !5297 CutMixBatch and MixUpBatch fix for 2D one-hot labels
Merge pull request !5297 from MahdiRahmaniHanzaki/cutmix-fix
2020-08-27 21:32:09 +08:00
mindspore-ci-bot 9392623066 !5181 Python pass pattern renaming and interface tweaking
Merge pull request !5181 from BowenK/new_parameter
2020-08-27 19:45:36 +08:00
mindspore-ci-bot e94416be0c !5283 Support setting operator io format in the frontend
Merge pull request !5283 from liangchenghui/io_format
2020-08-27 15:48:13 +08:00
mindspore-ci-bot fabebb2678 !5264 [bug]fix bugs when parameters updata
Merge pull request !5264 from vlne-v1/I1SP3I-return-value-not-the-exact-value
2020-08-27 14:13:20 +08:00
mindspore-ci-bot b346f0b3ec !5026 Fix the problem of resource clear
Merge pull request !5026 from Simson/enhancement-API
2020-08-27 11:19:02 +08:00
simson d4babf190c fix risk of memory leak 2020-08-27 10:54:06 +08:00
BowenK 641d12d6d9 python pass pattern renaming and interface tweaking 2020-08-27 10:03:46 +08:00
mindspore-ci-bot 66d6320b21 !5224 Add test case about loss scale in parallel mode
Merge pull request !5224 from yangzhenzhang/add-split-sens-and-loss-scale-test-case
2020-08-27 09:06:01 +08:00
mahdi 7ad7024c45 Fixed 2D one-hot label problems in CutMix and MixUp 2020-08-26 16:17:21 -04:00
islam_amin 94a4a3f20b changing affine and posterize apis 2020-08-26 10:51:54 -04:00
Wei Luning 4cc8342b5b fix bug in Parameter init_data 2020-08-26 22:15:22 +08:00
梁成辉 34d433fd9a Set io format for old backend 2020-08-26 20:49:15 +08:00
kpy 44b738e8ac fix grad all ci bug 2020-08-26 18:28:35 +08:00
mindspore-ci-bot 314c5ad055 !5172 remove name arg from gradoperation
Merge pull request !5172 from riemann_penn/remove_name_args_from_gradoperation
2020-08-26 16:55:57 +08:00
mindspore-ci-bot 95212b55a0 !3271 make reftype a subtype of MetaTensor and try to mark ref in node input
Merge pull request !3271 from vlne-v1/ref_demo
2020-08-26 15:45:48 +08:00
yangzhenzhang 6ae5893681 add test cases 2020-08-26 15:11:44 +08:00
Wei Luning 24a10225cf change base class of ref to tensor in cpp 2020-08-26 12:41:25 +08:00
mindspore-ci-bot e4d2f2fd3b !5030 Adding a BBox class and fixing Posterize C Op testing.
Merge pull request !5030 from islam_amin/bbox_class
2020-08-26 11:40:57 +08:00
panyifeng 1a54785fe2 remove name arg from gradoperation 2020-08-26 11:16:57 +08:00
mindspore-ci-bot 20b3134785 !5184 fix: padded dataset when no div and with repeat op
Merge pull request !5184 from guozhijian/fix_padded_with_no_div_repeat
2020-08-26 10:47:22 +08:00
mindspore-ci-bot f3fd7a5578 !5073 Add checks and exception handling DS callback
Merge pull request !5073 from h.farahat/map_callback_end
2020-08-26 10:40:40 +08:00
jonyguo 6df1a43ec2 fix: padded dataset with non div & repeat 2020-08-26 08:56:37 +08:00
mindspore-ci-bot 971716f4b9 !5136 fix large for loop runtime error due to lacking of backend operators
Merge pull request !5136 from fary86/fix_large_for_runtime_error
2020-08-25 22:26:25 +08:00
mindspore-ci-bot 346b97acb8 !5156 fix softdvpp coredump
Merge pull request !5156 from qianlong21st/master_fix_softdvpp_core
2020-08-25 22:20:00 +08:00
qianlong 12dfca71f1 fix softdvpp coredump 2020-08-25 18:56:40 +08:00
YangLuo 67f5c89cd6 Check input image type for random posterize 2020-08-25 16:26:17 +08:00
fary86 8d245497a4 Fix large for loop Runtime Error due to backend missing operators 2020-08-25 16:25:41 +08:00
huangdongrun 113641decd fix test cases 2020-08-25 14:38:08 +08:00
mindspore-ci-bot 7d4f481884 !5017 remove internal interface in wide&deep
Merge pull request !5017 from yao_yf/wide_and_deep_no_internal_interface
2020-08-25 14:11:51 +08:00
mindspore-ci-bot 957126375b !5095 Adding Float tensor support for CutMixBatch
Merge pull request !5095 from MahdiRahmaniHanzaki/cutmix-fix
2020-08-25 10:53:58 +08:00
mindspore-ci-bot afd16fbf0a !4963 fix bug of switch layer join
Merge pull request !4963 from fary86/fix_switch_layer_join_bug
2020-08-25 10:47:32 +08:00
mindspore-ci-bot abe6b82138 !5011 remove global grad ops
Merge pull request !5011 from riemann_penn/remove_global_grad_ops
2020-08-25 09:47:55 +08:00
fary86 947e19b839 Fix bug of switch layer join 2020-08-25 09:08:53 +08:00
islam_amin 641e751d5e adding bbox class 2020-08-24 18:22:58 -04:00
Mahdi a2c38d89f9 Added float32 support for CutMixBatch 2020-08-24 17:15:25 -04:00
hesham 8eeceb267b - release the wait if training is ended 2020-08-24 13:11:07 -04:00
yao_yf a9a8e323b2 remove internal interface in wide&deep 2020-08-24 19:18:47 +08:00
mindspore-ci-bot 4f6e63fcf8 !4576 Support if by if not inline
Merge pull request !4576 from amongo/SupportIfByIfNotInline
2020-08-24 19:15:39 +08:00
mindspore-ci-bot fc6eee3bda !5019 raise RuntimeError when set different mode after Initializer created
Merge pull request !5019 from yihuaijie/dev
2020-08-24 18:49:32 +08:00
huangdongrun 1bd9fefd84 support if by if not inline
add testcase of net of if by if
2020-08-24 17:11:26 +08:00
panyifeng 637e812347 remove global grad ops 2020-08-24 16:50:09 +08:00
mindspore-ci-bot 226f019e45 !4888 add parallel attention test
Merge pull request !4888 from hanyang/master
2020-08-24 15:50:56 +08:00
Yi Huaijie 394be43492 raise RuntimeError when set different mode after Initializer created 2020-08-24 14:08:09 +08:00
mindspore-ci-bot 8d693306f4 !4126 Add new parameter
Merge pull request !4126 from BowenK/new_parameter
2020-08-24 10:01:46 +08:00
Zichun Ye 9e7d6e2397 fix bernoulli prob formula; fix some other minor bugs
update threshold of softplus computation

support fp for bernoulli and geometric distribution
2020-08-23 17:49:09 -04:00
mindspore-ci-bot 94a109f476 !4898 Fix coredump caused by function call depth too large
Merge pull request !4898 from fary86/fix_call_depth_too_large
2020-08-22 16:08:27 +08:00
fary86 04524b6bd3 Fix coredump caused by function call depth too large 2020-08-22 15:00:04 +08:00
mindspore-ci-bot ac81886328 !4916 fix generator_dataset hangs and test_graphdata_distributed.py failing randomly
Merge pull request !4916 from heleiwang/gnn_fix_bug
2020-08-22 10:51:01 +08:00
mindspore-ci-bot b366608a3f !4952 Fix errors in log calculation logics
Merge pull request !4952 from peixu_ren/custom_pp_ops
2020-08-22 10:40:40 +08:00
mindspore-ci-bot 9b503e4f38 !4955 Fixes for Dynamic Augmentation Ops
Merge pull request !4955 from MahdiRahmaniHanzaki/dynamic-ops-fix
2020-08-22 10:27:50 +08:00
peixu_ren 1c8eb9b15d Fix errors in log calculation logics 2020-08-21 21:28:10 -04:00
Mahdi a5f9b8f92e Added fix for MixUpBatch and CutMixBatch and for RandomAffine
updated c color op descriptions
2020-08-21 17:40:08 -04:00
mindspore-ci-bot 9d7250c483 !4776 Introduce 2 extra ctrl flags to DataBuffer in dataset, address remaining cmts to PR4632
Merge pull request !4776 from ZiruiWu/map_callback_follow_up
2020-08-22 03:31:31 +08:00
Zirui Wu 74c1e6da60 introducing pause and quit flags to DataBuffer
fix review cmts

fix ci

fix Ci

fixci

address ci

ci

- add timeout
- add more test cases

fix CI

address review cmts
2020-08-21 14:33:26 -04:00
mindspore-ci-bot 82c888f065 !4930 Fix CI cifar hang issue
Merge pull request !4930 from xiefangqi/fix_cifar_nofile_issue
2020-08-21 20:49:40 +08:00
xiefangqi e3e7820413 fix cifar stuck problem 2020-08-21 19:35:07 +08:00
mindspore-ci-bot 0d1a7ac654 !4909 [bug]support implicit type conversion for parameter
Merge pull request !4909 from vlne-v1/I1QM7L-implicit-type-conversion-parameter
2020-08-21 17:08:23 +08:00
BowenK e7c6b7e66a Add NewParameter and Imm patterns 2020-08-21 16:53:04 +08:00
mindspore-ci-bot c92f7c9170 !4911 add func type check for switch layer
Merge pull request !4911 from riemann_penn/add_func_type_check_for_switch_layer
2020-08-21 16:42:12 +08:00
panyifeng abab21ed57 add func type check for switch layer 2020-08-21 16:11:40 +08:00
mindspore-ci-bot 6e8d3a3b82 !4859 Add CTCGrerdyDecoder ops for old backend.
Merge pull request !4859 from liuxiao93/Add-ReversSqueuce-EditDistance-CTCGrerdyDecoder
2020-08-21 16:05:19 +08:00
heleiwang 4870abc848 1. fix generator_dataset hangs
2. fix test_graphdata_distributed.py failing randomly
2020-08-21 16:03:06 +08:00
Wei Luning 77dcdd89ec support parameter updata with implicit type conversion 2020-08-21 15:24:57 +08:00
panyifeng f9f3cd7ce0 fix switch_layer_issues 2020-08-21 14:17:51 +08:00
mindspore-ci-bot bccb92adf7 !4868 fix: concat with none sample dataset
Merge pull request !4868 from guozhijian/fix_concat_with_zero_dataset
2020-08-21 12:02:30 +08:00
liuxiao93 9bc18ea2e5 Add CTCGrerdyDecoder ops for GE. 2020-08-21 10:12:01 +08:00
Su Teng e3ae23c939 add parallel attention test 2020-08-21 10:10:53 +08:00
mindspore-ci-bot 2ac410e90d !4789 Add EditDistance op for GE.
Merge pull request !4789 from liuxiao93/Add-EditDistance-op-for-GE
2020-08-21 09:49:38 +08:00
mindspore-ci-bot 3d06cbf987 !4801 Must set or change parallel mode before any Initializer created
Merge pull request !4801 from yihuaijie/dev
2020-08-21 09:47:32 +08:00
jonyguo 5b4b539751 fix: concat with none sample dataset 2020-08-21 09:19:50 +08:00
mindspore-ci-bot 2cb22a0f78 !4688 Fix bool operation parsing to be consistent with pynative
Merge pull request !4688 from amongo/FixBoolParse
2020-08-20 20:06:41 +08:00
liuxiao93 4c99f4f649 Add EditDistance op for GE. 2020-08-20 19:39:57 +08:00
Yi Huaijie 89a4ebf8a1 parallel mode must be set before create an initializer 2020-08-20 19:20:46 +08:00
huangdongrun f30418991c refactor bool op parsing to be consistent with pynative mode
add testcase of st
2020-08-20 16:45:30 +08:00
mindspore-ci-bot 9ee144ea40 !4744 [AutoParallel]Support bert
Merge pull request !4744 from lichen/support_bert
2020-08-20 14:13:19 +08:00
mindspore-ci-bot ed954dc407 !4782 Python UT fails on RandomPosterize
Merge pull request !4782 from islam_amin/bbox_class
2020-08-20 10:18:59 +08:00
mindspore-ci-bot 24700afa2d !4689 add check for user define bprop in Pynative mode
Merge pull request !4689 from zhangbuxue/add_check_for_user_define_bprop_in_Pynative_mode
2020-08-20 09:43:46 +08:00
islam_amin 85357238fe Fixing posterize python ut 2020-08-19 21:35:07 -04:00
Jesse Lee 8a08d0c37b Phase 2 of CacheOp 2020-08-19 13:45:55 -04:00
Zirui Wu 78c1aa1d96 Implemented Callback for Dataset
implment pause in MapOp, added more to callback

add ds_callback

- Initial drop of Python DSCallback

- Pybind DSCallback

- Pybind DSCallback

added callback to mapOp

- de_pipeline DSCallback

- de_pipeline DSCallback

add test case, segfault for now

fix seg fault

- de_pipeline DSCallback

remove 1 line

update callback test case, now works

use builder class for mapOp callback

- de_pipeline DSCallback

- de_pipeline DSCallback

- de_pipeline DSCallback

better test case

minor fix

add comments and minor clean ups

get rid of nullptr in MapOp, use other flag instead

fix a bug ParseMapOp only takes 1 callback

- Added WaitedDSCalabck

refactor callback param

fix text case incorrect number

- added testing

fix cpp test case

- added testing

- revert back lenet changes

- cleanup test_callbacks.py

- cleanup test_callbacks.py

fix CI stage I

fix CI stage II

fix CI and update epoch counter

- add validation
- add more testing  test_callbacks.py

use random data op to do tests

adjust when to call EpochBegin/End

- add repeat with callback

- addressing reviewers' comments

- docstring and CI fixes

- docstring and CI fixes

- docstring and CI fixes

- rebase with upstream/master

fix cpp test case

fix review comments

addr review cmts, add test case
2020-08-19 12:31:04 -04:00
buxue 855d6b8fed add check for user define bprop in Pynative mode. 2020-08-19 19:14:02 +08:00
lichenever 221a801395 auto parallel support bert 2020-08-19 17:47:59 +08:00
mindspore-ci-bot 70a218123b !4722 modiy error type
Merge pull request !4722 from lijiaqi/modify_error_type
2020-08-19 16:18:50 +08:00
mindspore-ci-bot 256dccc651 !4498 Gnn data processing supports distributed scenarios
Merge pull request !4498 from heleiwang/gnn_distributed
2020-08-19 16:09:05 +08:00
李嘉琪 c65ea1687b modify error type 2020-08-19 14:21:56 +08:00
mindspore-ci-bot 2d683234fb !4723 Support to concat more than 3 tensors in auto parallel mode
Merge pull request !4723 from yangzhenzhang/concat-more-than-3-tensors
2020-08-19 14:16:02 +08:00
yangzhenzhang cda08f6a52 concat 3 tensors in auto parallel mode 2020-08-19 11:27:35 +08:00
heleiwang 8ee4d8e92d Gnn data processing supports distributed scenarios 2020-08-19 11:09:01 +08:00
mindspore-ci-bot 50b5c8035b !4701 fix concat get_dataset_size error
Merge pull request !4701 from guozhijian/fix_concat_get_dataset_size_err
2020-08-19 09:14:30 +08:00
nhussain 738ae2c78d change api to use std_vector
try to display image
2020-08-18 15:41:21 -04:00
islam_amin 979111d0ef Added Posterize Op 2020-08-18 13:55:47 -04:00
jonyguo b0b370336f fix: concat get_dataset_size error 2020-08-18 23:40:17 +08:00
jonyguo 5f294fb90d fix: random affine parameter check 2020-08-18 21:58:53 +08:00
panyifeng 22a9d02e9f switch_layer incorporate env_get and tuple_get 2020-08-18 20:23:23 +08:00
mindspore-ci-bot cc077de9e3 !4425 fix if statement with no return coredump
Merge pull request !4425 from fary86/fix_if_no_return_coredump
2020-08-18 16:09:31 +08:00
mindspore-ci-bot 2ae6365d77 !4650 EmbeddingLookup support auto parallel
Merge pull request !4650 from yangzhenzhang/embedding-lookup-auto-parallel
2020-08-18 15:51:04 +08:00
fary86 38083e055a Fix coredump missing return statement after while loop 2020-08-18 14:16:21 +08:00
yangzhenzhang 6f6a8ae9f0 embedding lookup auto parallel 2020-08-18 11:40:09 +08:00
Yi Huaijie 0f7ead5f14 parameter slice init test all initializers 2020-08-18 10:34:15 +08:00
mindspore-ci-bot 113ff6ca24 !4367 CutMixBatch Augmentation Op
Merge pull request !4367 from MahdiRahmaniHanzaki/cutmix
2020-08-18 03:27:33 +08:00
mahdi 3ecc53fb4e Added CutMix 2020-08-17 13:01:47 -04:00
mindspore-ci-bot d1ad33676b !4598 support axis is None for all and any interface in graph mode
Merge pull request !4598 from zhangbuxue/support_axis_is_None_for_all_and_any_in_graph_mode
2020-08-17 19:52:40 +08:00
buxue 09f1a4bbaf support axis is None for all and any interface in graph mode. 2020-08-17 17:53:02 +08:00
jonyguo 8bb4449fa8 add testcase for padded dataset with decode op 2020-08-17 16:43:23 +08:00
mayang c410c6a6e2 soft_dvpp_decode_resize_jpeg_op issue resolved, input size can be an int, break the constraints of input size being sequence (height, width) 2020-08-17 14:57:04 +08:00
mindspore-ci-bot f875bf21bc !2948 fix control flow
Merge pull request !2948 from amongo/FixControlFlow
2020-08-17 08:56:22 +08:00
huangdongrun 2a6d346d2f support if by if grad parameter
add join for ref

adjust env eliminate to eliminate all env ops

add partial app cache

resolve while endless

fix env eliminate

support for "for while" cases

fix join shape error
2020-08-15 09:47:10 +08:00
mindspore-ci-bot 7d70fb4dc4 !3769 add RandomColorOp
Merge pull request !3769 from Alexey_Shevlyakov/ColorOp
2020-08-14 23:43:08 +08:00
mindspore-ci-bot 0e4d2c2535 !4188 fix switch layer sigle prim cell
Merge pull request !4188 from riemann_penn/fix_switch_layer_sigle_prim_cell
2020-08-14 19:54:37 +08:00
mindspore-ci-bot f41c21c5fa !4284 remove to_full_tensor and load_inputs in exexute stage
Merge pull request !4284 from yao_yf/remove_to_full_tensor_and_load_inputs_in_exexute_stage
2020-08-14 18:05:44 +08:00
panyifeng 1c296b96c9 fix switch layer sigle prim cell 2020-08-14 17:04:01 +08:00
Wei Luning d18ce95714 * add support to update by scalar* fix update error for by Initializer when slice_shape is* add ut for compute and update 2020-08-14 16:35:28 +08:00
yao_yf cbb4363fa7 remove to_full_tensor and load_inputs in exexute stage 2020-08-14 11:40:27 +08:00
mindspore-ci-bot 0f637fdc58 !4404 update field split
Merge pull request !4404 from yangzhenzhang/update-field-split-in-forward-communication
2020-08-14 10:16:24 +08:00
mindspore-ci-bot 93f60269c3 !4369 Added distribution_specific_args checking to some functions and fixed minor issues in docs
Merge pull request !4369 from XunDeng/pp_poc_v3
2020-08-14 09:33:23 +08:00
yangzhenzhang 14c77c9f03 update field split 2020-08-14 09:00:56 +08:00
Alexey Shevlyakov 8526d5414d RandomColor 2020-08-13 16:10:21 -04:00
mindspore-ci-bot 7a10e07fc6 !4383 Add distributedSampler to concatOP
Merge pull request !4383 from genglishuai/genglshOK
2020-08-14 00:06:06 +08:00
genglishuai 4d4df68d1e add DistributedSampler for Concat op 2020-08-13 22:52:02 +08:00
mindspore-ci-bot b4b6e5c8ed !4370 support kw and kwargs for cell in Pynative
Merge pull request !4370 from zhangbuxue/support_kw_and_kwargs_for_cell_in_pynative
2020-08-13 22:19:41 +08:00
mindspore-ci-bot ed1244558c !4366 Fixing param type in c++ api and fixing python validator for Repeat Op
Merge pull request !4366 from TinaMengtingZhang/cpp-api-repeat-count
2020-08-13 22:03:39 +08:00
buxue 0be4114240 support kw and kwargs for cell in Pynative 2020-08-13 20:29:47 +08:00
mindspore-ci-bot 1b63c76c61 !4194 Add infer and dpn to nn/probability
Merge pull request !4194 from zhangxinfeng3/master
2020-08-13 17:32:50 +08:00
mindspore-ci-bot 2db0290c49 !4356 Add validation for field split
Merge pull request !4356 from yangzhenzhang/update-field-split
2020-08-13 16:43:44 +08:00
mindspore-ci-bot 58be11907c !4346 all dataset support get_dataset_size
Merge pull request !4346 from anzhengqi/I1PXKS-Dataset-support-getsize
2020-08-13 14:49:22 +08:00
mindspore-ci-bot 579e0ab925 !4354 modify python ut runtest.sh
Merge pull request !4354 from changzherui/mod_python_ut
2020-08-13 14:17:44 +08:00
zhangxinfeng3 b16b71b9e8 add infer and dpn 2020-08-13 11:46:07 +08:00
yangzhenzhang 4a0e6ff7fc update field split 2020-08-13 10:35:04 +08:00
Xun Deng c0a3b51bb8 fixed minor issues in docs, updated parameter checking in some functions in distributions 2020-08-12 22:05:58 -04:00
tinazhang 0868720eb7 fix parameter type for repeat op in c++ api and added c++/python ut. 2020-08-12 17:23:42 -04:00
changzherui d3f709be55 modify python ut runtest.sh 2020-08-12 19:06:06 +08:00
anzhengqi 3e31ac6d62 all Dataset support get_dataset_size 2020-08-12 15:35:47 +08:00
yao_yf e4de26d5bc embeddinglookup wrap 2020-08-12 14:24:13 +08:00
mindspore-ci-bot 735fc98c78 !4265 support two mstypes do equal.
Merge pull request !4265 from zhangbuxue/support_two_mstypes_do_equal
2020-08-12 11:43:04 +08:00
mindspore-ci-bot 5b3f209e43 !4269 change export from geir to air
Merge pull request !4269 from fary86/change_export_interface
2020-08-12 10:25:00 +08:00
buxue 35677ac098 support two mstypes do equal. 2020-08-12 09:12:46 +08:00
mindspore-ci-bot 9276a9d2fb !3771 C++ API Support for TextFile Dataset
Merge pull request !3771 from cathwong/ckw_c_api_textfile_nosampler
2020-08-12 04:32:05 +08:00
avakh 477528de7f random sharpness cpp op support 2020-08-11 15:30:40 -04:00
mindspore-ci-bot 8ee68ae667 !4245 [MD] Add SolarizeOp
Merge pull request !4245 from nhussain/solarize
2020-08-12 02:27:42 +08:00
fary86 73325e0f01 Change export interface 2020-08-12 00:01:31 +08:00
nhussain 7766efd58e add files 2020-08-11 11:54:14 -04:00
Cathy Wong 7f39b5cfd7 C++ API Support for TextFile Dataset and Unit Tests 2020-08-11 11:53:53 -04:00
mindspore-ci-bot 4f75adb11a !4297 sync code incubator to master
Merge pull request !4297 from guozhijian/code_sync_incubator_f3c32baf_to_master_fcfc75a3_0811
2020-08-11 22:13:46 +08:00
mindspore-ci-bot c2997845c2 !4289 Fix pad op validate issue
Merge pull request !4289 from xiefangqi/fix_pad_validate
2020-08-11 20:20:35 +08:00
mindspore-ci-bot 67f5b0e916 !4258 change binary to mindir
Merge pull request !4258 from leopz/fix_doc
2020-08-11 20:17:41 +08:00
jonyguo 4964f7703a Merge branch 'master' into code_sync_incubator_f3c32baf_to_master_fcfc75a3_0811 2020-08-11 19:40:04 +08:00
xiefangqi 7ee1e46455 fix pad op validate issue 2020-08-11 17:28:08 +08:00
qianlong e9c4378ed8 add support of soft dvpp op 2020-08-11 15:46:07 +08:00
leopz eea597c92a change binary to mindir 2020-08-11 15:18:40 +08:00
mindspore-ci-bot b120cbcfb4 !4249 Add parameter checking in distributions
Merge pull request !4249 from XunDeng/pp_poc_v3
2020-08-11 14:16:29 +08:00
mindspore-ci-bot 6772bbde8d !4021 Add ScalarAffine and Softplus bijector
Merge pull request !4021 from XunDeng/scalar_affine_softplus
2020-08-11 14:14:35 +08:00
mindspore-ci-bot 266df56570 !4220 [MD] add num_samples support in minddataset pk sampler
Merge pull request !4220 from liyong126/minddataset_pk_num_samples
2020-08-11 11:22:28 +08:00
islam_amin e52d85ba9d Added RandomAffine Op 2020-08-10 17:52:50 -04:00
Xun Deng be6db4a6fe add scalar affine and softplus bijector 2020-08-10 16:07:54 -04:00
Xun Deng 415dad3adb added some parameter checking 2020-08-10 15:46:24 -04:00
mindspore-ci-bot 9ad82f79fd !3979 Adding MixUp operation
Merge pull request !3979 from MahdiRahmaniHanzaki/mixup
2020-08-10 23:01:26 +08:00
liyong 7341421d3b fix num samples in pk sampler 2020-08-10 19:05:47 +08:00
mindspore-ci-bot e195fa6f9e !4192 Fix md five_crop ci problem
Merge pull request !4192 from xiefangqi/xfq_validate_ci
2020-08-10 18:59:23 +08:00
xiefangqi 3d7826b6df test five crop problem 2020-08-10 16:59:24 +08:00
mindspore-ci-bot fe0b8d6272 !4068 Add parallel operator for Concat
Merge pull request !4068 from yangzhenzhang/add-concat-op
2020-08-10 10:15:29 +08:00
peixu_ren 3820533ad1 Refactor Gamma and Poisson ops 2020-08-09 19:47:26 -04:00
changzherui 22336c0843 sync 0807 code to ms-incubator 2020-08-08 10:43:09 +08:00
Mahdi 1896950ae5 Added Mixup 2020-08-07 17:47:16 -04:00
peixu_ren 517fed55a5 Added LGamma op 2020-08-07 11:40:59 -04:00
mindspore-ci-bot e19d382473 !3346 Maintain epoch/repeat count for ops
Merge pull request !3346 from lixiachen/repeat_rework
2020-08-07 20:39:19 +08:00
yangzhenzhang f4bb43bbaf add concat op 2020-08-07 15:47:17 +08:00
panyifeng 34e50e5d6e fix cell bprop 2020-08-07 10:57:01 +08:00
Lixia Chen ac85b77b76 Maintain epoch/repeat count for ops 2020-08-06 09:47:31 -04:00
mindspore-ci-bot 470328eeaf !4060 fix do concat in while loop specialize error
Merge pull request !4060 from fary86/fix_while_concat_specialize_error
2020-08-06 21:12:13 +08:00
Wei Luning d4d6457ea7 init parameter data by defaultOnly keep no data as MetaTensor in auto parallel mode 2020-08-06 19:52:31 +08:00
fary86 7602054acd Fix do concat in while loop specialize error 2020-08-06 19:41:11 +08:00
kingfo 28dabf0332 fix grad flag update issue in pynative 2020-08-06 15:12:31 +08:00
mindspore-ci-bot 0b407dfe78 !4005 unsortedsegsum grad
Merge pull request !4005 from fangzehua/unsortedsegsum
2020-08-06 14:19:20 +08:00
mindspore-ci-bot c493859978 !4004 add squreasumall grad
Merge pull request !4004 from fangzehua/squaresumall
2020-08-06 14:18:23 +08:00
mindspore-ci-bot 235378d5d7 !3789 eager mode sparse
Merge pull request !3789 from riemann_penn/eager_mode_sparse
2020-08-06 09:33:50 +08:00
mindspore-ci-bot 7ec0b5857a !3977 [MD] Refactor Concatenate Op
Merge pull request !3977 from nhussain/multi_dim_concat_2
2020-08-06 02:53:06 +08:00
nhussain 61769b2dd9 fix concat 2020-08-05 11:28:56 -04:00
fangzehua 99f2be7064 unsortedsegsum grad 2020-08-05 20:34:06 +08:00
fangzehua 7011508379 add squreasumall grad 2020-08-05 20:28:02 +08:00
panyifeng 9927e6eb5c eager mode sparse 2020-08-05 18:21:30 +08:00
mindspore-ci-bot 8dec74908a !4000 improve interface '__bool__' for tensor
Merge pull request !4000 from zhangbuxue/improve_bool_for_tensor
2020-08-05 17:21:41 +08:00
mindspore-ci-bot 617b98f104 !3966 [AutoParallel]Add dropout distributed op
Merge pull request !3966 from lichen/add_dropout_distributed_op
2020-08-05 16:38:32 +08:00
buxue ace34525cd improve interface '__bool__' for tensor 2020-08-05 16:14:14 +08:00
lichenever bfc96de1b9 add dropout distributed op 2020-08-05 14:07:24 +08:00
peixu_ren b9c8c0b439 Added Bijector TransformDistribution base classes and two instances: power and exp bijectors 2020-08-05 00:03:50 -04:00
mindspore-ci-bot a301fc1757 !3916 remove loss_scale range check which is a temp fix.
Merge pull request !3916 from xychow/remove-loss-scale-range-check
2020-08-05 10:16:15 +08:00
mindspore-ci-bot 5827ba9a8a !3940 View code support interface 'all' and 'any' of tensor
Merge pull request !3940 from zhangbuxue/support_interface_all_and_any_of_tensor
2020-08-04 20:08:44 +08:00
buxue 2c4cb49a11 support interface 'all' and 'any' of tensor 2020-08-04 18:24:56 +08:00
zhousiyi 7d31deb6fa remove loss_scale range check to make FP32Imm(inf) comparison equal 2020-08-04 08:08:29 +00:00
mindspore-ci-bot 8b396cea98 !3915 Revert modification of opt
Merge pull request !3915 from Simson/push-to-opensource
2020-08-04 15:59:20 +08:00
mindspore-ci-bot bac1781539 !3648 Add some testing cases for mindspore.profiler
Merge pull request !3648 from 张毅辉/zyh_profiler_test
2020-08-04 14:23:15 +08:00
mindspore-ci-bot c3edfe12bc !3715 Update python pattern expression
Merge pull request !3715 from BowenK/new_pattern
2020-08-04 12:58:32 +08:00
mindspore-ci-bot af9398b39a !3756 Change distribution api
Merge pull request !3756 from XunDeng/pp_poc_v3
2020-08-04 11:34:46 +08:00
mindspore-ci-bot 2da29bce66 !3370 same graph used in different context should be treat differently.
Merge pull request !3370 from xychow/fix-context-dup
2020-08-04 10:56:04 +08:00
simson 3617121ccf revert modification of opt 2020-08-04 10:09:21 +08:00
mindspore-ci-bot aa65cbf733 !3846 Add TBE op SquaredDifference\Xdivy\Xlogy for VM.
Merge pull request !3846 from liuxiao93/Add-ops-SeluSquaredDifference
2020-08-03 21:20:24 +08:00
mindspore-ci-bot 27a0a2e333 !3880 fix auto mix precision issue in pynative
Merge pull request !3880 from wangqiuliang/fix-gradients-issue-in-pynative
2020-08-03 19:23:03 +08:00
mindspore-ci-bot a182a87a6d !3820 support tensor attr shape and dtype in graph mode
Merge pull request !3820 from zhangbuxue/support_dtype_and_shape_as_attr_in_graph_mode
2020-08-03 18:57:46 +08:00
liuxiao93 374b7b8583 Add TBE op SquaredDifference for VM. 2020-08-03 18:52:18 +08:00
kingfo 577535b387 fix gradients issue in pynative 2020-08-03 17:35:21 +08:00
buxue b075674cf2 support tensor attr shape and dtype in graph mode 2020-08-03 17:09:31 +08:00
mindspore-ci-bot be507b96e0 !3473 [refine]change base class of parameter
Merge pull request !3473 from vlne-v1/change_base_class_of_parameter
2020-08-03 16:05:46 +08:00
zhousiyi f926650c64 if AbstractFunction comparison succeed in NewContext, then the evaluator should use the same one, otherwise one of the evaluator will not be evaluated.
if funcgraph or metafuncgraph call it recursively, then anf_node should be used as tracking_id to discriminate the first occurcance and the
recursive occurance.
add anf_node to PrimitiveAbstractClosure hash() to reduce cost of GetEvaluatorFor().

ignore the tracking_id to make cse work.
2020-08-03 07:57:07 +00:00
BowenK 6d4c07c886 Update python pattern expression 2020-08-03 15:29:22 +08:00
mindspore-ci-bot 25fdb67e3d !3744 [Auto parallel] Add a new graph operation in the DP algorithm
Merge pull request !3744 from Xiaoda/14-add-new-graph-operations-in-auto-parallel
2020-08-03 11:18:14 +08:00
Wei Luning a05c38bb63 make python Parameter inherit from Tensor 2020-08-03 09:12:24 +08:00
mindspore-ci-bot d1b3096418 !3837 add_test_for_mindrecord 3
Merge pull request !3837 from liucunwei/add_test_for_mindrecord3
2020-08-01 16:09:50 +08:00
z00505269 87668d6ea2 remove predict 2020-08-01 11:45:19 +08:00
liucunwei 8b99114f6d add mindrecord test case 2020-08-01 11:41:58 +08:00
Xun Deng e87e1fc6bc changed distribution api 2020-07-31 12:41:06 -04:00
mindspore-ci-bot 27e51c5a63 !3553 Unify np array comparisons
Merge pull request !3553 from tony_liu2/staging
2020-07-31 21:39:31 +08:00
dengyutao 388e43f7cb delete parameter block_reader for MindDataset 2020-07-31 11:30:05 +08:00
Xiaoda Zhang d24a902afe add a new graph operation in autoparallel 2020-07-31 10:57:19 +08:00
mindspore-ci-bot f1e717554c !3537 add sparse operators
Merge pull request !3537 from riemann_penn/add_sparse_operator
2020-07-31 10:25:55 +08:00
peixu_ren 374772035a Refactor random uniform ops and complete gamma and poisson 2020-07-30 09:46:52 -04:00
mindspore-ci-bot 8943d5de34 !3727 Fix fuzz issue and split problem
Merge pull request !3727 from xiefangqi/fuzz_issue_pad_01
2020-07-30 21:24:47 +08:00
panyifeng 598bfa0205 add sparse operators 2020-07-30 17:18:23 +08:00
mindspore-ci-bot 61867c7386 !3645 add mindspore hub for download ckpt file
Merge pull request !3645 from chenzhongming/master
2020-07-30 16:25:10 +08:00
mindspore-ci-bot ce08065c23 !3671 vgg: optimize the script and Readme
Merge pull request !3671 from ms_yan/vgg_optimize
2020-07-30 16:00:50 +08:00
xiefangqi 6017b050ac add generatordataset support split 2020-07-30 15:51:28 +08:00
chenzomi 8918c90b66 add mindspore hub for download ckpt file
add mindspore.hub and change model_zoo
2020-07-30 15:02:55 +08:00
mindspore-ci-bot ab4c43007f !3657 Add parallel operator for StridedSlice
Merge pull request !3657 from yangzhenzhang/add-stridedslice-op
2020-07-30 15:02:35 +08:00
mindspore-ci-bot 80dd2cfe00 !3405 fix optimizer parallel problems
Merge pull request !3405 from gziyan/fix_optimizer_parallel
2020-07-30 14:09:16 +08:00
zhangyihui 54f2cf4ef0 add some test case for profiler 2020-07-30 10:43:13 +08:00
ms_yan abbd7b50db optimize the vgg script 2020-07-30 07:48:35 +08:00
Xun Deng e94d91ba95 remove import probability from nn/__init__.py 2020-07-29 15:08:58 -04:00
tony_liu2 269b477684 use np.testing.assert instead of asserting
fix line lengths

fix spacing

reverse a few changes
2020-07-29 14:53:01 -04:00
Ziyan 98e2ee90de fix optimizer parallel problems 2020-07-29 20:55:31 +08:00
yangzhenzhang 9aa84b3d14 add strided slice op 2020-07-29 17:18:50 +08:00
mindspore-ci-bot d06da1d270 !3603 Check that the number columns of names and default matches
Merge pull request !3603 from jiangzhiwen/fix_column_names_exceeded
2020-07-29 11:40:06 +08:00
jiangzhiwen 2cc6b5cb52 fix number of columns not match 2020-07-29 09:19:33 +08:00
changzherui 758853ff52 modify case 2020-07-29 00:15:48 +08:00
mindspore-ci-bot 46ae7879d4 !3394 Three distribution class instances: Exponential, Geometric Uniform distribution
Merge pull request !3394 from XunDeng/pp_poc_v3
2020-07-28 22:21:29 +08:00
guansongsong 1906ed1be8 fix cache description again 2020-07-28 13:26:29 +08:00
guansongsong b6529b9096 fix cache description 2020-07-28 13:03:06 +08:00
guansongsong 620d951e5e Merge branch 'ql/fix_cache_core' of https://gitee.com/qianlong21st/mindspore into ql/fix_cache_core 2020-07-28 11:37:06 +08:00
mindspore-ci-bot 16079e6356 !3472 [Auto parallel] Cost model for GPU
Merge pull request !3472 from Xiaoda/13-add-gpu-costmodel
2020-07-28 09:27:26 +08:00
mindspore-ci-bot 72e45841a2 !3528 Fix the difference of Error type between graph&pynative mode
Merge pull request !3528 from Simson/push-to-opensource
2020-07-28 09:26:49 +08:00
mindspore-ci-bot d4165671d9 !3435 Add parallel operator for Tile
Merge pull request !3435 from yangzhenzhang/add-tile-op
2020-07-28 09:16:30 +08:00
peixu_ren 292f2de0cf Add sampling functions in exponential, geometric and uniform distributions 2020-07-27 17:07:14 -04:00
Xun Deng 7bb83067d0 added exponential uniform geometric distribution
added cdf, logcdf, survival, logsurvival, entropy, mode, cross_entropy wrapper
2020-07-27 17:03:37 -04:00
ms_yan cf3fff8996 init add vgg16 gpu version
merge the script

optimize the script
2020-07-27 22:26:17 +08:00
mindspore-ci-bot 6e7c673c90 !3519 remove diary file
Merge pull request !3519 from anzhengqi/remove-log
2020-07-27 20:53:41 +08:00
mindspore-ci-bot e9316b1389 !3500 fix sparse feature bug for auto parallel
Merge pull request !3500 from lirongzhen1/master
2020-07-27 19:27:39 +08:00
simson b2cdd5d848 Fix the difference of Error type between graph&pynative mode 2020-07-27 17:28:13 +08:00
mindspore-ci-bot 5f7d2ba396 !3525 Fix a bug for Parameter
Merge pull request !3525 from hewei/fix_parameter_bug
2020-07-27 17:17:16 +08:00
He Wei a6db29b11b Fix a bug for Parameter
1. Parameter's init_data() should have no effect if default_input already set;
2. This bug is introduced by 'decouple ParamValue from python';
3. An unit test case is added to ensure the right init_data() behavior.
2020-07-27 15:32:08 +08:00
Xiaoda Zhang 9097b36950 add resnet50 testcases for gpu 2020-07-27 15:22:30 +08:00
mindspore-ci-bot 568da0d510 !3425 fix avgpoolgrad
Merge pull request !3425 from fangzehua/avgpool
2020-07-27 14:15:29 +08:00
anzhengqi 081d876438 remove-log 2020-07-27 11:14:38 +08:00
fangzehua 86dd0c583a fix avgpool grad 2020-07-27 11:06:32 +08:00
lirongzhen1 51796aa624 fix sparse feature bug for auto parallel 2020-07-27 10:44:49 +08:00
mindspore-ci-bot 295038d346 !3324 add reduce_any op for vm
Merge pull request !3324 from fangzehua/reduce_any
2020-07-27 10:38:57 +08:00
mindspore-ci-bot 9c06a564d1 !2983 Dataset Tensor class cleanup
Merge pull request !2983 from h.farahat/tensor_class
2020-07-25 20:59:13 +08:00
qianlong bf87b1d1fb fix cache op core dump 2020-07-25 18:37:02 +08:00
yangzhenzhang 6a6e2bd271 add tile op 2020-07-25 11:42:06 +08:00
kingfo 73ea9b7855 fix mix precesion operator issue 2020-07-25 09:40:50 +08:00
mindspore-ci-bot 0a2980ca74 !3440 [MD]Fix Segementation Falut when SentencepieceTokenizer Op before zipOp and ConcatOp
Merge pull request !3440 from xulei/sentence_piece0715
2020-07-25 09:19:34 +08:00
hesham adfbc891d3 - Add checks and testing for empty tensors
- cleanup work on createTensor and Tensor's constructors
2020-07-24 17:23:18 -04:00
mindspore-ci-bot 06ed9ffd6a !3183 Remove files on test fail for test_minddataset*.py
Merge pull request !3183 from tony_liu2/master
2020-07-24 23:47:29 +08:00
xulei2020 0af6d75761 add code 2020-07-24 19:51:27 +08:00
mindspore-ci-bot b1fae868ba !3404 add sparse api docs
Merge pull request !3404 from riemann_penn/add_sparse_api_docs
2020-07-24 17:54:23 +08:00
panyifeng 963bd67a60 add sparse api docs 2020-07-24 15:40:46 +08:00
qianlong d28c63b6c0 fix diff workers disallow cache 2020-07-24 15:30:00 +08:00
buxue e9ca893431 remove ut test_expand_dims_grad 2020-07-24 15:15:41 +08:00
mindspore-ci-bot 2d973c9597 !3161 Set output value for dynamic graph.
Merge pull request !3161 from flywind/output
2020-07-23 21:14:08 +08:00
mindspore-ci-bot 366dd44ca8 !3371 support call super when class define in test_case
Merge pull request !3371 from zhangbuxue/support_call_super_when_class_define_in_test_case
2020-07-23 20:11:25 +08:00
panyifeng 8a89f003eb fix sparse related issues 2020-07-23 19:05:53 +08:00
buxue b812c1a17a support call super when class define in test_case. 2020-07-23 18:30:30 +08:00
kpy 570da089a8 set output value for dynamic graph 2020-07-23 17:05:47 +08:00
mindspore-ci-bot 684ff4f46b !3160 Rewrite tensor's __bool__ for pynative mode
Merge pull request !3160 from Simson/push-to-opensource
2020-07-23 16:55:49 +08:00
simson 5f77fbdd75 Rewrite tensor's __bool__ for pynative mode 2020-07-23 16:51:46 +08:00
mindspore-ci-bot 0a84b63fc3 !3305 modify the vgg16/lstm path to offical/{cv/npl}
Merge pull request !3305 from caojian05/ms_master_dev
2020-07-23 16:01:42 +08:00
fangzehua 228a959cc7 add reduce any op for vm 2020-07-23 14:43:53 +08:00
mindspore-ci-bot 48711414fc !3356 [common]Refine code & Add ToAbstruct for `FuncGraph`, `MetaFuncGraph` `Primitive`
Merge pull request !3356 from vlne-v1/add_to_abstract_for_function
2020-07-23 14:33:58 +08:00
Wei Luning 484d7f10c8 refine code* refine code in bert model* add ToAbstruct for `FuncGraph`, `MetaFuncGraph` `Primitive`* remove partial hard code in spec for poly* remove any in data convert cache 2020-07-23 12:43:37 +08:00
mindspore-ci-bot 7f1ccc5f3b !3311 add sparse feature test cases for auto parallel
Merge pull request !3311 from lirongzhen1/master
2020-07-23 11:35:49 +08:00
mindspore-ci-bot 21a5f06e93 !3328 Add testcases
Merge pull request !3328 from shenwei41/sw_master
2020-07-23 09:57:22 +08:00
tony_liu2 1f4251a440 add try to minddataset python tests to remove files on fail
delete unrelated file

change finally to except else

fix spacing alignment

fix indentation

fix indentation

fix indentation

add fix to new test case

add if main for pytest

fix spacing
2020-07-22 16:34:10 -04:00
mindspore-ci-bot 859fe6bc41 !3342 C++ API Support for Skip Dataset Op plus UTs
Merge pull request !3342 from cathwong/ckw_c_api_skip
2020-07-23 04:28:38 +08:00
mindspore-ci-bot df1300d9cb !3294 Refactor opt/pre passes
Merge pull request !3294 from nsyca/removal_pass
2020-07-23 02:51:31 +08:00
Cathy Wong 8921a6099c C++ API Support for Skip Dataset Op and UTs 2020-07-22 13:21:35 -04:00
mindspore-ci-bot c24122bb55 !3303 fix validator that checks the vocab_size is positive in vocab.from_file
Merge pull request !3303 from ZiruiWu/fix_vocab_validator
2020-07-23 00:49:29 +08:00
Nat Sutyanyong 9fb1904ed8 Refactoring opt/pre 2020-07-22 11:13:42 -04:00
buxue f84b055244 add check for implicit conversion when scalar is not number and bool. 2020-07-22 20:55:19 +08:00
shenwei41 4eaa396ca7 Add testcases 2020-07-22 20:21:19 +08:00
CaoJian f9fdb52373 modify the vgg16/lstm path to offical/{cv/npl} 2020-07-22 19:25:27 +08:00
mindspore-ci-bot bc20de741a !3315 restore reshape ut
Merge pull request !3315 from yao_yf/restore_auto_parallel_reshape_ut
2020-07-22 16:23:29 +08:00
yao_yf 1d3a06a3b0 recover reshape ut 2020-07-22 14:30:12 +08:00
lirongzhen1 5d63c60135 add sparse feature test cases for auto parallel 2020-07-22 14:27:12 +08:00
Amir Lashkari 6f186aafa0 Update Python UA op, AutoContrast Op and UT
Updated Validators.py

Fixed UA UT

Fixed UA UT

Fixed PyLint Errors

Added aditional changes

remove old golden AutoContrast UT file

updated Autocontrast python UT

Added golden files

Fixed issue

fixed UT
2020-07-22 14:16:16 +08:00
Zirui Wu 40ea84ae81 fix from_file validator minor error, 1 line change
add test case
2020-07-21 23:17:26 -04:00
mindspore-ci-bot 8da91ca3cf !3237 support call the parent class function
Merge pull request !3237 from zhangbuxue/support_call_the_parent_class_construct_function
2020-07-21 22:13:04 +08:00
mindspore-ci-bot c451146b14 !3255 Added cpp Equalize op to vision api
Merge pull request !3255 from alashkari/cpp_ops
2020-07-21 21:56:41 +08:00
mindspore-ci-bot 925172664b !3230 add bprop for sparse_tensor
Merge pull request !3230 from riemann_penn/add_bprop_for_sparse_tensor
2020-07-21 21:47:53 +08:00
mindspore-ci-bot cf4353f728 !3220 Add random normal op at MindSpore front-end
Merge pull request !3220 from peixu_ren/custom_gpu
2020-07-21 20:33:52 +08:00
mindspore-ci-bot 37cc6e2628 !3175 add ScatterNdAdd ScatterNdSub ScatterNonAliasingAdd ops
Merge pull request !3175 from fangzehua/scatter_add_vm
2020-07-21 20:26:07 +08:00
panyifeng 4d4e23fd9e Add bprop for sparse_tensor 2020-07-21 19:40:35 +08:00
buxue 073507a5e0 support call the parent class function 2020-07-21 16:38:11 +08:00
panfengfeng 5aad4bdfbf change size 2020-07-21 14:56:55 +08:00
xiefangqi 64a6ed56de fix annotation 2020-07-21 12:04:56 +08:00
mindspore-ci-bot ad651f38bf !3124 [MD] error occur when using numpy types
Merge pull request !3124 from liyong126/fix_numpy_generic
2020-07-21 11:44:34 +08:00
fangzehua dde74b227c add 5 vm op 2020-07-21 11:34:10 +08:00
peixu_ren 9b45018dfd Add random normal op at MindSpore front-end 2020-07-20 23:31:30 -04:00
mindspore-ci-bot bfc18704d5 !3254 [MD]Add more strict upper bounds to CenterCropOp and RandomCropWithBboxOp
Merge pull request !3254 from nhussain/padding_upperbound
2020-07-21 10:18:56 +08:00
mindspore-ci-bot 2e4bb93a1e !3250 [quant]bug fixes when export geir
Merge pull request !3250 from vlne-v1/quant_export_geir_biasadd_after_depth_wise
2020-07-21 09:35:28 +08:00
mindspore-ci-bot 718431429c !2755 unform learning rate behavior in optimizers
Merge pull request !2755 from wangnan39/uniform_lr_behavior_in_optimizers
2020-07-21 09:13:14 +08:00
mindspore-ci-bot 0e27dccbcf !3093 VOCDataset output change to multi-columns
Merge pull request !3093 from xiefangqi/md_voc_multi_columns
2020-07-21 09:12:01 +08:00
liyong 28ebd73096 fix bug when int or float is numpy type 2020-07-21 09:07:29 +08:00
Amir Lashkari 572750cd40 Added cpp Equalize op
adding missed files

Fixed Errors

fixed bugs

fixed bugs

fixed bugs

fixed bugs

fixed bugs

Updated Python UT for Equalize op

Added cpp Equalize op

adding missed files

Fixed Errors

fixed bugs

fixed bugs

fixed bugs

fixed bugs

fixed bugs

Updated Python UT for Equalize op

Fixed comment style

update files

deleted files

added files

added image_utils.h

Fixed PyLint and CPPLint Errors

updated tensor_op.h
2020-07-20 21:03:26 -04:00
nhussain b064cbab5d fix upper bound 2020-07-20 15:26:49 -04:00
mindspore-ci-bot b091f74c23 !3016 Add CSV dataset loader
Merge pull request !3016 from jiangzhiwen/dataset/csv
2020-07-20 22:14:52 +08:00
Wei Luning 7d5c9d52bc fix geir export bugs 2020-07-20 21:32:57 +08:00
wangnan39@huawei.com 082433183d uniform learning_rate behavior of optimizers 2020-07-20 21:09:20 +08:00
jiangzhiwen 2f506b7985 CSV dataset loader 2020-07-20 20:22:08 +08:00
mindspore-ci-bot fa7fa8a162 !3234 [MD] fix bug when save tfrecord data
Merge pull request !3234 from liyong126/fix_save_tfrecod
2020-07-20 20:18:12 +08:00
liyong f521532a06 fix field_name probelem from tfrecord to mindrecord 2020-07-20 17:12:21 +08:00
xulei2020 18b519ae0f add sentence piece 2020-07-20 15:50:35 +08:00
xiefangqi fbd9e3d402 vocdataset output multi-columns 2020-07-20 14:40:30 +08:00
anzhengqi 008b91b2a1 inject epoch ctrl op in the execution tree and send eos at the end of epoch 2020-07-20 13:02:47 +08:00
mindspore-ci-bot 6f8863b65d !3198 synchronize latest Ascend software suite 18 Jul 2020, and merging branches
Merge pull request !3198 from yanghaoran/code_sync_0718
2020-07-19 14:14:45 +08:00
yanghaoran 859acc6d2a synchronize latest Ascend software suite 18 Jul 2020, and merging branches 2020-07-18 21:09:55 +08:00
mindspore-ci-bot 05de773775 !3209 Fix bug about output of AddNGrad.
Merge pull request !3209 from liuxiao93/AddN
2020-07-18 19:56:31 +08:00
mindspore-ci-bot ffb7040c3c !3200 [clean]remove loop_can_unroll flag, clean some other python code
Merge pull request !3200 from vlne-v1/remove_loop_can_unroll
2020-07-18 19:44:29 +08:00
liuxiao93 8705545bcd Fix bug about output of AddNGrad. 2020-07-18 18:47:52 +08:00
Wei Luning f362503d57 support throw attribute error from c++ 2020-07-18 17:54:26 +08:00
Wei Luning 88e864a4a3 remove loop can unroll flag, clean some python usage 2020-07-18 17:41:34 +08:00
mindspore-ci-bot e8b26dbdaa !3151 Fix verification of BatchNorm2d input is 4D.
Merge pull request !3151 from liuxiao93/fix-BatchNorm2d
2020-07-18 16:22:04 +08:00
mindspore-ci-bot 4945d34a41 !3133 [MD] fix num_sample in distributed sampler
Merge pull request !3133 from liyong126/md_num_of_samples
2020-07-18 15:36:33 +08:00
liuxiao93 75881e5f2f check input of BatchNorm is 4D. 2020-07-18 14:53:11 +08:00
mindspore-ci-bot 4a19e6b8cb !3114 add coo_tensor
Merge pull request !3114 from riemann_penn/coo_tensor
2020-07-18 10:24:58 +08:00
mindspore-ci-bot a84092e89d !3102 [MD] Add additional parameter checks in RandomCropWithBBoxOp and RandomResizeWithBbox
Merge pull request !3102 from nhussain/random_crop_fixes
2020-07-17 22:33:50 +08:00
panyifeng 5a10383cc3 add coo_tensor 2020-07-17 18:53:03 +08:00
liyong e2ea1fa0df activate num_samples in distributed samplers 2020-07-17 16:55:57 +08:00
wangnan39@huawei.com 86889c59cb optimizer adapt IndexedSlices 2020-07-17 15:57:50 +08:00
mindspore-ci-bot 56f70e910c !3080 [parser]remove redundant phi
Merge pull request !3080 from vlne-v1/remove-redundant-phi
2020-07-17 15:19:41 +08:00
mindspore-ci-bot 6dd99ee35d !3130 [dump]support dump quant in binary format file
Merge pull request !3130 from vlne-v1/quant_op_depthwise
2020-07-17 14:25:57 +08:00
mindspore-ci-bot a10001cb58 !3152 remove 4 auto parallel reshape ut
Merge pull request !3152 from yao_yf/reshape_ut_remove
2020-07-17 14:12:24 +08:00
Wei Luning 28d1d37085 End at validate when export. 2020-07-17 12:44:12 +08:00
Wei Luning acbccea644 remove redundant phi 2020-07-17 11:46:09 +08:00
mindspore-ci-bot 1bcbbb08d6 !2973 [MD] Add implementation of SlidingWindow TensorOp, c++ & python
Merge pull request !2973 from luoyang/update
2020-07-17 11:06:35 +08:00
yao_yf abebb2004b remove 4 reshape ut 2020-07-17 10:56:24 +08:00
mindspore-ci-bot edec821c50 !2876 set reshape operator no redistribution for auto parallel
Merge pull request !2876 from lirongzhen1/master
2020-07-17 10:01:06 +08:00
mindspore-ci-bot 1a518e1cff !3144 [MD] Fix ResizeOp behaviour
Merge pull request !3144 from nhussain/dataset_check
2020-07-17 06:04:14 +08:00
nhussain c984b0fc88 fix size tuple 2020-07-16 17:02:34 -04:00
mindspore-ci-bot 35c0f1d2e6 !3143 Add python UT to MnistDataset op
Merge pull request !3143 from TinaMengtingZhang/dataset-op-ut-mnist
2020-07-17 04:40:26 +08:00
tinazhang ab37e87d7a adding Mnist python ut coverage 2020-07-16 14:14:20 -04:00
islam_amin 5647889c0d Added AutoContrast Op 2020-07-16 13:09:52 -04:00
mindspore-ci-bot 37e8439c0a !3077 supporting cpp invert operation
Merge pull request !3077 from ava/invert
2020-07-17 01:04:43 +08:00
mindspore-ci-bot c07a8d2033 !3137 Cleanup dataset UT: Remove deprecated save_and_check
Merge pull request !3137 from cathwong/ckw_dataset_ut_cleanup7
2020-07-17 00:45:56 +08:00
nhussain 5871ba8a05 more validator fixes 2020-07-16 10:10:36 -04:00
mindspore-ci-bot 74bbfa3cf6 !3095 modify the limit of loss scale
Merge pull request !3095 from Simson/push-to-opensource
2020-07-16 21:30:54 +08:00
lirongzhen1 c1eba79b83 set reshape redistribution strategy attribute to no redistribution 2020-07-16 21:20:46 +08:00
mindspore-ci-bot eeba046115 !3050 Add TBE ops Tan/TruncateDiv/TruncateMod for VM.
Merge pull request !3050 from liuxiao93/Tan/TruncateDiv/TruncateMOd
2020-07-16 20:36:50 +08:00
changzherui f4cb445ea8 syn code for 0715 2020-07-16 17:18:21 +08:00
mindspore-ci-bot 526770e09e !3049 [dataset] add save operator in dataset
Merge pull request !3049 from liyong126/dataset_save_op
2020-07-16 16:59:38 +08:00
simson 177e18f3f4 modify the limit of loss scale 2020-07-16 16:44:02 +08:00
mindspore-ci-bot 6335598fff !3111 Rollback to Normal that operates on D
Merge pull request !3111 from peixu_ren/custom_gpu
2020-07-16 16:09:24 +08:00
liyong bc676fe250 save op in minddataset 2020-07-16 15:10:48 +08:00
peixu_ren 1feca960aa Rollback to Normal on D 2020-07-16 00:49:23 -03:00
Ziyan 39f08eb7dd enable optimizer parallel 2020-07-16 11:47:41 +08:00
avakh 35c3a63701 support cpp invert operation 2020-07-15 23:45:45 -04:00
mindspore-ci-bot 7976d77593 !3104 fix mindspore dtype equal
Merge pull request !3104 from fary86/fix_mstype_eq
2020-07-16 10:26:34 +08:00
fary86 595767b4b5 Fix bug of mindspore dtype equal 2020-07-16 09:06:55 +08:00
Cathy Wong 04eb4f89c7 Cleanup dataset UT: Replace save_and_check 2020-07-15 20:47:31 -04:00
Zirui Wu d233c54139 implemented cpp random choice, apply and compos
python part of random ops

added random select sub policy

validators added

comments added, remaining issues addressed

add more python test cases

fix ci

fix CI

fix order of include files

addr review cmts

addr review cmts

reorg file

fix compile err

address review cmts

address review cmts
2020-07-15 13:39:10 -04:00
YangLuo 4136892a3e add SlidingWindow Op 2020-07-15 19:55:33 +08:00
mindspore-ci-bot 3e691e54f5 !3071 change ValueError to TypeError for enumerate start
Merge pull request !3071 from zhangbuxue/change_ValueError_to_TypeError_for_enumerate_start
2020-07-15 15:42:22 +08:00
mindspore-ci-bot bacbb26e3b !3062 fix valuenode simplify
Merge pull request !3062 from riemann_penn/fix_value_node_simplify
2020-07-15 14:42:49 +08:00
mindspore-ci-bot 45ad430af2 !3048 support use valuelist or valuetuple of primitives
Merge pull request !3048 from amongo/SupportPrimitiveList
2020-07-15 10:45:36 +08:00
buxue 60b0ded440 change ValueError to TypeError for enumerate start 2020-07-15 10:39:03 +08:00
panyifeng 394178569e fix valuenode simplify 2020-07-15 10:09:30 +08:00
mindspore-ci-bot 683920d1c8 !2987 Add random normal op at MindSpore front-end
Merge pull request !2987 from peixu_ren/custom_gpu2
2020-07-15 09:39:58 +08:00
huangdongrun ee2039fbba add support for value sequence of primitve 2020-07-15 09:24:39 +08:00
mindspore-ci-bot bc0a53cfb1 !3030 minddata support ps-lite feature
Merge pull request !3030 from xiefangqi/md_support-pslite
2020-07-15 09:11:37 +08:00
mindspore-ci-bot ba0143402c !3067 Cleanup dataset UT: Remove unneeded tf data files and tests
Merge pull request !3067 from cathwong/ckw_dataset_ut_cleanup6
2020-07-15 04:44:52 +08:00
mindspore-ci-bot 219a716eae !3066 fix some batch's get_dataset_size and some text validator inconsistency
Merge pull request !3066 from ZiruiWu/fix_validator
2020-07-15 03:11:31 +08:00
mindspore-ci-bot bed93a9ead !3039 [Dataset Python UT] adding coverage to Cifar Op and update test dataset
Merge pull request !3039 from TinaMengtingZhang/dataset-op-ut-cifar
2020-07-15 02:10:52 +08:00
Zirui Wu 63185cb20f fix some validators errors
address review cmts

addr review cmts
2020-07-14 14:04:40 -04:00
Cathy Wong ae1ed327ba Cleanup dataset UT: Remove unneeded data files and tests 2020-07-14 12:24:54 -04:00
nhussain 05b2a57d2a fix validation errors, and fix try catch error tests 2020-07-14 11:50:00 -04:00
tinazhang 340d98a4d1 added test case to cifar_op
update cifar10 dataset
fixing missing error handling code in validator
2020-07-14 11:22:38 -04:00
peixu_ren ac561f2956 Refactor random normal op 2020-07-14 11:35:19 -03:00
peixu_ren 20ca96c62b Add random normal MindSpore interface 2020-07-14 11:19:12 -03:00
xiefangqi add19a591c md support ps-lite 2020-07-14 21:46:11 +08:00
liuxiao93 c772b9e291 Add TBE ops Tan/TruncateDiv/TruncateMod for VM. 2020-07-14 16:27:01 +08:00
mindspore-ci-bot 8871f06f42 !2963 Add UT for python pass
Merge pull request !2963 from BowenK/python_pass_clean
2020-07-14 11:48:03 +08:00
BowenK f267a105b8 Add Python Pass UT 2020-07-14 10:18:22 +08:00
mindspore-ci-bot bfc3065fc7 !3025 [AutoParallel]Add embedding look up op
Merge pull request !3025 from lichen/add_embedding_look_up_op
2020-07-14 09:59:01 +08:00
mindspore-ci-bot 48654be14d !3040 BoundingBoxAugment op fix ratio
Merge pull request !3040 from islam_amin/bounding_box_augment_bugs
2020-07-14 09:36:34 +08:00
mindspore-ci-bot 69ce4bf2b2 !2970 Del mindspore/model_zoo
Merge pull request !2970 from panbingao/master
2020-07-14 08:57:31 +08:00
islam_amin 56da3b0ae1 Fixing ratio bug with BoundingBoxAugment 2020-07-13 18:11:19 -04:00
mindspore-ci-bot eadcb341e1 !2891 CacheOp phase 1
Merge pull request !2891 from Jamie/CacheOp_dev
2020-07-13 23:56:57 +08:00
Jesse Lee 7c1bc5192b Initial Drop of CacheOp Phase I 2020-07-13 10:18:53 -04:00
lichenever cde5cc2bd2 add_embedding_look_up 2020-07-13 22:00:55 +08:00
mindspore-ci-bot c465ea3269 !3031 fix context mode and device target dependency issue
Merge pull request !3031 from wangqiuliang/fix-tensor-bool-operation
2020-07-13 19:52:32 +08:00
mindspore-ci-bot 2f27c4e3e8 !2807 Apply indexed_slices
Merge pull request !2807 from riemann_penn/apply_indexed_slices
2020-07-13 17:08:25 +08:00
kingfo 8863dfd677 fix context mode and device_target dependency issue 2020-07-13 16:06:00 +08:00
panyifeng 44e74ad5aa Apply indexed_slices 2020-07-13 15:36:25 +08:00
mindspore-ci-bot 8f15d1f608 !2791 convert subgraph
Merge pull request !2791 from changzherui/subgraph
2020-07-13 15:06:15 +08:00
changzherui a27ce973ad convert subgraph 2020-07-13 12:31:22 +08:00
mindspore-ci-bot d3ec05d716 !2943 [quant]export bug fix
Merge pull request !2943 from vlne-v1/quant_export_bugfix
2020-07-13 10:02:18 +08:00
mindspore-ci-bot d925c52bb1 !2875 add grad all in pynative
Merge pull request !2875 from wangqiuliang/add-grad-all-in-pynative
2020-07-13 09:30:52 +08:00
mindspore-ci-bot 7cdd5581f9 !2914 make AbstractRef can join with AbstractTensor
Merge pull request !2914 from xychow/fix-abstractref-join
2020-07-13 09:26:19 +08:00
mindspore-ci-bot 6284c42a76 !2941 MD tokenizer support output offsets
Merge pull request !2941 from xiefangqi/md_add_offsets_feature
2020-07-11 14:36:00 +08:00
mindspore-ci-bot ebc6b92c27 !3002 add arg check for enumerate
Merge pull request !3002 from zhangbuxue/add_arg_check_for_enumerate
2020-07-11 12:31:30 +08:00
xiefangqi 47060631e5 add offsets feature to tokenizer 2020-07-11 11:20:02 +08:00
mindspore-ci-bot 541456044d !2934 GraphData support random_walk and get_edge_feature
Merge pull request !2934 from heleiwang/gnn_july
2020-07-11 10:26:17 +08:00
mindspore-ci-bot 2f565f4c20 !2776 Update API of dataset.text.lookup
Merge pull request !2776 from ZiruiWu/master
2020-07-10 22:18:48 +08:00
kingfo add3778a61 add grad all in pynative mode 2020-07-10 17:49:54 +08:00
panbingao 45dbc8bf04 Move model_zoo.resnet.py 2020-07-10 17:36:34 +08:00
heleiwang 7a046a1d70 support get_edge_feature 2020-07-10 17:05:23 +08:00
buxue cf797d3bf2 add arg check for enumerate 2020-07-10 16:58:38 +08:00
mindspore-ci-bot 87722b9e09 !2912 Update ssim and add msssim
Merge pull request !2912 from fanglei/msssim
2020-07-10 15:30:11 +08:00
Wei Luning b522368161 fix bug of quant export without input fakequant. 2020-07-10 14:11:45 +08:00
mindspore-ci-bot bccfa48509 !2980 Prevent empty column names
Merge pull request !2980 from nhussain/empty_column_b
2020-07-10 11:19:37 +08:00
leilei_snow 9b21420b3e update SSIM loss, add MSSSIM loss feature; add their ut testcases. 2020-07-10 11:11:48 +08:00
mindspore-ci-bot 00368b3683 !2972 Improving implicit type conversion
Merge pull request !2972 from zhangbuxue/Improving_implicit_type_conversion
2020-07-10 09:36:49 +08:00
Zirui Wu 7b15e5a742 rework on lookup
add test caser

fix ci

address review cmts

ci

addr review cmt

fix typo

address review cmts

add 2 more test cases

cpplint fix

addr cpplint

addr ci

fix tst case err

fix doc str
2020-07-09 17:10:18 -04:00
nhussain 2c7fd248f8 fixes for PR-2908: avoid empty strings for column names 2020-07-09 11:44:33 -04:00
buxue 4df1edf5b3 Improving implicit type conversion 2020-07-09 21:38:00 +08:00
wuyongkang e12255ad84 Add MixedPrecisionCast for KeywordArg 2020-07-09 19:10:57 +08:00
buxue 4e832b2309 support implicit type conversion for pynative mode 2020-07-09 15:41:41 +08:00
mindspore-ci-bot 323a80c620 !2765 fix large for loop segment fault
Merge pull request !2765 from fary86/fix_large_for_loop
2020-07-09 09:43:03 +08:00
mindspore-ci-bot 5fc6dcfb65 !2915 [Auto parallel] Rewrite EmbeddingLookup
Merge pull request !2915 from Xiaoda/8-move-embeddinglookup-external
2020-07-09 09:40:34 +08:00
nhussain 6c37ea3be0 fix validators
fixed random_apply tests

fix validators

fixed random_apply tests

fix engine validation
2020-07-08 16:40:33 -04:00
mindspore-ci-bot 915ddd25dd !2892 gnn random walk pr 1977 comment follow up
Merge pull request !2892 from tony_liu2/master
2020-07-09 03:35:55 +08:00
mindspore-ci-bot e2f51ccec8 !2922 updating the python ut tests based on floating point bounding boxes
Merge pull request !2922 from ava/float_change
2020-07-08 22:39:42 +08:00
Xiaoda Zhang fc906f7f58 move embeddinglookup to external 2020-07-08 16:27:40 +08:00
mindspore-ci-bot dffb76a0a9 !2605 High level abstraction of mathematical distributions
Merge pull request !2605 from XunDeng/pp_poc_v3
2020-07-08 12:44:52 +08:00
mindspore-ci-bot 403c1db8ce !2869 fix print bug
Merge pull request !2869 from jinyaohui/master
2020-07-08 09:40:29 +08:00
zhousiyi 9ad7c652a2 make abstractref can join with abstracttensor 2020-07-08 01:28:15 +00:00
peixu_ren bef1fc7f19 add sample functions in normal and bermoulli distributions 2020-07-07 18:13:58 -04:00
avakh 421b80bf8f updating python unit tests based on floating point bounding boxes + adding coco dataset in unit tests 2020-07-07 18:05:49 -04:00
tony_liu2 14899a1410 fix gnn random walk pr 1977 comments
add fix to random resize decode crop test case

fix pylint issues
2020-07-07 17:32:08 -04:00
Xun Deng 0aa26c1815 add high level abstract class Distribution and two example class:
Bernoulli and Normal
2020-07-07 17:29:42 -04:00
mindspore-ci-bot 9ba937b1af !2920 Updating 3 BBox AugOps for Float + Common Files for BBox Float Support - (VertFlip/RandomCrop/RandomResizeCrop)
Merge pull request !2920 from danishnxt/AugOps-M1-Python
2020-07-08 05:18:58 +08:00
mindspore-ci-bot c9929fd8a1 !2900 Update BoundingBoxAugment and RandomHorizontalFlipWithBBox to use float
Merge pull request !2900 from islam_amin/object_ops_cc_float
2020-07-08 03:53:39 +08:00
mindspore-ci-bot 92d2011b8b !2924 [Dataset Python UT] Disable md5 random perspective test
Merge pull request !2924 from TinaMengtingZhang/redo-skip-md5-random-perspective-test
2020-07-08 03:52:21 +08:00
Danish Farid 78c370f72a First Commit - New Infrastructure - Python UT tests + Common Aug Files
fix accidental change overwrite

fix 2

updated inits from 0 to 0.0 for float

improvd python ut comments

updated macro
2020-07-07 14:50:34 -04:00
tinazhang 8455f957ac disable md5 random perspective test case 2020-07-07 14:21:06 -04:00
jinyaohui c7f6527e92 fix print file bug 2020-07-07 21:05:17 +08:00
mindspore-ci-bot faa1084bd8 !2865 asymmetric param row split support for GatherV2
Merge pull request !2865 from yihuaijie/dev
2020-07-07 20:04:32 +08:00
mindspore-ci-bot 5baae2ebd0 !2884 Add TBE op UnsortedSegmentProd for VM.
Merge pull request !2884 from liuxiao93/UnsortedSegmentProd
2020-07-07 17:12:43 +08:00
mindspore-ci-bot bd60db5c11 !2811 support vm for ParallelConcat
Merge pull request !2811 from jiangjinsheng/vm_parallel_concat
2020-07-07 16:23:46 +08:00
liuxiao93 2b0ecfd2b1 Add TBE op UnsortedSegmentProd for VM. 2020-07-07 15:35:00 +08:00
Yi Huaijie cae254f4df asymmetric row split support for GatherV2 2020-07-07 14:36:07 +08:00
islam_amin dfc3409f67 Update RandomHorizontalFlipWithBBox and BoundingBouxAugment C++ Ops to use floats 2020-07-06 23:49:21 -04:00
mindspore-ci-bot 751b5e6fac !2897 Modify VOCDataset output float dtype bbox
Merge pull request !2897 from xiefangqi/md_voc_support_float
2020-07-07 11:11:19 +08:00
xiefangqi 62d55fdbce vocdataset support float bbox 2020-07-07 10:07:42 +08:00
jiangjinsheng a3565a75d1 vm for ParallelConcat 2020-07-06 18:35:12 +08:00
changzherui 17da929b82 syn code 0706 2020-07-06 17:51:17 +08:00
mindspore-ci-bot 3d377c51b9 !2839 support vm for PopulationCount
Merge pull request !2839 from jiangjinsheng/vm_population_count
2020-07-06 17:32:08 +08:00
mindspore-ci-bot aef002ad6c !2809 support Python built-in function 'enumerate'
Merge pull request !2809 from zhangbuxue/support_Python_built-in_functions_enumerate
2020-07-06 09:38:47 +08:00
leilei_snow 5cccfbc61b Add TransShape Operator. 2020-07-05 03:34:35 +00:00
mindspore-ci-bot b5066e81ee !2308 Unskip md5 python UT case for RandomPerspective
Merge pull request !2308 from TinaMengtingZhang/unskip-case-random-perspective
2020-07-04 03:37:58 +08:00
tinazhang dc03019200 unskip md5 testcase for RandomPerspective 2020-07-03 13:10:13 -04:00
Danish Farid 5a9673ee6f fix_annotate bug fix 2020-07-03 11:17:13 -04:00
jiangjinsheng ee7aef98df vm for PopulationCount 2020-07-03 17:47:11 +08:00
mindspore-ci-bot 860a32632e !2671 vm for MaxPoolGradGrad, MaxPoolGradGradWithArgmax
Merge pull request !2671 from jiangjinsheng/vm_max_pool_ext2
2020-07-03 17:40:54 +08:00
buxue cfa41733d6 support Python built-in function 'enumerate' 2020-07-03 14:42:10 +08:00
fary86 e17469bf42 Fix bug of large for loop 2020-07-03 11:15:41 +08:00
mindspore-ci-bot 2cd9649b9e !2810 Add operator adapting in ME for Softsign
Merge pull request !2810 from zhangzheng/softsign
2020-07-03 09:31:59 +08:00
mindspore-ci-bot 391f5e44e4 !2832 check types for optional boolean parameters
Merge pull request !2832 from Peilin/invalid-type-bucket-check
2020-07-03 09:20:28 +08:00
Hoai Linh Tran 6bd66e7953 Fix memcpy calls. Add ut tests for arithmetic_simplify. Split long arithmetic_simplify.h to arithmetic_simplify.cc
Code checking
2020-07-02 17:51:08 -04:00
peilin-wang 29aa589972 added check for invalid type for boolean args 2020-07-02 16:49:09 -04:00
mindspore-ci-bot c1a53d3f68 !2822 Fix bool tensor problem
Merge pull request !2822 from hewei/fix_bool_tensor
2020-07-02 20:41:27 +08:00
He Wei a0623e1528 Fix bool type tensor problem
Problem: Create 'uint8' type tensor from float data raise RuntimeError;
Fix:  Use same internal data type for 'uint8' and 'bool' tensor and allows
convert float data to bool tensor.
2020-07-02 19:22:35 +08:00
panbingao 1e51414f1b Adapting operator Softsign in ME 2020-07-02 03:31:25 -04:00
liuxiao ddedc41613 Add TBE operators SparseApplyFtrlV2\SparseApplyAdagradV2 for VM. 2020-07-02 12:00:58 +08:00
mindspore-ci-bot f1a9a7ceb1 !2718 fix quantization aware training auto create graph bug
Merge pull request !2718 from chenzhongming/master
2020-07-02 09:57:30 +08:00
mindspore-ci-bot 622b97f3b6 !2787 Add op ScatterMul ScatterDiv vm
Merge pull request !2787 from zhaozhenlong/op/scatter-div-mul-vm
2020-07-01 20:41:03 +08:00
jiangjinsheng ce4e15b0b3 vm for MaxPoolExt2,MaxPoolGradGrad,MaxPoolGradGradWithArgmax 2020-07-01 17:05:11 +08:00
yangzhenzhang 2351845ede delete shape validation in initializer 2020-07-01 16:01:31 +08:00
zhaozhenlong 8d9939eaa4 ScatterMull and ScatterDiv vm 2020-07-01 15:49:24 +08:00
mindspore-ci-bot 4eafb21ea8 !2638 support vm for mod
Merge pull request !2638 from jiangjinsheng/vm_mod
2020-07-01 14:26:07 +08:00
mindspore-ci-bot 30fc1bd0c3 !2747 refactor StridedSlice op
Merge pull request !2747 from zhangbuxue/refactor_the_StridedSlice_op
2020-07-01 12:04:11 +08:00
buxue be771aa9e4 refactor StridedSlice op 2020-07-01 11:08:36 +08:00
jiangjinsheng ffd0352162 vm for mod 2020-07-01 10:16:47 +08:00
mindspore-ci-bot d1fa90a3d9 !2769 fix get loss error and NoneType error cause by _proceesor_specified_data
Merge pull request !2769 from ougongchang/fix_nonetype
2020-07-01 10:01:05 +08:00
mindspore-ci-bot ea475637a1 !2720 fix assign used in while loop
Merge pull request !2720 from xychow/fix-assign-in-while
2020-07-01 09:16:13 +08:00
mindspore-ci-bot 9377e432d2 !2766 get default value if num_parallel_workers is None
Merge pull request !2766 from yanghaitao/yht_serialize_num_parallel_worker
2020-06-30 23:11:44 +08:00
ougongchang cd868aea52 fix get loss error and NoneType error cause by _proceesor_specified_data
fix get loss error when it not a scalar and fix process specified data
failed when the action is False, and collect_specified_data parameter is
not None
2020-06-30 21:11:06 +08:00
yanghaitao 365c901ee0 get default value if num_parallel_worker is None 2020-06-30 21:10:37 +08:00
mindspore-ci-bot 3a89f93cc5 !2699 add ScatterMax ScatterMin ScatterSub vm
Merge pull request !2699 from zhaozhenlong/op/scatter-max-vm
2020-06-30 20:10:17 +08:00
mindspore-ci-bot fe82d82155 !1904 Add IndexedSlices
Merge pull request !1904 from riemann_penn/add_indexed_slices
2020-06-30 19:03:12 +08:00
mindspore-ci-bot 2fadbb1d04 !2743 add more ut and st for SummaryCollector
Merge pull request !2743 from ougongchang/summary_collector_ut
2020-06-30 18:58:03 +08:00
panyifeng d6635bbbe2 Add IndexedSlices 2020-06-30 17:38:24 +08:00
chenzomi 1089c908a9 cherry-pick r0.5 to master for quantizaiton aware training 2020-06-30 17:23:08 +08:00
ougongchang 3dc6f6f2d9 add more ut and st for SummaryCollector
Has fixed collecting optimizer error when mode is eval
2020-06-30 17:02:03 +08:00
zhousiyi d5255fe311 fix assign used in while 2020-06-30 08:22:27 +00:00
guohongzilong 652093642e change order param same as group params 2020-06-30 14:56:55 +08:00
mindspore-ci-bot d08a89ab87 !2737 makes 0 an invaild bucket size
Merge pull request !2737 from Peilin/zero-input-bucket-check
2020-06-30 05:33:41 +08:00
mindspore-ci-bot 1227719cdd !2603 [Dataset Python UT] Cleanup mse and md5 validation
Merge pull request !2603 from TinaMengtingZhang/I1LTCA-mse-check-cleanup
2020-06-30 04:46:49 +08:00
peilin-wang 9468b49e28 bucket_batch_sizes must be strictly positive, 0 is not a valid batch size 2020-06-29 16:34:39 -04:00
mindspore-ci-bot c70e6987ba !2624 Fix config test
Merge pull request !2624 from EricZ/fix_config_test
2020-06-30 01:11:12 +08:00
mindspore-ci-bot 9b4399480a !2321 Connector throughput performance metric
Merge pull request !2321 from Alexey_Shevlyakov/connector_throughput_dev
2020-06-29 23:54:42 +08:00
tinazhang66 5cd3136355 remove local defined mse and add missing mse/md5 validation 2020-06-29 11:51:07 -04:00
mindspore-ci-bot 51c4f4a499 !2683 Add TBE operaters ApplyAddSign\ApplyPowerSign\ApplyGradientDescent\ApplyProximalGradientDescent for VM.
Merge pull request !2683 from liuxiao/ops-for-VM
2020-06-29 21:30:17 +08:00
mindspore-ci-bot 5b8957a884 !2717 dataset: some parameter check for NumpySlices and num_sharads
Merge pull request !2717 from ms_yan/check_param
2020-06-29 20:02:36 +08:00
ms_yan 7fa0d9e7e4 add paramter check for numpyslices and num_shards 2020-06-29 19:12:52 +08:00
jinyaohui dd5fba1db9 add notice 2020-06-29 17:39:25 +08:00
zhaozhenlong a8654ac3b5 add ScatterMax ScatterMin ScatterSub for vm 2020-06-29 17:21:08 +08:00
jin-xiulang 8dff818a18 Add Laplace random operator. 2020-06-29 15:51:59 +08:00
mindspore-ci-bot 6fb5538117 !2661 add support dtype for scatter_add vm
Merge pull request !2661 from zhaozhenlong/op/scatter-add
2020-06-29 11:46:49 +08:00
liuxiao 2097a0e90a Add optimizer operators for VM. 2020-06-29 11:35:45 +08:00
mindspore-ci-bot 99d4289251 !248 Add 5 random ops
Merge pull request !248 from peixu_ren/custom_aicpu
2020-06-29 09:15:22 +08:00
peixu_ren c5f72582dc Added 5 random ops 2020-06-28 12:34:02 -03:00
mindspore-ci-bot 9be17e2a59 !2668 support weight decay for sparse optimizer
Merge pull request !2668 from wangnan39/support_weight_decay_for_sparse_optimizer
2020-06-28 22:24:45 +08:00
mindspore-ci-bot 0ab7fd98ea !2654 fix: tfrecord to mindrecord para check
Merge pull request !2654 from guozhijian/fix_tfrecord_to_mr_para_check
2020-06-28 22:06:50 +08:00
mindspore-ci-bot 32a2d5d21c !2629 get monitor sampling interval from json file
Merge pull request !2629 from yanghaitao/yht_sampling_interval
2020-06-28 20:05:05 +08:00
mindspore-ci-bot 363489d00f !2580 BasicTokenizer do not case fold on preserved words
Merge pull request !2580 from qianlong21st/fix_basic_tokenizer
2020-06-28 19:36:28 +08:00
mindspore-ci-bot db6c4bf784 !2640 [MD] fix minddata error message
Merge pull request !2640 from liyong126/minddataset_fix_errmsg
2020-06-28 19:36:23 +08:00
wangnan39@huawei.com 172728a6a6 support weight decay for sparse optimizer 2020-06-28 17:49:03 +08:00
jonyguo 3450c35d9b fix: tfrecord to mindrecord parameter check 2020-06-28 17:48:52 +08:00
mindspore-ci-bot bc30576ac9 !2631 Add ExpandDims to whitelist
Merge pull request !2631 from amongo/FixExpandDimsOps
2020-06-28 17:40:20 +08:00
zhaozhenlong d55c0f6679 complement scatter add support dtype 2020-06-28 16:51:53 +08:00
qianlong cae77c0c22 BasicTokenizer not case fold on preserverd words 2020-06-28 16:28:00 +08:00
liyong 68e2097897 fix split erroer message 2020-06-28 15:47:10 +08:00
zhaozhenlong 15580f8f6e limit ssim input img type to fp32 and fp16 2020-06-28 15:36:30 +08:00
zhaozhenlong 71d33b087e limit ssim input img type to fp32 and fp16 2020-06-28 15:35:07 +08:00
yanghaitao fd701b8504 set monitor sampling interval through json file 2020-06-28 15:18:21 +08:00
huangdongrun 96b38f72b2 add ExpandDims whitelist
add comment for control_depend
2020-06-28 11:29:16 +08:00
Eric a4f5802924 Added Fix for test config 2020-06-27 15:20:48 -04:00
mindspore-ci-bot 87213648bc !2612 delete pynative lenet test
Merge pull request !2612 from changzherui/del_test
2020-06-27 18:38:36 +08:00
changzherui 9e83337e2f delete pynative lenet_model test 2020-06-27 15:33:27 +08:00
Ziyan 0925e35252 enable optimizer parallel with broadcast 2020-06-27 14:36:17 +08:00
mindspore-ci-bot df795daf75 !2562 [bug]when multi times print same thing, do not merge in cse
Merge pull request !2562 from vlne-v1/I1LHCF-print-multi-times-and-same-str
2020-06-27 07:26:52 +08:00
Alexey Shevlyakov 698abf75fc Connector throughput + PerfData + CyclicArray 2020-06-26 14:45:01 -04:00
mindspore-ci-bot a1b17bd2e2 !2593 python unit tests for randomResizeWithBBox and ResizeWithBBox
Merge pull request !2593 from ava/python_ut_tests
2020-06-27 02:31:31 +08:00
avakh 1e869146e9 applying comments removing VOC 2020-06-26 12:39:48 -04:00
Cathy Wong 277aba5326 dataset: Fixup docs; remove pylint disabled messages in UT 2020-06-26 12:26:41 -04:00
mindspore-ci-bot e11c953225 !2587 Implementing Python UTs for BoundingBoxAugment and RandomHorizontalFlipWithBBox
Merge pull request !2587 from imaaamin/object_ops_ut
2020-06-26 00:43:31 +08:00
mindspore-ci-bot 067592ccf9 !2590 Updated Python UTs for RandomVerticalFlipWithBBox, RandomCropWithBBox and RandomResizedCropWithBBox
Merge pull request !2590 from danishnxt/AugOps2
2020-06-25 23:40:34 +08:00
islam_amin 0f58f0338e updating ut for RandomHorizontalFlipWithBBox and BBoxAugment 2020-06-25 11:35:22 -04:00
mindspore-ci-bot b0a10c26a4 !2532 adding random-resize-with-bbox-op and resize-with-bbox-op
Merge pull request !2532 from ava/NNNewMaster
2020-06-25 20:42:00 +08:00
Danish Farid 3d1ecaaeb5 updated UT test for Python (3) AugOps with BBox - MD5 checks + imrpv comments 2020-06-25 03:19:14 -04:00
avakh 587e260236 addressing comments 2020-06-24 18:54:47 -04:00