Commit Graph

1734 Commits

Author SHA1 Message Date
yao_yf f60d81a15f support reshape redistribution in all scenes 2020-10-13 21:21:17 +08:00
Lizhenglong 46667aac4f Transition tools for tensorrecord to mindrecord,support 1.13.0-rc1 and higher version 2020-10-12 16:06:34 +08:00
xsmq 6364d56ebe 回退 'Pull Request !6995 : Support the transition of datarecord from 1.x.x version Tensorflow to Mindspore ' 2020-10-12 14:16:04 +08:00
mindspore-ci-bot e62481845e !6995 Support the transition of datarecord from 1.x.x version Tensorflow to Mindspore
Merge pull request !6995 from lizhenglong1992/TF_to_MR
2020-10-12 11:52:36 +08:00
lizhenglong 16ef0977ee support_1.x.x tfrecord to mindrecord 2020-10-12 10:29:34 +08:00
buxue 559c741cce improve the way passing ags of partial 2020-10-12 09:40:20 +08:00
mindspore-ci-bot 55e369a125 !7144 [ME] change `check_integer` to format `check_positive_int` and `check_integeter`
Merge pull request !7144 from chenzhongming/zomi_master
2020-10-10 14:14:38 +08:00
chenzomi d471d32e87 [ME] change `check_integer` to format `check_positive_int` and `check_integeter` 2020-10-10 12:08:10 +08:00
mindspore-ci-bot 3d21c80e3b !7110 [ME] delete check_bool and replace with Validate.check_bool
Merge pull request !7110 from chenzhongming/zomi_master
2020-10-10 11:56:39 +08:00
mindspore-ci-bot fd0c03c493 !7090 implement parallel BroadcastTo
Merge pull request !7090 from yihuaijie/master
2020-10-09 19:10:20 +08:00
chenzomi d4e8e94981 [ME] delete check_bool and replace with Validate.check_bool 2020-10-09 16:46:07 +08:00
Yi Huaijie 45d373d40e implement parallel BroadcastTo 2020-10-09 15:17:37 +08:00
mindspore-ci-bot ab9cec0531 !7083 Support Categorical distribution
Merge pull request !7083 from XunDeng/categorical
2020-10-09 09:47:40 +08:00
mindspore-ci-bot b1dd00f3a9 !7092 Support Logistic Distribution
Merge pull request !7092 from XunDeng/logistic
2020-10-09 09:16:58 +08:00
Xun Deng 05a0dac125 add logistic distribution 2020-10-08 10:23:50 -04:00
Ziyan ddc0113058 enable parallel optimizer in auto parallel 2020-10-08 14:51:15 +08:00
Xun Deng 877b561e77 added categorical distribution 2020-10-07 11:49:44 -04:00
mindspore-ci-bot 6f77ec45f1 !6905 [MD] Enable cache for more leaf datasets
Merge pull request !6905 from lixiachen/CacheOp_dev
2020-09-30 16:49:23 +08:00
mindspore-ci-bot 86bbd1dc98 !6832 Add BCELoss
Merge pull request !6832 from wanyiming/add_BCELoss
2020-09-30 11:47:44 +08:00
mindspore-ci-bot 58610443cb !7023 modify endofsequence for multi-machine
Merge pull request !7023 from HW_KK/master
2020-09-30 08:40:57 +08:00
wuweikang a32811e160 modify endofsequence for multi-machine 2020-09-29 16:17:38 +08:00
wanyiming 4e93413c5a add_BCELoss 2020-09-29 10:23:38 +08:00
mindspore-ci-bot 2a799fe90e !6018 Set the number of epochs in mode.train() non-sink Mode
Merge pull request !6018 from h.farahat/ms_nonsink_epochs
2020-09-28 22:15:54 +08:00
xiefangqi 82bc278e26 minddata use new ps api 2020-09-27 17:38:22 +08:00
jonyguo 19ca9762db skip graphdata distributed test case when asan mode 2020-09-27 16:24:20 +08:00
mindspore-ci-bot 5171c90048 !6908 Added raise_not_implement_error functionality in distribution
Merge pull request !6908 from XunDeng/not_impl_error
2020-09-27 14:54:59 +08:00
mindspore-ci-bot 9bd34a1b29 !6673 Add stage information for ops and strategy
Merge pull request !6673 from huangxinjing/stage_strategy
2020-09-27 11:31:07 +08:00
Xun Deng ea57699ed1 added raise_not_implemented_error in distribution 2020-09-25 17:15:04 -04:00
Lixia Chen 477808e622 Enable cache for other leaf ops 2020-09-25 13:11:04 -04:00
mindspore-ci-bot 0d8015b043 !5300 [MD] Add nD Slice Support
Merge pull request !5300 from nhussain/slice_op
2020-09-25 20:38:19 +08:00
mindspore-ci-bot b785b7d0ff !6813 dataset UT: check PIL version, delete test_callback_2maps
Merge pull request !6813 from cathwong/ckw_dataset_cleanup8
2020-09-25 20:34:55 +08:00
hesham 9cee0d2143 Add num_epochs to non-sink training 2020-09-24 23:24:43 -04:00
huangxinjing 4ef439e27b Add stage information for ops and strategy 2020-09-25 10:42:43 +08:00
Cathy Wong f2b07d907a dataset UT: check PIL version, delete test_callback_2maps 2020-09-24 17:01:06 -04:00
mindspore-ci-bot 4c0b3c1bd3 !6017 per_batch_map needs to support x input columns and y output columns
Merge pull request !6017 from ZiruiWu/per_batch_map_multi_col
2020-09-25 04:08:01 +08:00
mindspore-ci-bot e88e114a50 !5930 Cache server phase 2 single node
Merge pull request !5930 from Jamie/CacheOp_dev
2020-09-25 03:54:55 +08:00
nhussain 77d507279c first working implementation
add string implementation, can handle partial string slices

finish core implementation, added Index object

fix up the logic

add in new SliceOption object, cleaning up tests
2020-09-24 15:39:28 -04:00
Lixia Chen 983827ec5c Rebase up to 88ded11f59 2020-09-24 14:09:08 -04:00
Zirui Wu 0cab373223 per_batch_map supports x num_columns to y num_columns
decided to use project after batch as well

per_batch_map 1->x colunm works

add more test case

add test cases, project after map

col order hahaah

fix ci

add test cases

addr review cmts

ci

fix build err

fix test case failure

ci
2020-09-24 12:01:22 -04:00
mindspore-ci-bot 2f3add4acd !6301 [MD] Combine c++ and python ops in map
Merge pull request !6301 from nhussain/c_py_compose
2020-09-24 23:10:47 +08:00
mindspore-ci-bot 55be3c42a5 !5875 Add IFMR op for new backend.
Merge pull request !5875 from liuxiao93/IFMR-OpenSource-new-backend
2020-09-24 15:01:08 +08:00
peixu_ren 23ff21edd8 Added lognormal distribuition 2020-09-23 16:57:33 -04:00
mindspore-ci-bot 39874d133f !6644 fix testcase running slowly
Merge pull request !6644 from guozhijian/fix_testcase_slowly
2020-09-23 14:53:32 +08:00
mindspore-ci-bot 9f84920f64 !6761 remove redundant check about IsInstance op
Merge pull request !6761 from liangzelang/fix_isinstance_op_bug
2020-09-23 14:18:38 +08:00
liangzelang 195d97ad46 Remove redundant check about IsInstance op 2020-09-23 10:53:02 +08:00
jonyguo 1c6c54ae0f fix: testcase test_cutmix_batch_op.py slowly 2020-09-23 10:24:39 +08:00
Yi Huaijie 6066b16838 implement parallel Pack 2020-09-23 09:22:21 +08:00
mindspore-ci-bot 9475f9a19a !6548 Implement parallel Split
Merge pull request !6548 from yihuaijie/dev
2020-09-22 19:41:04 +08:00
mindspore-ci-bot f72f2c22fb !6653 fix stream sync error for mixed precesion on pynative mode
Merge pull request !6653 from chujinjin/fix_stream_sync_error_for_mixed_precision
2020-09-22 10:56:55 +08:00
liuxiao93 0e02df812a Add IFMR op for new backend.
(cherry picked from commit 17a5995e97)
2020-09-22 10:12:12 +08:00
mindspore-ci-bot 091ee5085e !6651 Modify init interface to internal interface
Merge pull request !6651 from lijiaqi/init
2020-09-22 09:06:48 +08:00
nhussain fda9462682 embed python compose op
Leaf ops do self-reset.

embed python compose op

add implicit compose op

more tests
2020-09-21 11:24:55 -04:00
Jiaqi 4e3e6006b6 modify init 2020-09-21 21:49:28 +08:00
mindspore-ci-bot dfe77372f5 !6505 Set top graph parameters' name the same as original graph parameters.
Merge pull request !6505 from 张清华/master2
2020-09-21 20:06:59 +08:00
chujinjin 1cf8f3b777 fix stream sync error for mixed precision 2020-09-21 19:10:25 +08:00
mindspore-ci-bot 428927bdff !6554 fix pylint
Merge pull request !6554 from jinyaohui/master
2020-09-21 19:09:21 +08:00
mindspore-ci-bot dde9f5ac25 !6607 delete SoftmaxCrossEntropyExpand interface
Merge pull request !6607 from ghzl/delete-SoftmaxCrossEntropyExpand
2020-09-21 17:51:24 +08:00
Zhang Qinghua 6c72d88ba1 Set top graph parameters' name as original graph parameters. 2020-09-21 17:44:02 +08:00
jinyaohui 334a32d501 fix pylint 2020-09-21 16:24:04 +08:00
Wei Luning cdbd16de0c fix bug in parameter set & fix code style in pynative_executa.cc 2020-09-21 11:32:39 +08:00
guohongzilong a754dea90c delete SoftmaxCrossEntropyExpand 2020-09-20 21:17:24 +08:00
mindspore-ci-bot 861602bce9 !6512 Clean up the view code
Merge pull request !6512 from shenwei41/sw_master
2020-09-19 23:04:26 +08:00
mindspore-ci-bot 3aa07a4362 !6320 change mix_precision to c++
Merge pull request !6320 from vlne-v1/pynative_amp
2020-09-19 21:29:34 +08:00
mindspore-ci-bot 4905de06bd !6545 improve the recognition of Parameter object and raise error when convert keywordarg to pydata
Merge pull request !6545 from zhangbuxue/improve_the_recognition_of_Parameter_object_and_raise_error_when_convert_keywordarg_to_pydata
2020-09-19 21:25:02 +08:00
shenwei41 f2e34b2eaf Clean up the view code 2020-09-19 19:02:04 +08:00
mindspore-ci-bot 53a82fa6e0 !6472 fix get_dataset_size error in CelebaDataset when usage is not 'all'
Merge pull request !6472 from yanghaitao/yht_celeba_get_dataset_size
2020-09-19 18:07:25 +08:00
buxue 483c8a179a improve the recognition of Parameter object and raise error when convert keywordarg to pydata 2020-09-19 18:01:00 +08:00
mindspore-ci-bot 5a20b11012 !6502 [AutoParallel]Fix auto parallel find loss bug
Merge pull request !6502 from lichen/fix_auto_parallel_find_loss_bug
2020-09-19 15:56:56 +08:00
mindspore-ci-bot 92aecf128f !6549 [MD] minddata add iterator parameter validation
Merge pull request !6549 from xiefangqi/add_output_numpy_valid
2020-09-19 14:30:10 +08:00
yanghaitao1 4ff4c17632 fix get_dataset_size in CelebADataset when usage is not all 2020-09-19 02:16:29 -04:00
Yi Huaijie 18ed2bec53 implement parallel Split 2020-09-19 12:35:56 +08:00
xiefangqi a6360cb2e4 add output_numpy validation to iterator 2020-09-19 11:56:24 +08:00
yanghaitao1 dd0d9fe9ab fix ci error 2020-09-18 23:49:20 -04:00
kpy 44c01e27c0 do mixprecision in c++ for pynative 2020-09-19 10:38:09 +08:00
mindspore-ci-bot 1cfad93704 !6479 fix bucket_batch_by_length show pyfunc timeout
Merge pull request !6479 from yanghaitao/yht_bucket_batch_ci
2020-09-19 09:30:43 +08:00
lichenever d4bba3f1d2 fix_auto_parallel_find_loss_bug 2020-09-18 20:27:33 +08:00
yanghaitao1 da15495d7b fix bucket_batch ci error 2020-09-18 08:16:14 -04:00
mindspore-ci-bot 4d54de100b !6411 [Auto parallel] Add a flag to control whether to overwrite the right-node in triangle-elimination of DP algorithm
Merge pull request !6411 from Xiaoda/23-fix-the-triangle-elimination-problem
2020-09-18 19:32:37 +08:00
Xiaoda Zhang 970490a6f0 add a flag to control whether overwrite the right-node in triangle elimination of DP algorithm 2020-09-18 15:37:18 +08:00
mindspore-ci-bot 8346da267b !6400 add overflow check for make_range and optimize isinstance processing
Merge pull request !6400 from zhangbuxue/add_overflow_check_for_make_range_and_optimize_isinstance_processing
2020-09-18 11:07:12 +08:00
mindspore-ci-bot d8d2a70cb3 !6344 [AutoParallel]fix auto parallel multigraph bug
Merge pull request !6344 from lichen/fix_auto_parallel_mutigraph_bug
2020-09-17 20:30:32 +08:00
buxue 14f6c95c28 add overflow check for make_range and optimize isinstance processing 2020-09-17 19:47:10 +08:00
lichenever 6b2a9de09f fix auto parallel mutigrpah bug 2020-09-17 14:51:14 +08:00
mindspore-ci-bot c57a472748 !5918 optimizer pynative memory
Merge pull request !5918 from flywind/optimizer_pynative_memory
2020-09-17 09:44:36 +08:00
mindspore-ci-bot 5e43308613 !6365 Refactoring Laplace random operator.
Merge pull request !6365 from jxlang910/push-to-opensource
2020-09-17 09:16:36 +08:00
mindspore-ci-bot 72d5256d1c !6332 check wether full_batch valid
Merge pull request !6332 from yihuaijie/master
2020-09-17 09:09:32 +08:00
jin-xiulang 5873614b86 Refactoring laplace random operator. 2020-09-16 18:40:31 +08:00
buxue 458498900c support not in and add check for grad_with_sens with no sense provide. 2020-09-16 17:28:17 +08:00
kpy 4338dd266e optimizer pynative graph memory 2020-09-16 16:14:05 +08:00
mindspore-ci-bot 111efc7538 !6248 change the API interface of op ConfusionMulGrad
Merge pull request !6248 from lihongkang/v2_master
2020-09-16 14:55:05 +08:00
Yi Huaijie e4cd67596f raise RuntimeError when using full_batch neither under semi_auto_parallel nor auto_parallel 2020-09-16 14:51:09 +08:00
mindspore-ci-bot 3fe8916afa !6241 [bug]add doc for some Parameter property & fix bug for `Isinstance`
Merge pull request !6241 from vlne-v1/I1V5VO-fix-isinstance
2020-09-16 10:13:30 +08:00
mindspore-ci-bot bef2118253 !6300 [MD] fix get_dataset_size bug when set num_samples in DistributedSampler
Merge pull request !6300 from liyong126/fix_md_num_samples
2020-09-16 09:56:53 +08:00
mindspore-ci-bot 0d486adef1 !3974 Eliminate the pause for each cycle of the Repeat
Merge pull request !3974 from lixiachen/repeat_task2
2020-09-16 09:35:39 +08:00
mindspore-ci-bot 14b4763b15 !6224 Move pp test cases to probability folder
Merge pull request !6224 from XunDeng/pp_tests_folder_update
2020-09-16 08:57:01 +08:00
liyong 930e85ed5c fix get_dataset_size in distributedSampler & num_samples 2020-09-15 22:53:57 +08:00
Wei Luning 8d17a2b8af * add doc for some Parameter property.* add export in quant __all__* fix bug for isinstance & add ut for it 2020-09-15 18:25:12 +08:00
lihongkang 74e3adebb8 change api interface 2020-09-15 15:25:28 +08:00
buxue c3c06514d7 perfect annotation of ops and context and support bool equal 2020-09-15 14:32:02 +08:00
mindspore-ci-bot b83d921735 !3317 add check for stridedslice when choose aicpu or aicore
Merge pull request !3317 from zhangbuxue/add_check_for_stridedslice_when_choose_aicpu_or_aicore
2020-09-15 10:37:09 +08:00