Commit Graph

2375 Commits

Author SHA1 Message Date
mindspore-ci-bot 4905de06bd !6545 improve the recognition of Parameter object and raise error when convert keywordarg to pydata
Merge pull request !6545 from zhangbuxue/improve_the_recognition_of_Parameter_object_and_raise_error_when_convert_keywordarg_to_pydata
2020-09-19 21:25:02 +08:00
shenwei41 f2e34b2eaf Clean up the view code 2020-09-19 19:02:04 +08:00
mindspore-ci-bot 53a82fa6e0 !6472 fix get_dataset_size error in CelebaDataset when usage is not 'all'
Merge pull request !6472 from yanghaitao/yht_celeba_get_dataset_size
2020-09-19 18:07:25 +08:00
buxue 483c8a179a improve the recognition of Parameter object and raise error when convert keywordarg to pydata 2020-09-19 18:01:00 +08:00
mindspore-ci-bot 5a20b11012 !6502 [AutoParallel]Fix auto parallel find loss bug
Merge pull request !6502 from lichen/fix_auto_parallel_find_loss_bug
2020-09-19 15:56:56 +08:00
mindspore-ci-bot 92aecf128f !6549 [MD] minddata add iterator parameter validation
Merge pull request !6549 from xiefangqi/add_output_numpy_valid
2020-09-19 14:30:10 +08:00
yanghaitao1 4ff4c17632 fix get_dataset_size in CelebADataset when usage is not all 2020-09-19 02:16:29 -04:00
Hoai Linh Tran 46f07efc31 Fix AdjustAllReduceMulAdd pass
Revive tests in lib_test

Code cleaning
2020-09-19 01:07:01 -04:00
Yi Huaijie 18ed2bec53 implement parallel Split 2020-09-19 12:35:56 +08:00
xiefangqi a6360cb2e4 add output_numpy validation to iterator 2020-09-19 11:56:24 +08:00
yanghaitao1 dd0d9fe9ab fix ci error 2020-09-18 23:49:20 -04:00
kpy 44c01e27c0 do mixprecision in c++ for pynative 2020-09-19 10:38:09 +08:00
mindspore-ci-bot 1cfad93704 !6479 fix bucket_batch_by_length show pyfunc timeout
Merge pull request !6479 from yanghaitao/yht_bucket_batch_ci
2020-09-19 09:30:43 +08:00
lichenever d4bba3f1d2 fix_auto_parallel_find_loss_bug 2020-09-18 20:27:33 +08:00
yanghaitao1 da15495d7b fix bucket_batch ci error 2020-09-18 08:16:14 -04:00
mindspore-ci-bot 4d54de100b !6411 [Auto parallel] Add a flag to control whether to overwrite the right-node in triangle-elimination of DP algorithm
Merge pull request !6411 from Xiaoda/23-fix-the-triangle-elimination-problem
2020-09-18 19:32:37 +08:00
Xiaoda Zhang 970490a6f0 add a flag to control whether overwrite the right-node in triangle elimination of DP algorithm 2020-09-18 15:37:18 +08:00
mindspore-ci-bot c8e9d46391 !6450 Change PS directory.
Merge pull request !6450 from ZPaC/master-change-ps-dir
2020-09-18 11:42:41 +08:00
mindspore-ci-bot 8346da267b !6400 add overflow check for make_range and optimize isinstance processing
Merge pull request !6400 from zhangbuxue/add_overflow_check_for_make_range_and_optimize_isinstance_processing
2020-09-18 11:07:12 +08:00
ZPaC 0b49f0fb57 change PS dir 2020-09-18 10:48:09 +08:00
mindspore-ci-bot 5d0b91cb22 !6436 [Ascend Profiling] FIx start profiling failed
Merge pull request !6436 from caifubi/profiling
2020-09-18 10:02:19 +08:00
caifubi 39039974b2 fix profiling start up fail 2020-09-18 08:56:13 +08:00
mindspore-ci-bot ddac441dfd !6171 [MD] loading dataset log / dataset validation / dataset description
Merge pull request !6171 from luoyang/c-api-pyfunc
2020-09-17 21:44:42 +08:00
luoyang 9064a5f731 add num_row check & fix api distributed sampler, lookup, default value
of usage
2020-09-17 20:31:26 +08:00
mindspore-ci-bot d8d2a70cb3 !6344 [AutoParallel]fix auto parallel multigraph bug
Merge pull request !6344 from lichen/fix_auto_parallel_mutigraph_bug
2020-09-17 20:30:32 +08:00
buxue 14f6c95c28 add overflow check for make_range and optimize isinstance processing 2020-09-17 19:47:10 +08:00
lichenever 6b2a9de09f fix auto parallel mutigrpah bug 2020-09-17 14:51:14 +08:00
mindspore-ci-bot c57a472748 !5918 optimizer pynative memory
Merge pull request !5918 from flywind/optimizer_pynative_memory
2020-09-17 09:44:36 +08:00
mindspore-ci-bot 5e43308613 !6365 Refactoring Laplace random operator.
Merge pull request !6365 from jxlang910/push-to-opensource
2020-09-17 09:16:36 +08:00
mindspore-ci-bot 72d5256d1c !6332 check wether full_batch valid
Merge pull request !6332 from yihuaijie/master
2020-09-17 09:09:32 +08:00
mindspore-ci-bot af1c5aba5b !6354 [Data][BUG]add SubStractMeanNormalize input param check
Merge pull request !6354 from xulei/lite_test0905
2020-09-17 09:06:19 +08:00
jin-xiulang 5873614b86 Refactoring laplace random operator. 2020-09-16 18:40:31 +08:00
buxue 458498900c support not in and add check for grad_with_sens with no sense provide. 2020-09-16 17:28:17 +08:00
xulei2020 85962adffd add code 2020-09-16 17:01:30 +08:00
kpy 4338dd266e optimizer pynative graph memory 2020-09-16 16:14:05 +08:00
mindspore-ci-bot 111efc7538 !6248 change the API interface of op ConfusionMulGrad
Merge pull request !6248 from lihongkang/v2_master
2020-09-16 14:55:05 +08:00
Yi Huaijie e4cd67596f raise RuntimeError when using full_batch neither under semi_auto_parallel nor auto_parallel 2020-09-16 14:51:09 +08:00
mindspore-ci-bot c899bcd001 !6111 sync-from-trunk-to-blue-zone-0912-c75b220
Merge pull request !6111 from HW_KK/master
2020-09-16 14:47:14 +08:00
wuweikang e24f534002 sync-from-trunk-to-blue-zone-0912-c75b220 2020-09-16 11:28:22 +08:00
mindspore-ci-bot 3fe8916afa !6241 [bug]add doc for some Parameter property & fix bug for `Isinstance`
Merge pull request !6241 from vlne-v1/I1V5VO-fix-isinstance
2020-09-16 10:13:30 +08:00
mindspore-ci-bot bef2118253 !6300 [MD] fix get_dataset_size bug when set num_samples in DistributedSampler
Merge pull request !6300 from liyong126/fix_md_num_samples
2020-09-16 09:56:53 +08:00
mindspore-ci-bot 0d486adef1 !3974 Eliminate the pause for each cycle of the Repeat
Merge pull request !3974 from lixiachen/repeat_task2
2020-09-16 09:35:39 +08:00
mindspore-ci-bot 14b4763b15 !6224 Move pp test cases to probability folder
Merge pull request !6224 from XunDeng/pp_tests_folder_update
2020-09-16 08:57:01 +08:00
liyong 930e85ed5c fix get_dataset_size in distributedSampler & num_samples 2020-09-15 22:53:57 +08:00
Wei Luning 8d17a2b8af * add doc for some Parameter property.* add export in quant __all__* fix bug for isinstance & add ut for it 2020-09-15 18:25:12 +08:00
lihongkang 74e3adebb8 change api interface 2020-09-15 15:25:28 +08:00
buxue c3c06514d7 perfect annotation of ops and context and support bool equal 2020-09-15 14:32:02 +08:00
mindspore-ci-bot b83d921735 !3317 add check for stridedslice when choose aicpu or aicore
Merge pull request !3317 from zhangbuxue/add_check_for_stridedslice_when_choose_aicpu_or_aicore
2020-09-15 10:37:09 +08:00
mindspore-ci-bot 7a5ef7894d !6227 dataset API docstring: Update datasets and text desc and examples
Merge pull request !6227 from cathwong/ckw_api_engine
2020-09-15 10:29:11 +08:00
mindspore-ci-bot 2b05208a6f !6153 [AutoParallel]Check device target in init
Merge pull request !6153 from lichen/add_checks_for_init
2020-09-15 09:34:56 +08:00
Cathy Wong f7adf648e9 dataset API docstring: Update datasets, samplers, graphdata and text 2020-09-14 18:10:44 -04:00
Xun Deng c64f6a0a2a move pp related tests cases to probability folder 2020-09-14 13:29:43 -04:00
mindspore-ci-bot d0e49c5cf8 !6192 Improve the functions of class SequentialCell and add examples
Merge pull request !6192 from lijiaqi/sequentialcell
2020-09-14 23:24:04 +08:00
mindspore-ci-bot 1b956c77e0 !6155 modify path of ut and st of mdp
Merge pull request !6155 from byweng/master
2020-09-14 22:30:52 +08:00
Lixia Chen b5b333726f Leaf ops do self-reset. 2020-09-14 09:48:14 -04:00
Jiaqi 76cec24098 modify sequentialcell 2020-09-14 17:13:47 +08:00
mindspore-ci-bot 9824d0b20f !6142 MindData fix batch ops issue
Merge pull request !6142 from xiefangqi/md_fix_map_issue
2020-09-14 16:00:23 +08:00
lichenever aaf7045cdf add checks for init 2020-09-14 14:40:41 +08:00
mindspore-ci-bot bb4dbf4989 !5803 Combine Async Dump with E2e Dump
Merge pull request !5803 from caifubi/dump
2020-09-14 11:47:00 +08:00
bingyaweng 866a8a1178 modify path of ut and st of mdp 2020-09-14 11:23:55 +08:00
caifubi 372c2e7951 Combine Async Dump and E2E Dump 2020-09-14 10:57:46 +08:00
mindspore-ci-bot 37e3b6082f !6002 Reduce inline passes traversal by skipping inline action if no pre-ad python pass exists
Merge pull request !6002 from BowenK/pre_ad
2020-09-14 10:16:56 +08:00
xiefangqi 653c79b4af md fix per_batch_map issue 2020-09-14 09:55:51 +08:00
mindspore-ci-bot a9a3d5a1f5 !5753 remove sens parameter
Merge pull request !5753 from lijiaqi/loss_scale_sens
2020-09-13 17:27:27 +08:00
mindspore-ci-bot c10341dfb7 !6020 Add common check_param_type and set_param_type in distribution
Merge pull request !6020 from XunDeng/new_check_param
2020-09-13 13:54:39 +08:00
Jiaqi 94d63b90f4 remove sens parameter 2020-09-13 11:34:56 +08:00
mindspore-ci-bot 02c6852699 !6108 add model with loss test case
Merge pull request !6108 from hanyang/master
2020-09-12 16:58:23 +08:00
mindspore-ci-bot 8bf5ac1c15 !6032 [bug]add import for ops in ops.py in __init__
Merge pull request !6032 from vlne-v1/change_ops_import
2020-09-12 16:57:15 +08:00
mindspore-ci-bot 72615134aa !6110 [MD] fix num_samples in concatDataset
Merge pull request !6110 from liyong126/fix_bug
2020-09-12 16:08:16 +08:00
Wei Luning 7b6899fdc0 add import of ops in in ops __init__ 2020-09-12 15:29:43 +08:00
liyong 16147669a6 fix num_samples in concatDataset 2020-09-12 15:06:18 +08:00
Wan Hanyang 0b7570eb53 add model with loss, without loso and o2 test case 2020-09-12 14:26:40 +08:00
luoyang 581335453e Change return val of GetNextRow 2020-09-12 14:19:46 +08:00
mindspore-ci-bot 3c0aa0a6e4 !6069 support function as condition of if
Merge pull request !6069 from zhangbuxue/support_function_as_condition_of_if
2020-09-12 12:39:15 +08:00
mindspore-ci-bot a084196300 !6094 Adding input checks to C API
Merge pull request !6094 from EricZ/add_input_check_capi
2020-09-12 09:47:50 +08:00
mindspore-ci-bot eb049b0e93 !5842 [Dataset] dataset op log changes
Merge pull request !5842 from luoyang/pylint
2020-09-12 09:42:42 +08:00
mindspore-ci-bot 461eeaf70d !6076 [Data]reame the lite of minddata tar name
Merge pull request !6076 from xulei/lite_test0905
2020-09-12 09:41:06 +08:00
mindspore-ci-bot 28e2b0253e !6086 Order dict by column_id in create_dict_iterator()
Merge pull request !6086 from ZiruiWu/order_dict_in_create_dict_iterator
2020-09-12 08:41:46 +08:00
eric cd5af9472e Added input check 2020-09-11 20:36:12 -04:00
Xun Deng 67325d63b0 edited common_dtype and check_param dtype logic 2020-09-11 16:51:19 -04:00
Zirui Wu d54ba374b9 order dict by column_id in create_dict_iterator()
fix CI
2020-09-11 15:33:47 -04:00
YangLuo f5a85510f2 [MD] dataset op log changes 2020-09-12 00:43:36 +08:00
nhussain 96de2ffdb6 fix errors from old compose call in Python 2020-09-11 10:30:23 -04:00
mindspore-ci-bot d8c09067ce !5801 [MD][Feature] minddata iterator output ms_tensor
Merge pull request !5801 from xiefangqi/md_modify_output_tensor
2020-09-11 20:19:06 +08:00
xulei2020 72861a68f3 add code 2020-09-11 19:28:35 +08:00
buxue b9c9046b93 support function as condition of if 2020-09-11 17:43:07 +08:00
Wan Hanyang 2ceea1e59d add a self attention test case 2020-09-11 16:30:28 +08:00
mindspore-ci-bot 5b4642d10a !4950 Fixing Minddata profiling monitor
Merge pull request !4950 from anthonyaje/monitor_fix
2020-09-11 14:34:27 +08:00
mindspore-ci-bot 48b337f206 !6026 fix some test case
Merge pull request !6026 from suteng/master
2020-09-11 14:09:11 +08:00
xiefangqi 9b3c33e157 minddata iterator output ms_tensor 2020-09-11 11:35:50 +08:00
mindspore-ci-bot cf7d6eddc4 !6019 [MD] Move Random(Choice/Apply/Order) from vision to transforms module
Merge pull request !6019 from nhussain/move_random_choice_apply
2020-09-11 10:37:21 +08:00
Su Teng 7b46f46a65 remove unuse test 2020-09-11 10:16:56 +08:00
buxue 08059f5c61 add check for stridedslice when choose aicpu or aicore 2020-09-11 10:11:14 +08:00
mindspore-ci-bot dd215f4080 !5735 delete seed0 and seed1
Merge pull request !5735 from caozhou/delete_seed
2020-09-11 09:58:56 +08:00
mindspore-ci-bot 2dfb2f3578 !6009 Add Affine transformation ut for Lite Dataset
Merge pull request !6009 from jiangzhiwen/lite/affine_ut
2020-09-11 09:57:56 +08:00
mindspore-ci-bot f1979f8fe5 !5998 change internal API _get_strategy() to _get_shard_strategy()
Merge pull request !5998 from yihuaijie/master
2020-09-11 09:15:18 +08:00
mindspore-ci-bot a778868a5a !5929 BucketBatchByLength column issue
Merge pull request !5929 from MahdiRahmaniHanzaki/bucket_batch_by_length_fix
2020-09-11 05:53:48 +08:00
nhussain f42f9ef9d7 move random apply order and choice ops 2020-09-10 15:39:56 -04:00
nhussain 92e99ff224 change map calls 2020-09-10 10:25:05 -04:00
jiangzhiwen d4ce668b9b add Affine ut 2020-09-10 21:50:56 +08:00
mindspore-ci-bot eedbbb3649 !5958 Modify interface for function and remove duplicated def
Merge pull request !5958 from lilei/modify_bug
2020-09-10 21:22:32 +08:00
BowenK e482e4e8bf reduce pass traversals if no pre-ad python pass exists 2020-09-10 20:00:10 +08:00
mindspore-ci-bot 2f529c149a !5991 Change API set_strategy() to shard()
Merge pull request !5991 from yihuaijie/master
2020-09-10 19:17:32 +08:00
mindspore-ci-bot c882e4863c !5961 [Data]Add lite_cv lib for mindspore lite data preprocessing
Merge pull request !5961 from xulei/lite_test0905
2020-09-10 18:51:07 +08:00
Yi Huaijie eb83ea9607 change internal API _get_strategy() to _get_shard_strategy() 2020-09-10 17:46:53 +08:00
mindspore-ci-bot ea94756839 !5605 Introduce usage flag to MNIST and CIFAR dataset
Merge pull request !5605 from ZiruiWu/add_usage_to_cifar_mnist_coco
2020-09-10 15:47:48 +08:00
xulei2020 b356211413 add init code 2020-09-10 15:35:08 +08:00
Yi Huaijie a836d25c64 change API set_strategy() to shard() 2020-09-10 15:30:19 +08:00
mindspore-ci-bot 7152fe04be !5783 GraphKernel supports GPU
Merge pull request !5783 from DeshiChen/graph_kernel_1.0
2020-09-10 09:15:21 +08:00
anthonyaje 2d08d83247 Fixed connector_size and monitor. 2020-09-09 17:54:59 -04:00
Zirui Wu 1bb93580dd Add usage flag to MNIST/CIFAR
ci fix 1

fix ci 2

fix ci 3

fix ci 4

fix ci 5

fix ci 6

fix ci 7

change var name in CelebA from dataset_type to usage

address review cmts

fix cpp ut fail

change mode to usage in VOCDataset

fix cmts

fix ci test case fail
2020-09-09 09:59:55 -04:00
lilei 71adabd944 modify_bug 2020-09-09 18:20:32 +08:00
dayschan 37a48f6aac GraphKernel supports GPU
1. Update akg submodule
2. Refactor akg_kernel_build, akg_ascend_kernel_build, akg_gpu_kernel_build
3. Add akg_kernel_json_decoder to support converting kernel_json to AnfNode.
4. Add GraphKernel Cost Model. (mindspore/_extends/graph_kernel)
5. Add some GraphKernel passes to GpuSession, move these passes to backend/optimizer/graph_kernel.
6. Add global id for ir files.
7. Fix bug in ConstInputToAttr.
2020-09-09 17:46:50 +08:00
Wei Luning 249382899b fix bug in cell pickle and copy 2020-09-09 15:33:56 +08:00
mindspore-ci-bot 2350a5990b !5885 [doc]add some document for composite op
Merge pull request !5885 from vlne-v1/add-doc-for-composite-op
2020-09-09 14:13:23 +08:00
mindspore-ci-bot eff187d83d !5806 [MD] minddata delete set_dataset_size interface
Merge pull request !5806 from xiefangqi/md_delete_setdatasetsize
2020-09-09 11:50:52 +08:00
mindspore-ci-bot 0aa9f900dd !5749 Support multi grad
Merge pull request !5749 from amongo/SupportPyantiveMultiGrad
2020-09-09 10:31:35 +08:00
Wei Luning 8c6475fd0b add composite op doc 2020-09-09 10:18:49 +08:00
xiefangqi d0410d6191 md delete set_dataset_size interface 2020-09-09 09:56:03 +08:00
mindspore-ci-bot c45f79d36b !5384 [MD]-Api changes
Merge pull request !5384 from nhussain/api_changes
2020-09-09 09:49:05 +08:00
mindspore-ci-bot 88f5cbe5db !5692 Add requires_grad option for python pass
Merge pull request !5692 from BowenK/pre_ad
2020-09-09 09:28:52 +08:00
mahdi a152a65227 Fixed the column problem in BucketBatchByLength 2020-09-08 17:48:42 -04:00
Zirui Wu bde9f18f5a update lookup api to take in a type
ci

add test case

address some of the review cmts

address review cmts
2020-09-08 11:59:28 -04:00
nhussain 3bac9d3713 switch input columns and operation
change ImagefolderDV2 name

change ds.transforms.vision to ds.vision

change batch api to match map api more closely

compose op changes

test_pylint

remove compose op from vision, move to transform module, refactor map and batch to use column_order
2020-09-08 10:26:20 -04:00
huangdongrun 341b8468eb add support for pynative multicases
clear df builder

add testcases
2020-09-08 16:09:48 +08:00
mindspore-ci-bot f984518150 !5872 remove timeout exception test case
Merge pull request !5872 from zhangbuxue/remove_timeout_exception_test_case
2020-09-08 14:11:06 +08:00
mindspore-ci-bot a838c9bd3d !5685 update run for br: master
Merge pull request !5685 from guozhijian/udpate_run_from_c75b100_to_c75b150_master
2020-09-08 12:34:13 +08:00
mindspore-ci-bot b40677002f !5714 [refine]change top graph and add cell class
Merge pull request !5714 from vlne-v1/change-top-graph
2020-09-08 11:56:36 +08:00
wuxuejian bd527a331d update aicpu proto and update module: graphengine
Support Dynamic Shape Aicpu Run Package

adapt tensorengin modify, fix ub fusion
2020-09-08 11:38:44 +08:00
caozhou 6509fa9023 delete seed0 and seed1 in Dropout 2020-09-08 10:51:12 +08:00
buxue 1ae9da85e0 remove timeout exception test case 2020-09-08 10:34:22 +08:00
mindspore-ci-bot ad186e79d8 !5599 Collect input data when `dataset_sink_mode` set on GPU
Merge pull request !5599 from LiHongzhang/dataset_sink_mode
2020-09-08 10:21:33 +08:00
Wei Luning e6f82af849 add cell class to c++ 2020-09-07 21:06:07 +08:00
Li Hongzhang 066950f69e GPU dataset_sink_mode collect inputs 2020-09-07 17:12:36 +08:00
lichenever f2d3fd34ce rectification_allreduce_fusion_api 2020-09-07 16:38:58 +08:00
mindspore-ci-bot 77dd91a646 !5669 Fix get_py_obj_dtype() for mindspore type
Merge pull request !5669 from hewei/fix_get_py_obj_dtype
2020-09-07 08:59:01 +08:00
mindspore-ci-bot 5c7fa52468 !5673 [performance]cell init opt performance
Merge pull request !5673 from kingxian/master
2020-09-05 17:10:08 +08:00
kingxian 92bebe65a9 cell init performance opt 2020-09-04 19:52:56 +08:00
mindspore-ci-bot d0c7b1ba24 !5731 Manifest Dataset check invalid filename string
Merge pull request !5731 from jiangzhiwen/fix/invalid_filename_string
2020-09-04 16:36:29 +08:00
yao_yf d4cfe55c04 rename mirror_mean to gradients_mean 2020-09-04 14:47:36 +08:00
BowenK 1bdb26f9e8 Warming up python pass by adding inline passes before it 2020-09-04 14:26:17 +08:00
mindspore-ci-bot bc4c5afc1a !5667 add kernel select after optimize pass
Merge pull request !5667 from zyli2020/code_refactor
2020-09-04 14:24:44 +08:00
mindspore-ci-bot 2f3684d4fa !4872 Add C++ API support for TFRecordDataset
Merge pull request !4872 from TinaMengtingZhang/cpp-api-tfrecord-dataset
2020-09-04 11:53:08 +08:00
mindspore-ci-bot 9018737e99 !5696 [Auto parallel] Move 'multi-subgraphs' interface to internal
Merge pull request !5696 from Xiaoda/20-moving-multi-graph-interface-internal
2020-09-04 11:17:28 +08:00
mindspore-ci-bot c064c01b6b !5729 [AutoParallel]Add FuseBatchNormEx op
Merge pull request !5729 from lichen/add_batchnormex_op
2020-09-04 11:17:22 +08:00
lizhenyu c3d6918649 add kernel select after optimize pass 2020-09-04 10:52:51 +08:00
mindspore-ci-bot 7786adc3aa !5722 fix semi auto parallel parameter of reshape has another user
Merge pull request !5722 from yao_yf/semi_auto_parallel_reshape_parameter_has_another_user
2020-09-04 09:45:41 +08:00
mindspore-ci-bot d76ac7c6e8 !5648 GetColumnNames for Python
Merge pull request !5648 from MahdiRahmaniHanzaki/get-col-name
2020-09-03 22:37:42 +08:00
lichenever d22f506431 add BatchNormEx op 2020-09-03 22:22:19 +08:00
jiangzhiwen 294f7b620a check invalid filename string 2020-09-03 22:09:26 +08:00