Commit Graph

3074 Commits

Author SHA1 Message Date
mindspore-ci-bot a566838b04 !6281 add testcase for bert_thor
Merge pull request !6281 from wangshuangling/master
2020-09-16 10:34:59 +08:00
mindspore-ci-bot 3bc3f8ed8e !6259 add ut-test_example
Merge pull request !6259 from lijiaqi/add_uttest
2020-09-16 10:31:17 +08:00
peixu_ren fdd2d8209f Support erf and erfc ant GPU backend 2020-09-15 22:14:32 -04:00
mindspore-ci-bot 3fe8916afa !6241 [bug]add doc for some Parameter property & fix bug for `Isinstance`
Merge pull request !6241 from vlne-v1/I1V5VO-fix-isinstance
2020-09-16 10:13:30 +08:00
wangmin d96ecd2740 add st for bert_thor 2020-09-16 10:04:29 +08:00
mindspore-ci-bot bef2118253 !6300 [MD] fix get_dataset_size bug when set num_samples in DistributedSampler
Merge pull request !6300 from liyong126/fix_md_num_samples
2020-09-16 09:56:53 +08:00
yoonlee666 528072f45f move batch_size from bert_cfg_cfg to cfg 2020-09-16 09:46:38 +08:00
mindspore-ci-bot 0d486adef1 !3974 Eliminate the pause for each cycle of the Repeat
Merge pull request !3974 from lixiachen/repeat_task2
2020-09-16 09:35:39 +08:00
mindspore-ci-bot 14b4763b15 !6224 Move pp test cases to probability folder
Merge pull request !6224 from XunDeng/pp_tests_folder_update
2020-09-16 08:57:01 +08:00
liyong 930e85ed5c fix get_dataset_size in distributedSampler & num_samples 2020-09-15 22:53:57 +08:00
baihuawei 09a3f2ff5e fix GPU hete 2020-09-15 20:36:23 +08:00
mindspore-ci-bot e49d8cb697 !6250 fix aicpu ut
Merge pull request !6250 from yanzhenxiang2020/br_fix_aicpu_ut
2020-09-15 20:22:09 +08:00
mindspore-ci-bot 59a63d2566 !6257 modify yolov3-resnet18 test case and improve yolov3-darknet-quant performance
Merge pull request !6257 from chengxb7532/master
2020-09-15 20:19:44 +08:00
Wei Luning 8d17a2b8af * add doc for some Parameter property.* add export in quant __all__* fix bug for isinstance & add ut for it 2020-09-15 18:25:12 +08:00
Jiaqi aa4ddc1b28 add ut-test_example 2020-09-15 17:04:35 +08:00
mindspore-ci-bot 2f451fa1b0 !6201 perfect annotation of ops and context and support bool equal
Merge pull request !6201 from zhangbuxue/perfect_annotation_for_ops_and_context
2020-09-15 16:46:02 +08:00
mindspore-ci-bot f6ac30ef29 !6221 stop send data to device after end of sequence
Merge pull request !6221 from anzhengqi/stop-send-at-eos
2020-09-15 16:10:35 +08:00
chengxianbin d934814e5b fix yolov3-darknet52-quant net performance problem and modify yolov3 test case 2020-09-15 15:54:52 +08:00
lihongkang 74e3adebb8 change api interface 2020-09-15 15:25:28 +08:00
anzhengqi 8e1a2ef5ae stop send data to device after end of sequence 2020-09-15 15:02:37 +08:00
buxue c3c06514d7 perfect annotation of ops and context and support bool equal 2020-09-15 14:32:02 +08:00
yanzhenxiang2020 c6db808bbf fix aicpu ut 2020-09-15 14:31:56 +08:00
mindspore-ci-bot b83d921735 !3317 add check for stridedslice when choose aicpu or aicore
Merge pull request !3317 from zhangbuxue/add_check_for_stridedslice_when_choose_aicpu_or_aicore
2020-09-15 10:37:09 +08:00
mindspore-ci-bot 7a5ef7894d !6227 dataset API docstring: Update datasets and text desc and examples
Merge pull request !6227 from cathwong/ckw_api_engine
2020-09-15 10:29:11 +08:00
mindspore-ci-bot 2b05208a6f !6153 [AutoParallel]Check device target in init
Merge pull request !6153 from lichen/add_checks_for_init
2020-09-15 09:34:56 +08:00
Cathy Wong f7adf648e9 dataset API docstring: Update datasets, samplers, graphdata and text 2020-09-14 18:10:44 -04:00
Xun Deng c64f6a0a2a move pp related tests cases to probability folder 2020-09-14 13:29:43 -04:00
mindspore-ci-bot d0e49c5cf8 !6192 Improve the functions of class SequentialCell and add examples
Merge pull request !6192 from lijiaqi/sequentialcell
2020-09-14 23:24:04 +08:00
mindspore-ci-bot 1b956c77e0 !6155 modify path of ut and st of mdp
Merge pull request !6155 from byweng/master
2020-09-14 22:30:52 +08:00
Lixia Chen b5b333726f Leaf ops do self-reset. 2020-09-14 09:48:14 -04:00
Jiaqi 76cec24098 modify sequentialcell 2020-09-14 17:13:47 +08:00
mindspore-ci-bot 9824d0b20f !6142 MindData fix batch ops issue
Merge pull request !6142 from xiefangqi/md_fix_map_issue
2020-09-14 16:00:23 +08:00
mindspore-ci-bot 9c896fd22c !5899 Fix Some bugs and add test cases on Tensor printing.
Merge pull request !5899 from huangbingjian/master
2020-09-14 15:38:20 +08:00
lichenever aaf7045cdf add checks for init 2020-09-14 14:40:41 +08:00
mindspore-ci-bot 144998894f !6057 transformer bucket batch modification
Merge pull request !6057 from yuchaojie/transformer2
2020-09-14 14:21:15 +08:00
mindspore-ci-bot bb4dbf4989 !5803 Combine Async Dump with E2e Dump
Merge pull request !5803 from caifubi/dump
2020-09-14 11:47:00 +08:00
bingyaweng 866a8a1178 modify path of ut and st of mdp 2020-09-14 11:23:55 +08:00
caifubi 372c2e7951 Combine Async Dump and E2E Dump 2020-09-14 10:57:46 +08:00
mindspore-ci-bot 37e3b6082f !6002 Reduce inline passes traversal by skipping inline action if no pre-ad python pass exists
Merge pull request !6002 from BowenK/pre_ad
2020-09-14 10:16:56 +08:00
xiefangqi 653c79b4af md fix per_batch_map issue 2020-09-14 09:55:51 +08:00
yuchaojie fa1247a85e transformer bucket batch modification 2020-09-14 09:52:34 +08:00
mindspore-ci-bot a9a3d5a1f5 !5753 remove sens parameter
Merge pull request !5753 from lijiaqi/loss_scale_sens
2020-09-13 17:27:27 +08:00
mindspore-ci-bot c10341dfb7 !6020 Add common check_param_type and set_param_type in distribution
Merge pull request !6020 from XunDeng/new_check_param
2020-09-13 13:54:39 +08:00
Jiaqi 94d63b90f4 remove sens parameter 2020-09-13 11:34:56 +08:00
HuangBingjian 07d1f5ac37 fix tensor.cc 2020-09-12 17:25:09 +08:00
mindspore-ci-bot 02c6852699 !6108 add model with loss test case
Merge pull request !6108 from hanyang/master
2020-09-12 16:58:23 +08:00
mindspore-ci-bot 8bf5ac1c15 !6032 [bug]add import for ops in ops.py in __init__
Merge pull request !6032 from vlne-v1/change_ops_import
2020-09-12 16:57:15 +08:00
mindspore-ci-bot 72615134aa !6110 [MD] fix num_samples in concatDataset
Merge pull request !6110 from liyong126/fix_bug
2020-09-12 16:08:16 +08:00
Wei Luning 7b6899fdc0 add import of ops in in ops __init__ 2020-09-12 15:29:43 +08:00
liyong 16147669a6 fix num_samples in concatDataset 2020-09-12 15:06:18 +08:00
Wan Hanyang 0b7570eb53 add model with loss, without loso and o2 test case 2020-09-12 14:26:40 +08:00
luoyang 581335453e Change return val of GetNextRow 2020-09-12 14:19:46 +08:00
mindspore-ci-bot 3c0aa0a6e4 !6069 support function as condition of if
Merge pull request !6069 from zhangbuxue/support_function_as_condition_of_if
2020-09-12 12:39:15 +08:00
mindspore-ci-bot a084196300 !6094 Adding input checks to C API
Merge pull request !6094 from EricZ/add_input_check_capi
2020-09-12 09:47:50 +08:00
mindspore-ci-bot eb049b0e93 !5842 [Dataset] dataset op log changes
Merge pull request !5842 from luoyang/pylint
2020-09-12 09:42:42 +08:00
mindspore-ci-bot 461eeaf70d !6076 [Data]reame the lite of minddata tar name
Merge pull request !6076 from xulei/lite_test0905
2020-09-12 09:41:06 +08:00
mindspore-ci-bot 28e2b0253e !6086 Order dict by column_id in create_dict_iterator()
Merge pull request !6086 from ZiruiWu/order_dict_in_create_dict_iterator
2020-09-12 08:41:46 +08:00
eric cd5af9472e Added input check 2020-09-11 20:36:12 -04:00
Xun Deng 67325d63b0 edited common_dtype and check_param dtype logic 2020-09-11 16:51:19 -04:00
Zirui Wu d54ba374b9 order dict by column_id in create_dict_iterator()
fix CI
2020-09-11 15:33:47 -04:00
YangLuo f5a85510f2 [MD] dataset op log changes 2020-09-12 00:43:36 +08:00
nhussain 96de2ffdb6 fix errors from old compose call in Python 2020-09-11 10:30:23 -04:00
mindspore-ci-bot d8c09067ce !5801 [MD][Feature] minddata iterator output ms_tensor
Merge pull request !5801 from xiefangqi/md_modify_output_tensor
2020-09-11 20:19:06 +08:00
xulei2020 72861a68f3 add code 2020-09-11 19:28:35 +08:00
buxue b9c9046b93 support function as condition of if 2020-09-11 17:43:07 +08:00
Wan Hanyang 2ceea1e59d add a self attention test case 2020-09-11 16:30:28 +08:00
mindspore-ci-bot 5b4642d10a !4950 Fixing Minddata profiling monitor
Merge pull request !4950 from anthonyaje/monitor_fix
2020-09-11 14:34:27 +08:00
mindspore-ci-bot 48b337f206 !6026 fix some test case
Merge pull request !6026 from suteng/master
2020-09-11 14:09:11 +08:00
xiefangqi 9b3c33e157 minddata iterator output ms_tensor 2020-09-11 11:35:50 +08:00
mindspore-ci-bot cf7d6eddc4 !6019 [MD] Move Random(Choice/Apply/Order) from vision to transforms module
Merge pull request !6019 from nhussain/move_random_choice_apply
2020-09-11 10:37:21 +08:00
Su Teng 7b46f46a65 remove unuse test 2020-09-11 10:16:56 +08:00
buxue 08059f5c61 add check for stridedslice when choose aicpu or aicore 2020-09-11 10:11:14 +08:00
mindspore-ci-bot dd215f4080 !5735 delete seed0 and seed1
Merge pull request !5735 from caozhou/delete_seed
2020-09-11 09:58:56 +08:00
mindspore-ci-bot 2dfb2f3578 !6009 Add Affine transformation ut for Lite Dataset
Merge pull request !6009 from jiangzhiwen/lite/affine_ut
2020-09-11 09:57:56 +08:00
mindspore-ci-bot f1979f8fe5 !5998 change internal API _get_strategy() to _get_shard_strategy()
Merge pull request !5998 from yihuaijie/master
2020-09-11 09:15:18 +08:00
mindspore-ci-bot 483b364d92 !5984 Add CPU kernels: Sub, Square
Merge pull request !5984 from huanghui/cpu-basic-kernel
2020-09-11 09:14:02 +08:00
mindspore-ci-bot a778868a5a !5929 BucketBatchByLength column issue
Merge pull request !5929 from MahdiRahmaniHanzaki/bucket_batch_by_length_fix
2020-09-11 05:53:48 +08:00
nhussain f42f9ef9d7 move random apply order and choice ops 2020-09-10 15:39:56 -04:00
nhussain 92e99ff224 change map calls 2020-09-10 10:25:05 -04:00
jiangzhiwen d4ce668b9b add Affine ut 2020-09-10 21:50:56 +08:00
mindspore-ci-bot eedbbb3649 !5958 Modify interface for function and remove duplicated def
Merge pull request !5958 from lilei/modify_bug
2020-09-10 21:22:32 +08:00
huanghui a82577c00e Add CPU kernels: TensorAdd, Sub, Mul, Div 2020-09-10 20:45:03 +08:00
BowenK e482e4e8bf reduce pass traversals if no pre-ad python pass exists 2020-09-10 20:00:10 +08:00
mindspore-ci-bot 55372b41fd !5908 delete DataWrapper in Model to unify the expression of dataset sinking
Merge pull request !5908 from wangnan39/optim_datawrapper_in_model
2020-09-10 19:33:26 +08:00
mindspore-ci-bot 2f529c149a !5991 Change API set_strategy() to shard()
Merge pull request !5991 from yihuaijie/master
2020-09-10 19:17:32 +08:00
mindspore-ci-bot c882e4863c !5961 [Data]Add lite_cv lib for mindspore lite data preprocessing
Merge pull request !5961 from xulei/lite_test0905
2020-09-10 18:51:07 +08:00
wangnan39@huawei.com fdac02feed delete DataWrapper and optim Model 2020-09-10 18:47:37 +08:00
Yi Huaijie eb83ea9607 change internal API _get_strategy() to _get_shard_strategy() 2020-09-10 17:46:53 +08:00
mindspore-ci-bot ea94756839 !5605 Introduce usage flag to MNIST and CIFAR dataset
Merge pull request !5605 from ZiruiWu/add_usage_to_cifar_mnist_coco
2020-09-10 15:47:48 +08:00
xulei2020 b356211413 add init code 2020-09-10 15:35:08 +08:00
Yi Huaijie a836d25c64 change API set_strategy() to shard() 2020-09-10 15:30:19 +08:00
mindspore-ci-bot 7152fe04be !5783 GraphKernel supports GPU
Merge pull request !5783 from DeshiChen/graph_kernel_1.0
2020-09-10 09:15:21 +08:00
anthonyaje 2d08d83247 Fixed connector_size and monitor. 2020-09-09 17:54:59 -04:00
mindspore-ci-bot 87d0d0bf8d !5754 adding int32 support for Greater gpu kernel
Merge pull request !5754 from Peilin/add-type-support-for-greater
2020-09-09 22:29:12 +08:00
Zirui Wu 1bb93580dd Add usage flag to MNIST/CIFAR
ci fix 1

fix ci 2

fix ci 3

fix ci 4

fix ci 5

fix ci 6

fix ci 7

change var name in CelebA from dataset_type to usage

address review cmts

fix cpp ut fail

change mode to usage in VOCDataset

fix cmts

fix ci test case fail
2020-09-09 09:59:55 -04:00
lilei 71adabd944 modify_bug 2020-09-09 18:20:32 +08:00
dayschan 37a48f6aac GraphKernel supports GPU
1. Update akg submodule
2. Refactor akg_kernel_build, akg_ascend_kernel_build, akg_gpu_kernel_build
3. Add akg_kernel_json_decoder to support converting kernel_json to AnfNode.
4. Add GraphKernel Cost Model. (mindspore/_extends/graph_kernel)
5. Add some GraphKernel passes to GpuSession, move these passes to backend/optimizer/graph_kernel.
6. Add global id for ir files.
7. Fix bug in ConstInputToAttr.
2020-09-09 17:46:50 +08:00
Wei Luning 249382899b fix bug in cell pickle and copy 2020-09-09 15:33:56 +08:00
mindspore-ci-bot 2350a5990b !5885 [doc]add some document for composite op
Merge pull request !5885 from vlne-v1/add-doc-for-composite-op
2020-09-09 14:13:23 +08:00
mindspore-ci-bot eff187d83d !5806 [MD] minddata delete set_dataset_size interface
Merge pull request !5806 from xiefangqi/md_delete_setdatasetsize
2020-09-09 11:50:52 +08:00
mindspore-ci-bot 0aa9f900dd !5749 Support multi grad
Merge pull request !5749 from amongo/SupportPyantiveMultiGrad
2020-09-09 10:31:35 +08:00
Wei Luning 8c6475fd0b add composite op doc 2020-09-09 10:18:49 +08:00
xiefangqi d0410d6191 md delete set_dataset_size interface 2020-09-09 09:56:03 +08:00
mindspore-ci-bot c45f79d36b !5384 [MD]-Api changes
Merge pull request !5384 from nhussain/api_changes
2020-09-09 09:49:05 +08:00
mindspore-ci-bot 88f5cbe5db !5692 Add requires_grad option for python pass
Merge pull request !5692 from BowenK/pre_ad
2020-09-09 09:28:52 +08:00
Peilin Wang f020e19636 add int32 support to greater gpu kernel
fix ci
2020-09-08 18:32:44 -04:00
mahdi a152a65227 Fixed the column problem in BucketBatchByLength 2020-09-08 17:48:42 -04:00
Zirui Wu bde9f18f5a update lookup api to take in a type
ci

add test case

address some of the review cmts

address review cmts
2020-09-08 11:59:28 -04:00
nhussain 3bac9d3713 switch input columns and operation
change ImagefolderDV2 name

change ds.transforms.vision to ds.vision

change batch api to match map api more closely

compose op changes

test_pylint

remove compose op from vision, move to transform module, refactor map and batch to use column_order
2020-09-08 10:26:20 -04:00
mindspore-ci-bot 6fdb43d22d !5895 gpu maximum minimum absgrad kernel fix
Merge pull request !5895 from chenweifeng/maximum-fix
2020-09-08 20:44:43 +08:00
mindspore-ci-bot 98725bc865 !5790 [MS][GPU][CUDA] Dedicated new user facing Pad API kernel
Merge pull request !5790 from danishnxt/GPU_three
2020-09-08 20:40:50 +08:00
mindspore-ci-bot b717a686cf !5690 ROIAlign kernel memory leak
Merge pull request !5690 from JonathanY/rcnn
2020-09-08 20:32:25 +08:00
mindspore-ci-bot 2a9c458870 !5812 Add PS context.
Merge pull request !5812 from ZPaC/master-context-for-ps
2020-09-08 16:12:59 +08:00
huangdongrun 341b8468eb add support for pynative multicases
clear df builder

add testcases
2020-09-08 16:09:48 +08:00
xuyongfei 28746d6e57 serving: handle exception 2020-09-08 15:11:21 +08:00
wilfChen 3b54e55223 gpu maximum & minimum kernel with fp16 input 2020-09-08 15:03:22 +08:00
mindspore-ci-bot f984518150 !5872 remove timeout exception test case
Merge pull request !5872 from zhangbuxue/remove_timeout_exception_test_case
2020-09-08 14:11:06 +08:00
ZPaC 87bf2a7dcd Add PS context. 2020-09-08 14:06:58 +08:00
mindspore-ci-bot a838c9bd3d !5685 update run for br: master
Merge pull request !5685 from guozhijian/udpate_run_from_c75b100_to_c75b150_master
2020-09-08 12:34:13 +08:00
mindspore-ci-bot b40677002f !5714 [refine]change top graph and add cell class
Merge pull request !5714 from vlne-v1/change-top-graph
2020-09-08 11:56:36 +08:00
wuxuejian bd527a331d update aicpu proto and update module: graphengine
Support Dynamic Shape Aicpu Run Package

adapt tensorengin modify, fix ub fusion
2020-09-08 11:38:44 +08:00
caozhou 6509fa9023 delete seed0 and seed1 in Dropout 2020-09-08 10:51:12 +08:00
buxue 1ae9da85e0 remove timeout exception test case 2020-09-08 10:34:22 +08:00
mindspore-ci-bot ad186e79d8 !5599 Collect input data when `dataset_sink_mode` set on GPU
Merge pull request !5599 from LiHongzhang/dataset_sink_mode
2020-09-08 10:21:33 +08:00
mindspore-ci-bot 89c76840ee !5828 revert ci pass condition.
Merge pull request !5828 from anzhengqi/fix-ci-condition
2020-09-08 09:14:32 +08:00
Wei Luning e6f82af849 add cell class to c++ 2020-09-07 21:06:07 +08:00
mindspore-ci-bot 4535faa2b0 !5837 [AutoParallel]Rectification allreduce fusion api
Merge pull request !5837 from lichen/rectification_allreduce_fusion_api
2020-09-07 20:37:44 +08:00
mindspore-ci-bot a3d0ddb4db !5779 tenoradd profiling
Merge pull request !5779 from chenweifeng/broadcast-refactor
2020-09-07 20:27:26 +08:00
Li Hongzhang 066950f69e GPU dataset_sink_mode collect inputs 2020-09-07 17:12:36 +08:00
wilfChen 6ebe132cd3 broadcast refactor 2020-09-07 16:57:50 +08:00
lichenever f2d3fd34ce rectification_allreduce_fusion_api 2020-09-07 16:38:58 +08:00
anzhengqi 38b5d91ede fix ci pass condition 2020-09-07 11:02:01 +08:00
mindspore-ci-bot 4e7346509f !5782 change allreduce fusion function
Merge pull request !5782 from wangmin0104/master
2020-09-07 10:24:41 +08:00
mindspore-ci-bot 77dd91a646 !5669 Fix get_py_obj_dtype() for mindspore type
Merge pull request !5669 from hewei/fix_get_py_obj_dtype
2020-09-07 08:59:01 +08:00
mindspore-ci-bot 5c7fa52468 !5673 [performance]cell init opt performance
Merge pull request !5673 from kingxian/master
2020-09-05 17:10:08 +08:00
danish 273fc0071c New User facing Pad Kernel + ST + Allows for channel padding
style fix

lint fixes

added check in NN layer for > 4 paddings, plus lint fix

fix python lint

lint fix

lint fix

updating to pytest asserts to improve testing

removed unnecc vars from test file fail checks
2020-09-04 15:13:05 -04:00
kingxian 92bebe65a9 cell init performance opt 2020-09-04 19:52:56 +08:00
wangmin b035890128 allreduce fusion 2020-09-04 17:28:07 +08:00
mindspore-ci-bot d0c7b1ba24 !5731 Manifest Dataset check invalid filename string
Merge pull request !5731 from jiangzhiwen/fix/invalid_filename_string
2020-09-04 16:36:29 +08:00
yao_yf d4cfe55c04 rename mirror_mean to gradients_mean 2020-09-04 14:47:36 +08:00
BowenK 1bdb26f9e8 Warming up python pass by adding inline passes before it 2020-09-04 14:26:17 +08:00
mindspore-ci-bot bc4c5afc1a !5667 add kernel select after optimize pass
Merge pull request !5667 from zyli2020/code_refactor
2020-09-04 14:24:44 +08:00
mindspore-ci-bot 2f3684d4fa !4872 Add C++ API support for TFRecordDataset
Merge pull request !4872 from TinaMengtingZhang/cpp-api-tfrecord-dataset
2020-09-04 11:53:08 +08:00
mindspore-ci-bot 9018737e99 !5696 [Auto parallel] Move 'multi-subgraphs' interface to internal
Merge pull request !5696 from Xiaoda/20-moving-multi-graph-interface-internal
2020-09-04 11:17:28 +08:00
mindspore-ci-bot c064c01b6b !5729 [AutoParallel]Add FuseBatchNormEx op
Merge pull request !5729 from lichen/add_batchnormex_op
2020-09-04 11:17:22 +08:00
lizhenyu c3d6918649 add kernel select after optimize pass 2020-09-04 10:52:51 +08:00
mindspore-ci-bot 7786adc3aa !5722 fix semi auto parallel parameter of reshape has another user
Merge pull request !5722 from yao_yf/semi_auto_parallel_reshape_parameter_has_another_user
2020-09-04 09:45:41 +08:00
mindspore-ci-bot d76ac7c6e8 !5648 GetColumnNames for Python
Merge pull request !5648 from MahdiRahmaniHanzaki/get-col-name
2020-09-03 22:37:42 +08:00
lichenever d22f506431 add BatchNormEx op 2020-09-03 22:22:19 +08:00
jiangzhiwen 294f7b620a check invalid filename string 2020-09-03 22:09:26 +08:00
mindspore-ci-bot a50bc2182e !5665 delete enable_fused_layernorm
Merge pull request !5665 from yoonlee666/bugfix
2020-09-03 21:21:46 +08:00
mindspore-ci-bot 527d7f0afb !5580 [MD] remove finish in FileReader
Merge pull request !5580 from liyong126/rmv_filereader_finish
2020-09-03 21:18:35 +08:00
yao_yf 05c003ae6b origin/semi_auto_parallel_reshape_parameter_has_another_user 2020-09-03 20:27:46 +08:00
mindspore-ci-bot fc79997de5 !5502 Mod SoftmaxCrossEntropyWithlogits
Merge pull request !5502 from wanyiming/mod_SoftmaxCrossEntropyWithlogits
2020-09-03 20:24:43 +08:00
mindspore-ci-bot b961d47d40 !5642 UTest compiling performance optimization
Merge pull request !5642 from zhoufeng/ut-compile-performance
2020-09-03 20:21:13 +08:00
liyong ac39c20f41 del finish in FileReader 2020-09-03 20:05:38 +08:00
mindspore-ci-bot 01da7d2c1a !5713 Align num_samples of CSV with other dataset
Merge pull request !5713 from jiangzhiwen/fix/csv_num_samples
2020-09-03 19:52:43 +08:00
Xiaoda Zhang 42f1241270 remove 'multi-subgraphs' to internal 2020-09-03 19:07:08 +08:00
wanyiming 0ec70068ae mod_SoftmaxCrossEntropyWithLogits 2020-09-03 17:33:20 +08:00
jiangzhiwen 1a1a8893a4 Align num_samples of CSV with other dataset 2020-09-03 17:30:39 +08:00
zhoufeng 6d500223b2 utest compiling performance optimization
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
2020-09-03 16:57:19 +08:00
zhousiyi 301aeaaf1d remove gvar source file from compile as ut_tests will use gvar so 2020-09-03 06:49:30 +00:00
yoonlee666 dfd85caa1b delete enable_fused_layernorm 2020-09-03 11:40:38 +08:00
Jonathan Yan bbd19dbe43 roi align memory leak 2020-09-02 22:17:59 -04:00
mindspore-ci-bot 0118930c6b !5671 modify voc doc & fix buildvocab bug
Merge pull request !5671 from luoyang/c-api-pyfunc
2020-09-03 09:25:13 +08:00
mindspore-ci-bot 290979853e !5663 add check for mod when y in (-1, 0)
Merge pull request !5663 from zhangbuxue/add_check_for_mod_for_y
2020-09-03 09:16:45 +08:00
mindspore-ci-bot 021ba724cf !5645 [bug][api]updata signature
Merge pull request !5645 from vlne-v1/ref_demo
2020-09-03 09:11:50 +08:00
Mahdi 6e7aab8c4f Added GetColumnNames for Datasets 2020-09-02 17:12:48 -04:00
Cathy Wong 4d4c11b133 dataset API docstring cleanup: Standard product terms NumPy, Python 2020-09-02 10:42:12 -04:00
tinazhang e430b4056a add tfrecord dataset to cpp api
fix to support schema=nullptr
2020-09-02 08:55:47 -04:00
mindspore-ci-bot 35e6cca1a3 !5634 wrap numpy random seed into an api
Merge pull request !5634 from yihuaijie/master
2020-09-02 19:28:33 +08:00
buxue 4d59fe9ee1 add check for mod when y in (-1, 0) 2020-09-02 18:10:00 +08:00
Wei Luning 879a519136 updata signature 2020-09-02 17:29:29 +08:00
Yi Huaijie 4a5d115a66 add get_seed() and set_seed() 2020-09-02 17:17:04 +08:00
luoyang 8aba39a71b Modify VOCDataset doc & Fix BuildVocab bug 2020-09-02 16:54:50 +08:00
He Wei c1469d61ce Fix get_py_obj_dtype() for mindspore type
Return mstype.type_type if input is mindspore type object,
for example:
```
get_py_obj_dtype(mstype.float32) ---> mstype.type_type
```
2020-09-02 16:14:25 +08:00
mindspore-ci-bot ccc0ea60ee !5661 fix auto parallel reshape strategy set when it is first operator
Merge pull request !5661 from yao_yf/auto_parallel_reshape_fix
2020-09-02 15:42:47 +08:00
mindspore-ci-bot 847fadc8b9 !5516 auto parallel context modify
Merge pull request !5516 from yao_yf/auto_parallel_context_collation
2020-09-02 15:41:05 +08:00
mindspore-ci-bot bb84f50407 !5473 optim pylint
Merge pull request !5473 from jinyaohui/master
2020-09-02 15:25:30 +08:00
mindspore-ci-bot 4ec343961e !5482 modify save_checkpoint
Merge pull request !5482 from liuyang/md_save_checkpoint
2020-09-02 14:20:48 +08:00
yao_yf 755f381406 fix auto parallel reshape strategy set when it is first operator 2020-09-02 14:15:54 +08:00
mindspore-ci-bot 5e3e583b47 !5615 Add check for duplicate column to a-cpi & add voc descriptions for class_index
Merge pull request !5615 from luoyang/c-api-pyfunc
2020-09-02 11:59:34 +08:00
mindspore-ci-bot 3048240f16 !5508 Add AdamApplyOneWithDecayAssign fusion pass
Merge pull request !5508 from YuJianfeng/adam_assign
2020-09-02 11:23:34 +08:00
luoyang ce419404ce Add check for duplicate column for a-cpi 2020-09-02 10:41:52 +08:00
mindspore-ci-bot 03093778df !5387 Set num_epochs=1 for MindData python testcases
Merge pull request !5387 from lixiachen/testcase_epoch
2020-09-02 09:45:13 +08:00
mindspore-ci-bot be3d79cb6b !4204 add dynamic shape support for GatherV2 and others
Merge pull request !4204 from fary86/adapt_primitive_dynamic_shape
2020-09-02 09:31:14 +08:00
mindspore-ci-bot 120ab80b23 !5641 check user define bprop when there is parameter in nested network
Merge pull request !5641 from zhangbuxue/check_user_define_bprop_when_there_is_parameter_in_nested_network
2020-09-02 09:04:05 +08:00
mindspore-ci-bot 0cb6d29f0c !4998 Shared memory pool clean up
Merge pull request !4998 from JesseKLee/mem_pool
2020-09-02 02:01:19 +08:00
Lixia Chen 27d5281641 Change epoch count to 1 for python testcases 2020-09-01 11:24:26 -04:00
mindspore-ci-bot 749979e7c4 !5458 NMS GPU OP Performance improvement
Merge pull request !5458 from danishnxt/GPU_two
2020-09-01 23:05:56 +08:00
buxue 359e1f236e check user define bprop when there is parameter in nested network 2020-09-01 21:24:27 +08:00
mindspore-ci-bot 91a0fa75a5 !5594 add st about loss_scale and parser for pynative mode
Merge pull request !5594 from Simson/push-to-opensource
2020-09-01 19:30:18 +08:00
fary86 144a35b17e Adapt GatherV2 for dynamic shape 2020-09-01 19:24:21 +08:00
mindspore-ci-bot 8f3ebfd469 !5624 Optimize the performance of GraphData.get_neg_sampled_neighbors
Merge pull request !5624 from heleiwang/gnn_perf
2020-09-01 19:22:53 +08:00
heleiwang 857cf2f77f Optimize the negative sampling process 2020-09-01 16:29:59 +08:00
mindspore-ci-bot c2fddb56c8 !4922 Transform tuple parameter to multiple parameters
Merge pull request !4922 from amongo/TupleTransform
2020-09-01 15:15:56 +08:00
simson 26fa5c7d8c add st about loss_scale and parser for pynative mode 2020-09-01 15:10:47 +08:00
mindspore-ci-bot 087212441a !5192 Add unit tests for scatternd
Merge pull request !5192 from Peilin/scatternd-type-support
2020-09-01 14:26:15 +08:00
huangdongrun 0099da2c99 add support for tuple parameter transform
add support for pynative pass

add testcases
2020-09-01 14:17:52 +08:00
mindspore-ci-bot dff02cc282 !5188 rename image files in imagefolder
Merge pull request !5188 from tony_liu2/alt
2020-09-01 11:16:30 +08:00
mindspore-ci-bot 5453b40311 !4477 add dataset compare function to utils
Merge pull request !4477 from tony_liu2/staging
2020-09-01 11:15:18 +08:00
mindspore-ci-bot b99149dc37 !4901 Adding data_helper for minddata
Merge pull request !4901 from EricZ/md_helper
2020-09-01 11:14:11 +08:00
mindspore-ci-bot ab29dbf98b !5385 dataset fixes: Update OneHot API doc; fixup UTs
Merge pull request !5385 from cathwong/ckw_dataset_ut_cleanup8
2020-09-01 11:11:49 +08:00
mindspore-ci-bot 8ebc8ce9c6 !5438 support parameter tuple input in pynative mode
Merge pull request !5438 from wangqiuliang/support-parameter-tuple-input
2020-09-01 11:04:03 +08:00
mindspore-ci-bot 3be136f6f0 !5354 Fix randomdata issue
Merge pull request !5354 from xiefangqi/fix_randomdata_columnlist
2020-09-01 11:03:54 +08:00
mindspore-ci-bot 6cba0deb05 !4877 BucketBatchByLength for C++ API
Merge pull request !4877 from MahdiRahmaniHanzaki/bucket_batch_by_length_c
2020-09-01 10:58:51 +08:00
mindspore-ci-bot 1a4d3e351e !5586 Boost python pass compile and train performance
Merge pull request !5586 from BowenK/performance
2020-09-01 09:19:02 +08:00
mahdi 84efa0b96b Added BucketBatchByLength for C API 2020-08-31 17:06:16 -04:00
Eric 65bf3ecc3e Adding data_helper class 2020-08-31 16:29:14 -04:00
Cathy Wong 7f6782be2a dataset fixes: Update OneHot API docs; fixup Python UTs 2020-08-31 15:04:26 -04:00
mindspore-ci-bot 65819fb50c !5488 heck arg is tensor when graph output is a const or parameter
Merge pull request !5488 from zhangbuxue/add_check_tensor_before_compile_graph
2020-08-31 21:36:04 +08:00
yao_yf 8f7aa5bd5a auto parallel context modify 2020-08-31 21:19:49 +08:00
kingfo 7765d44b76 support parameter tuple input in pynative mode 2020-08-31 20:38:43 +08:00
BowenK d6fb7d2db1 Remove debug drawing and printing to boost compile performance; re-opt after python pass to boost training; fix NewParameter tensor clone 2020-08-31 17:42:00 +08:00
buxue 4168c51f0d add check tensor when graph output is a const or parameter 2020-08-31 17:17:24 +08:00
liuyang_655 4683de3443 modify save_checkpoint 2020-08-31 16:24:57 +08:00
jinyaohui a9972a7def optim pylint 2020-08-31 14:49:57 +08:00
mindspore-ci-bot 8d41931456 !5352 refactor ms_context implementation
Merge pull request !5352 from fary86/refactor_context_interface
2020-08-31 09:27:33 +08:00
mindspore-ci-bot 4d963d96f4 !5534 Fix Tensor.from_numpy() returns wrong type
Merge pull request !5534 from hewei/fix_tensor_from_numpy
2020-08-31 09:15:48 +08:00
Jesse Lee e89b4648f6 Memory pool clean up 2020-08-30 11:28:24 -04:00
fary86 fcbb3e0edc Refactor ms_context implementation 2020-08-30 22:51:40 +08:00
He Wei 27721ff4ea Fix Tensor.from_numpy() returns wrong type
Tensor.from_numpy() should return mindspore.Tensor not _c_expression.Tensor.
2020-08-29 19:05:44 +08:00
yujianfeng 4b77f6b53c Add AdamApplyOneWithDecayAssign fusion pass 2020-08-29 17:54:15 +08:00
mindspore-ci-bot e6a4d932b4 !5350 [AutoParallel]Rectification distributed init
Merge pull request !5350 from lichen/rectification_init
2020-08-29 14:55:18 +08:00
mindspore-ci-bot d81b30e6a0 !5312 make backend/optimizer free of pybind
Merge pull request !5312 from xychow/remove-backend-py-dependency-2
2020-08-29 14:42:33 +08:00
mindspore-ci-bot be606ba8f5 !5432 Mindspore parallel supports all elementary-wise operators
Merge pull request !5432 from yihuaijie/master
2020-08-29 14:16:48 +08:00
lichenever d3e55b543e rectification init 2020-08-29 09:34:58 +08:00
mindspore-ci-bot 1821e98e07 !4087 asyn run graph
Merge pull request !4087 from kisnwang/async-run-graph
2020-08-29 09:18:37 +08:00
danish 7d7fa760a0 reduce based nms final pass - speed improv
refactored faster nms

refactored faster nms + typo fix

added box flipping choice

set choice to true for testing - yz

switching back

new test file
2020-08-28 13:41:09 -04:00
Yi Huaijie 84948ca730 parallel supports more elementary-wise operators 2020-08-28 18:19:06 +08:00
kswang 756bb6d53f async run graph 2020-08-28 18:18:47 +08:00
zhousiyi c25e37e7bf make backend/optimizer pybind free 2020-08-28 08:56:58 +00:00
mindspore-ci-bot 414184c184 !5367 Check the parameter's split strategies if it has multiple users
Merge pull request !5367 from yangzhenzhang/check-parameter-split
2020-08-28 16:26:46 +08:00
mindspore-ci-bot 820f2cb4eb !5351 move ParalleMode to Context
Merge pull request !5351 from yao_yf/parallel_context_collation
2020-08-28 16:13:01 +08:00
yao_yf 07117e4dd4 mv ParallelMode to context 2020-08-28 19:13:55 +08:00
xiefangqi e2085a9505 fix randomdata issue 2020-08-28 11:55:49 +08:00
He Wei d7cdda1cb0 Provide Tensor.from_numpy() to avoid copy 2020-08-28 11:03:14 +08:00
yangzhenzhang fbda03bbcc check parameter split 2020-08-28 10:49:27 +08:00
tony_liu2 70bfd506a1 add function
pr comment fix

revert graphengine
2020-08-27 16:50:19 -04:00
tony_liu2 5e4c314130 rename dataset dir and image files
change references to use path original

revert folder name

revert graphengine
2020-08-27 16:49:23 -04:00
mindspore-ci-bot 716329df6c !5278 Change default value of sampler in c-api
Merge pull request !5278 from luoyang/c-api
2020-08-27 21:33:18 +08:00
mindspore-ci-bot 7aaf4118bf !5297 CutMixBatch and MixUpBatch fix for 2D one-hot labels
Merge pull request !5297 from MahdiRahmaniHanzaki/cutmix-fix
2020-08-27 21:32:09 +08:00
YangLuo 419478b410 Change default value of sampler to seperate behaviour of default sampler
& null sampler, add check for duplicate column name
2020-08-27 21:24:37 +08:00
mindspore-ci-bot 9392623066 !5181 Python pass pattern renaming and interface tweaking
Merge pull request !5181 from BowenK/new_parameter
2020-08-27 19:45:36 +08:00
mindspore-ci-bot da8d04e8bd !5237 Enbale ub fusion of Matmul+ConfusionTransposeD
Merge pull request !5237 from huanghui/ub-fusion-matmul-confusion-transpose
2020-08-27 18:47:52 +08:00
mindspore-ci-bot a8317acee8 !5111 Support int64 for cpu sparse optimizers
Merge pull request !5111 from YuJianfeng/int64
2020-08-27 17:17:05 +08:00
mindspore-ci-bot e94416be0c !5283 Support setting operator io format in the frontend
Merge pull request !5283 from liangchenghui/io_format
2020-08-27 15:48:13 +08:00
mindspore-ci-bot fabebb2678 !5264 [bug]fix bugs when parameters updata
Merge pull request !5264 from vlne-v1/I1SP3I-return-value-not-the-exact-value
2020-08-27 14:13:20 +08:00
mindspore-ci-bot b346f0b3ec !5026 Fix the problem of resource clear
Merge pull request !5026 from Simson/enhancement-API
2020-08-27 11:19:02 +08:00
yujianfeng e949540062 Support int64 for cpu sparse optimizers 2020-08-27 10:57:53 +08:00
simson d4babf190c fix risk of memory leak 2020-08-27 10:54:06 +08:00
mindspore-ci-bot def1ff4307 !5302 Enlarge-the-threshold-of-resnet50-in-pynative
Merge pull request !5302 from JoyLvliang/enlarge-the-threshold-of-resnet50-in-pynative
2020-08-27 10:45:54 +08:00
mindspore-ci-bot 042f6a8d97 !5201 serving st time optimization
Merge pull request !5201 from hexia/st_optimization_time
2020-08-27 10:43:03 +08:00
mindspore-ci-bot 454ae16335 !4777 Add test cases for uniform ops on GPU
Merge pull request !4777 from peixu_ren/custom_gpu
2020-08-27 10:42:39 +08:00
mindspore-ci-bot d1b95ed9bd !5240 Fix remove internal output for unique device target
Merge pull request !5240 from YuJianfeng/internal_output
2020-08-27 10:35:37 +08:00
BowenK 641d12d6d9 python pass pattern renaming and interface tweaking 2020-08-27 10:03:46 +08:00
mindspore-ci-bot 66d6320b21 !5224 Add test case about loss scale in parallel mode
Merge pull request !5224 from yangzhenzhang/add-split-sens-and-loss-scale-test-case
2020-08-27 09:06:01 +08:00
lvliang 1b018b8167 enlarge-the-threshold-of-resnet50-in-pynative 2020-08-27 08:52:32 +08:00
mahdi 7ad7024c45 Fixed 2D one-hot label problems in CutMix and MixUp 2020-08-26 16:17:21 -04:00
peixu_ren 2d5d44ab22 Add test cases for uniform ops on GPU 2020-08-26 12:02:27 -04:00
islam_amin 94a4a3f20b changing affine and posterize apis 2020-08-26 10:51:54 -04:00
mindspore-ci-bot adbb75556d !4778 Added type support for Reshape gpu kernel for faster RCNN
Merge pull request !4778 from Peilin/reshape-gpu-kernel-type-support
2020-08-26 22:41:12 +08:00
Wei Luning 4cc8342b5b fix bug in Parameter init_data 2020-08-26 22:15:22 +08:00
梁成辉 34d433fd9a Set io format for old backend 2020-08-26 20:49:15 +08:00
kpy 44b738e8ac fix grad all ci bug 2020-08-26 18:28:35 +08:00
yujianfeng e688e1df32 Fix remove internal output for unique device target 2020-08-26 17:31:35 +08:00
mindspore-ci-bot 8eff6c96b4 !5045 merge slice parameter checkpoints in wide&deep
Merge pull request !5045 from yao_yf/wide_and_deep_eval_host_device
2020-08-26 17:16:30 +08:00
mindspore-ci-bot 314c5ad055 !5172 remove name arg from gradoperation
Merge pull request !5172 from riemann_penn/remove_name_args_from_gradoperation
2020-08-26 16:55:57 +08:00
mindspore-ci-bot 8b5c35210f !5208 Modify the name of parameters in uniform
Merge pull request !5208 from peixu_ren/custom_pp_ops
2020-08-26 16:06:40 +08:00
huanghui 7755a54452 fix ub-fusion 2020-08-26 16:02:25 +08:00
mindspore-ci-bot 95212b55a0 !3271 make reftype a subtype of MetaTensor and try to mark ref in node input
Merge pull request !3271 from vlne-v1/ref_demo
2020-08-26 15:45:48 +08:00
yangzhenzhang 6ae5893681 add test cases 2020-08-26 15:11:44 +08:00
Wei Luning 24a10225cf change base class of ref to tensor in cpp 2020-08-26 12:41:25 +08:00
mindspore-ci-bot e4d2f2fd3b !5030 Adding a BBox class and fixing Posterize C Op testing.
Merge pull request !5030 from islam_amin/bbox_class
2020-08-26 11:40:57 +08:00
panyifeng 1a54785fe2 remove name arg from gradoperation 2020-08-26 11:16:57 +08:00
mindspore-ci-bot cd1240180b !5187 C++ API: Lexicographical order support for CLUE, CSV & TextFile Datasets
Merge pull request !5187 from cathwong/ckw_c_api_fixes2
2020-08-26 10:48:05 +08:00
yao_yf eeede168fa wide_and_deep merge ckpt in eval 2020-08-26 10:47:26 +08:00
mindspore-ci-bot 20b3134785 !5184 fix: padded dataset when no div and with repeat op
Merge pull request !5184 from guozhijian/fix_padded_with_no_div_repeat
2020-08-26 10:47:22 +08:00
peixu_ren 10f381d662 Modify the name of parameters in uniform 2020-08-25 22:44:21 -04:00
mindspore-ci-bot f3fd7a5578 !5073 Add checks and exception handling DS callback
Merge pull request !5073 from h.farahat/map_callback_end
2020-08-26 10:40:40 +08:00
hexia e1c240f86a serving st time optimization 2020-08-26 09:51:48 +08:00
mindspore-ci-bot 9e8c4f373f !5070 Fix wrong index error msg
Merge pull request !5070 from fanglei/new_case
2020-08-26 09:26:55 +08:00
jonyguo 6df1a43ec2 fix: padded dataset with non div & repeat 2020-08-26 08:56:37 +08:00
Peilin Wang d92a357e4a add scatternd ut 2020-08-25 17:03:57 -04:00
Cathy Wong 46e9d79a50 C++ API: Lexicographical order support for CLUE, CSV & TextFile Datasets 2020-08-25 14:11:19 -04:00
mindspore-ci-bot 971716f4b9 !5136 fix large for loop runtime error due to lacking of backend operators
Merge pull request !5136 from fary86/fix_large_for_runtime_error
2020-08-25 22:26:25 +08:00
mindspore-ci-bot 346b97acb8 !5156 fix softdvpp coredump
Merge pull request !5156 from qianlong21st/master_fix_softdvpp_core
2020-08-25 22:20:00 +08:00
mindspore-ci-bot 2e3f5cd41b !5114 fix bug in c-api: rename, concat, take
Merge pull request !5114 from luoyang/c-api-pyfunc
2020-08-25 20:57:41 +08:00
qianlong 12dfca71f1 fix softdvpp coredump 2020-08-25 18:56:40 +08:00
YangLuo 67f5c89cd6 Check input image type for random posterize 2020-08-25 16:26:17 +08:00
fary86 8d245497a4 Fix large for loop Runtime Error due to backend missing operators 2020-08-25 16:25:41 +08:00
luoyang b26f6b3d5e fix bug in c-api: rename, concat, take 2020-08-25 16:25:00 +08:00
leilei_snow df9df609f8 fix index error 2020-08-25 08:05:07 +00:00
huangdongrun 113641decd fix test cases 2020-08-25 14:38:08 +08:00
mindspore-ci-bot 7d4f481884 !5017 remove internal interface in wide&deep
Merge pull request !5017 from yao_yf/wide_and_deep_no_internal_interface
2020-08-25 14:11:51 +08:00
mindspore-ci-bot 957126375b !5095 Adding Float tensor support for CutMixBatch
Merge pull request !5095 from MahdiRahmaniHanzaki/cutmix-fix
2020-08-25 10:53:58 +08:00
mindspore-ci-bot afd16fbf0a !4963 fix bug of switch layer join
Merge pull request !4963 from fary86/fix_switch_layer_join_bug
2020-08-25 10:47:32 +08:00
mindspore-ci-bot abe6b82138 !5011 remove global grad ops
Merge pull request !5011 from riemann_penn/remove_global_grad_ops
2020-08-25 09:47:55 +08:00
fary86 947e19b839 Fix bug of switch layer join 2020-08-25 09:08:53 +08:00
islam_amin 641e751d5e adding bbox class 2020-08-24 18:22:58 -04:00