Commit Graph

2820 Commits

Author SHA1 Message Date
mindspore-ci-bot eb049b0e93 !5842 [Dataset] dataset op log changes
Merge pull request !5842 from luoyang/pylint
2020-09-12 09:42:42 +08:00
mindspore-ci-bot 461eeaf70d !6076 [Data]reame the lite of minddata tar name
Merge pull request !6076 from xulei/lite_test0905
2020-09-12 09:41:06 +08:00
mindspore-ci-bot 28e2b0253e !6086 Order dict by column_id in create_dict_iterator()
Merge pull request !6086 from ZiruiWu/order_dict_in_create_dict_iterator
2020-09-12 08:41:46 +08:00
eric cd5af9472e Added input check 2020-09-11 20:36:12 -04:00
Xun Deng 67325d63b0 edited common_dtype and check_param dtype logic 2020-09-11 16:51:19 -04:00
Zirui Wu d54ba374b9 order dict by column_id in create_dict_iterator()
fix CI
2020-09-11 15:33:47 -04:00
YangLuo f5a85510f2 [MD] dataset op log changes 2020-09-12 00:43:36 +08:00
nhussain 96de2ffdb6 fix errors from old compose call in Python 2020-09-11 10:30:23 -04:00
mindspore-ci-bot d8c09067ce !5801 [MD][Feature] minddata iterator output ms_tensor
Merge pull request !5801 from xiefangqi/md_modify_output_tensor
2020-09-11 20:19:06 +08:00
xulei2020 72861a68f3 add code 2020-09-11 19:28:35 +08:00
buxue b9c9046b93 support function as condition of if 2020-09-11 17:43:07 +08:00
Wan Hanyang 2ceea1e59d add a self attention test case 2020-09-11 16:30:28 +08:00
mindspore-ci-bot 5b4642d10a !4950 Fixing Minddata profiling monitor
Merge pull request !4950 from anthonyaje/monitor_fix
2020-09-11 14:34:27 +08:00
mindspore-ci-bot 48b337f206 !6026 fix some test case
Merge pull request !6026 from suteng/master
2020-09-11 14:09:11 +08:00
xiefangqi 9b3c33e157 minddata iterator output ms_tensor 2020-09-11 11:35:50 +08:00
mindspore-ci-bot cf7d6eddc4 !6019 [MD] Move Random(Choice/Apply/Order) from vision to transforms module
Merge pull request !6019 from nhussain/move_random_choice_apply
2020-09-11 10:37:21 +08:00
Su Teng 7b46f46a65 remove unuse test 2020-09-11 10:16:56 +08:00
buxue 08059f5c61 add check for stridedslice when choose aicpu or aicore 2020-09-11 10:11:14 +08:00
mindspore-ci-bot dd215f4080 !5735 delete seed0 and seed1
Merge pull request !5735 from caozhou/delete_seed
2020-09-11 09:58:56 +08:00
mindspore-ci-bot 2dfb2f3578 !6009 Add Affine transformation ut for Lite Dataset
Merge pull request !6009 from jiangzhiwen/lite/affine_ut
2020-09-11 09:57:56 +08:00
mindspore-ci-bot f1979f8fe5 !5998 change internal API _get_strategy() to _get_shard_strategy()
Merge pull request !5998 from yihuaijie/master
2020-09-11 09:15:18 +08:00
mindspore-ci-bot 483b364d92 !5984 Add CPU kernels: Sub, Square
Merge pull request !5984 from huanghui/cpu-basic-kernel
2020-09-11 09:14:02 +08:00
mindspore-ci-bot a778868a5a !5929 BucketBatchByLength column issue
Merge pull request !5929 from MahdiRahmaniHanzaki/bucket_batch_by_length_fix
2020-09-11 05:53:48 +08:00
nhussain f42f9ef9d7 move random apply order and choice ops 2020-09-10 15:39:56 -04:00
nhussain 92e99ff224 change map calls 2020-09-10 10:25:05 -04:00
jiangzhiwen d4ce668b9b add Affine ut 2020-09-10 21:50:56 +08:00
mindspore-ci-bot eedbbb3649 !5958 Modify interface for function and remove duplicated def
Merge pull request !5958 from lilei/modify_bug
2020-09-10 21:22:32 +08:00
huanghui a82577c00e Add CPU kernels: TensorAdd, Sub, Mul, Div 2020-09-10 20:45:03 +08:00
BowenK e482e4e8bf reduce pass traversals if no pre-ad python pass exists 2020-09-10 20:00:10 +08:00
mindspore-ci-bot 55372b41fd !5908 delete DataWrapper in Model to unify the expression of dataset sinking
Merge pull request !5908 from wangnan39/optim_datawrapper_in_model
2020-09-10 19:33:26 +08:00
mindspore-ci-bot 2f529c149a !5991 Change API set_strategy() to shard()
Merge pull request !5991 from yihuaijie/master
2020-09-10 19:17:32 +08:00
mindspore-ci-bot c882e4863c !5961 [Data]Add lite_cv lib for mindspore lite data preprocessing
Merge pull request !5961 from xulei/lite_test0905
2020-09-10 18:51:07 +08:00
wangnan39@huawei.com fdac02feed delete DataWrapper and optim Model 2020-09-10 18:47:37 +08:00
Yi Huaijie eb83ea9607 change internal API _get_strategy() to _get_shard_strategy() 2020-09-10 17:46:53 +08:00
mindspore-ci-bot ea94756839 !5605 Introduce usage flag to MNIST and CIFAR dataset
Merge pull request !5605 from ZiruiWu/add_usage_to_cifar_mnist_coco
2020-09-10 15:47:48 +08:00
xulei2020 b356211413 add init code 2020-09-10 15:35:08 +08:00
Yi Huaijie a836d25c64 change API set_strategy() to shard() 2020-09-10 15:30:19 +08:00
mindspore-ci-bot 7152fe04be !5783 GraphKernel supports GPU
Merge pull request !5783 from DeshiChen/graph_kernel_1.0
2020-09-10 09:15:21 +08:00
anthonyaje 2d08d83247 Fixed connector_size and monitor. 2020-09-09 17:54:59 -04:00
mindspore-ci-bot 87d0d0bf8d !5754 adding int32 support for Greater gpu kernel
Merge pull request !5754 from Peilin/add-type-support-for-greater
2020-09-09 22:29:12 +08:00
Zirui Wu 1bb93580dd Add usage flag to MNIST/CIFAR
ci fix 1

fix ci 2

fix ci 3

fix ci 4

fix ci 5

fix ci 6

fix ci 7

change var name in CelebA from dataset_type to usage

address review cmts

fix cpp ut fail

change mode to usage in VOCDataset

fix cmts

fix ci test case fail
2020-09-09 09:59:55 -04:00
lilei 71adabd944 modify_bug 2020-09-09 18:20:32 +08:00
dayschan 37a48f6aac GraphKernel supports GPU
1. Update akg submodule
2. Refactor akg_kernel_build, akg_ascend_kernel_build, akg_gpu_kernel_build
3. Add akg_kernel_json_decoder to support converting kernel_json to AnfNode.
4. Add GraphKernel Cost Model. (mindspore/_extends/graph_kernel)
5. Add some GraphKernel passes to GpuSession, move these passes to backend/optimizer/graph_kernel.
6. Add global id for ir files.
7. Fix bug in ConstInputToAttr.
2020-09-09 17:46:50 +08:00
Wei Luning 249382899b fix bug in cell pickle and copy 2020-09-09 15:33:56 +08:00
mindspore-ci-bot 2350a5990b !5885 [doc]add some document for composite op
Merge pull request !5885 from vlne-v1/add-doc-for-composite-op
2020-09-09 14:13:23 +08:00
mindspore-ci-bot eff187d83d !5806 [MD] minddata delete set_dataset_size interface
Merge pull request !5806 from xiefangqi/md_delete_setdatasetsize
2020-09-09 11:50:52 +08:00
mindspore-ci-bot 0aa9f900dd !5749 Support multi grad
Merge pull request !5749 from amongo/SupportPyantiveMultiGrad
2020-09-09 10:31:35 +08:00
Wei Luning 8c6475fd0b add composite op doc 2020-09-09 10:18:49 +08:00
xiefangqi d0410d6191 md delete set_dataset_size interface 2020-09-09 09:56:03 +08:00
mindspore-ci-bot c45f79d36b !5384 [MD]-Api changes
Merge pull request !5384 from nhussain/api_changes
2020-09-09 09:49:05 +08:00
mindspore-ci-bot 88f5cbe5db !5692 Add requires_grad option for python pass
Merge pull request !5692 from BowenK/pre_ad
2020-09-09 09:28:52 +08:00
Peilin Wang f020e19636 add int32 support to greater gpu kernel
fix ci
2020-09-08 18:32:44 -04:00
mahdi a152a65227 Fixed the column problem in BucketBatchByLength 2020-09-08 17:48:42 -04:00
Zirui Wu bde9f18f5a update lookup api to take in a type
ci

add test case

address some of the review cmts

address review cmts
2020-09-08 11:59:28 -04:00
nhussain 3bac9d3713 switch input columns and operation
change ImagefolderDV2 name

change ds.transforms.vision to ds.vision

change batch api to match map api more closely

compose op changes

test_pylint

remove compose op from vision, move to transform module, refactor map and batch to use column_order
2020-09-08 10:26:20 -04:00
mindspore-ci-bot 6fdb43d22d !5895 gpu maximum minimum absgrad kernel fix
Merge pull request !5895 from chenweifeng/maximum-fix
2020-09-08 20:44:43 +08:00
mindspore-ci-bot 98725bc865 !5790 [MS][GPU][CUDA] Dedicated new user facing Pad API kernel
Merge pull request !5790 from danishnxt/GPU_three
2020-09-08 20:40:50 +08:00
mindspore-ci-bot b717a686cf !5690 ROIAlign kernel memory leak
Merge pull request !5690 from JonathanY/rcnn
2020-09-08 20:32:25 +08:00
mindspore-ci-bot 2a9c458870 !5812 Add PS context.
Merge pull request !5812 from ZPaC/master-context-for-ps
2020-09-08 16:12:59 +08:00
huangdongrun 341b8468eb add support for pynative multicases
clear df builder

add testcases
2020-09-08 16:09:48 +08:00
xuyongfei 28746d6e57 serving: handle exception 2020-09-08 15:11:21 +08:00
wilfChen 3b54e55223 gpu maximum & minimum kernel with fp16 input 2020-09-08 15:03:22 +08:00
mindspore-ci-bot f984518150 !5872 remove timeout exception test case
Merge pull request !5872 from zhangbuxue/remove_timeout_exception_test_case
2020-09-08 14:11:06 +08:00
ZPaC 87bf2a7dcd Add PS context. 2020-09-08 14:06:58 +08:00
mindspore-ci-bot a838c9bd3d !5685 update run for br: master
Merge pull request !5685 from guozhijian/udpate_run_from_c75b100_to_c75b150_master
2020-09-08 12:34:13 +08:00
mindspore-ci-bot b40677002f !5714 [refine]change top graph and add cell class
Merge pull request !5714 from vlne-v1/change-top-graph
2020-09-08 11:56:36 +08:00
wuxuejian bd527a331d update aicpu proto and update module: graphengine
Support Dynamic Shape Aicpu Run Package

adapt tensorengin modify, fix ub fusion
2020-09-08 11:38:44 +08:00
caozhou 6509fa9023 delete seed0 and seed1 in Dropout 2020-09-08 10:51:12 +08:00
buxue 1ae9da85e0 remove timeout exception test case 2020-09-08 10:34:22 +08:00
mindspore-ci-bot ad186e79d8 !5599 Collect input data when `dataset_sink_mode` set on GPU
Merge pull request !5599 from LiHongzhang/dataset_sink_mode
2020-09-08 10:21:33 +08:00
mindspore-ci-bot 89c76840ee !5828 revert ci pass condition.
Merge pull request !5828 from anzhengqi/fix-ci-condition
2020-09-08 09:14:32 +08:00
Wei Luning e6f82af849 add cell class to c++ 2020-09-07 21:06:07 +08:00
mindspore-ci-bot 4535faa2b0 !5837 [AutoParallel]Rectification allreduce fusion api
Merge pull request !5837 from lichen/rectification_allreduce_fusion_api
2020-09-07 20:37:44 +08:00
mindspore-ci-bot a3d0ddb4db !5779 tenoradd profiling
Merge pull request !5779 from chenweifeng/broadcast-refactor
2020-09-07 20:27:26 +08:00
Li Hongzhang 066950f69e GPU dataset_sink_mode collect inputs 2020-09-07 17:12:36 +08:00
wilfChen 6ebe132cd3 broadcast refactor 2020-09-07 16:57:50 +08:00
lichenever f2d3fd34ce rectification_allreduce_fusion_api 2020-09-07 16:38:58 +08:00
anzhengqi 38b5d91ede fix ci pass condition 2020-09-07 11:02:01 +08:00
mindspore-ci-bot 4e7346509f !5782 change allreduce fusion function
Merge pull request !5782 from wangmin0104/master
2020-09-07 10:24:41 +08:00
mindspore-ci-bot 77dd91a646 !5669 Fix get_py_obj_dtype() for mindspore type
Merge pull request !5669 from hewei/fix_get_py_obj_dtype
2020-09-07 08:59:01 +08:00
mindspore-ci-bot 5c7fa52468 !5673 [performance]cell init opt performance
Merge pull request !5673 from kingxian/master
2020-09-05 17:10:08 +08:00
danish 273fc0071c New User facing Pad Kernel + ST + Allows for channel padding
style fix

lint fixes

added check in NN layer for > 4 paddings, plus lint fix

fix python lint

lint fix

lint fix

updating to pytest asserts to improve testing

removed unnecc vars from test file fail checks
2020-09-04 15:13:05 -04:00
kingxian 92bebe65a9 cell init performance opt 2020-09-04 19:52:56 +08:00
wangmin b035890128 allreduce fusion 2020-09-04 17:28:07 +08:00
mindspore-ci-bot d0c7b1ba24 !5731 Manifest Dataset check invalid filename string
Merge pull request !5731 from jiangzhiwen/fix/invalid_filename_string
2020-09-04 16:36:29 +08:00
yao_yf d4cfe55c04 rename mirror_mean to gradients_mean 2020-09-04 14:47:36 +08:00
BowenK 1bdb26f9e8 Warming up python pass by adding inline passes before it 2020-09-04 14:26:17 +08:00
mindspore-ci-bot bc4c5afc1a !5667 add kernel select after optimize pass
Merge pull request !5667 from zyli2020/code_refactor
2020-09-04 14:24:44 +08:00
mindspore-ci-bot 2f3684d4fa !4872 Add C++ API support for TFRecordDataset
Merge pull request !4872 from TinaMengtingZhang/cpp-api-tfrecord-dataset
2020-09-04 11:53:08 +08:00
mindspore-ci-bot 9018737e99 !5696 [Auto parallel] Move 'multi-subgraphs' interface to internal
Merge pull request !5696 from Xiaoda/20-moving-multi-graph-interface-internal
2020-09-04 11:17:28 +08:00
mindspore-ci-bot c064c01b6b !5729 [AutoParallel]Add FuseBatchNormEx op
Merge pull request !5729 from lichen/add_batchnormex_op
2020-09-04 11:17:22 +08:00
lizhenyu c3d6918649 add kernel select after optimize pass 2020-09-04 10:52:51 +08:00
mindspore-ci-bot 7786adc3aa !5722 fix semi auto parallel parameter of reshape has another user
Merge pull request !5722 from yao_yf/semi_auto_parallel_reshape_parameter_has_another_user
2020-09-04 09:45:41 +08:00
mindspore-ci-bot d76ac7c6e8 !5648 GetColumnNames for Python
Merge pull request !5648 from MahdiRahmaniHanzaki/get-col-name
2020-09-03 22:37:42 +08:00
lichenever d22f506431 add BatchNormEx op 2020-09-03 22:22:19 +08:00
jiangzhiwen 294f7b620a check invalid filename string 2020-09-03 22:09:26 +08:00
mindspore-ci-bot a50bc2182e !5665 delete enable_fused_layernorm
Merge pull request !5665 from yoonlee666/bugfix
2020-09-03 21:21:46 +08:00
mindspore-ci-bot 527d7f0afb !5580 [MD] remove finish in FileReader
Merge pull request !5580 from liyong126/rmv_filereader_finish
2020-09-03 21:18:35 +08:00
yao_yf 05c003ae6b origin/semi_auto_parallel_reshape_parameter_has_another_user 2020-09-03 20:27:46 +08:00
mindspore-ci-bot fc79997de5 !5502 Mod SoftmaxCrossEntropyWithlogits
Merge pull request !5502 from wanyiming/mod_SoftmaxCrossEntropyWithlogits
2020-09-03 20:24:43 +08:00