mindspore-Ecosystem
/
mindspore
21
0
Fork 27
Code Issues Pull Requests 6 Projects Releases Wiki Activity
11,582 Commits 23 Branches 30 Tags 4 GiB
Commit Graph

2375 Commits

Author SHA1 Message Date
mindspore-ci-bot eedbbb3649 !5958 Modify interface for function and remove duplicated def 
Merge pull request !5958 from lilei/modify_bug
 2020-09-10 21:22:32 +08:00
BowenK e482e4e8bf reduce pass traversals if no pre-ad python pass exists 2020-09-10 20:00:10 +08:00
mindspore-ci-bot 2f529c149a !5991 Change API set_strategy() to shard() 
Merge pull request !5991 from yihuaijie/master
 2020-09-10 19:17:32 +08:00
mindspore-ci-bot c882e4863c !5961 [Data]Add lite_cv lib for mindspore lite data preprocessing 
Merge pull request !5961 from xulei/lite_test0905
 2020-09-10 18:51:07 +08:00
Yi Huaijie eb83ea9607 change internal API _get_strategy() to _get_shard_strategy() 2020-09-10 17:46:53 +08:00
mindspore-ci-bot ea94756839 !5605 Introduce usage flag to MNIST and CIFAR dataset 
Merge pull request !5605 from ZiruiWu/add_usage_to_cifar_mnist_coco
 2020-09-10 15:47:48 +08:00
xulei2020 b356211413 add init code 2020-09-10 15:35:08 +08:00
Yi Huaijie a836d25c64 change API set_strategy() to shard() 2020-09-10 15:30:19 +08:00
mindspore-ci-bot 7152fe04be !5783 GraphKernel supports GPU 
Merge pull request !5783 from DeshiChen/graph_kernel_1.0
 2020-09-10 09:15:21 +08:00
anthonyaje 2d08d83247 Fixed connector_size and monitor. 2020-09-09 17:54:59 -04:00
Zirui Wu 1bb93580dd Add usage flag to MNIST/CIFAR 
ci fix 1

fix ci 2

fix ci 3

fix ci 4

fix ci 5

fix ci 6

fix ci 7

change var name in CelebA from dataset_type to usage

address review cmts

fix cpp ut fail

change mode to usage in VOCDataset

fix cmts

fix ci test case fail
 2020-09-09 09:59:55 -04:00
lilei 71adabd944 modify_bug 2020-09-09 18:20:32 +08:00
dayschan 37a48f6aac GraphKernel supports GPU 
1. Update akg submodule
2. Refactor akg_kernel_build, akg_ascend_kernel_build, akg_gpu_kernel_build
3. Add akg_kernel_json_decoder to support converting kernel_json to AnfNode.
4. Add GraphKernel Cost Model. (mindspore/_extends/graph_kernel)
5. Add some GraphKernel passes to GpuSession, move these passes to backend/optimizer/graph_kernel.
6. Add global id for ir files.
7. Fix bug in ConstInputToAttr.
 2020-09-09 17:46:50 +08:00
Wei Luning 249382899b fix bug in cell pickle and copy 2020-09-09 15:33:56 +08:00
mindspore-ci-bot 2350a5990b !5885 [doc]add some document for composite op 
Merge pull request !5885 from vlne-v1/add-doc-for-composite-op
 2020-09-09 14:13:23 +08:00
mindspore-ci-bot eff187d83d !5806 [MD] minddata delete set_dataset_size interface 
Merge pull request !5806 from xiefangqi/md_delete_setdatasetsize
 2020-09-09 11:50:52 +08:00
mindspore-ci-bot 0aa9f900dd !5749 Support multi grad 
Merge pull request !5749 from amongo/SupportPyantiveMultiGrad
 2020-09-09 10:31:35 +08:00
Wei Luning 8c6475fd0b add composite op doc 2020-09-09 10:18:49 +08:00
xiefangqi d0410d6191 md delete set_dataset_size interface 2020-09-09 09:56:03 +08:00
mindspore-ci-bot c45f79d36b !5384 [MD]-Api changes 
Merge pull request !5384 from nhussain/api_changes
 2020-09-09 09:49:05 +08:00
mindspore-ci-bot 88f5cbe5db !5692 Add requires_grad option for python pass 
Merge pull request !5692 from BowenK/pre_ad
 2020-09-09 09:28:52 +08:00
mahdi a152a65227 Fixed the column problem in BucketBatchByLength 2020-09-08 17:48:42 -04:00
Zirui Wu bde9f18f5a update lookup api to take in a type 
ci

add test case

address some of the review cmts

address review cmts
 2020-09-08 11:59:28 -04:00
nhussain 3bac9d3713 switch input columns and operation 
change ImagefolderDV2 name

change ds.transforms.vision to ds.vision

change batch api to match map api more closely

compose op changes

test_pylint

remove compose op from vision, move to transform module, refactor map and batch to use column_order
 2020-09-08 10:26:20 -04:00
huangdongrun 341b8468eb add support for pynative multicases 
clear df builder

add testcases
 2020-09-08 16:09:48 +08:00
mindspore-ci-bot f984518150 !5872 remove timeout exception test case 
Merge pull request !5872 from zhangbuxue/remove_timeout_exception_test_case
 2020-09-08 14:11:06 +08:00
mindspore-ci-bot a838c9bd3d !5685 update run for br: master 
Merge pull request !5685 from guozhijian/udpate_run_from_c75b100_to_c75b150_master
 2020-09-08 12:34:13 +08:00
mindspore-ci-bot b40677002f !5714 [refine]change top graph and add cell class 
Merge pull request !5714 from vlne-v1/change-top-graph
 2020-09-08 11:56:36 +08:00
wuxuejian bd527a331d update aicpu proto and update module: graphengine 
Support Dynamic Shape Aicpu Run Package

adapt tensorengin modify, fix ub fusion
 2020-09-08 11:38:44 +08:00
caozhou 6509fa9023 delete seed0 and seed1 in Dropout 2020-09-08 10:51:12 +08:00
buxue 1ae9da85e0 remove timeout exception test case 2020-09-08 10:34:22 +08:00
mindspore-ci-bot ad186e79d8 !5599 Collect input data when `dataset_sink_mode` set on GPU 
Merge pull request !5599 from LiHongzhang/dataset_sink_mode
 2020-09-08 10:21:33 +08:00
Wei Luning e6f82af849 add cell class to c++ 2020-09-07 21:06:07 +08:00
Li Hongzhang 066950f69e GPU dataset_sink_mode collect inputs 2020-09-07 17:12:36 +08:00
lichenever f2d3fd34ce rectification_allreduce_fusion_api 2020-09-07 16:38:58 +08:00
mindspore-ci-bot 77dd91a646 !5669 Fix get_py_obj_dtype() for mindspore type 
Merge pull request !5669 from hewei/fix_get_py_obj_dtype
 2020-09-07 08:59:01 +08:00
mindspore-ci-bot 5c7fa52468 !5673 [performance]cell init opt performance 
Merge pull request !5673 from kingxian/master
 2020-09-05 17:10:08 +08:00
kingxian 92bebe65a9 cell init performance opt 2020-09-04 19:52:56 +08:00
mindspore-ci-bot d0c7b1ba24 !5731 Manifest Dataset check invalid filename string 
Merge pull request !5731 from jiangzhiwen/fix/invalid_filename_string
 2020-09-04 16:36:29 +08:00
yao_yf d4cfe55c04 rename mirror_mean to gradients_mean 2020-09-04 14:47:36 +08:00
BowenK 1bdb26f9e8 Warming up python pass by adding inline passes before it 2020-09-04 14:26:17 +08:00
mindspore-ci-bot bc4c5afc1a !5667 add kernel select after optimize pass 
Merge pull request !5667 from zyli2020/code_refactor
 2020-09-04 14:24:44 +08:00
mindspore-ci-bot 2f3684d4fa !4872 Add C++ API support for TFRecordDataset 
Merge pull request !4872 from TinaMengtingZhang/cpp-api-tfrecord-dataset
 2020-09-04 11:53:08 +08:00
mindspore-ci-bot 9018737e99 !5696 [Auto parallel] Move 'multi-subgraphs' interface to internal 
Merge pull request !5696 from Xiaoda/20-moving-multi-graph-interface-internal
 2020-09-04 11:17:28 +08:00
mindspore-ci-bot c064c01b6b !5729 [AutoParallel]Add FuseBatchNormEx op 
Merge pull request !5729 from lichen/add_batchnormex_op
 2020-09-04 11:17:22 +08:00
lizhenyu c3d6918649 add kernel select after optimize pass 2020-09-04 10:52:51 +08:00
mindspore-ci-bot 7786adc3aa !5722 fix semi auto parallel parameter of reshape has another user 
Merge pull request !5722 from yao_yf/semi_auto_parallel_reshape_parameter_has_another_user
 2020-09-04 09:45:41 +08:00
mindspore-ci-bot d76ac7c6e8 !5648 GetColumnNames for Python 
Merge pull request !5648 from MahdiRahmaniHanzaki/get-col-name
 2020-09-03 22:37:42 +08:00
lichenever d22f506431 add BatchNormEx op 2020-09-03 22:22:19 +08:00
jiangzhiwen 294f7b620a check invalid filename string 2020-09-03 22:09:26 +08:00
mindspore-ci-bot 527d7f0afb !5580 [MD] remove finish in FileReader 
Merge pull request !5580 from liyong126/rmv_filereader_finish
 2020-09-03 21:18:35 +08:00
yao_yf 05c003ae6b origin/semi_auto_parallel_reshape_parameter_has_another_user 2020-09-03 20:27:46 +08:00
mindspore-ci-bot fc79997de5 !5502 Mod SoftmaxCrossEntropyWithlogits 
Merge pull request !5502 from wanyiming/mod_SoftmaxCrossEntropyWithlogits
 2020-09-03 20:24:43 +08:00
mindspore-ci-bot b961d47d40 !5642 UTest compiling performance optimization 
Merge pull request !5642 from zhoufeng/ut-compile-performance
 2020-09-03 20:21:13 +08:00
liyong ac39c20f41 del finish in FileReader 2020-09-03 20:05:38 +08:00
mindspore-ci-bot 01da7d2c1a !5713 Align num_samples of CSV with other dataset 
Merge pull request !5713 from jiangzhiwen/fix/csv_num_samples
 2020-09-03 19:52:43 +08:00
Xiaoda Zhang 42f1241270 remove 'multi-subgraphs' to internal 2020-09-03 19:07:08 +08:00
wanyiming 0ec70068ae mod_SoftmaxCrossEntropyWithLogits 2020-09-03 17:33:20 +08:00
jiangzhiwen 1a1a8893a4 Align num_samples of CSV with other dataset 2020-09-03 17:30:39 +08:00
zhoufeng 6d500223b2 utest compiling performance optimization 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2020-09-03 16:57:19 +08:00
zhousiyi 301aeaaf1d remove gvar source file from compile as ut_tests will use gvar so 2020-09-03 06:49:30 +00:00
mindspore-ci-bot 0118930c6b !5671 modify voc doc & fix buildvocab bug 
Merge pull request !5671 from luoyang/c-api-pyfunc
 2020-09-03 09:25:13 +08:00
mindspore-ci-bot 290979853e !5663 add check for mod when y in (-1, 0) 
Merge pull request !5663 from zhangbuxue/add_check_for_mod_for_y
 2020-09-03 09:16:45 +08:00
mindspore-ci-bot 021ba724cf !5645 [bug][api]updata signature 
Merge pull request !5645 from vlne-v1/ref_demo
 2020-09-03 09:11:50 +08:00
Mahdi 6e7aab8c4f Added GetColumnNames for Datasets 2020-09-02 17:12:48 -04:00
Cathy Wong 4d4c11b133 dataset API docstring cleanup: Standard product terms NumPy, Python 2020-09-02 10:42:12 -04:00
tinazhang e430b4056a add tfrecord dataset to cpp api 
fix to support schema=nullptr
 2020-09-02 08:55:47 -04:00
mindspore-ci-bot 35e6cca1a3 !5634 wrap numpy random seed into an api 
Merge pull request !5634 from yihuaijie/master
 2020-09-02 19:28:33 +08:00
buxue 4d59fe9ee1 add check for mod when y in (-1, 0) 2020-09-02 18:10:00 +08:00
Wei Luning 879a519136 updata signature 2020-09-02 17:29:29 +08:00
Yi Huaijie 4a5d115a66 add get_seed() and set_seed() 2020-09-02 17:17:04 +08:00
luoyang 8aba39a71b Modify VOCDataset doc & Fix BuildVocab bug 2020-09-02 16:54:50 +08:00
He Wei c1469d61ce Fix get_py_obj_dtype() for mindspore type 
Return mstype.type_type if input is mindspore type object,
for example:
```
get_py_obj_dtype(mstype.float32) ---> mstype.type_type
```
 2020-09-02 16:14:25 +08:00
mindspore-ci-bot ccc0ea60ee !5661 fix auto parallel reshape strategy set when it is first operator 
Merge pull request !5661 from yao_yf/auto_parallel_reshape_fix
 2020-09-02 15:42:47 +08:00
mindspore-ci-bot 847fadc8b9 !5516 auto parallel context modify 
Merge pull request !5516 from yao_yf/auto_parallel_context_collation
 2020-09-02 15:41:05 +08:00
mindspore-ci-bot bb84f50407 !5473 optim pylint 
Merge pull request !5473 from jinyaohui/master
 2020-09-02 15:25:30 +08:00
mindspore-ci-bot 4ec343961e !5482 modify save_checkpoint 
Merge pull request !5482 from liuyang/md_save_checkpoint
 2020-09-02 14:20:48 +08:00
yao_yf 755f381406 fix auto parallel reshape strategy set when it is first operator 2020-09-02 14:15:54 +08:00
mindspore-ci-bot 5e3e583b47 !5615 Add check for duplicate column to a-cpi & add voc descriptions for class_index 
Merge pull request !5615 from luoyang/c-api-pyfunc
 2020-09-02 11:59:34 +08:00
mindspore-ci-bot 3048240f16 !5508 Add AdamApplyOneWithDecayAssign fusion pass 
Merge pull request !5508 from YuJianfeng/adam_assign
 2020-09-02 11:23:34 +08:00
luoyang ce419404ce Add check for duplicate column for a-cpi 2020-09-02 10:41:52 +08:00
mindspore-ci-bot 03093778df !5387 Set num_epochs=1 for MindData python testcases 
Merge pull request !5387 from lixiachen/testcase_epoch
 2020-09-02 09:45:13 +08:00
mindspore-ci-bot be3d79cb6b !4204 add dynamic shape support for GatherV2 and others 
Merge pull request !4204 from fary86/adapt_primitive_dynamic_shape
 2020-09-02 09:31:14 +08:00
mindspore-ci-bot 120ab80b23 !5641 check user define bprop when there is parameter in nested network 
Merge pull request !5641 from zhangbuxue/check_user_define_bprop_when_there_is_parameter_in_nested_network
 2020-09-02 09:04:05 +08:00
mindspore-ci-bot 0cb6d29f0c !4998 Shared memory pool clean up 
Merge pull request !4998 from JesseKLee/mem_pool
 2020-09-02 02:01:19 +08:00
Lixia Chen 27d5281641 Change epoch count to 1 for python testcases 2020-09-01 11:24:26 -04:00
buxue 359e1f236e check user define bprop when there is parameter in nested network 2020-09-01 21:24:27 +08:00
fary86 144a35b17e Adapt GatherV2 for dynamic shape 2020-09-01 19:24:21 +08:00
mindspore-ci-bot 8f3ebfd469 !5624 Optimize the performance of GraphData.get_neg_sampled_neighbors 
Merge pull request !5624 from heleiwang/gnn_perf
 2020-09-01 19:22:53 +08:00
heleiwang 857cf2f77f Optimize the negative sampling process 2020-09-01 16:29:59 +08:00
mindspore-ci-bot c2fddb56c8 !4922 Transform tuple parameter to multiple parameters 
Merge pull request !4922 from amongo/TupleTransform
 2020-09-01 15:15:56 +08:00
huangdongrun 0099da2c99 add support for tuple parameter transform 
add support for pynative pass

add testcases
 2020-09-01 14:17:52 +08:00
mindspore-ci-bot dff02cc282 !5188 rename image files in imagefolder 
Merge pull request !5188 from tony_liu2/alt
 2020-09-01 11:16:30 +08:00
mindspore-ci-bot 5453b40311 !4477 add dataset compare function to utils 
Merge pull request !4477 from tony_liu2/staging
 2020-09-01 11:15:18 +08:00
mindspore-ci-bot b99149dc37 !4901 Adding data_helper for minddata 
Merge pull request !4901 from EricZ/md_helper
 2020-09-01 11:14:11 +08:00
mindspore-ci-bot ab29dbf98b !5385 dataset fixes: Update OneHot API doc; fixup UTs 
Merge pull request !5385 from cathwong/ckw_dataset_ut_cleanup8
 2020-09-01 11:11:49 +08:00
mindspore-ci-bot 8ebc8ce9c6 !5438 support parameter tuple input in pynative mode 
Merge pull request !5438 from wangqiuliang/support-parameter-tuple-input
 2020-09-01 11:04:03 +08:00
mindspore-ci-bot 3be136f6f0 !5354 Fix randomdata issue 
Merge pull request !5354 from xiefangqi/fix_randomdata_columnlist
 2020-09-01 11:03:54 +08:00
mindspore-ci-bot 6cba0deb05 !4877 BucketBatchByLength for C++ API 
Merge pull request !4877 from MahdiRahmaniHanzaki/bucket_batch_by_length_c
 2020-09-01 10:58:51 +08:00
mindspore-ci-bot 1a4d3e351e !5586 Boost python pass compile and train performance 
Merge pull request !5586 from BowenK/performance
 2020-09-01 09:19:02 +08:00
mahdi 84efa0b96b Added BucketBatchByLength for C API 2020-08-31 17:06:16 -04:00
Eric 65bf3ecc3e Adding data_helper class 2020-08-31 16:29:14 -04:00
Cathy Wong 7f6782be2a dataset fixes: Update OneHot API docs; fixup Python UTs 2020-08-31 15:04:26 -04:00
mindspore-ci-bot 65819fb50c !5488 heck arg is tensor when graph output is a const or parameter 
Merge pull request !5488 from zhangbuxue/add_check_tensor_before_compile_graph
 2020-08-31 21:36:04 +08:00
yao_yf 8f7aa5bd5a auto parallel context modify 2020-08-31 21:19:49 +08:00
kingfo 7765d44b76 support parameter tuple input in pynative mode 2020-08-31 20:38:43 +08:00
BowenK d6fb7d2db1 Remove debug drawing and printing to boost compile performance; re-opt after python pass to boost training; fix NewParameter tensor clone 2020-08-31 17:42:00 +08:00
buxue 4168c51f0d add check tensor when graph output is a const or parameter 2020-08-31 17:17:24 +08:00
liuyang_655 4683de3443 modify save_checkpoint 2020-08-31 16:24:57 +08:00
jinyaohui a9972a7def optim pylint 2020-08-31 14:49:57 +08:00
mindspore-ci-bot 8d41931456 !5352 refactor ms_context implementation 
Merge pull request !5352 from fary86/refactor_context_interface
 2020-08-31 09:27:33 +08:00
mindspore-ci-bot 4d963d96f4 !5534 Fix Tensor.from_numpy() returns wrong type 
Merge pull request !5534 from hewei/fix_tensor_from_numpy
 2020-08-31 09:15:48 +08:00
Jesse Lee e89b4648f6 Memory pool clean up 2020-08-30 11:28:24 -04:00
fary86 fcbb3e0edc Refactor ms_context implementation 2020-08-30 22:51:40 +08:00
He Wei 27721ff4ea Fix Tensor.from_numpy() returns wrong type 
Tensor.from_numpy() should return mindspore.Tensor not _c_expression.Tensor.
 2020-08-29 19:05:44 +08:00
yujianfeng 4b77f6b53c Add AdamApplyOneWithDecayAssign fusion pass 2020-08-29 17:54:15 +08:00
mindspore-ci-bot e6a4d932b4 !5350 [AutoParallel]Rectification distributed init 
Merge pull request !5350 from lichen/rectification_init
 2020-08-29 14:55:18 +08:00
mindspore-ci-bot d81b30e6a0 !5312 make backend/optimizer free of pybind 
Merge pull request !5312 from xychow/remove-backend-py-dependency-2
 2020-08-29 14:42:33 +08:00
mindspore-ci-bot be606ba8f5 !5432 Mindspore parallel supports all elementary-wise operators 
Merge pull request !5432 from yihuaijie/master
 2020-08-29 14:16:48 +08:00
lichenever d3e55b543e rectification init 2020-08-29 09:34:58 +08:00
mindspore-ci-bot 1821e98e07 !4087 asyn run graph 
Merge pull request !4087 from kisnwang/async-run-graph
 2020-08-29 09:18:37 +08:00
Yi Huaijie 84948ca730 parallel supports more elementary-wise operators 2020-08-28 18:19:06 +08:00
kswang 756bb6d53f async run graph 2020-08-28 18:18:47 +08:00
zhousiyi c25e37e7bf make backend/optimizer pybind free 2020-08-28 08:56:58 +00:00
mindspore-ci-bot 414184c184 !5367 Check the parameter's split strategies if it has multiple users 
Merge pull request !5367 from yangzhenzhang/check-parameter-split
 2020-08-28 16:26:46 +08:00
mindspore-ci-bot 820f2cb4eb !5351 move ParalleMode to Context 
Merge pull request !5351 from yao_yf/parallel_context_collation
 2020-08-28 16:13:01 +08:00
yao_yf 07117e4dd4 mv ParallelMode to context 2020-08-28 19:13:55 +08:00
xiefangqi e2085a9505 fix randomdata issue 2020-08-28 11:55:49 +08:00
He Wei d7cdda1cb0 Provide Tensor.from_numpy() to avoid copy 2020-08-28 11:03:14 +08:00
yangzhenzhang fbda03bbcc check parameter split 2020-08-28 10:49:27 +08:00
tony_liu2 70bfd506a1 add function 
pr comment fix

revert graphengine
 2020-08-27 16:50:19 -04:00
tony_liu2 5e4c314130 rename dataset dir and image files 
change references to use path original

revert folder name

revert graphengine
 2020-08-27 16:49:23 -04:00
mindspore-ci-bot 716329df6c !5278 Change default value of sampler in c-api 
Merge pull request !5278 from luoyang/c-api
 2020-08-27 21:33:18 +08:00
mindspore-ci-bot 7aaf4118bf !5297 CutMixBatch and MixUpBatch fix for 2D one-hot labels 
Merge pull request !5297 from MahdiRahmaniHanzaki/cutmix-fix
 2020-08-27 21:32:09 +08:00
YangLuo 419478b410 Change default value of sampler to seperate behaviour of default sampler 
& null sampler, add check for duplicate column name
 2020-08-27 21:24:37 +08:00
mindspore-ci-bot 9392623066 !5181 Python pass pattern renaming and interface tweaking 
Merge pull request !5181 from BowenK/new_parameter
 2020-08-27 19:45:36 +08:00
mindspore-ci-bot a8317acee8 !5111 Support int64 for cpu sparse optimizers 
Merge pull request !5111 from YuJianfeng/int64
 2020-08-27 17:17:05 +08:00
mindspore-ci-bot e94416be0c !5283 Support setting operator io format in the frontend 
Merge pull request !5283 from liangchenghui/io_format
 2020-08-27 15:48:13 +08:00
mindspore-ci-bot fabebb2678 !5264 [bug]fix bugs when parameters updata 
Merge pull request !5264 from vlne-v1/I1SP3I-return-value-not-the-exact-value
 2020-08-27 14:13:20 +08:00
mindspore-ci-bot b346f0b3ec !5026 Fix the problem of resource clear 
Merge pull request !5026 from Simson/enhancement-API
 2020-08-27 11:19:02 +08:00
yujianfeng e949540062 Support int64 for cpu sparse optimizers 2020-08-27 10:57:53 +08:00
simson d4babf190c fix risk of memory leak 2020-08-27 10:54:06 +08:00
mindspore-ci-bot d1b95ed9bd !5240 Fix remove internal output for unique device target 
Merge pull request !5240 from YuJianfeng/internal_output
 2020-08-27 10:35:37 +08:00
BowenK 641d12d6d9 python pass pattern renaming and interface tweaking 2020-08-27 10:03:46 +08:00
mindspore-ci-bot 66d6320b21 !5224 Add test case about loss scale in parallel mode 
Merge pull request !5224 from yangzhenzhang/add-split-sens-and-loss-scale-test-case
 2020-08-27 09:06:01 +08:00
mahdi 7ad7024c45 Fixed 2D one-hot label problems in CutMix and MixUp 2020-08-26 16:17:21 -04:00
islam_amin 94a4a3f20b changing affine and posterize apis 2020-08-26 10:51:54 -04:00
Wei Luning 4cc8342b5b fix bug in Parameter init_data 2020-08-26 22:15:22 +08:00
梁成辉 34d433fd9a Set io format for old backend 2020-08-26 20:49:15 +08:00
kpy 44b738e8ac fix grad all ci bug 2020-08-26 18:28:35 +08:00
yujianfeng e688e1df32 Fix remove internal output for unique device target 2020-08-26 17:31:35 +08:00
mindspore-ci-bot 314c5ad055 !5172 remove name arg from gradoperation 
Merge pull request !5172 from riemann_penn/remove_name_args_from_gradoperation
 2020-08-26 16:55:57 +08:00
mindspore-ci-bot 95212b55a0 !3271 make reftype a subtype of MetaTensor and try to mark ref in node input 
Merge pull request !3271 from vlne-v1/ref_demo
 2020-08-26 15:45:48 +08:00
yangzhenzhang 6ae5893681 add test cases 2020-08-26 15:11:44 +08:00
Wei Luning 24a10225cf change base class of ref to tensor in cpp 2020-08-26 12:41:25 +08:00
mindspore-ci-bot e4d2f2fd3b !5030 Adding a BBox class and fixing Posterize C Op testing. 
Merge pull request !5030 from islam_amin/bbox_class
 2020-08-26 11:40:57 +08:00
panyifeng 1a54785fe2 remove name arg from gradoperation 2020-08-26 11:16:57 +08:00
mindspore-ci-bot cd1240180b !5187 C++ API: Lexicographical order support for CLUE, CSV & TextFile Datasets 
Merge pull request !5187 from cathwong/ckw_c_api_fixes2
 2020-08-26 10:48:05 +08:00
mindspore-ci-bot 20b3134785 !5184 fix: padded dataset when no div and with repeat op 
Merge pull request !5184 from guozhijian/fix_padded_with_no_div_repeat
 2020-08-26 10:47:22 +08:00
mindspore-ci-bot f3fd7a5578 !5073 Add checks and exception handling DS callback 
Merge pull request !5073 from h.farahat/map_callback_end
 2020-08-26 10:40:40 +08:00
jonyguo 6df1a43ec2 fix: padded dataset with non div & repeat 2020-08-26 08:56:37 +08:00
Cathy Wong 46e9d79a50 C++ API: Lexicographical order support for CLUE, CSV & TextFile Datasets 2020-08-25 14:11:19 -04:00
mindspore-ci-bot 971716f4b9 !5136 fix large for loop runtime error due to lacking of backend operators 
Merge pull request !5136 from fary86/fix_large_for_runtime_error
 2020-08-25 22:26:25 +08:00
mindspore-ci-bot 346b97acb8 !5156 fix softdvpp coredump 
Merge pull request !5156 from qianlong21st/master_fix_softdvpp_core
 2020-08-25 22:20:00 +08:00
mindspore-ci-bot 2e3f5cd41b !5114 fix bug in c-api: rename, concat, take 
Merge pull request !5114 from luoyang/c-api-pyfunc
 2020-08-25 20:57:41 +08:00
qianlong 12dfca71f1 fix softdvpp coredump 2020-08-25 18:56:40 +08:00
YangLuo 67f5c89cd6 Check input image type for random posterize 2020-08-25 16:26:17 +08:00
fary86 8d245497a4 Fix large for loop Runtime Error due to backend missing operators 2020-08-25 16:25:41 +08:00
luoyang b26f6b3d5e fix bug in c-api: rename, concat, take 2020-08-25 16:25:00 +08:00
huangdongrun 113641decd fix test cases 2020-08-25 14:38:08 +08:00
mindspore-ci-bot 7d4f481884 !5017 remove internal interface in wide&deep 
Merge pull request !5017 from yao_yf/wide_and_deep_no_internal_interface
 2020-08-25 14:11:51 +08:00
mindspore-ci-bot 957126375b !5095 Adding Float tensor support for CutMixBatch 
Merge pull request !5095 from MahdiRahmaniHanzaki/cutmix-fix
 2020-08-25 10:53:58 +08:00
mindspore-ci-bot afd16fbf0a !4963 fix bug of switch layer join 
Merge pull request !4963 from fary86/fix_switch_layer_join_bug
 2020-08-25 10:47:32 +08:00
mindspore-ci-bot abe6b82138 !5011 remove global grad ops 
Merge pull request !5011 from riemann_penn/remove_global_grad_ops
 2020-08-25 09:47:55 +08:00
fary86 947e19b839 Fix bug of switch layer join 2020-08-25 09:08:53 +08:00
islam_amin 641e751d5e adding bbox class 2020-08-24 18:22:58 -04:00
Mahdi a2c38d89f9 Added float32 support for CutMixBatch 2020-08-24 17:15:25 -04:00
hesham 8eeceb267b - release the wait if training is ended 2020-08-24 13:11:07 -04:00
yao_yf a9a8e323b2 remove internal interface in wide&deep 2020-08-24 19:18:47 +08:00
mindspore-ci-bot 4f6e63fcf8 !4576 Support if by if not inline 
Merge pull request !4576 from amongo/SupportIfByIfNotInline
 2020-08-24 19:15:39 +08:00
mindspore-ci-bot fc6eee3bda !5019 raise RuntimeError when set different mode after Initializer created 
Merge pull request !5019 from yihuaijie/dev
 2020-08-24 18:49:32 +08:00
huangdongrun 1bd9fefd84 support if by if not inline 
add testcase of net of if by if
 2020-08-24 17:11:26 +08:00
panyifeng 637e812347 remove global grad ops 2020-08-24 16:50:09 +08:00
mindspore-ci-bot 226f019e45 !4888 add parallel attention test 
Merge pull request !4888 from hanyang/master
 2020-08-24 15:50:56 +08:00
Yi Huaijie 394be43492 raise RuntimeError when set different mode after Initializer created 2020-08-24 14:08:09 +08:00
mindspore-ci-bot 8d693306f4 !4126 Add new parameter 
Merge pull request !4126 from BowenK/new_parameter
 2020-08-24 10:01:46 +08:00
mindspore-ci-bot 56835aaf88 !5005 Fix the bug in the formula in Bernoulli log_probs 
Merge pull request !5005 from zichun_ye/fix_bernoulli_probs
 2020-08-24 09:09:43 +08:00
mindspore-ci-bot 0bbce9367e !4772 Adding AlbumDataset for device training 
Merge pull request !4772 from EricZ/ms-album
 2020-08-24 08:27:14 +08:00
Zichun Ye 9e7d6e2397 fix bernoulli prob formula; fix some other minor bugs 
update threshold of softplus computation

support fp for bernoulli and geometric distribution
 2020-08-23 17:49:09 -04:00
Eric c79db93c48 Initial commit for album 
Added linter fix for album dataset

Added testDataset

Adding signature

Added JsonDataset example API

Example dataset

Resolving format

More fixing

Refactor

Small fix

Added compiling album dataset

Running tests

Added linter fix #1

Passing UT

Added dataset API

Addressing clang

Clang part 2

Fixing pass

Fixed tree check

lint fix

Added lint fix part 2
 2020-08-22 11:07:10 -04:00
mindspore-ci-bot 94a109f476 !4898 Fix coredump caused by function call depth too large 
Merge pull request !4898 from fary86/fix_call_depth_too_large
 2020-08-22 16:08:27 +08:00
fary86 04524b6bd3 Fix coredump caused by function call depth too large 2020-08-22 15:00:04 +08:00
mindspore-ci-bot ac81886328 !4916 fix generator_dataset hangs and test_graphdata_distributed.py failing randomly 
Merge pull request !4916 from heleiwang/gnn_fix_bug
 2020-08-22 10:51:01 +08:00
mindspore-ci-bot b366608a3f !4952 Fix errors in log calculation logics 
Merge pull request !4952 from peixu_ren/custom_pp_ops
 2020-08-22 10:40:40 +08:00
mindspore-ci-bot 9b503e4f38 !4955 Fixes for Dynamic Augmentation Ops 
Merge pull request !4955 from MahdiRahmaniHanzaki/dynamic-ops-fix
 2020-08-22 10:27:50 +08:00
peixu_ren 1c8eb9b15d Fix errors in log calculation logics 2020-08-21 21:28:10 -04:00
Mahdi a5f9b8f92e Added fix for MixUpBatch and CutMixBatch and for RandomAffine 
updated c color op descriptions
 2020-08-21 17:40:08 -04:00
mindspore-ci-bot 9d7250c483 !4776 Introduce 2 extra ctrl flags to DataBuffer in dataset, address remaining cmts to PR4632 
Merge pull request !4776 from ZiruiWu/map_callback_follow_up
 2020-08-22 03:31:31 +08:00
Zirui Wu 74c1e6da60 introducing pause and quit flags to DataBuffer 
fix review cmts

fix ci

fix Ci

fixci

address ci

ci

- add timeout
- add more test cases

fix CI

address review cmts
 2020-08-21 14:33:26 -04:00
mindspore-ci-bot 82c888f065 !4930 Fix CI cifar hang issue 
Merge pull request !4930 from xiefangqi/fix_cifar_nofile_issue
 2020-08-21 20:49:40 +08:00
xiefangqi e3e7820413 fix cifar stuck problem 2020-08-21 19:35:07 +08:00
mindspore-ci-bot 0d1a7ac654 !4909 [bug]support implicit type conversion for parameter 
Merge pull request !4909 from vlne-v1/I1QM7L-implicit-type-conversion-parameter
 2020-08-21 17:08:23 +08:00
BowenK e7c6b7e66a Add NewParameter and Imm patterns 2020-08-21 16:53:04 +08:00
mindspore-ci-bot c92f7c9170 !4911 add func type check for switch layer 
Merge pull request !4911 from riemann_penn/add_func_type_check_for_switch_layer
 2020-08-21 16:42:12 +08:00
panyifeng abab21ed57 add func type check for switch layer 2020-08-21 16:11:40 +08:00
mindspore-ci-bot 6e8d3a3b82 !4859 Add CTCGrerdyDecoder ops for old backend. 
Merge pull request !4859 from liuxiao93/Add-ReversSqueuce-EditDistance-CTCGrerdyDecoder
 2020-08-21 16:05:19 +08:00
heleiwang 4870abc848 1. fix generator_dataset hangs 
2. fix test_graphdata_distributed.py failing randomly
 2020-08-21 16:03:06 +08:00
Wei Luning 77dcdd89ec support parameter updata with implicit type conversion 2020-08-21 15:24:57 +08:00
panyifeng f9f3cd7ce0 fix switch_layer_issues 2020-08-21 14:17:51 +08:00
mindspore-ci-bot b2a5440548 !4883 Fix compilation warnings 
Merge pull request !4883 from zhoufeng/xiu-ba-ge
 2020-08-21 12:33:20 +08:00
mindspore-ci-bot bccb92adf7 !4868 fix: concat with none sample dataset 
Merge pull request !4868 from guozhijian/fix_concat_with_zero_dataset
 2020-08-21 12:02:30 +08:00
liuxiao93 9bc18ea2e5 Add CTCGrerdyDecoder ops for GE. 2020-08-21 10:12:01 +08:00
Su Teng e3ae23c939 add parallel attention test 2020-08-21 10:10:53 +08:00
mindspore-ci-bot 2ac410e90d !4789 Add EditDistance op for GE. 
Merge pull request !4789 from liuxiao93/Add-EditDistance-op-for-GE
 2020-08-21 09:49:38 +08:00
mindspore-ci-bot 3d06cbf987 !4801 Must set or change parallel mode before any Initializer created 
Merge pull request !4801 from yihuaijie/dev
 2020-08-21 09:47:32 +08:00
zhoufeng 22ec976ef7 fix compilation warnings 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2020-08-21 09:44:04 +08:00
jonyguo 5b4b539751 fix: concat with none sample dataset 2020-08-21 09:19:50 +08:00
mindspore-ci-bot 9a3baf4f6c !4314 [MD] remove defaults used in binding code, and remove bilinear resize op 
Merge pull request !4314 from nhussain/clean_up_bindings
 2020-08-20 22:16:56 +08:00
mindspore-ci-bot bfa3cd900e !4843 remove ccsrc/common.h by explicit dependent header file 
Merge pull request !4843 from xychow/remove-ccsrc-common-h
 2020-08-20 22:02:13 +08:00
mindspore-ci-bot 98052f9d06 !4847 [MD] Add some data validation 
Merge pull request !4847 from xiefangqi/xfq_add_numworker_validate
 2020-08-20 20:22:51 +08:00
mindspore-ci-bot 2cb22a0f78 !4688 Fix bool operation parsing to be consistent with pynative 
Merge pull request !4688 from amongo/FixBoolParse
 2020-08-20 20:06:41 +08:00
liuxiao93 4c99f4f649 Add EditDistance op for GE. 2020-08-20 19:39:57 +08:00
Yi Huaijie 89a4ebf8a1 parallel mode must be set before create an initializer 2020-08-20 19:20:46 +08:00
zhousiyi d0e58dd765 remove ccsrc/common.h 
replace frontend/operator/ops.h in backend with base/core_ops.h as
backend should not use any frontend-only primitive
 2020-08-20 09:34:07 +00:00
xiefangqi 7dc7990d75 add NumWorkers validate 2020-08-20 17:25:30 +08:00
huangdongrun f30418991c refactor bool op parsing to be consistent with pynative mode 
add testcase of st
 2020-08-20 16:45:30 +08:00
mindspore-ci-bot 9ee144ea40 !4744 [AutoParallel]Support bert 
Merge pull request !4744 from lichen/support_bert
 2020-08-20 14:13:19 +08:00
mindspore-ci-bot 7b0a4e5929 !4796 Fix randomdata ut core dump problem 
Merge pull request !4796 from xiefangqi/fix_randomdata_ut
 2020-08-20 14:11:55 +08:00
xiefangqi c0d18d2517 fix randomdata ut problem 2020-08-20 11:13:02 +08:00
mindspore-ci-bot ed954dc407 !4782 Python UT fails on RandomPosterize 
Merge pull request !4782 from islam_amin/bbox_class
 2020-08-20 10:18:59 +08:00
mindspore-ci-bot 24700afa2d !4689 add check for user define bprop in Pynative mode 
Merge pull request !4689 from zhangbuxue/add_check_for_user_define_bprop_in_Pynative_mode
 2020-08-20 09:43:46 +08:00
islam_amin 85357238fe Fixing posterize python ut 2020-08-19 21:35:07 -04:00
Jesse Lee 8a08d0c37b Phase 2 of CacheOp 2020-08-19 13:45:55 -04:00
Zirui Wu 78c1aa1d96 Implemented Callback for Dataset 
implment pause in MapOp, added more to callback

add ds_callback

- Initial drop of Python DSCallback

- Pybind DSCallback

- Pybind DSCallback

added callback to mapOp

- de_pipeline DSCallback

- de_pipeline DSCallback

add test case, segfault for now

fix seg fault

- de_pipeline DSCallback

remove 1 line

update callback test case, now works

use builder class for mapOp callback

- de_pipeline DSCallback

- de_pipeline DSCallback

- de_pipeline DSCallback

better test case

minor fix

add comments and minor clean ups

get rid of nullptr in MapOp, use other flag instead

fix a bug ParseMapOp only takes 1 callback

- Added WaitedDSCalabck

refactor callback param

fix text case incorrect number

- added testing

fix cpp test case

- added testing

- revert back lenet changes

- cleanup test_callbacks.py

- cleanup test_callbacks.py

fix CI stage I

fix CI stage II

fix CI and update epoch counter

- add validation
- add more testing  test_callbacks.py

use random data op to do tests

adjust when to call EpochBegin/End

- add repeat with callback

- addressing reviewers' comments

- docstring and CI fixes

- docstring and CI fixes

- docstring and CI fixes

- rebase with upstream/master

fix cpp test case

fix review comments

addr review cmts, add test case
 2020-08-19 12:31:04 -04:00
YangLuo b50ae27c72 !4597 [Dataset] C++ API Support for build_vocab 2020-08-19 22:47:47 +08:00
nhussain eb9a611041 remove old defaults 2020-08-19 10:11:19 -04:00
buxue 855d6b8fed add check for user define bprop in Pynative mode. 2020-08-19 19:14:02 +08:00
lichenever 221a801395 auto parallel support bert 2020-08-19 17:47:59 +08:00
mindspore-ci-bot d541e261a0 !4696 C++ API Support for CSV Dataset 
Merge pull request !4696 from jiangzhiwen/jzw/c_api_csv
 2020-08-19 17:08:33 +08:00
mindspore-ci-bot 70a218123b !4722 modiy error type 
Merge pull request !4722 from lijiaqi/modify_error_type
 2020-08-19 16:18:50 +08:00
mindspore-ci-bot 2db4bda219 !4622 serving restful init 
Merge pull request !4622 from hexia/http_init
 2020-08-19 16:15:58 +08:00
mindspore-ci-bot 256dccc651 !4498 Gnn data processing supports distributed scenarios 
Merge pull request !4498 from heleiwang/gnn_distributed
 2020-08-19 16:09:05 +08:00
jiangzhiwen 39df25f803 c++ api for CSV Dataset 2020-08-19 16:02:11 +08:00
李嘉琪 c65ea1687b modify error type 2020-08-19 14:21:56 +08:00
mindspore-ci-bot 2d683234fb !4723 Support to concat more than 3 tensors in auto parallel mode 
Merge pull request !4723 from yangzhenzhang/concat-more-than-3-tensors
 2020-08-19 14:16:02 +08:00
yangzhenzhang cda08f6a52 concat 3 tensors in auto parallel mode 2020-08-19 11:27:35 +08:00
heleiwang 8ee4d8e92d Gnn data processing supports distributed scenarios 2020-08-19 11:09:01 +08:00
mindspore-ci-bot 6868b9b6fa !4422 Minddata new dataset api ==> RandomData 
Merge pull request !4422 from xiefangqi/xfq_c++api_randomdata
 2020-08-19 10:48:53 +08:00
mindspore-ci-bot 50b5c8035b !4701 fix concat get_dataset_size error 
Merge pull request !4701 from guozhijian/fix_concat_get_dataset_size_err
 2020-08-19 09:14:30 +08:00
xiefangqi b91e56375e add randomdataset and schema 2020-08-19 09:13:43 +08:00