Nigel
/
mindspore
forked from mindspore-Ecosystem/mindspore
0
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
22,898 Commits 24 Branches 0 Tags 3.9 GiB
Commit Graph

2386 Commits

Author SHA1 Message Date
Peilin Wang f7dc2432a0 initial commit 
fix ci

fix ci

remove old sequence mask api

fix ci

fix ci

remove old seuqence mask tests
 2020-11-30 14:44:22 -05:00
buxue d6f91133c3 Support the outermost layer network inputs are list or dict or scalar 2020-11-30 20:21:38 +08:00
mindspore-ci-bot 762793cb8f !9175 fix a bug in random resize crop op and some lint 
From: @tiancixiao
Reviewed-by: @liucunwei,@jonyguo,@liucunwei
Signed-off-by: @liucunwei
 2020-11-30 20:03:51 +08:00
mindspore-ci-bot f0671ce513 !9076 [MD] Support vision c_transform python eager: Resize, Rescale, Normalize, HWC2CHW, Pad 
From: @luoyang42
Reviewed-by: 
Signed-off-by:
 2020-11-30 20:03:45 +08:00
mxm 59f9ac9975 Primitive 'AddN' support dynamic shape 2020-11-30 17:30:20 +08:00
yangzhenzhang 7b33f3e2ac gatherv2 axis split repeated calculation 2020-11-30 17:03:29 +08:00
mindspore-ci-bot b85bcff4b2 !9057 modify export file name 
From: @changzherui
Reviewed-by: 
Signed-off-by:
 2020-11-30 16:39:27 +08:00
Xiao Tianci 12da8717b7 1.correct param check for vision op 2.fix config review 3.fix api doc 2020-11-30 16:12:31 +08:00
yangzhenzhang 7278f5c109 update_gatherv2_op 2020-11-28 16:56:39 +08:00
Xiaoda Zhang c79e988b0d set fullname for reshape after reshape-elimination 2020-11-28 12:16:51 +08:00
mindspore-ci-bot a146f982bc !8983 support variabel length virtual_dataset in auto parallel 
From: @yao_yf
Reviewed-by: 
Signed-off-by:
 2020-11-28 11:07:27 +08:00
mindspore-ci-bot dcde1fc70a !9092 Add LBeta op at nn level 
From: @peixu_ren
Reviewed-by: 
Signed-off-by:
 2020-11-28 10:44:45 +08:00
luoyang aa4bf9a3f2 [MD] Support python-eager: Resize, Rescale, Normalize, HWC2CHW, Pad 2020-11-28 10:06:53 +08:00
changzherui 91301a6d1a modify export file name 2020-11-28 09:59:41 +08:00
mindspore-ci-bot 55f7e3dc16 !9135 Minor fixs for cache error message 
From: @tina_mengting_zhang
Reviewed-by: @mikef,@robingrosman
Signed-off-by: @nsyca
 2020-11-28 08:49:25 +08:00
peixu_ren 37d40bc495 Add Beta distribution 2020-11-27 17:07:54 -05:00
tinazhang 6f31bdbf67 fix issues for hq testers: I277HD, I277HV 2020-11-27 17:01:23 -05:00
peixu_ren 6355f46d32 Add LBeta op at nn level 2020-11-27 11:59:06 -05:00
tinazhang 27698866d1 Block take/skip under cache and fix docstring 
and other minor changes per the request of HQ testers
 2020-11-26 17:44:19 -05:00
yao_yf 9cda064716 auto parallel predict 2020-11-26 20:13:15 +08:00
mindspore-ci-bot 421cad24ef !8715 Add Gamma distribution 
From: @peixu_ren
Reviewed-by: 
Signed-off-by:
 2020-11-26 09:57:31 +08:00
mindspore-ci-bot adc8e3e707 !8594 [MD] Pybind Pushdown Support for dataset 
From: @cathwong
Reviewed-by: 
Signed-off-by:
 2020-11-26 05:55:49 +08:00
Eric Zhang 809e1d5086 added python api based on cpp api 
1st draft of python iterator

Added Cifar10 and Cifar100 pybind port

Change pybind to use IR for Skip and Manifest

Signed-off-by: alex-yuyue <yue.yu1@huawei.com>

DatasetNode as a base for all IR nodes

namespace change

Fix the namespace issue and make ut tests work

Signed-off-by: alex-yuyue <yue.yu1@huawei.com>

Add VOCDataset

!63 Added RandomDataset
* Added RandomDataset

add imagefolder ir

Pybind switch: CelebA and UT

!61 CLUE example with class definition
* Merge branch 'python-api' of gitee.com:ezphlow/mindspore into clue_class_pybind
* Passing testcases
* Added CLUE, not working

add ManifestDataset IR

Signed-off-by: alex-yuyue <yue.yu1@huawei.com>

Update Coco & VOC & TFReader, Update clang-format, Reorder
datasets_binding

!69 Add Generator and move c_dataset.Iterator to dataset.Iterator
* Add GeneratorDataset to c_dataset
* Add GeneratorDataset to c_dataset

!67 Moving c_datasets and adding sampler wrapper
* Need to add create() method in datasets.py
* migration from c_dataset to dataset part 1

!71 Fix indent error
* Fix indentation error

!72 Fix c_api tests cases
* Fix c_api tests cases

!73 Added CSV Dataset
* Added CSVDataset

pybind switch: Take and CelebA fixes

!75 move c_dataset functionality to datasets
* Fixed existing testcases
* Added working clue and imagefolder
* Added sampler conversion from pybind
* Added sampler creation

!77 Add Python API tree
* Python API tree

add minddataset

TextFileDataset pybind

Rename to skip test_concat.py and test_minddataset_exception.py

!80 Add batch IR to python-api branch, most test cases work
* staging III
* staging, add pybind

Enable more c_api take and CelebA tests; delete util_c_api

!84 Schema changes in datasets.py
* Schema changes

!85 Remove input_indexes from sub-classes
* remove input_index from each subclass

!83 Remove C datasets
* Removed c_dataset package
* Remove c_datasets

!82  pybind switch: shuffle
* pybind switch: shuffle

!86 Add build_vocab
* Add build_vocab

Rebase with upstream/master
_shuffle conflict
BatchNode error

!88 Fix rebase problem
* fix rebase problem

Enable more unit tests; code typo/nit fixes

!91 Fix python vocag hang
* Fix python vocab hang

!89 Added BucketBatchByLength Pybind switch
* Added BucketBatchByLength

Update and enable more tet_c_api_*.py tests

!95 Add BuildSentencePeiceVocab
* - Add BuildSentencePeiceVocab

!96 Fix more tests
* - Fix some tests

- Enable more test_c_api_*
- Add syncwait

!99 pybind switch for device op
* pybind switch for device op

!93 Add getters to python API
* Add getters to python API

!101 Validate tree, error if graph
* - Add sync wait

!103 TFrecord/Random Datasets schema problem
* - TfRecord/Random schem aproblem

!102 Added filter pybind switch
* Added Filter pybind switch

!104 Fix num_samples
* - TfRecord/Random schem aproblem

!105 Fix to_device hang
* Fix to_device hang

!94 Adds Cache support for CLUE dataset
* Added cache for all dataset ops
* format change
* Added CLUE cache support
* Added Cache conversion

Add save pybind

fix compile err

init modify concat_node

!107 Fix some tests cases
* Fix tests cases

Enable and fix more tests

!109 pybind switch for get dataset size
* pybind_get_dataset_size

some check-code fixes for pylint, cpplint and clang-format

!113 Add callback
* revert
* dataset_sz 1 line
* fix typo
* get callback to work

!114 Make Android compile clean
* Make Android Compile Clean

Fix build issues due to rebase

!115 Fix more tests
* Fix tests cases
* !93 Add getters to python API

fix test_profiling.py

!116 fix get dataset size
* fix get dataset size

!117 GetColumnNames pybind switch
* Added GetColumnNames pybind switch

code-check fixes: clangformat, cppcheck, cpplint, pylint

Delete duplicate test_c_api_*.py files; more lint fixes

!121 Fix cpp tests
* Remove extra call to getNext in cpp tests

!122 Fix Schema with Generator
* Fix Schema with Generator

fix some cases of csv & mindrecord

!124 fix tfrecord get_dataset_size and add some UTs
* fix tfrecord get dataset size and add some ut for get_dataset_size

!125 getter separation
* Getter separation

!126 Fix sampler.GetNumSamples
* Fix sampler.GetNumSampler

!127 Assign runtime getter to each get function
* Assign runtime getter to each get function

Fix compile issues

!128 Match master code
* Match master code

!129 Cleanup DeviceOp/save code
* Cleanup ToDevice/Save code

!130 Add cache fix
* Added cache fix for map and image folder

!132 Fix testing team issues
* Pass queue_name from python to C++
* Add Schema.from_json

!131 Fix Cache op issues and delete de_pipeline
* Roll back C++ change
* Removed de_pipeline and passing all cache tests.
* fixed cache tests

!134 Cleanup datasets.py part1
* Cleanup dataset.py part1

!133 Updated validation for SentencePieceVocab.from_dataset
* Added type_check for column names in SentencePieceVocab.from_dataset

Rebase on master 181120 10:20

fix profiling

temporary solution of catching stauts from Node.Build()

!141 ToDevice Termination
* ToDevice termination

pylint fixes

!137 Fix test team issues and add some corresponding tests
* Fix test team issues and add some corresponding tests

!138 TreeGetter changes to use OptPass
* Getter changes to use OptPass (Zirui)

Rebase fix

!143 Fix cpplint issue
* Fix cpplint issue

pylint fixes in updated testcases

!145 Reset exceptions testcase
* reset exception test to master

!146 Fix Check_Pylint Error
* Fix Check_Pylint Error

!147 fix android
* fix android

!148 ToDevice changes
* Add ToDevice to the iterator List for cleanup at exit

!149 Pylint issue
* Add ToDevice to the iterator List for cleanup at exit

!150 Pylint 2
* Add ToDevice to the iterator List for cleanup at exit

!152 ExecutionTree error
* ET destructor error

!153 in getter_pass, only remove callback, without deleting map op
* getter pass no longer removes map

!156 early __del__ of iterator/to_device
* early __del__ of iterator

!155 Address review comments Eric 1
* Added one liner fix to validators.py
* roll back signature fix
* lint fix
* Eric Address comments 2
* C++ lint fix
* Address comments Eric 1

!158 Review rework for dataset bindings - part 1
* Reorder nodes repeat and rename
* Review rework for dataset bindings - part 1

!154 Fixing minor problems in the comments (datasets.py, python_tree_consumer.cc, iterators_bindings.cc, and iterators.py)
* Fixing minor problems in the comments (datasets.py, python_tree_consum…

!157 add replace none
* Add replace_none to datasets.py, address comments in tests

Trying to resolve copy

Override the deepcopy method of deviceop

Create_ir_tree method

Create_ir_tree method 2

Create_ir_tree method 2

del to_device if already exists

del to_device if already exists

cache getters shapes and types

Added yolov3 relaxation, to be rolled back

Get shapes and types together

bypass yolo

NumWorkers for MapOp

revert Yolo

revert Thor

Print more info

Debug code: Update LOG INFO to LOG ERROR

do not remove epochctrl for getter pass

Remove repeat(1)

pritn batch size

add log to tree_consumer and device_queue op

Revert PR 8744

Signed-off-by: alex-yuyue <yue.yu1@huawei.com>

__del__ toDEvice

__del__ toDevice2

!165 add ifndef ENABLE_ANDROID to device queue print
* Add ifndef ENABLE_ANDROID to device queue print

revert some changes

!166 getter: get_data_info
* getter: get_data_info

!168 add back tree print
* revert info to warnning in one log
* add back the missed print tree log

Release GIL in GetDataInfo
 2020-11-25 15:46:59 -05:00
mindspore-ci-bot 979bb26cba !9031 Fix DatasetCache parameter check 
From: @lixiachen
Reviewed-by: @nsyca,@mikef
Signed-off-by: @nsyca
 2020-11-26 03:55:02 +08:00
Lixia Chen ab7427f1a9 Minor fix for DatasetCache param validation 2020-11-25 13:20:30 -05:00
peixu_ren 93d4ef428f Add Gamma distribution 2020-11-25 09:40:46 -05:00
mindspore-ci-bot 22d683a805 !8920 Adapt ops LinSpace for Ascend. 
From: @liu_xiao_93
Reviewed-by: @liangchenghui,@linqingke,@liangchenghui
Signed-off-by: @liangchenghui,@liangchenghui
 2020-11-25 12:03:56 +08:00
mindspore-ci-bot d9b4b5c750 !8954 Add SequenceMask operator. 
From: @liangzhibo
Reviewed-by: @chenfei52,@zh_qh
Signed-off-by: @zh_qh
 2020-11-25 11:41:59 +08:00
liuxiao93 584e241e29 Adapt ops LinSpace for Ascend. 2020-11-25 09:50:03 +08:00
peixu_ren 01f5da0a14 Add Poisson distribution 2020-11-24 11:55:39 -05:00
l00591931 17c0810f9e add SequenceMask operator 2020-11-24 19:47:28 +08:00
mindspore-ci-bot 3d6d820612 !8154 Add nn.MultiFieldEmbedding for the embedding lookup opearations 
From: @huangxinjing
Reviewed-by: 
Signed-off-by:
 2020-11-24 09:49:39 +08:00
mindspore-ci-bot d915fd9b96 !8592 change repeat_elements to a composite op 
From: @tom__chen
Reviewed-by: 
Signed-off-by:
 2020-11-23 23:15:23 +08:00
huangxinjing b0deb7a289 Add dense embedding 2020-11-23 20:21:58 +08:00
mindspore-ci-bot 2eee1c06f0 !8842 Change Ones/Zeros operator 
From: @liangzhibo
Reviewed-by: @chenfei52
Signed-off-by:
 2020-11-23 12:37:19 +08:00
mindspore-ci-bot 7f725b93a3 !8234 Remove expm1_generic and log1p_generic from PP utils 
From: @peixu_ren
Reviewed-by: 
Signed-off-by:
 2020-11-23 09:56:07 +08:00
l00591931 f1e92d0ea7 Change Ones/zeros 2020-11-23 09:33:38 +08:00
mindspore-ci-bot e3371a01d5 !8751 Fix minor bugs in bijector and distribution 
From: @shallydeng
Reviewed-by: @zichun_ye,@sunnybeike
Signed-off-by:
 2020-11-23 08:50:57 +08:00
mindspore-ci-bot cfb9fb40d0 !8794 Add nn.Interpolate() function. 
From: @liangzhibo
Reviewed-by: @chenfei52,@zh_qh
Signed-off-by: @zh_qh
 2020-11-20 14:55:21 +08:00
l00591931 05e26f4739 Add nn.interpolate() 2020-11-20 10:00:47 +08:00
mindspore-ci-bot 81dfd70ece !8785 Add Parallel Operator UnsortedSegmentMax 
From: @huangxinjing
Reviewed-by: @yangzhenzhang,@stsuteng,@kisnwang
Signed-off-by: @stsuteng
 2020-11-20 09:23:30 +08:00
tom__chen a52cd685fc change repeat_element op to a composite op 2020-11-19 15:42:22 -05:00
mindspore-ci-bot 8980bc3de7 !8675 support allreduce prod 
From: @yao_yf
Reviewed-by: @stsuteng,@kisnwang
Signed-off-by: @stsuteng
 2020-11-19 20:21:27 +08:00
mindspore-ci-bot 39352ca658 !8580 Add Operation AllSwap Primitive 
From: @huangxinjing
Reviewed-by: 
Signed-off-by:
 2020-11-19 19:41:06 +08:00
huangxinjing 89e7778497 Add UnsortedSegmentMax Operation 2020-11-19 17:41:54 +08:00
mindspore-ci-bot fa2185b8ef !8661 Add nn.Tril() and nn.Triu() 
From: @liangzhibo
Reviewed-by: 
Signed-off-by:
 2020-11-19 16:34:32 +08:00
mindspore-ci-bot f827c18f1d !8289 Add Parallel Implements of Slice Op 
From: @huangxinjing
Reviewed-by: 
Signed-off-by:
 2020-11-19 15:54:20 +08:00
mindspore-ci-bot a3ae3b9794 !8695 add AdamOffload optimizer 
From: @wangnan39
Reviewed-by: @stsuteng,@stsuteng,@kingxian
Signed-off-by: @kingxian
 2020-11-19 10:42:14 +08:00
l00591931 e1dba1337c Add nn.Tril function 2020-11-19 10:31:30 +08:00
Xun Deng b5e05472ce fix minor bugs in bijector and distribution utils, fix docs issues 2020-11-18 21:13:47 -05:00
mindspore-ci-bot f1ef84e1a6 !8714 dataset Python UT: Add Sampler Chain Tests, with get_dataset_size 
From: @cathwong
Reviewed-by: @nsyca,@mikef
Signed-off-by: @nsyca
 2020-11-19 03:26:44 +08:00
mindspore-ci-bot 8e1ce841b4 !8688 dataset: modify the error log msg in python layer to be more acceptable 
From: @ms_yan
Reviewed-by: 
Signed-off-by:
 2020-11-18 21:43:48 +08:00
huangxinjing 8129806475 Add slice parallel op 2020-11-18 20:20:33 +08:00
mindspore-ci-bot ee72de1db2 !8441 Add Parallel Implements of UniformCandidateSampler 
From: @huangxinjing
Reviewed-by: 
Signed-off-by:
 2020-11-18 18:59:31 +08:00
mindspore-ci-bot cd6236c0a0 !8712 update pipeline parallel interface 
From: @yangzhenzhang
Reviewed-by: @kisnwang
Signed-off-by:
 2020-11-18 18:59:04 +08:00
mindspore-ci-bot fb0e866ad1 !8269 forward unique dynamic shape 
From: @yao_yf
Reviewed-by: 
Signed-off-by:
 2020-11-18 18:53:46 +08:00
huangxinjing 23284f0b35 Add AllSwap Op 2020-11-18 18:35:28 +08:00
ms_yan 0cb5c47856 add err modify 2020-11-18 16:30:24 +08:00
wangnan39@huawei.com ab811fca8f add AdamOffload optimizer 2020-11-18 16:13:47 +08:00
yao_yf 31819bb4a7 support forward unique 2020-11-18 15:22:14 +08:00
yangzhenzhang 278e82a849 update pipeline parallel 2020-11-18 13:55:34 +08:00
yao_yf 1529d544b9 add allreduce prod 2020-11-18 11:08:56 +08:00
mindspore-ci-bot f40a4781e4 !8656 Adapt DynamicGRUV2Grad for Ascend new backend. 
From: @liu_xiao_93
Reviewed-by: @jjfeing,@liangchenghui
Signed-off-by: @liangchenghui
 2020-11-18 09:54:05 +08:00
huangxinjing 2730cef047 Uniform Sampler Base Update 2020-11-18 09:39:32 +08:00
Cathy Wong e5f62013f4 dataset Python UT: Add Sampler Chain Tests, with get_dataset_size 2020-11-17 15:24:44 -05:00
peixu_ren 4aa836dae1 Add Digamma op 2020-11-17 11:49:20 -05:00
liuxiao93 2aaf5e2e1b Adapt DynamicGRUV2Grad for Ascend new backend. 2020-11-17 20:27:18 +08:00
peixu_ren 65d50861ec Remove expm1_generic and log1p_generic from PP utils 2020-11-16 16:12:13 -05:00
peixu_ren 5e9178c5b6 Add IGamma operator 2020-11-16 15:40:09 -05:00
mindspore-ci-bot 52eb2d3401 !8477 Add Cauchy distribution 
From: @shallydeng
Reviewed-by: @zichun_ye
Signed-off-by:
 2020-11-16 23:24:00 +08:00
mindspore-ci-bot b411c05de0 !8495 Adapt DynamicGRUV2 forward for Ascend new backend. 
From: @liu_xiao_93
Reviewed-by: 
Signed-off-by:
 2020-11-16 19:13:16 +08:00
mindspore-ci-bot a321f402c8 !8579 Add view function for tensor 
From: @liangzhibo
Reviewed-by: @zh_qh,@chenfei52
Signed-off-by: @zh_qh
 2020-11-16 14:37:21 +08:00
l00591931 7a192973ff Add view function for tensor 2020-11-16 10:49:19 +08:00
mindspore-ci-bot 2bf165c0b4 !8557 run cast before allgather in parallel optimzier 
From: @gong_zi_yan
Reviewed-by: 
Signed-off-by:
 2020-11-16 09:55:44 +08:00
mindspore-ci-bot c11c79170e !8554 Add expand_as function to tensor 
From: @liangzhibo
Reviewed-by: @zh_qh,@chenfei52
Signed-off-by: @zh_qh
 2020-11-13 15:19:01 +08:00
liuxiao93 d471ac491e Adapt DynamicGRUV2 forward for Ascend new backend. 2020-11-13 14:54:40 +08:00
Ziyan 0ddb754edb run cast before parallel optimizer 2020-11-13 14:04:04 +08:00
l00591931 ba7ee2aa13 add expand_as function 2020-11-13 11:42:54 +08:00
mindspore-ci-bot d2427b6e89 !8538 fix get_num_class in imagefolder 
From: @ziruiwu
Reviewed-by: @robingrosman,@nsyca
Signed-off-by: @nsyca
 2020-11-13 05:07:11 +08:00
Zirui Wu 3555d19b07 fix get num_class in imagefolder 
address cmt

review cmts
 2020-11-12 14:26:54 -05:00
mindspore-ci-bot ffc5209c09 !8476 Merge CacheOp_dev fixes for HQ system test. 
From: @jkl_lee
Reviewed-by: 
Signed-off-by:
 2020-11-13 01:30:41 +08:00
Jesse Lee c795879313 CacheOp delivery for HQ tester 2020-11-12 08:48:29 -05:00
mindspore-ci-bot a442024604 !8510 Add Ones and Zeros operators 
From: @liangzhibo
Reviewed-by: @zh_qh,@chenfei52
Signed-off-by: @zh_qh
 2020-11-12 20:45:52 +08:00
l00591931 886ef520d7 Add Ones and Zeros operators 2020-11-12 16:26:28 +08:00
mindspore-ci-bot f16509388c !8409 Multi-dimensional list value assignment 
From: @liangzhibo
Reviewed-by: @chenfei52
Signed-off-by:
 2020-11-12 14:36:20 +08:00
Xun Deng 1a68ccb40b added Cauchy distribution 2020-11-11 22:36:34 -05:00
mindspore-ci-bot 156980778b !8416 Fix RealDiv Type Error when insert an VirtualDiv Operation 
From: @huangxinjing
Reviewed-by: @stsuteng
Signed-off-by: @stsuteng
 2020-11-11 17:24:19 +08:00
huangxinjing 12e9107162 Fix VirtualDiv Int32 error 2020-11-11 09:32:57 +08:00
l00591931 c5b5a6719c Enable multi-dimensional list value assignment 2020-11-11 09:25:12 +08:00
liuxiao93 92ba9d94df Adapt UnsortedSegmentMax for Ascend. 2020-11-10 14:12:00 +08:00
mindspore-ci-bot 4e07f43dff !8323 [Auto parallel] Supporting for-loop in strategy-searching 
From: @xiaoda_zh
Reviewed-by: 
Signed-off-by:
 2020-11-10 10:33:25 +08:00
mindspore-ci-bot 5a4af56c15 !8322 add parallel op for Range 
From: @yangzhenzhang
Reviewed-by: @xiaoda_zh,@cristoval
Signed-off-by:
 2020-11-10 09:18:56 +08:00
Xiaoda Zhang aa13d6b1cd support for-loop in auto-parallel 2020-11-09 17:18:30 +08:00
yangzhenzhang 9747bde861 add range op 2020-11-09 15:14:07 +08:00
HuangBingjian 265a6d61b6 reverse fix shape=0 2020-11-09 15:06:37 +08:00
mindspore-ci-bot 470027a3a2 !8318 Fix some bugs about API. 
From: @liu_xiao_93
Reviewed-by: @liangchenghui
Signed-off-by: @liangchenghui
 2020-11-09 11:26:32 +08:00
mindspore-ci-bot ec5c86c1bb !8191 redesigned bijector broadcast shape and bijector's dtype logic 
From: @shallydeng
Reviewed-by: @zichun_ye,@sunnybeike
Signed-off-by: @sunnybeike
 2020-11-09 09:47:08 +08:00
mindspore-ci-bot 027916cb5f !8315 Cache server stability 
From: @jkl_lee
Reviewed-by: @mikef,@nsyca
Signed-off-by: @nsyca
 2020-11-08 20:03:23 +08:00
liuxiao93 0a1155f938 Fix some bugs about API. 2020-11-07 17:06:25 +08:00
Lixia Chen f24a788eed Rebase up to 5792d50ca7 2020-11-06 18:39:05 -05:00
mindspore-ci-bot a9a9c45662 !8232 C++ api add Filter 
From: @tiancixiao
Reviewed-by: 
Signed-off-by:
 2020-11-07 00:32:15 +08:00
mindspore-ci-bot 8c2ed3bb80 !8138 Throw an exception when a tensor with 0 shape is constructed. 
Merge pull request !8138 from huangbingjian/fix_shape
 2020-11-06 16:26:58 +08:00
Xiao Tianci 4a5e287b92 add filter c api and ut 2020-11-06 15:49:23 +08:00
HuangBingjian 4477fcfe19 fix shape bug. 2020-11-06 12:59:03 +08:00
yangzhenzhang 0a79ab82ae add parallel ops 2020-11-06 12:09:19 +08:00
mindspore-ci-bot c253d874e0 !8280 add export lenet grad example 
Merge pull request !8280 from changzherui/add_export_grad_example
 2020-11-06 10:14:54 +08:00
changzherui 6b823282aa add export mindir lenet grad 2020-11-05 23:01:43 +08:00
Yi Huaijie d7faa77b5e support int64 shape 2020-11-05 21:15:49 +08:00
Xiaoda Zhang aa84484049 enabling approximation in DP algorithms 2020-11-05 16:07:26 +08:00
mindspore-ci-bot b3855530e3 !7838 Enumerate function enable tensor as input 
Merge pull request !7838 from LiangZhibo/master
 2020-11-05 11:33:02 +08:00
Xun Deng fb0263f869 redesigned bijector classes, changed bacth_shape calculation in transformed distribution and upgraded dtype logic of bijector class 2020-11-03 15:28:45 -05:00
mindspore-ci-bot 49eb4d3106 !8089 add antialias option for py reset 
Merge pull request !8089 from guozhijian/enhance_py_resize
 2020-11-03 16:25:21 +08:00
mindspore-ci-bot f3d7b32d56 !7855 Move backend opt pass ir files to the fold: verbose_ir_files 
Merge pull request !7855 from huanghui/move_ir_files
 2020-11-03 15:34:17 +08:00
mindspore-ci-bot e9cd12e904 !8114 rectify and optimize the type checking function 
Merge pull request !8114 from zhangbuxue/rectify_and_optimize_the_type_checking_function
 2020-11-03 14:48:12 +08:00
mindspore-ci-bot 00294473e3 !7976 [pynative] Add nested derivative feature 
Merge pull request !7976 from zjun/Add_nested_derivative
 2020-11-03 14:02:43 +08:00
buxue 346bcfa3fd Rectify and optimize the type checking function 2020-11-03 13:48:43 +08:00
jonyguo 1b78e34310 add ANTIALIAS support for python progress 2020-11-03 11:03:46 +08:00
mindspore-ci-bot bbfef6233a !8134 Add TBE op DynamicGRU for new and old backend. 
Merge pull request !8134 from liuxiao93/DynamicGRU-new-old-backend
 2020-11-03 09:53:08 +08:00
l00591931 6f165ee5e3 enumerate function and enumerate test case added 2020-11-02 21:11:52 +08:00
mindspore-ci-bot e909b9077c !7946 fix auto parallel optimizer weight shard 
Merge pull request !7946 from gziyan/fix_auto_optim_shard
 2020-11-02 20:51:56 +08:00
mindspore-ci-bot e99a8bd784 !8120 fix CI randomly fails 
Merge pull request !8120 from yihuaijie/master
 2020-11-02 20:08:33 +08:00
liuxiao93 45d343257b Add DynamicGRU. 2020-11-02 19:59:40 +08:00
zjun ccedf71de5 Add pynative bprop nested grad 
Signed-off-by: zjun <zhangjun0@huawei.com>
 2020-11-02 19:33:33 +08:00
mindspore-ci-bot ad930b30db !7891 add layer of clipbyglobalnorm 
Merge pull request !7891 from jiangzhenguang/add_clip_by_global_norm
 2020-11-02 19:18:33 +08:00
huanghui fa6c23358a Move some ir files which backend optpass dumped to the fold: verbose_ir_files 2020-11-02 19:18:24 +08:00
Yi Huaijie da29f232c6 fix CI random fails 2020-11-02 16:28:28 +08:00
Ziyan c33f2cd796 fix auto optimizer weight shard 2020-11-02 16:25:48 +08:00
jzg 4851a67bb5 add layer of clipbyglobalnorm. 2020-11-02 16:15:17 +08:00
mindspore-ci-bot 7e43eaf5e8 !8072 Revert changes to weighted_random_sampler in PR7866 
Merge pull request !8072 from luoyang/pylint
 2020-11-02 15:36:45 +08:00
mindspore-ci-bot 7092a33e87 !8039 support key ward way to pass arg for outermost net in graph mode 
Merge pull request !8039 from zhangbuxue/support_key_ward_way_to_pass_arg_for_outermost_net_in_graph_mode
 2020-10-31 14:58:40 +08:00
YangLuo 82cc7c3f63 [MD] Revert changes to weighted_random_sampler in PR7866 2020-10-31 12:56:17 +08:00
mindspore-ci-bot cacebd1211 !7933 Cache performance updates 
Merge pull request !7933 from Jamie/CacheOp_dev
 2020-10-31 04:25:47 +08:00
buxue 1364b5c301 support key ward way to pass arg for outermost net in graph mode 2020-10-30 16:55:53 +08:00
mindspore-ci-bot eb3b093686 !8013 [MD] fix minddataset padding bug 
Merge pull request !8013 from liyong126/fix_md_pad
 2020-10-30 16:44:45 +08:00
mindspore-ci-bot 015b244471 !7991 fix ReLUV2 error 
Merge pull request !7991 from yihuaijie/dev
 2020-10-30 14:16:33 +08:00
liyong 0d40abf5dd fix md padding bug 2020-10-30 12:00:44 +08:00
Lixia Chen 572c5e5f29 Rebase up to 542a52fbf8 2020-10-29 20:34:09 -04:00
Yi Huaijie 148d645915 fix ReLUV2 error 2020-10-29 20:29:01 +08:00
mindspore-ci-bot 870afe08f5 !7914 get keys and values from dictionary & set tuple to dictionary 
Merge pull request !7914 from Simson/push-to-opensource
 2020-10-29 19:58:35 +08:00
simson 3b21822824 get keys and values from dictionary & set tuple to dictionary 2020-10-29 18:06:06 +08:00
Zirui Wu ea97197311 fix tfrecord_op core dump 
add test case

fix ci

fix ci round 2

address review cmts
 2020-10-28 17:38:43 -04:00
mindspore-ci-bot 163544795f !7922 add params check for offset in distributed_sampler 
Merge pull request !7922 from xiaotianci/fix_distributed_sampler
 2020-10-28 20:57:50 +08:00
mindspore-ci-bot 376fa95717 !7771 Add Parallel SegmentOps 
Merge pull request !7771 from huangxinjing/segment_ops
 2020-10-28 17:19:35 +08:00
Xiao Tianci 823e52f1dc add params checking of offset in distributed_sampler 
add related comment to explain
add related UT
 2020-10-28 16:46:12 +08:00
mindspore-ci-bot 0d43e37f22 !7651 Add embedding and embedding_lookup 
Merge pull request !7651 from jiangzhenguang/add_embedding_and_enbedding_lookup
 2020-10-28 15:13:40 +08:00
huangxinjing bf5d21770a Add UnsortedSegmentSum and UnosrtedSemenMin For Oparallel Implements 2020-10-28 08:57:02 +08:00
Xun Deng d4df6f82ea support get_dist_args 2020-10-27 16:17:38 -04:00
mindspore-ci-bot d4142d682d !7437 auto parallel support dynamic 
Merge pull request !7437 from yao_yf/auto_parallel_support_dynamic_shape
 2020-10-27 21:02:28 +08:00
jzg 7cbd55e17d add embedding layer. 2020-10-27 20:51:49 +08:00
mindspore-ci-bot 08e6ac0b09 !7805 support split ValueList 
Merge pull request !7805 from yihuaijie/master
 2020-10-27 19:22:52 +08:00
yao_yf 0cfe72cd22 auto parallel dynamic 2020-10-27 19:17:27 +08:00
Yi Huaijie 3102c4ff8d support split ValueList 2020-10-27 17:58:36 +08:00
mindspore-ci-bot 2fac6d0595 !7794 Renamed ut test_invert.py to test_invert_bijector.py 
Merge pull request !7794 from XunDeng/pp_issue_branch
 2020-10-27 09:53:36 +08:00
Xun Deng 5ffc16c6db renamed test_invert_bijector 2020-10-26 10:51:07 -04:00
yao_yf 65d8e63580 set last node data parallel or repeat calculate in eval/predict 2020-10-26 20:05:00 +08:00
huanghui a9e781921a Support determine tensor in(not in) a list(tuple) 2020-10-26 14:41:04 +08:00
mindspore-ci-bot f711e01f61 !7719 refactor cnode strategy 
Merge pull request !7719 from gziyan/refactor_cnode
 2020-10-24 16:16:29 +08:00
Ziyan 069318899a refactor get cnode strategy 2020-10-24 15:06:26 +08:00
mindspore-ci-bot c5867d2d7e !7676 [MD] fix arm compile error 
Merge pull request !7676 from liyong126/fix_arm_env
 2020-10-24 14:43:39 +08:00
liyong 1e7f46c998 fix unorder_map hash 2020-10-24 11:03:06 +08:00
liyong ee042b90f7 fix num_sample in sequentialSampler and randomSampler 2020-10-23 19:26:10 +08:00
mindspore-ci-bot 2af6313f53 !7534 SummaryRecord support to record mindexplain data 
Merge pull request !7534 from ougongchang/feature_mindexplain
 2020-10-23 14:38:33 +08:00
mindspore-ci-bot d50736df2c !7607 modify_normal_seed 
Merge pull request !7607 from lilei/modify_normal
 2020-10-23 10:40:58 +08:00
mindspore-ci-bot 1795840436 !7581 Extension interface for dense 
Merge pull request !7581 from lilei/modify_bug
 2020-10-23 10:40:42 +08:00
mindspore-ci-bot dc1ecdab28 !7623 [Data]Modify the behavior of the lite dataset, the default setting is to compile the dataset and mindspore lite trainging together 
Merge pull request !7623 from xulei/lite_test0905
 2020-10-23 08:48:50 +08:00
lilei 0c043d18ef modify_normal 2020-10-22 21:35:44 +08:00
xulei2020 8f392204be minddata build with mindspore-lite train 2020-10-22 21:34:56 +08:00
lilei 127f70ce40 Extension interface for dense 2020-10-22 17:58:24 +08:00
mindspore-ci-bot 22bde4bd9b !7390 Add nonzero and moments 
Merge pull request !7390 from jiangzhenguang/add_nonzero_and_moments
 2020-10-22 17:10:41 +08:00
ougongchang 6072b25a07 SummaryRecord support to record mindexplain data 
The SummaryRecord.add_value() method is extended to record the data of
MindExplain.
 2020-10-22 15:52:54 +08:00
jzg 374e9e199d add moment and nonzero. 2020-10-22 14:53:26 +08:00
mindspore-ci-bot 1ee9c4d014 !6645 [MD] add unique op 
Merge pull request !6645 from liyong126/md_unique_op
 2020-10-22 14:43:37 +08:00
mindspore-ci-bot 8bfe141680 !7571 fix bug in reshape strategy search when reshape as the first operator 
Merge pull request !7571 from yao_yf/reshape_strategy_search_fix_when_reshape_is_first_op
 2020-10-22 10:16:33 +08:00
mindspore-ci-bot 3b55a25f8d !7463 move train.quant to compression module & add QuantizationAwareTraining 
Merge pull request !7463 from yuchaojie/quant2
 2020-10-22 09:19:44 +08:00
yao_yf f7189adb91 fix bug in reshape strategy search when reshape is first operator 2020-10-22 09:15:18 +08:00
liyong fb2bd156c9 add unique op 2020-10-22 09:12:37 +08:00
mindspore-ci-bot f487797694 !7495 [Auto-parallel] Overwrite strategies for star graph structures 
Merge pull request !7495 from Xiaoda/27-star-elimination-overload
 2020-10-22 09:10:52 +08:00
mindspore-ci-bot 20cd47b4d8 !7416 Support Gumbel Distribution 
Merge pull request !7416 from XunDeng/gumbel
 2020-10-22 01:55:25 +08:00
yuchaojie c8ec34d638 move train.quant to compression module & add QuantizationAwareTraining 2020-10-21 17:30:40 +08:00
mindspore-ci-bot b2b9016ddf !7429 modify normal seed 
Merge pull request !7429 from lilei/modify_bug
 2020-10-21 09:37:47 +08:00
Xun Deng ce170b2241 added Gumbel distribution 2020-10-20 10:26:04 -04:00
lilei 04075671cf modify_normal_seed 2020-10-20 22:06:17 +08:00
mindspore-ci-bot 620d8b99b6 !6760 sparse optimizer 
Merge pull request !6760 from lijiaqi/sparse_optimizer
 2020-10-20 20:19:06 +08:00
Jiaqi a30ccea62c sparse optimizer 2020-10-20 17:56:45 +08:00
Xiaoda Zhang fba2bfeb54 overwrite strategies for star graph structure 2020-10-20 13:40:24 +08:00
mindspore-ci-bot 3fd54fd58f !7361 Check whether the network args are tensors in the compile phase 
Merge pull request !7361 from YuJianfeng/master
 2020-10-19 14:32:15 +08:00
yujianfeng 18a76ff3c5 Check whether the network args are tensors in the compile phase 2020-10-19 11:46:10 +08:00
yangzhenzhang fc4ed975c4 handle repeated calculation 2020-10-19 10:47:01 +08:00
mindspore-ci-bot 7a45596593 !7373 Use MetaTensor instead of Initializer 
Merge pull request !7373 from lilei/modify_MetaTensor
 2020-10-17 20:54:13 +08:00
mindspore-ci-bot 7b060b2562 !7209 Add some fake-quant operators 
Merge pull request !7209 from jiangzhenguang/add_fake_quant_operator
 2020-10-17 14:14:35 +08:00
chenzomi acadb694aa [ME] delete reduant function in check_parameter 2020-10-16 16:22:28 +08:00
jzg 2c6a9c8486 add fake-quant operators. 2020-10-16 15:50:18 +08:00
chenzomi 5b769dfb20 [ME] Bug fix 2020-10-16 13:01:34 +08:00
lilei 7b135990e7 Use MetaTensor instead of Initializer 2020-10-16 09:38:11 +08:00
mindspore-ci-bot c68f36c81e !7311 [ME] change _check_parameter format 
Merge pull request !7311 from chenzhongming/zomi_master
 2020-10-15 20:52:29 +08:00
mindspore-ci-bot c967bf6846 !7339 fix for se-resnet50 accurancy 
Merge pull request !7339 from qujianwei/master
 2020-10-15 19:50:16 +08:00
mindspore-ci-bot a5e8c1eab3 !7345 fix a bug case in reshape redistribution 
Merge pull request !7345 from yao_yf/reshape_redistribution_all_scene_support_add
 2020-10-15 19:43:32 +08:00
yao_yf 022005b94a fix a bug cases in reshape redistribution 2020-10-15 16:58:09 +08:00
mindspore-ci-bot fc14f2f785 !7268 Support Invert and GumbelCDF Bijectors 
Merge pull request !7268 from XunDeng/gumbel_cdf
 2020-10-14 22:02:57 +08:00
mindspore-ci-bot 2801429db0 !7240 auto parallel support reshape redistribution in all scenes 
Merge pull request !7240 from yao_yf/reshape_redistribution_all_scene_support
 2020-10-14 10:09:12 +08:00
Xun Deng f2e8e143be added gumbel_cdf and invert bijectors 2020-10-13 15:41:43 -04:00
Zirui Wu c42a1b4a2f fix batch core dump when col name doesn't exist 
fix ci
 2020-10-13 10:50:07 -04:00
yao_yf f60d81a15f support reshape redistribution in all scenes 2020-10-13 21:21:17 +08:00
Lizhenglong 46667aac4f Transition tools for tensorrecord to mindrecord,support 1.13.0-rc1 and higher version 2020-10-12 16:06:34 +08:00
xsmq 6364d56ebe 回退 'Pull Request !6995 : Support the transition of datarecord from 1.x.x version Tensorflow to Mindspore ' 2020-10-12 14:16:04 +08:00
mindspore-ci-bot e62481845e !6995 Support the transition of datarecord from 1.x.x version Tensorflow to Mindspore 
Merge pull request !6995 from lizhenglong1992/TF_to_MR
 2020-10-12 11:52:36 +08:00
lizhenglong 16ef0977ee support_1.x.x tfrecord to mindrecord 2020-10-12 10:29:34 +08:00
buxue 559c741cce improve the way passing ags of partial 2020-10-12 09:40:20 +08:00
mindspore-ci-bot 55e369a125 !7144 [ME] change `check_integer` to format `check_positive_int` and `check_integeter` 
Merge pull request !7144 from chenzhongming/zomi_master
 2020-10-10 14:14:38 +08:00
chenzomi d471d32e87 [ME] change `check_integer` to format `check_positive_int` and `check_integeter` 2020-10-10 12:08:10 +08:00
mindspore-ci-bot 3d21c80e3b !7110 [ME] delete check_bool and replace with Validate.check_bool 
Merge pull request !7110 from chenzhongming/zomi_master
 2020-10-10 11:56:39 +08:00
mindspore-ci-bot fd0c03c493 !7090 implement parallel BroadcastTo 
Merge pull request !7090 from yihuaijie/master
 2020-10-09 19:10:20 +08:00
chenzomi d4e8e94981 [ME] delete check_bool and replace with Validate.check_bool 2020-10-09 16:46:07 +08:00
Yi Huaijie 45d373d40e implement parallel BroadcastTo 2020-10-09 15:17:37 +08:00
mindspore-ci-bot ab9cec0531 !7083 Support Categorical distribution 
Merge pull request !7083 from XunDeng/categorical
 2020-10-09 09:47:40 +08:00
mindspore-ci-bot b1dd00f3a9 !7092 Support Logistic Distribution 
Merge pull request !7092 from XunDeng/logistic
 2020-10-09 09:16:58 +08:00
Xun Deng 05a0dac125 add logistic distribution 2020-10-08 10:23:50 -04:00
Ziyan ddc0113058 enable parallel optimizer in auto parallel 2020-10-08 14:51:15 +08:00
Xun Deng 877b561e77 added categorical distribution 2020-10-07 11:49:44 -04:00
mindspore-ci-bot 6f77ec45f1 !6905 [MD] Enable cache for more leaf datasets 
Merge pull request !6905 from lixiachen/CacheOp_dev
 2020-09-30 16:49:23 +08:00
mindspore-ci-bot 86bbd1dc98 !6832 Add BCELoss 
Merge pull request !6832 from wanyiming/add_BCELoss
 2020-09-30 11:47:44 +08:00
mindspore-ci-bot 58610443cb !7023 modify endofsequence for multi-machine 
Merge pull request !7023 from HW_KK/master
 2020-09-30 08:40:57 +08:00
wuweikang a32811e160 modify endofsequence for multi-machine 2020-09-29 16:17:38 +08:00
wanyiming 4e93413c5a add_BCELoss 2020-09-29 10:23:38 +08:00
mindspore-ci-bot 2a799fe90e !6018 Set the number of epochs in mode.train() non-sink Mode 
Merge pull request !6018 from h.farahat/ms_nonsink_epochs
 2020-09-28 22:15:54 +08:00
xiefangqi 82bc278e26 minddata use new ps api 2020-09-27 17:38:22 +08:00
jonyguo 19ca9762db skip graphdata distributed test case when asan mode 2020-09-27 16:24:20 +08:00
mindspore-ci-bot 5171c90048 !6908 Added raise_not_implement_error functionality in distribution 
Merge pull request !6908 from XunDeng/not_impl_error
 2020-09-27 14:54:59 +08:00
mindspore-ci-bot 9bd34a1b29 !6673 Add stage information for ops and strategy 
Merge pull request !6673 from huangxinjing/stage_strategy
 2020-09-27 11:31:07 +08:00
Xun Deng ea57699ed1 added raise_not_implemented_error in distribution 2020-09-25 17:15:04 -04:00
Lixia Chen 477808e622 Enable cache for other leaf ops 2020-09-25 13:11:04 -04:00
mindspore-ci-bot 0d8015b043 !5300 [MD] Add nD Slice Support 
Merge pull request !5300 from nhussain/slice_op
 2020-09-25 20:38:19 +08:00
mindspore-ci-bot b785b7d0ff !6813 dataset UT: check PIL version, delete test_callback_2maps 
Merge pull request !6813 from cathwong/ckw_dataset_cleanup8
 2020-09-25 20:34:55 +08:00
hesham 9cee0d2143 Add num_epochs to non-sink training 2020-09-24 23:24:43 -04:00
huangxinjing 4ef439e27b Add stage information for ops and strategy 2020-09-25 10:42:43 +08:00
Cathy Wong f2b07d907a dataset UT: check PIL version, delete test_callback_2maps 2020-09-24 17:01:06 -04:00
mindspore-ci-bot 4c0b3c1bd3 !6017 per_batch_map needs to support x input columns and y output columns 
Merge pull request !6017 from ZiruiWu/per_batch_map_multi_col
 2020-09-25 04:08:01 +08:00
mindspore-ci-bot e88e114a50 !5930 Cache server phase 2 single node 
Merge pull request !5930 from Jamie/CacheOp_dev
 2020-09-25 03:54:55 +08:00
nhussain 77d507279c first working implementation 
add string implementation, can handle partial string slices

finish core implementation, added Index object

fix up the logic

add in new SliceOption object, cleaning up tests
 2020-09-24 15:39:28 -04:00
Lixia Chen 983827ec5c Rebase up to 88ded11f59 2020-09-24 14:09:08 -04:00
Zirui Wu 0cab373223 per_batch_map supports x num_columns to y num_columns 
decided to use project after batch as well

per_batch_map 1->x colunm works

add more test case

add test cases, project after map

col order hahaah

fix ci

add test cases

addr review cmts

ci

fix build err

fix test case failure

ci
 2020-09-24 12:01:22 -04:00
mindspore-ci-bot 2f3add4acd !6301 [MD] Combine c++ and python ops in map 
Merge pull request !6301 from nhussain/c_py_compose
 2020-09-24 23:10:47 +08:00
mindspore-ci-bot 55be3c42a5 !5875 Add IFMR op for new backend. 
Merge pull request !5875 from liuxiao93/IFMR-OpenSource-new-backend
 2020-09-24 15:01:08 +08:00
peixu_ren 23ff21edd8 Added lognormal distribuition 2020-09-23 16:57:33 -04:00
mindspore-ci-bot 39874d133f !6644 fix testcase running slowly 
Merge pull request !6644 from guozhijian/fix_testcase_slowly
 2020-09-23 14:53:32 +08:00
mindspore-ci-bot 9f84920f64 !6761 remove redundant check about IsInstance op 
Merge pull request !6761 from liangzelang/fix_isinstance_op_bug
 2020-09-23 14:18:38 +08:00
liangzelang 195d97ad46 Remove redundant check about IsInstance op 2020-09-23 10:53:02 +08:00
jonyguo 1c6c54ae0f fix: testcase test_cutmix_batch_op.py slowly 2020-09-23 10:24:39 +08:00
Yi Huaijie 6066b16838 implement parallel Pack 2020-09-23 09:22:21 +08:00
mindspore-ci-bot 9475f9a19a !6548 Implement parallel Split 
Merge pull request !6548 from yihuaijie/dev
 2020-09-22 19:41:04 +08:00
mindspore-ci-bot f72f2c22fb !6653 fix stream sync error for mixed precesion on pynative mode 
Merge pull request !6653 from chujinjin/fix_stream_sync_error_for_mixed_precision
 2020-09-22 10:56:55 +08:00
liuxiao93 0e02df812a Add IFMR op for new backend. 
(cherry picked from commit 17a5995e97)
 2020-09-22 10:12:12 +08:00
mindspore-ci-bot 091ee5085e !6651 Modify init interface to internal interface 
Merge pull request !6651 from lijiaqi/init
 2020-09-22 09:06:48 +08:00
nhussain fda9462682 embed python compose op 
Leaf ops do self-reset.

embed python compose op

add implicit compose op

more tests
 2020-09-21 11:24:55 -04:00
Jiaqi 4e3e6006b6 modify init 2020-09-21 21:49:28 +08:00
mindspore-ci-bot dfe77372f5 !6505 Set top graph parameters' name the same as original graph parameters. 
Merge pull request !6505 from 张清华/master2
 2020-09-21 20:06:59 +08:00
chujinjin 1cf8f3b777 fix stream sync error for mixed precision 2020-09-21 19:10:25 +08:00
mindspore-ci-bot 428927bdff !6554 fix pylint 
Merge pull request !6554 from jinyaohui/master
 2020-09-21 19:09:21 +08:00
mindspore-ci-bot dde9f5ac25 !6607 delete SoftmaxCrossEntropyExpand interface 
Merge pull request !6607 from ghzl/delete-SoftmaxCrossEntropyExpand
 2020-09-21 17:51:24 +08:00
Zhang Qinghua 6c72d88ba1 Set top graph parameters' name as original graph parameters. 2020-09-21 17:44:02 +08:00
jinyaohui 334a32d501 fix pylint 2020-09-21 16:24:04 +08:00
Wei Luning cdbd16de0c fix bug in parameter set & fix code style in pynative_executa.cc 2020-09-21 11:32:39 +08:00
guohongzilong a754dea90c delete SoftmaxCrossEntropyExpand 2020-09-20 21:17:24 +08:00
mindspore-ci-bot 861602bce9 !6512 Clean up the view code 
Merge pull request !6512 from shenwei41/sw_master
 2020-09-19 23:04:26 +08:00
mindspore-ci-bot 3aa07a4362 !6320 change mix_precision to c++ 
Merge pull request !6320 from vlne-v1/pynative_amp
 2020-09-19 21:29:34 +08:00
mindspore-ci-bot 4905de06bd !6545 improve the recognition of Parameter object and raise error when convert keywordarg to pydata 
Merge pull request !6545 from zhangbuxue/improve_the_recognition_of_Parameter_object_and_raise_error_when_convert_keywordarg_to_pydata
 2020-09-19 21:25:02 +08:00
shenwei41 f2e34b2eaf Clean up the view code 2020-09-19 19:02:04 +08:00
mindspore-ci-bot 53a82fa6e0 !6472 fix get_dataset_size error in CelebaDataset when usage is not 'all' 
Merge pull request !6472 from yanghaitao/yht_celeba_get_dataset_size
 2020-09-19 18:07:25 +08:00
buxue 483c8a179a improve the recognition of Parameter object and raise error when convert keywordarg to pydata 2020-09-19 18:01:00 +08:00
mindspore-ci-bot 5a20b11012 !6502 [AutoParallel]Fix auto parallel find loss bug 
Merge pull request !6502 from lichen/fix_auto_parallel_find_loss_bug
 2020-09-19 15:56:56 +08:00
mindspore-ci-bot 92aecf128f !6549 [MD] minddata add iterator parameter validation 
Merge pull request !6549 from xiefangqi/add_output_numpy_valid
 2020-09-19 14:30:10 +08:00
yanghaitao1 4ff4c17632 fix get_dataset_size in CelebADataset when usage is not all 2020-09-19 02:16:29 -04:00
Yi Huaijie 18ed2bec53 implement parallel Split 2020-09-19 12:35:56 +08:00
xiefangqi a6360cb2e4 add output_numpy validation to iterator 2020-09-19 11:56:24 +08:00
yanghaitao1 dd0d9fe9ab fix ci error 2020-09-18 23:49:20 -04:00
kpy 44c01e27c0 do mixprecision in c++ for pynative 2020-09-19 10:38:09 +08:00
mindspore-ci-bot 1cfad93704 !6479 fix bucket_batch_by_length show pyfunc timeout 
Merge pull request !6479 from yanghaitao/yht_bucket_batch_ci
 2020-09-19 09:30:43 +08:00
lichenever d4bba3f1d2 fix_auto_parallel_find_loss_bug 2020-09-18 20:27:33 +08:00
yanghaitao1 da15495d7b fix bucket_batch ci error 2020-09-18 08:16:14 -04:00
mindspore-ci-bot 4d54de100b !6411 [Auto parallel] Add a flag to control whether to overwrite the right-node in triangle-elimination of DP algorithm 
Merge pull request !6411 from Xiaoda/23-fix-the-triangle-elimination-problem
 2020-09-18 19:32:37 +08:00
Xiaoda Zhang 970490a6f0 add a flag to control whether overwrite the right-node in triangle elimination of DP algorithm 2020-09-18 15:37:18 +08:00
mindspore-ci-bot 8346da267b !6400 add overflow check for make_range and optimize isinstance processing 
Merge pull request !6400 from zhangbuxue/add_overflow_check_for_make_range_and_optimize_isinstance_processing
 2020-09-18 11:07:12 +08:00
mindspore-ci-bot d8d2a70cb3 !6344 [AutoParallel]fix auto parallel multigraph bug 
Merge pull request !6344 from lichen/fix_auto_parallel_mutigraph_bug
 2020-09-17 20:30:32 +08:00
buxue 14f6c95c28 add overflow check for make_range and optimize isinstance processing 2020-09-17 19:47:10 +08:00
lichenever 6b2a9de09f fix auto parallel mutigrpah bug 2020-09-17 14:51:14 +08:00
mindspore-ci-bot c57a472748 !5918 optimizer pynative memory 
Merge pull request !5918 from flywind/optimizer_pynative_memory
 2020-09-17 09:44:36 +08:00
mindspore-ci-bot 5e43308613 !6365 Refactoring Laplace random operator. 
Merge pull request !6365 from jxlang910/push-to-opensource
 2020-09-17 09:16:36 +08:00
mindspore-ci-bot 72d5256d1c !6332 check wether full_batch valid 
Merge pull request !6332 from yihuaijie/master
 2020-09-17 09:09:32 +08:00
jin-xiulang 5873614b86 Refactoring laplace random operator. 2020-09-16 18:40:31 +08:00
buxue 458498900c support not in and add check for grad_with_sens with no sense provide. 2020-09-16 17:28:17 +08:00
kpy 4338dd266e optimizer pynative graph memory 2020-09-16 16:14:05 +08:00
mindspore-ci-bot 111efc7538 !6248 change the API interface of op ConfusionMulGrad 
Merge pull request !6248 from lihongkang/v2_master
 2020-09-16 14:55:05 +08:00
Yi Huaijie e4cd67596f raise RuntimeError when using full_batch neither under semi_auto_parallel nor auto_parallel 2020-09-16 14:51:09 +08:00
mindspore-ci-bot 3fe8916afa !6241 [bug]add doc for some Parameter property & fix bug for `Isinstance` 
Merge pull request !6241 from vlne-v1/I1V5VO-fix-isinstance
 2020-09-16 10:13:30 +08:00
mindspore-ci-bot bef2118253 !6300 [MD] fix get_dataset_size bug when set num_samples in DistributedSampler 
Merge pull request !6300 from liyong126/fix_md_num_samples
 2020-09-16 09:56:53 +08:00
mindspore-ci-bot 0d486adef1 !3974 Eliminate the pause for each cycle of the Repeat 
Merge pull request !3974 from lixiachen/repeat_task2
 2020-09-16 09:35:39 +08:00
mindspore-ci-bot 14b4763b15 !6224 Move pp test cases to probability folder 
Merge pull request !6224 from XunDeng/pp_tests_folder_update
 2020-09-16 08:57:01 +08:00
liyong 930e85ed5c fix get_dataset_size in distributedSampler & num_samples 2020-09-15 22:53:57 +08:00
Wei Luning 8d17a2b8af * add doc for some Parameter property.* add export in quant __all__* fix bug for isinstance & add ut for it 2020-09-15 18:25:12 +08:00
lihongkang 74e3adebb8 change api interface 2020-09-15 15:25:28 +08:00
buxue c3c06514d7 perfect annotation of ops and context and support bool equal 2020-09-15 14:32:02 +08:00
mindspore-ci-bot b83d921735 !3317 add check for stridedslice when choose aicpu or aicore 
Merge pull request !3317 from zhangbuxue/add_check_for_stridedslice_when_choose_aicpu_or_aicore
 2020-09-15 10:37:09 +08:00
mindspore-ci-bot 7a5ef7894d !6227 dataset API docstring: Update datasets and text desc and examples 
Merge pull request !6227 from cathwong/ckw_api_engine
 2020-09-15 10:29:11 +08:00
mindspore-ci-bot 2b05208a6f !6153 [AutoParallel]Check device target in init 
Merge pull request !6153 from lichen/add_checks_for_init
 2020-09-15 09:34:56 +08:00
Cathy Wong f7adf648e9 dataset API docstring: Update datasets, samplers, graphdata and text 2020-09-14 18:10:44 -04:00
Xun Deng c64f6a0a2a move pp related tests cases to probability folder 2020-09-14 13:29:43 -04:00
mindspore-ci-bot d0e49c5cf8 !6192 Improve the functions of class SequentialCell and add examples 
Merge pull request !6192 from lijiaqi/sequentialcell
 2020-09-14 23:24:04 +08:00
mindspore-ci-bot 1b956c77e0 !6155 modify path of ut and st of mdp 
Merge pull request !6155 from byweng/master
 2020-09-14 22:30:52 +08:00
Lixia Chen b5b333726f Leaf ops do self-reset. 2020-09-14 09:48:14 -04:00
Jiaqi 76cec24098 modify sequentialcell 2020-09-14 17:13:47 +08:00
mindspore-ci-bot 9824d0b20f !6142 MindData fix batch ops issue 
Merge pull request !6142 from xiefangqi/md_fix_map_issue
 2020-09-14 16:00:23 +08:00
lichenever aaf7045cdf add checks for init 2020-09-14 14:40:41 +08:00
bingyaweng 866a8a1178 modify path of ut and st of mdp 2020-09-14 11:23:55 +08:00
mindspore-ci-bot 37e3b6082f !6002 Reduce inline passes traversal by skipping inline action if no pre-ad python pass exists 
Merge pull request !6002 from BowenK/pre_ad
 2020-09-14 10:16:56 +08:00
xiefangqi 653c79b4af md fix per_batch_map issue 2020-09-14 09:55:51 +08:00
mindspore-ci-bot a9a3d5a1f5 !5753 remove sens parameter 
Merge pull request !5753 from lijiaqi/loss_scale_sens
 2020-09-13 17:27:27 +08:00
mindspore-ci-bot c10341dfb7 !6020 Add common check_param_type and set_param_type in distribution 
Merge pull request !6020 from XunDeng/new_check_param
 2020-09-13 13:54:39 +08:00
Jiaqi 94d63b90f4 remove sens parameter 2020-09-13 11:34:56 +08:00
mindspore-ci-bot 02c6852699 !6108 add model with loss test case 
Merge pull request !6108 from hanyang/master
 2020-09-12 16:58:23 +08:00
mindspore-ci-bot 8bf5ac1c15 !6032 [bug]add import for ops in ops.py in __init__ 
Merge pull request !6032 from vlne-v1/change_ops_import
 2020-09-12 16:57:15 +08:00
Wei Luning 7b6899fdc0 add import of ops in in ops __init__ 2020-09-12 15:29:43 +08:00
liyong 16147669a6 fix num_samples in concatDataset 2020-09-12 15:06:18 +08:00
Wan Hanyang 0b7570eb53 add model with loss, without loso and o2 test case 2020-09-12 14:26:40 +08:00
mindspore-ci-bot 3c0aa0a6e4 !6069 support function as condition of if 
Merge pull request !6069 from zhangbuxue/support_function_as_condition_of_if
 2020-09-12 12:39:15 +08:00
mindspore-ci-bot eb049b0e93 !5842 [Dataset] dataset op log changes 
Merge pull request !5842 from luoyang/pylint
 2020-09-12 09:42:42 +08:00
mindspore-ci-bot 28e2b0253e !6086 Order dict by column_id in create_dict_iterator() 
Merge pull request !6086 from ZiruiWu/order_dict_in_create_dict_iterator
 2020-09-12 08:41:46 +08:00
Xun Deng 67325d63b0 edited common_dtype and check_param dtype logic 2020-09-11 16:51:19 -04:00
Zirui Wu d54ba374b9 order dict by column_id in create_dict_iterator() 
fix CI
 2020-09-11 15:33:47 -04:00
YangLuo f5a85510f2 [MD] dataset op log changes 2020-09-12 00:43:36 +08:00
nhussain 96de2ffdb6 fix errors from old compose call in Python 2020-09-11 10:30:23 -04:00
mindspore-ci-bot d8c09067ce !5801 [MD][Feature] minddata iterator output ms_tensor 
Merge pull request !5801 from xiefangqi/md_modify_output_tensor
 2020-09-11 20:19:06 +08:00
buxue b9c9046b93 support function as condition of if 2020-09-11 17:43:07 +08:00
Wan Hanyang 2ceea1e59d add a self attention test case 2020-09-11 16:30:28 +08:00
mindspore-ci-bot 5b4642d10a !4950 Fixing Minddata profiling monitor 
Merge pull request !4950 from anthonyaje/monitor_fix
 2020-09-11 14:34:27 +08:00
mindspore-ci-bot 48b337f206 !6026 fix some test case 
Merge pull request !6026 from suteng/master
 2020-09-11 14:09:11 +08:00
xiefangqi 9b3c33e157 minddata iterator output ms_tensor 2020-09-11 11:35:50 +08:00
mindspore-ci-bot cf7d6eddc4 !6019 [MD] Move Random(Choice/Apply/Order) from vision to transforms module 
Merge pull request !6019 from nhussain/move_random_choice_apply
 2020-09-11 10:37:21 +08:00
Su Teng 7b46f46a65 remove unuse test 2020-09-11 10:16:56 +08:00
buxue 08059f5c61 add check for stridedslice when choose aicpu or aicore 2020-09-11 10:11:14 +08:00
mindspore-ci-bot dd215f4080 !5735 delete seed0 and seed1 
Merge pull request !5735 from caozhou/delete_seed
 2020-09-11 09:58:56 +08:00
mindspore-ci-bot f1979f8fe5 !5998 change internal API _get_strategy() to _get_shard_strategy() 
Merge pull request !5998 from yihuaijie/master
 2020-09-11 09:15:18 +08:00
mindspore-ci-bot a778868a5a !5929 BucketBatchByLength column issue 
Merge pull request !5929 from MahdiRahmaniHanzaki/bucket_batch_by_length_fix
 2020-09-11 05:53:48 +08:00
nhussain f42f9ef9d7 move random apply order and choice ops 2020-09-10 15:39:56 -04:00
nhussain 92e99ff224 change map calls 2020-09-10 10:25:05 -04:00
mindspore-ci-bot eedbbb3649 !5958 Modify interface for function and remove duplicated def 
Merge pull request !5958 from lilei/modify_bug
 2020-09-10 21:22:32 +08:00
BowenK e482e4e8bf reduce pass traversals if no pre-ad python pass exists 2020-09-10 20:00:10 +08:00
mindspore-ci-bot 2f529c149a !5991 Change API set_strategy() to shard() 
Merge pull request !5991 from yihuaijie/master
 2020-09-10 19:17:32 +08:00
Yi Huaijie eb83ea9607 change internal API _get_strategy() to _get_shard_strategy() 2020-09-10 17:46:53 +08:00
Yi Huaijie a836d25c64 change API set_strategy() to shard() 2020-09-10 15:30:19 +08:00
anthonyaje 2d08d83247 Fixed connector_size and monitor. 2020-09-09 17:54:59 -04:00
Zirui Wu 1bb93580dd Add usage flag to MNIST/CIFAR 
ci fix 1

fix ci 2

fix ci 3

fix ci 4

fix ci 5

fix ci 6

fix ci 7

change var name in CelebA from dataset_type to usage

address review cmts

fix cpp ut fail

change mode to usage in VOCDataset

fix cmts

fix ci test case fail
 2020-09-09 09:59:55 -04:00
lilei 71adabd944 modify_bug 2020-09-09 18:20:32 +08:00
Wei Luning 249382899b fix bug in cell pickle and copy 2020-09-09 15:33:56 +08:00
mindspore-ci-bot 2350a5990b !5885 [doc]add some document for composite op 
Merge pull request !5885 from vlne-v1/add-doc-for-composite-op
 2020-09-09 14:13:23 +08:00
mindspore-ci-bot eff187d83d !5806 [MD] minddata delete set_dataset_size interface 
Merge pull request !5806 from xiefangqi/md_delete_setdatasetsize
 2020-09-09 11:50:52 +08:00
mindspore-ci-bot 0aa9f900dd !5749 Support multi grad 
Merge pull request !5749 from amongo/SupportPyantiveMultiGrad
 2020-09-09 10:31:35 +08:00
Wei Luning 8c6475fd0b add composite op doc 2020-09-09 10:18:49 +08:00
xiefangqi d0410d6191 md delete set_dataset_size interface 2020-09-09 09:56:03 +08:00
mindspore-ci-bot c45f79d36b !5384 [MD]-Api changes 
Merge pull request !5384 from nhussain/api_changes
 2020-09-09 09:49:05 +08:00
mindspore-ci-bot 88f5cbe5db !5692 Add requires_grad option for python pass 
Merge pull request !5692 from BowenK/pre_ad
 2020-09-09 09:28:52 +08:00
mahdi a152a65227 Fixed the column problem in BucketBatchByLength 2020-09-08 17:48:42 -04:00
Zirui Wu bde9f18f5a update lookup api to take in a type 
ci

add test case

address some of the review cmts

address review cmts
 2020-09-08 11:59:28 -04:00
nhussain 3bac9d3713 switch input columns and operation 
change ImagefolderDV2 name

change ds.transforms.vision to ds.vision

change batch api to match map api more closely

compose op changes

test_pylint

remove compose op from vision, move to transform module, refactor map and batch to use column_order
 2020-09-08 10:26:20 -04:00
huangdongrun 341b8468eb add support for pynative multicases 
clear df builder

add testcases
 2020-09-08 16:09:48 +08:00
mindspore-ci-bot f984518150 !5872 remove timeout exception test case 
Merge pull request !5872 from zhangbuxue/remove_timeout_exception_test_case
 2020-09-08 14:11:06 +08:00
mindspore-ci-bot b40677002f !5714 [refine]change top graph and add cell class 
Merge pull request !5714 from vlne-v1/change-top-graph
 2020-09-08 11:56:36 +08:00
caozhou 6509fa9023 delete seed0 and seed1 in Dropout 2020-09-08 10:51:12 +08:00
buxue 1ae9da85e0 remove timeout exception test case 2020-09-08 10:34:22 +08:00
mindspore-ci-bot ad186e79d8 !5599 Collect input data when `dataset_sink_mode` set on GPU 
Merge pull request !5599 from LiHongzhang/dataset_sink_mode
 2020-09-08 10:21:33 +08:00
Wei Luning e6f82af849 add cell class to c++ 2020-09-07 21:06:07 +08:00
Li Hongzhang 066950f69e GPU dataset_sink_mode collect inputs 2020-09-07 17:12:36 +08:00
lichenever f2d3fd34ce rectification_allreduce_fusion_api 2020-09-07 16:38:58 +08:00
mindspore-ci-bot 77dd91a646 !5669 Fix get_py_obj_dtype() for mindspore type 
Merge pull request !5669 from hewei/fix_get_py_obj_dtype
 2020-09-07 08:59:01 +08:00
mindspore-ci-bot 5c7fa52468 !5673 [performance]cell init opt performance 
Merge pull request !5673 from kingxian/master
 2020-09-05 17:10:08 +08:00
kingxian 92bebe65a9 cell init performance opt 2020-09-04 19:52:56 +08:00
yao_yf d4cfe55c04 rename mirror_mean to gradients_mean 2020-09-04 14:47:36 +08:00
BowenK 1bdb26f9e8 Warming up python pass by adding inline passes before it 2020-09-04 14:26:17 +08:00
mindspore-ci-bot 9018737e99 !5696 [Auto parallel] Move 'multi-subgraphs' interface to internal 
Merge pull request !5696 from Xiaoda/20-moving-multi-graph-interface-internal
 2020-09-04 11:17:28 +08:00
mindspore-ci-bot c064c01b6b !5729 [AutoParallel]Add FuseBatchNormEx op 
Merge pull request !5729 from lichen/add_batchnormex_op
 2020-09-04 11:17:22 +08:00
mindspore-ci-bot 7786adc3aa !5722 fix semi auto parallel parameter of reshape has another user 
Merge pull request !5722 from yao_yf/semi_auto_parallel_reshape_parameter_has_another_user
 2020-09-04 09:45:41 +08:00
mindspore-ci-bot d76ac7c6e8 !5648 GetColumnNames for Python 
Merge pull request !5648 from MahdiRahmaniHanzaki/get-col-name
 2020-09-03 22:37:42 +08:00
lichenever d22f506431 add BatchNormEx op 2020-09-03 22:22:19 +08:00
mindspore-ci-bot 527d7f0afb !5580 [MD] remove finish in FileReader 
Merge pull request !5580 from liyong126/rmv_filereader_finish
 2020-09-03 21:18:35 +08:00
yao_yf 05c003ae6b origin/semi_auto_parallel_reshape_parameter_has_another_user 2020-09-03 20:27:46 +08:00
mindspore-ci-bot fc79997de5 !5502 Mod SoftmaxCrossEntropyWithlogits 
Merge pull request !5502 from wanyiming/mod_SoftmaxCrossEntropyWithlogits
 2020-09-03 20:24:43 +08:00
liyong ac39c20f41 del finish in FileReader 2020-09-03 20:05:38 +08:00
Xiaoda Zhang 42f1241270 remove 'multi-subgraphs' to internal 2020-09-03 19:07:08 +08:00
wanyiming 0ec70068ae mod_SoftmaxCrossEntropyWithLogits 2020-09-03 17:33:20 +08:00
mindspore-ci-bot 290979853e !5663 add check for mod when y in (-1, 0) 
Merge pull request !5663 from zhangbuxue/add_check_for_mod_for_y
 2020-09-03 09:16:45 +08:00
mindspore-ci-bot 021ba724cf !5645 [bug][api]updata signature 
Merge pull request !5645 from vlne-v1/ref_demo
 2020-09-03 09:11:50 +08:00
Mahdi 6e7aab8c4f Added GetColumnNames for Datasets 2020-09-02 17:12:48 -04:00
Cathy Wong 4d4c11b133 dataset API docstring cleanup: Standard product terms NumPy, Python 2020-09-02 10:42:12 -04:00
mindspore-ci-bot 35e6cca1a3 !5634 wrap numpy random seed into an api 
Merge pull request !5634 from yihuaijie/master
 2020-09-02 19:28:33 +08:00
buxue 4d59fe9ee1 add check for mod when y in (-1, 0) 2020-09-02 18:10:00 +08:00
Wei Luning 879a519136 updata signature 2020-09-02 17:29:29 +08:00
Yi Huaijie 4a5d115a66 add get_seed() and set_seed() 2020-09-02 17:17:04 +08:00
He Wei c1469d61ce Fix get_py_obj_dtype() for mindspore type 
Return mstype.type_type if input is mindspore type object,
for example:
```
get_py_obj_dtype(mstype.float32) ---> mstype.type_type
```
 2020-09-02 16:14:25 +08:00
mindspore-ci-bot ccc0ea60ee !5661 fix auto parallel reshape strategy set when it is first operator 
Merge pull request !5661 from yao_yf/auto_parallel_reshape_fix
 2020-09-02 15:42:47 +08:00
mindspore-ci-bot 847fadc8b9 !5516 auto parallel context modify 
Merge pull request !5516 from yao_yf/auto_parallel_context_collation
 2020-09-02 15:41:05 +08:00
mindspore-ci-bot bb84f50407 !5473 optim pylint 
Merge pull request !5473 from jinyaohui/master
 2020-09-02 15:25:30 +08:00
mindspore-ci-bot 4ec343961e !5482 modify save_checkpoint 
Merge pull request !5482 from liuyang/md_save_checkpoint
 2020-09-02 14:20:48 +08:00
yao_yf 755f381406 fix auto parallel reshape strategy set when it is first operator 2020-09-02 14:15:54 +08:00
mindspore-ci-bot 03093778df !5387 Set num_epochs=1 for MindData python testcases 
Merge pull request !5387 from lixiachen/testcase_epoch
 2020-09-02 09:45:13 +08:00
mindspore-ci-bot be3d79cb6b !4204 add dynamic shape support for GatherV2 and others 
Merge pull request !4204 from fary86/adapt_primitive_dynamic_shape
 2020-09-02 09:31:14 +08:00
Lixia Chen 27d5281641 Change epoch count to 1 for python testcases 2020-09-01 11:24:26 -04:00
buxue 359e1f236e check user define bprop when there is parameter in nested network 2020-09-01 21:24:27 +08:00
fary86 144a35b17e Adapt GatherV2 for dynamic shape 2020-09-01 19:24:21 +08:00
mindspore-ci-bot 8f3ebfd469 !5624 Optimize the performance of GraphData.get_neg_sampled_neighbors 
Merge pull request !5624 from heleiwang/gnn_perf
 2020-09-01 19:22:53 +08:00
heleiwang 857cf2f77f Optimize the negative sampling process 2020-09-01 16:29:59 +08:00
mindspore-ci-bot c2fddb56c8 !4922 Transform tuple parameter to multiple parameters 
Merge pull request !4922 from amongo/TupleTransform
 2020-09-01 15:15:56 +08:00
huangdongrun 0099da2c99 add support for tuple parameter transform 
add support for pynative pass

add testcases
 2020-09-01 14:17:52 +08:00
mindspore-ci-bot 5453b40311 !4477 add dataset compare function to utils 
Merge pull request !4477 from tony_liu2/staging
 2020-09-01 11:15:18 +08:00
mindspore-ci-bot ab29dbf98b !5385 dataset fixes: Update OneHot API doc; fixup UTs 
Merge pull request !5385 from cathwong/ckw_dataset_ut_cleanup8
 2020-09-01 11:11:49 +08:00
mindspore-ci-bot 8ebc8ce9c6 !5438 support parameter tuple input in pynative mode 
Merge pull request !5438 from wangqiuliang/support-parameter-tuple-input
 2020-09-01 11:04:03 +08:00
mindspore-ci-bot 1a4d3e351e !5586 Boost python pass compile and train performance 
Merge pull request !5586 from BowenK/performance
 2020-09-01 09:19:02 +08:00
Cathy Wong 7f6782be2a dataset fixes: Update OneHot API docs; fixup Python UTs 2020-08-31 15:04:26 -04:00
mindspore-ci-bot 65819fb50c !5488 heck arg is tensor when graph output is a const or parameter 
Merge pull request !5488 from zhangbuxue/add_check_tensor_before_compile_graph
 2020-08-31 21:36:04 +08:00
yao_yf 8f7aa5bd5a auto parallel context modify 2020-08-31 21:19:49 +08:00
kingfo 7765d44b76 support parameter tuple input in pynative mode 2020-08-31 20:38:43 +08:00
BowenK d6fb7d2db1 Remove debug drawing and printing to boost compile performance; re-opt after python pass to boost training; fix NewParameter tensor clone 2020-08-31 17:42:00 +08:00
buxue 4168c51f0d add check tensor when graph output is a const or parameter 2020-08-31 17:17:24 +08:00
liuyang_655 4683de3443 modify save_checkpoint 2020-08-31 16:24:57 +08:00
jinyaohui a9972a7def optim pylint 2020-08-31 14:49:57 +08:00
mindspore-ci-bot 4d963d96f4 !5534 Fix Tensor.from_numpy() returns wrong type 
Merge pull request !5534 from hewei/fix_tensor_from_numpy
 2020-08-31 09:15:48 +08:00
He Wei 27721ff4ea Fix Tensor.from_numpy() returns wrong type 
Tensor.from_numpy() should return mindspore.Tensor not _c_expression.Tensor.
 2020-08-29 19:05:44 +08:00
mindspore-ci-bot e6a4d932b4 !5350 [AutoParallel]Rectification distributed init 
Merge pull request !5350 from lichen/rectification_init
 2020-08-29 14:55:18 +08:00
mindspore-ci-bot be606ba8f5 !5432 Mindspore parallel supports all elementary-wise operators 
Merge pull request !5432 from yihuaijie/master
 2020-08-29 14:16:48 +08:00
lichenever d3e55b543e rectification init 2020-08-29 09:34:58 +08:00
Yi Huaijie 84948ca730 parallel supports more elementary-wise operators 2020-08-28 18:19:06 +08:00
mindspore-ci-bot 414184c184 !5367 Check the parameter's split strategies if it has multiple users 
Merge pull request !5367 from yangzhenzhang/check-parameter-split
 2020-08-28 16:26:46 +08:00
mindspore-ci-bot 820f2cb4eb !5351 move ParalleMode to Context 
Merge pull request !5351 from yao_yf/parallel_context_collation
 2020-08-28 16:13:01 +08:00
yao_yf 07117e4dd4 mv ParallelMode to context 2020-08-28 19:13:55 +08:00
He Wei d7cdda1cb0 Provide Tensor.from_numpy() to avoid copy 2020-08-28 11:03:14 +08:00
yangzhenzhang fbda03bbcc check parameter split 2020-08-28 10:49:27 +08:00
tony_liu2 70bfd506a1 add function 
pr comment fix

revert graphengine
 2020-08-27 16:50:19 -04:00
mindspore-ci-bot 7aaf4118bf !5297 CutMixBatch and MixUpBatch fix for 2D one-hot labels 
Merge pull request !5297 from MahdiRahmaniHanzaki/cutmix-fix
 2020-08-27 21:32:09 +08:00
mindspore-ci-bot 9392623066 !5181 Python pass pattern renaming and interface tweaking 
Merge pull request !5181 from BowenK/new_parameter
 2020-08-27 19:45:36 +08:00
mindspore-ci-bot e94416be0c !5283 Support setting operator io format in the frontend 
Merge pull request !5283 from liangchenghui/io_format
 2020-08-27 15:48:13 +08:00
mindspore-ci-bot fabebb2678 !5264 [bug]fix bugs when parameters updata 
Merge pull request !5264 from vlne-v1/I1SP3I-return-value-not-the-exact-value
 2020-08-27 14:13:20 +08:00
mindspore-ci-bot b346f0b3ec !5026 Fix the problem of resource clear 
Merge pull request !5026 from Simson/enhancement-API
 2020-08-27 11:19:02 +08:00
simson d4babf190c fix risk of memory leak 2020-08-27 10:54:06 +08:00
BowenK 641d12d6d9 python pass pattern renaming and interface tweaking 2020-08-27 10:03:46 +08:00
mindspore-ci-bot 66d6320b21 !5224 Add test case about loss scale in parallel mode 
Merge pull request !5224 from yangzhenzhang/add-split-sens-and-loss-scale-test-case
 2020-08-27 09:06:01 +08:00
mahdi 7ad7024c45 Fixed 2D one-hot label problems in CutMix and MixUp 2020-08-26 16:17:21 -04:00
islam_amin 94a4a3f20b changing affine and posterize apis 2020-08-26 10:51:54 -04:00
Wei Luning 4cc8342b5b fix bug in Parameter init_data 2020-08-26 22:15:22 +08:00
梁成辉 34d433fd9a Set io format for old backend 2020-08-26 20:49:15 +08:00
kpy 44b738e8ac fix grad all ci bug 2020-08-26 18:28:35 +08:00
mindspore-ci-bot 314c5ad055 !5172 remove name arg from gradoperation 
Merge pull request !5172 from riemann_penn/remove_name_args_from_gradoperation
 2020-08-26 16:55:57 +08:00
mindspore-ci-bot 95212b55a0 !3271 make reftype a subtype of MetaTensor and try to mark ref in node input 
Merge pull request !3271 from vlne-v1/ref_demo
 2020-08-26 15:45:48 +08:00
yangzhenzhang 6ae5893681 add test cases 2020-08-26 15:11:44 +08:00
Wei Luning 24a10225cf change base class of ref to tensor in cpp 2020-08-26 12:41:25 +08:00
mindspore-ci-bot e4d2f2fd3b !5030 Adding a BBox class and fixing Posterize C Op testing. 
Merge pull request !5030 from islam_amin/bbox_class
 2020-08-26 11:40:57 +08:00
panyifeng 1a54785fe2 remove name arg from gradoperation 2020-08-26 11:16:57 +08:00
mindspore-ci-bot 20b3134785 !5184 fix: padded dataset when no div and with repeat op 
Merge pull request !5184 from guozhijian/fix_padded_with_no_div_repeat
 2020-08-26 10:47:22 +08:00
mindspore-ci-bot f3fd7a5578 !5073 Add checks and exception handling DS callback 
Merge pull request !5073 from h.farahat/map_callback_end
 2020-08-26 10:40:40 +08:00
jonyguo 6df1a43ec2 fix: padded dataset with non div & repeat 2020-08-26 08:56:37 +08:00
mindspore-ci-bot 971716f4b9 !5136 fix large for loop runtime error due to lacking of backend operators 
Merge pull request !5136 from fary86/fix_large_for_runtime_error
 2020-08-25 22:26:25 +08:00
mindspore-ci-bot 346b97acb8 !5156 fix softdvpp coredump 
Merge pull request !5156 from qianlong21st/master_fix_softdvpp_core
 2020-08-25 22:20:00 +08:00
qianlong 12dfca71f1 fix softdvpp coredump 2020-08-25 18:56:40 +08:00
YangLuo 67f5c89cd6 Check input image type for random posterize 2020-08-25 16:26:17 +08:00
fary86 8d245497a4 Fix large for loop Runtime Error due to backend missing operators 2020-08-25 16:25:41 +08:00
huangdongrun 113641decd fix test cases 2020-08-25 14:38:08 +08:00
mindspore-ci-bot 7d4f481884 !5017 remove internal interface in wide&deep 
Merge pull request !5017 from yao_yf/wide_and_deep_no_internal_interface
 2020-08-25 14:11:51 +08:00
mindspore-ci-bot 957126375b !5095 Adding Float tensor support for CutMixBatch 
Merge pull request !5095 from MahdiRahmaniHanzaki/cutmix-fix
 2020-08-25 10:53:58 +08:00
mindspore-ci-bot afd16fbf0a !4963 fix bug of switch layer join 
Merge pull request !4963 from fary86/fix_switch_layer_join_bug
 2020-08-25 10:47:32 +08:00
mindspore-ci-bot abe6b82138 !5011 remove global grad ops 
Merge pull request !5011 from riemann_penn/remove_global_grad_ops
 2020-08-25 09:47:55 +08:00
fary86 947e19b839 Fix bug of switch layer join 2020-08-25 09:08:53 +08:00
islam_amin 641e751d5e adding bbox class 2020-08-24 18:22:58 -04:00
Mahdi a2c38d89f9 Added float32 support for CutMixBatch 2020-08-24 17:15:25 -04:00
hesham 8eeceb267b - release the wait if training is ended 2020-08-24 13:11:07 -04:00
yao_yf a9a8e323b2 remove internal interface in wide&deep 2020-08-24 19:18:47 +08:00
mindspore-ci-bot 4f6e63fcf8 !4576 Support if by if not inline 
Merge pull request !4576 from amongo/SupportIfByIfNotInline
 2020-08-24 19:15:39 +08:00
mindspore-ci-bot fc6eee3bda !5019 raise RuntimeError when set different mode after Initializer created 
Merge pull request !5019 from yihuaijie/dev
 2020-08-24 18:49:32 +08:00
huangdongrun 1bd9fefd84 support if by if not inline 
add testcase of net of if by if
 2020-08-24 17:11:26 +08:00
panyifeng 637e812347 remove global grad ops 2020-08-24 16:50:09 +08:00
mindspore-ci-bot 226f019e45 !4888 add parallel attention test 
Merge pull request !4888 from hanyang/master
 2020-08-24 15:50:56 +08:00
Yi Huaijie 394be43492 raise RuntimeError when set different mode after Initializer created 2020-08-24 14:08:09 +08:00
mindspore-ci-bot 8d693306f4 !4126 Add new parameter 
Merge pull request !4126 from BowenK/new_parameter
 2020-08-24 10:01:46 +08:00
Zichun Ye 9e7d6e2397 fix bernoulli prob formula; fix some other minor bugs 
update threshold of softplus computation

support fp for bernoulli and geometric distribution
 2020-08-23 17:49:09 -04:00
mindspore-ci-bot 94a109f476 !4898 Fix coredump caused by function call depth too large 
Merge pull request !4898 from fary86/fix_call_depth_too_large
 2020-08-22 16:08:27 +08:00
fary86 04524b6bd3 Fix coredump caused by function call depth too large 2020-08-22 15:00:04 +08:00
mindspore-ci-bot ac81886328 !4916 fix generator_dataset hangs and test_graphdata_distributed.py failing randomly 
Merge pull request !4916 from heleiwang/gnn_fix_bug
 2020-08-22 10:51:01 +08:00
mindspore-ci-bot b366608a3f !4952 Fix errors in log calculation logics 
Merge pull request !4952 from peixu_ren/custom_pp_ops
 2020-08-22 10:40:40 +08:00
mindspore-ci-bot 9b503e4f38 !4955 Fixes for Dynamic Augmentation Ops 
Merge pull request !4955 from MahdiRahmaniHanzaki/dynamic-ops-fix
 2020-08-22 10:27:50 +08:00
peixu_ren 1c8eb9b15d Fix errors in log calculation logics 2020-08-21 21:28:10 -04:00
Mahdi a5f9b8f92e Added fix for MixUpBatch and CutMixBatch and for RandomAffine 
updated c color op descriptions
 2020-08-21 17:40:08 -04:00
mindspore-ci-bot 9d7250c483 !4776 Introduce 2 extra ctrl flags to DataBuffer in dataset, address remaining cmts to PR4632 
Merge pull request !4776 from ZiruiWu/map_callback_follow_up
 2020-08-22 03:31:31 +08:00
Zirui Wu 74c1e6da60 introducing pause and quit flags to DataBuffer 
fix review cmts

fix ci

fix Ci

fixci

address ci

ci

- add timeout
- add more test cases

fix CI

address review cmts
 2020-08-21 14:33:26 -04:00
mindspore-ci-bot 82c888f065 !4930 Fix CI cifar hang issue 
Merge pull request !4930 from xiefangqi/fix_cifar_nofile_issue
 2020-08-21 20:49:40 +08:00
xiefangqi e3e7820413 fix cifar stuck problem 2020-08-21 19:35:07 +08:00
mindspore-ci-bot 0d1a7ac654 !4909 [bug]support implicit type conversion for parameter 
Merge pull request !4909 from vlne-v1/I1QM7L-implicit-type-conversion-parameter
 2020-08-21 17:08:23 +08:00
BowenK e7c6b7e66a Add NewParameter and Imm patterns 2020-08-21 16:53:04 +08:00
mindspore-ci-bot c92f7c9170 !4911 add func type check for switch layer 
Merge pull request !4911 from riemann_penn/add_func_type_check_for_switch_layer
 2020-08-21 16:42:12 +08:00
panyifeng abab21ed57 add func type check for switch layer 2020-08-21 16:11:40 +08:00
mindspore-ci-bot 6e8d3a3b82 !4859 Add CTCGrerdyDecoder ops for old backend. 
Merge pull request !4859 from liuxiao93/Add-ReversSqueuce-EditDistance-CTCGrerdyDecoder
 2020-08-21 16:05:19 +08:00
heleiwang 4870abc848 1. fix generator_dataset hangs 
2. fix test_graphdata_distributed.py failing randomly
 2020-08-21 16:03:06 +08:00
Wei Luning 77dcdd89ec support parameter updata with implicit type conversion 2020-08-21 15:24:57 +08:00
panyifeng f9f3cd7ce0 fix switch_layer_issues 2020-08-21 14:17:51 +08:00
mindspore-ci-bot bccb92adf7 !4868 fix: concat with none sample dataset 
Merge pull request !4868 from guozhijian/fix_concat_with_zero_dataset
 2020-08-21 12:02:30 +08:00
liuxiao93 9bc18ea2e5 Add CTCGrerdyDecoder ops for GE. 2020-08-21 10:12:01 +08:00
Su Teng e3ae23c939 add parallel attention test 2020-08-21 10:10:53 +08:00
mindspore-ci-bot 2ac410e90d !4789 Add EditDistance op for GE. 
Merge pull request !4789 from liuxiao93/Add-EditDistance-op-for-GE
 2020-08-21 09:49:38 +08:00
mindspore-ci-bot 3d06cbf987 !4801 Must set or change parallel mode before any Initializer created 
Merge pull request !4801 from yihuaijie/dev
 2020-08-21 09:47:32 +08:00
jonyguo 5b4b539751 fix: concat with none sample dataset 2020-08-21 09:19:50 +08:00
mindspore-ci-bot 2cb22a0f78 !4688 Fix bool operation parsing to be consistent with pynative 
Merge pull request !4688 from amongo/FixBoolParse
 2020-08-20 20:06:41 +08:00
liuxiao93 4c99f4f649 Add EditDistance op for GE. 2020-08-20 19:39:57 +08:00
Yi Huaijie 89a4ebf8a1 parallel mode must be set before create an initializer 2020-08-20 19:20:46 +08:00
huangdongrun f30418991c refactor bool op parsing to be consistent with pynative mode 
add testcase of st
 2020-08-20 16:45:30 +08:00
mindspore-ci-bot 9ee144ea40 !4744 [AutoParallel]Support bert 
Merge pull request !4744 from lichen/support_bert
 2020-08-20 14:13:19 +08:00
mindspore-ci-bot ed954dc407 !4782 Python UT fails on RandomPosterize 
Merge pull request !4782 from islam_amin/bbox_class
 2020-08-20 10:18:59 +08:00
mindspore-ci-bot 24700afa2d !4689 add check for user define bprop in Pynative mode 
Merge pull request !4689 from zhangbuxue/add_check_for_user_define_bprop_in_Pynative_mode
 2020-08-20 09:43:46 +08:00
islam_amin 85357238fe Fixing posterize python ut 2020-08-19 21:35:07 -04:00
Jesse Lee 8a08d0c37b Phase 2 of CacheOp 2020-08-19 13:45:55 -04:00
Zirui Wu 78c1aa1d96 Implemented Callback for Dataset 
implment pause in MapOp, added more to callback

add ds_callback

- Initial drop of Python DSCallback

- Pybind DSCallback

- Pybind DSCallback

added callback to mapOp

- de_pipeline DSCallback

- de_pipeline DSCallback

add test case, segfault for now

fix seg fault

- de_pipeline DSCallback

remove 1 line

update callback test case, now works

use builder class for mapOp callback

- de_pipeline DSCallback

- de_pipeline DSCallback

- de_pipeline DSCallback

better test case

minor fix

add comments and minor clean ups

get rid of nullptr in MapOp, use other flag instead

fix a bug ParseMapOp only takes 1 callback

- Added WaitedDSCalabck

refactor callback param

fix text case incorrect number

- added testing

fix cpp test case

- added testing

- revert back lenet changes

- cleanup test_callbacks.py

- cleanup test_callbacks.py

fix CI stage I

fix CI stage II

fix CI and update epoch counter

- add validation
- add more testing  test_callbacks.py

use random data op to do tests

adjust when to call EpochBegin/End

- add repeat with callback

- addressing reviewers' comments

- docstring and CI fixes

- docstring and CI fixes

- docstring and CI fixes

- rebase with upstream/master

fix cpp test case

fix review comments

addr review cmts, add test case
 2020-08-19 12:31:04 -04:00
buxue 855d6b8fed add check for user define bprop in Pynative mode. 2020-08-19 19:14:02 +08:00
lichenever 221a801395 auto parallel support bert 2020-08-19 17:47:59 +08:00
mindspore-ci-bot 70a218123b !4722 modiy error type 
Merge pull request !4722 from lijiaqi/modify_error_type
 2020-08-19 16:18:50 +08:00
mindspore-ci-bot 256dccc651 !4498 Gnn data processing supports distributed scenarios 
Merge pull request !4498 from heleiwang/gnn_distributed
 2020-08-19 16:09:05 +08:00
李嘉琪 c65ea1687b modify error type 2020-08-19 14:21:56 +08:00
mindspore-ci-bot 2d683234fb !4723 Support to concat more than 3 tensors in auto parallel mode 
Merge pull request !4723 from yangzhenzhang/concat-more-than-3-tensors
 2020-08-19 14:16:02 +08:00
yangzhenzhang cda08f6a52 concat 3 tensors in auto parallel mode 2020-08-19 11:27:35 +08:00
heleiwang 8ee4d8e92d Gnn data processing supports distributed scenarios 2020-08-19 11:09:01 +08:00
mindspore-ci-bot 50b5c8035b !4701 fix concat get_dataset_size error 
Merge pull request !4701 from guozhijian/fix_concat_get_dataset_size_err
 2020-08-19 09:14:30 +08:00
nhussain 738ae2c78d change api to use std_vector 
try to display image
 2020-08-18 15:41:21 -04:00
islam_amin 979111d0ef Added Posterize Op 2020-08-18 13:55:47 -04:00
jonyguo b0b370336f fix: concat get_dataset_size error 2020-08-18 23:40:17 +08:00
jonyguo 5f294fb90d fix: random affine parameter check 2020-08-18 21:58:53 +08:00
panyifeng 22a9d02e9f switch_layer incorporate env_get and tuple_get 2020-08-18 20:23:23 +08:00
mindspore-ci-bot cc077de9e3 !4425 fix if statement with no return coredump 
Merge pull request !4425 from fary86/fix_if_no_return_coredump
 2020-08-18 16:09:31 +08:00
mindspore-ci-bot 2ae6365d77 !4650 EmbeddingLookup support auto parallel 
Merge pull request !4650 from yangzhenzhang/embedding-lookup-auto-parallel
 2020-08-18 15:51:04 +08:00
fary86 38083e055a Fix coredump missing return statement after while loop 2020-08-18 14:16:21 +08:00
yangzhenzhang 6f6a8ae9f0 embedding lookup auto parallel 2020-08-18 11:40:09 +08:00
Yi Huaijie 0f7ead5f14 parameter slice init test all initializers 2020-08-18 10:34:15 +08:00
mindspore-ci-bot 113ff6ca24 !4367 CutMixBatch Augmentation Op 
Merge pull request !4367 from MahdiRahmaniHanzaki/cutmix
 2020-08-18 03:27:33 +08:00
mahdi 3ecc53fb4e Added CutMix 2020-08-17 13:01:47 -04:00
mindspore-ci-bot d1ad33676b !4598 support axis is None for all and any interface in graph mode 
Merge pull request !4598 from zhangbuxue/support_axis_is_None_for_all_and_any_in_graph_mode
 2020-08-17 19:52:40 +08:00
buxue 09f1a4bbaf support axis is None for all and any interface in graph mode. 2020-08-17 17:53:02 +08:00
jonyguo 8bb4449fa8 add testcase for padded dataset with decode op 2020-08-17 16:43:23 +08:00
mayang c410c6a6e2 soft_dvpp_decode_resize_jpeg_op issue resolved, input size can be an int, break the constraints of input size being sequence (height, width) 2020-08-17 14:57:04 +08:00
mindspore-ci-bot f875bf21bc !2948 fix control flow 
Merge pull request !2948 from amongo/FixControlFlow
 2020-08-17 08:56:22 +08:00
huangdongrun 2a6d346d2f support if by if grad parameter 
add join for ref

adjust env eliminate to eliminate all env ops

add partial app cache

resolve while endless

fix env eliminate

support for "for while" cases

fix join shape error
 2020-08-15 09:47:10 +08:00
mindspore-ci-bot 7d70fb4dc4 !3769 add RandomColorOp 
Merge pull request !3769 from Alexey_Shevlyakov/ColorOp
 2020-08-14 23:43:08 +08:00
mindspore-ci-bot 0e4d2c2535 !4188 fix switch layer sigle prim cell 
Merge pull request !4188 from riemann_penn/fix_switch_layer_sigle_prim_cell
 2020-08-14 19:54:37 +08:00
mindspore-ci-bot f41c21c5fa !4284 remove to_full_tensor and load_inputs in exexute stage 
Merge pull request !4284 from yao_yf/remove_to_full_tensor_and_load_inputs_in_exexute_stage
 2020-08-14 18:05:44 +08:00
panyifeng 1c296b96c9 fix switch layer sigle prim cell 2020-08-14 17:04:01 +08:00
Wei Luning d18ce95714 * add support to update by scalar* fix update error for by Initializer when slice_shape is* add ut for compute and update 2020-08-14 16:35:28 +08:00
yao_yf cbb4363fa7 remove to_full_tensor and load_inputs in exexute stage 2020-08-14 11:40:27 +08:00
mindspore-ci-bot 0f637fdc58 !4404 update field split 
Merge pull request !4404 from yangzhenzhang/update-field-split-in-forward-communication
 2020-08-14 10:16:24 +08:00
mindspore-ci-bot 93f60269c3 !4369 Added distribution_specific_args checking to some functions and fixed minor issues in docs 
Merge pull request !4369 from XunDeng/pp_poc_v3
 2020-08-14 09:33:23 +08:00