Nigel
/
mindspore
forked from mindspore-Ecosystem/mindspore
0
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
19,824 Commits 24 Branches 0 Tags 3.9 GiB
Commit Graph

2263 Commits

Author SHA1 Message Date
yao_yf 19fe28cb9b hange strategys of last nodes in eval/predict at auto parallel mode 2020-12-11 11:11:28 +08:00
Zirui Wu 77521e78d2 staging 2020-12-10 14:45:04 -05:00
Bairong 8cf43e59e0 hide arange, delete related test case and improve the doc string of nn.Range 2020-12-10 21:42:59 +08:00
mindspore-ci-bot 8c0d066bf9 !9763 Change name from interpolate to resizeBilinear 
From: @liangzhibo
Reviewed-by: @ginfung,@zh_qh,@zhunaipan
Signed-off-by: @zh_qh
 2020-12-10 17:41:14 +08:00
Xiaoda Zhang e78228603b move parallel-related black-list to core/ir, and fix the cloneCNode bug 2020-12-10 15:57:01 +08:00
l00591931 130c61cfc0 change name from interpolate to resizeBilinear 2020-12-10 11:46:40 +08:00
mindspore-ci-bot 9ecf062581 !9552 change the import level of dynamic_lr 
From: @wangnan39
Reviewed-by: @kingxian,@zh_qh,@kingxian
Signed-off-by: @kingxian,@kingxian
 2020-12-10 11:15:08 +08:00
mindspore-ci-bot 78fba32865 !9752 Fix potential hang in RandomData and incorrectly named functions 
From: @ziruiwu
Reviewed-by: @heleiwang,@pandoublefeng
Signed-off-by: @pandoublefeng
 2020-12-10 10:51:01 +08:00
mindspore-ci-bot 3f82405d17 !9639 Add Numpy Native to Mindspore 
From: @yanglf1121
Reviewed-by: 
Signed-off-by:
 2020-12-10 09:45:16 +08:00
Zirui Wu 91a6b2b0ca Add checks to RandomData and LookUp 2020-12-09 17:09:34 -05:00
yanglf1121 59e5afd2bb Add mindnumpy to mindspore 2020-12-09 21:35:16 +08:00
wangnan39@huawei.com 0fe9e2e4cb support import dynamic_lr from nn 2020-12-09 17:47:52 +08:00
mindspore-ci-bot a2aea8cba5 !9578 add_conv3d_transpose_object 
From: @jiangzg001
Reviewed-by: @liangchenghui,@liangchenghui
Signed-off-by: @liangchenghui
 2020-12-09 16:41:48 +08:00
mindspore-ci-bot 6d34bacc17 !9470 support arange in functional.py 
From: @bairongz
Reviewed-by: @ginfung
Signed-off-by:
 2020-12-09 14:39:36 +08:00
jiangzhenguang 5060565920 add conv3d_transpose. 2020-12-09 13:48:23 +08:00
mindspore-ci-bot 317a97e6b9 !9336 auto num_parallel_workers setup 
From: @ziruiwu
Reviewed-by: 
Signed-off-by:
 2020-12-09 08:32:55 +08:00
mindspore-ci-bot a2c80435ce !9685 Fix a core dump in TreeConsumer::Terminate() plus minor cache fixes 
From: @lixiachen
Reviewed-by: @mikef,@nsyca
Signed-off-by: @nsyca
 2020-12-09 08:21:22 +08:00
Zirui Wu d6df1b0832 Implemented AutoNumWorker Pass which sets num_workers of selected parallel ops automatically if enabled 2020-12-08 17:49:05 -05:00
Lixia Chen 32b82c2737 Fix a core dump in TreeConsumer::Terminate() 
and other minor cache changes
 2020-12-08 15:38:40 -05:00
mindspore-ci-bot 934005f390 !9636 Remove batch_map multi-process test case 
From: @hfarahat
Reviewed-by: @nsyca,@mikef
Signed-off-by: @mikef
 2020-12-08 23:24:56 +08:00
mindspore-ci-bot 231fccf66c !9600 Add Adagrad Optimizer 
From: @zyx5256
Reviewed-by: @liangchenghui,@kingxian
Signed-off-by: @liangchenghui
 2020-12-08 18:29:18 +08:00
hesham ff65f6feb8 Remove batch_map multiprocess test case 2020-12-08 00:36:02 -05:00
mindspore-ci-bot f6a22cb455 !9591 Assignment enables negative index 
From: @liangzhibo
Reviewed-by: @ginfung,@zh_qh
Signed-off-by: @zh_qh
 2020-12-08 11:03:48 +08:00
mindspore-ci-bot ec3983b77d !9577 support distributed predict 
From: @gong_zi_yan
Reviewed-by: @caozhou_huawei,@yao_yf,@stsuteng,@zh_qh
Signed-off-by: @stsuteng
 2020-12-08 10:28:30 +08:00
zhuyuxiao 37bebc751b add adagrad optim 2020-12-08 09:38:15 +08:00
mindspore-ci-bot e6ec9be6c2 !9386 l1_regularizer开发 
From: @dangjiaqi1
Reviewed-by: 
Signed-off-by:
 2020-12-07 21:58:58 +08:00
“dangjiaqi1” 39948670dd new update basic.py which add class L1Regularizer(Cell). new add test_l1_regularizer.py. new add test_l1_regularizer.py 2020-12-07 20:08:35 +08:00
l00591931 3189868a15 Assignment enable index smaller than 0 2020-12-07 17:09:03 +08:00
Bairong 2eeaec7512 support arange in functional.py 2020-12-07 16:22:55 +08:00
Ziyan e7e9dae54d support distributed predict 2020-12-07 16:12:45 +08:00
mindspore-ci-bot 186f5394ba !9155 add_conv3d_object 
From: @jiangzg001
Reviewed-by: 
Signed-off-by:
 2020-12-07 11:48:06 +08:00
mindspore-ci-bot 5d1a8b09db !9097 Primitive Shape support return range of dynamic shape 
From: @M20211031
Reviewed-by: @ginfung
Signed-off-by:
 2020-12-07 10:30:02 +08:00
mindspore-ci-bot 3c4a585143 !9545 Move API inner.DynamicGRUV2 to P.DynamicGRUV2. 
From: @liu_xiao_93
Reviewed-by: @liangchenghui
Signed-off-by: @liangchenghui
 2020-12-05 18:26:34 +08:00
mindspore-ci-bot aa5d4e08a9 !9544 Fix a possible seg fault in GenerateCRC caused by std::regex 
From: @lixiachen
Reviewed-by: @jonyguo,@heleiwang
Signed-off-by: @heleiwang
 2020-12-05 15:31:40 +08:00
liuxiao93 712ad98a92 Move API inner.DynamicGRUV2 to P.DynamicGRUV2. 2020-12-05 14:53:14 +08:00
mindspore-ci-bot 3b7acc57c9 !9508 [Auto parallel] Set CNODE's fullname when cloning 
From: @xiaoda_zh
Reviewed-by: @kisnwang,@stsuteng
Signed-off-by: @stsuteng
 2020-12-05 13:56:13 +08:00
Lixia Chen 27579fe858 Fix a seg fault caused by std::regex 2020-12-04 20:58:11 -05:00
Nat Sutyanyong 4cb78f2e03 Remove Repeat(1),Take(-1), and Skip(0) in NodeRemovalPass 2020-12-04 17:37:07 -05:00
mindspore-ci-bot 3280474d71 !9533 dataset Python Pushdown - more minor code rework; CSVDataset delim_field bug fix 
From: @cathwong
Reviewed-by: @nsyca,@mikef
Signed-off-by: @nsyca
 2020-12-05 06:01:13 +08:00
Jesse Lee 0c8dfc68ec Fix hang on RequestFreeTag 2020-12-04 14:54:30 -05:00
Cathy Wong 69b269c6cf dataset Python Pushdown - more minor code rework; CSVDataset delim_field bug fix 2020-12-04 14:39:52 -05:00
jiangzhenguang c45eee9b94 add conv3d object 2020-12-04 20:13:29 +08:00
Xiaoda Zhang 9a9e3a751e set cnode's fullname when cloning 2020-12-04 15:59:44 +08:00
mindspore-ci-bot 4f607e9c26 !9335 Add multiprocessing support to per_batch_map 
From: @hfarahat
Reviewed-by: 
Signed-off-by:
 2020-12-04 15:13:46 +08:00
mindspore-ci-bot a6b716003f !9469 Fix minor issues in distribution classes 
From: @shallydeng
Reviewed-by: @zichun_ye,@sunnybeike
Signed-off-by: @sunnybeike
 2020-12-04 09:41:49 +08:00
Xun Deng 4ef9e9e57f fix minor issues in distribution classes 2020-12-03 14:47:08 -05:00
Nat Sutyanyong d69a29a44e Migrate 3 pre passes to IR optimizer, namely, cache_error_pass, epoch_injection, and removal_pass 2020-12-03 14:40:03 -05:00
mindspore-ci-bot 73c91e05b1 !9398 Change Build to return status 
From: @alex-yuyue
Reviewed-by: @mikef
Signed-off-by:
 2020-12-03 23:43:08 +08:00
mindspore-ci-bot 4bb7303463 !9424 [PipelineSplit]Fix Shared Parameter bug 
From: @lichen666
Reviewed-by: @zh_qh
Signed-off-by:
 2020-12-03 20:43:31 +08:00
lichenever 818e920f02 fix_pipeline_split_param_shared_bug 2020-12-03 19:30:29 +08:00
mxm 82268dc703 support DynamicShape and StridedSlice primitive return range of shape value. 2020-12-03 19:08:34 +08:00
alex-yuyue ccff3a5316 Change build to return status 
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
 2020-12-02 22:46:49 -05:00
mindspore-ci-bot b9d2392937 !9350 Add Matrix_Determinant and Matrix_Inverse to Mindspore front-end 
From: @peixu_ren
Reviewed-by: @liangchenghui,@zh_qh
Signed-off-by: @liangchenghui
 2020-12-03 10:01:16 +08:00
hesham 809f9c91be Add multiprocessing support to per_batch_map 2020-12-02 15:40:14 -05:00
lichenever 78e131cf15 pipeline_split adapt parallel 2020-12-02 18:52:40 +08:00
mindspore-ci-bot 79fef0df0e !9142 fix bug of addn not supported dynamic shape 
From: @M20211031
Reviewed-by: @zh_qh
Signed-off-by: @zh_qh
 2020-12-02 17:59:37 +08:00
bai-yangfan c46c4dffe4 mindir_suffix 2020-12-02 11:52:37 +08:00
peixu_ren 0adab15de7 Add Matrix_Determinant and Matrix_Inverse to Mindspore front-end 2020-12-01 22:25:50 -05:00
mindspore-ci-bot 51d885815a !9281 increase variable_memory_max_size max size from 30GB to 31GB 
From: @laiyongqiang
Reviewed-by: 
Signed-off-by:
 2020-12-02 10:43:57 +08:00
mindspore-ci-bot df44e1339e !9249 Optimizing GetDatasetSize 
From: @mahdirahmanihanzaki
Reviewed-by: 
Signed-off-by:
 2020-12-02 08:26:34 +08:00
mindspore-ci-bot 4ffd9b578f !9331 More cache minor fix for HQ testers 
From: @lixiachen
Reviewed-by: @mikef,@nsyca
Signed-off-by: @nsyca
 2020-12-02 06:45:15 +08:00
Mahdi f80553bc6e Optimization for GetDatasetSize 2020-12-01 17:40:25 -05:00
Lixia Chen 2ddb1fb75e More CRC fix and blocking BatchOp under cache 2020-12-01 15:20:33 -05:00
mindspore-ci-bot 77ef72be30 !9306 fix ndarray field without type in mindrecord 
From: @jonyguo
Reviewed-by: @pandoublefeng,@liucunwei
Signed-off-by: @liucunwei
 2020-12-01 20:50:37 +08:00
laiyongqiang 11244f790a increase variable_memory_max_size max size from 30GB to 31GB 2020-12-01 20:29:57 +08:00
mindspore-ci-bot 45b705bca0 !9129 support abs() and mean() method for Tensor object 
From: @bairongz
Reviewed-by: 
Signed-off-by:
 2020-12-01 19:03:42 +08:00
jonyguo 847e59bd6c fix: ndarray field without type in mindrecord 2020-12-01 17:30:57 +08:00
mindspore-ci-bot 920bbf1541 !9277 fix schema & zip validation 
From: @luoyang42
Reviewed-by: @pandoublefeng,@liucunwei
Signed-off-by: @liucunwei
 2020-12-01 16:28:48 +08:00
YangLuo 5cc3b76577 fix schema & zip validation 2020-12-01 14:23:56 +08:00
Bairong 623b2e3f99 support abs and mean of Tensor 2020-12-01 11:34:12 +08:00
mindspore-ci-bot e45f19adc8 !8697 support the outermost layer network inputs are list or dict or scalar 
From: @zhangbuxue
Reviewed-by: 
Signed-off-by:
 2020-12-01 11:11:43 +08:00
mindspore-ci-bot 5306c91cb7 !9214 support repeated calculation when the axis of gatherv2 is 0 and split 
From: @yangzhenzhang
Reviewed-by: @kisnwang,@stsuteng
Signed-off-by: @stsuteng
 2020-12-01 09:14:50 +08:00
mindspore-ci-bot af3c27d354 !9244 Fix core dump with concat and getter_pass 
From: @ziruiwu
Reviewed-by: 
Signed-off-by:
 2020-12-01 06:56:41 +08:00
mindspore-ci-bot ccf637f64a !9241 SequenceMask gpu kernel 
From: @peilin-wang
Reviewed-by: @tom__chen
Signed-off-by:
 2020-12-01 06:49:47 +08:00
mindspore-ci-bot c3e7a8255c !9248 Add input check to nlp operators 
From: @ezphlow
Reviewed-by: @nsyca,@mikef
Signed-off-by: @nsyca
 2020-12-01 06:45:26 +08:00
Eric cf802c839c Added missing input check for nlp operator 2020-11-30 16:23:40 -05:00
Zirui Wu 23487fae09 fix get_shape/type and a segfault in getter_pass 
add test case
 2020-11-30 16:22:33 -05:00
Peilin Wang f7dc2432a0 initial commit 
fix ci

fix ci

remove old sequence mask api

fix ci

fix ci

remove old seuqence mask tests
 2020-11-30 14:44:22 -05:00
buxue d6f91133c3 Support the outermost layer network inputs are list or dict or scalar 2020-11-30 20:21:38 +08:00
mindspore-ci-bot 762793cb8f !9175 fix a bug in random resize crop op and some lint 
From: @tiancixiao
Reviewed-by: @liucunwei,@jonyguo,@liucunwei
Signed-off-by: @liucunwei
 2020-11-30 20:03:51 +08:00
mindspore-ci-bot f0671ce513 !9076 [MD] Support vision c_transform python eager: Resize, Rescale, Normalize, HWC2CHW, Pad 
From: @luoyang42
Reviewed-by: 
Signed-off-by:
 2020-11-30 20:03:45 +08:00
mxm 59f9ac9975 Primitive 'AddN' support dynamic shape 2020-11-30 17:30:20 +08:00
yangzhenzhang 7b33f3e2ac gatherv2 axis split repeated calculation 2020-11-30 17:03:29 +08:00
mindspore-ci-bot b85bcff4b2 !9057 modify export file name 
From: @changzherui
Reviewed-by: 
Signed-off-by:
 2020-11-30 16:39:27 +08:00
Xiao Tianci 12da8717b7 1.correct param check for vision op 2.fix config review 3.fix api doc 2020-11-30 16:12:31 +08:00
yangzhenzhang 7278f5c109 update_gatherv2_op 2020-11-28 16:56:39 +08:00
Xiaoda Zhang c79e988b0d set fullname for reshape after reshape-elimination 2020-11-28 12:16:51 +08:00
mindspore-ci-bot a146f982bc !8983 support variabel length virtual_dataset in auto parallel 
From: @yao_yf
Reviewed-by: 
Signed-off-by:
 2020-11-28 11:07:27 +08:00
mindspore-ci-bot dcde1fc70a !9092 Add LBeta op at nn level 
From: @peixu_ren
Reviewed-by: 
Signed-off-by:
 2020-11-28 10:44:45 +08:00
luoyang aa4bf9a3f2 [MD] Support python-eager: Resize, Rescale, Normalize, HWC2CHW, Pad 2020-11-28 10:06:53 +08:00
changzherui 91301a6d1a modify export file name 2020-11-28 09:59:41 +08:00
mindspore-ci-bot 55f7e3dc16 !9135 Minor fixs for cache error message 
From: @tina_mengting_zhang
Reviewed-by: @mikef,@robingrosman
Signed-off-by: @nsyca
 2020-11-28 08:49:25 +08:00
peixu_ren 37d40bc495 Add Beta distribution 2020-11-27 17:07:54 -05:00
tinazhang 6f31bdbf67 fix issues for hq testers: I277HD, I277HV 2020-11-27 17:01:23 -05:00
peixu_ren 6355f46d32 Add LBeta op at nn level 2020-11-27 11:59:06 -05:00
tinazhang 27698866d1 Block take/skip under cache and fix docstring 
and other minor changes per the request of HQ testers
 2020-11-26 17:44:19 -05:00
yao_yf 9cda064716 auto parallel predict 2020-11-26 20:13:15 +08:00
mindspore-ci-bot 421cad24ef !8715 Add Gamma distribution 
From: @peixu_ren
Reviewed-by: 
Signed-off-by:
 2020-11-26 09:57:31 +08:00
mindspore-ci-bot adc8e3e707 !8594 [MD] Pybind Pushdown Support for dataset 
From: @cathwong
Reviewed-by: 
Signed-off-by:
 2020-11-26 05:55:49 +08:00
Eric Zhang 809e1d5086 added python api based on cpp api 
1st draft of python iterator

Added Cifar10 and Cifar100 pybind port

Change pybind to use IR for Skip and Manifest

Signed-off-by: alex-yuyue <yue.yu1@huawei.com>

DatasetNode as a base for all IR nodes

namespace change

Fix the namespace issue and make ut tests work

Signed-off-by: alex-yuyue <yue.yu1@huawei.com>

Add VOCDataset

!63 Added RandomDataset
* Added RandomDataset

add imagefolder ir

Pybind switch: CelebA and UT

!61 CLUE example with class definition
* Merge branch 'python-api' of gitee.com:ezphlow/mindspore into clue_class_pybind
* Passing testcases
* Added CLUE, not working

add ManifestDataset IR

Signed-off-by: alex-yuyue <yue.yu1@huawei.com>

Update Coco & VOC & TFReader, Update clang-format, Reorder
datasets_binding

!69 Add Generator and move c_dataset.Iterator to dataset.Iterator
* Add GeneratorDataset to c_dataset
* Add GeneratorDataset to c_dataset

!67 Moving c_datasets and adding sampler wrapper
* Need to add create() method in datasets.py
* migration from c_dataset to dataset part 1

!71 Fix indent error
* Fix indentation error

!72 Fix c_api tests cases
* Fix c_api tests cases

!73 Added CSV Dataset
* Added CSVDataset

pybind switch: Take and CelebA fixes

!75 move c_dataset functionality to datasets
* Fixed existing testcases
* Added working clue and imagefolder
* Added sampler conversion from pybind
* Added sampler creation

!77 Add Python API tree
* Python API tree

add minddataset

TextFileDataset pybind

Rename to skip test_concat.py and test_minddataset_exception.py

!80 Add batch IR to python-api branch, most test cases work
* staging III
* staging, add pybind

Enable more c_api take and CelebA tests; delete util_c_api

!84 Schema changes in datasets.py
* Schema changes

!85 Remove input_indexes from sub-classes
* remove input_index from each subclass

!83 Remove C datasets
* Removed c_dataset package
* Remove c_datasets

!82  pybind switch: shuffle
* pybind switch: shuffle

!86 Add build_vocab
* Add build_vocab

Rebase with upstream/master
_shuffle conflict
BatchNode error

!88 Fix rebase problem
* fix rebase problem

Enable more unit tests; code typo/nit fixes

!91 Fix python vocag hang
* Fix python vocab hang

!89 Added BucketBatchByLength Pybind switch
* Added BucketBatchByLength

Update and enable more tet_c_api_*.py tests

!95 Add BuildSentencePeiceVocab
* - Add BuildSentencePeiceVocab

!96 Fix more tests
* - Fix some tests

- Enable more test_c_api_*
- Add syncwait

!99 pybind switch for device op
* pybind switch for device op

!93 Add getters to python API
* Add getters to python API

!101 Validate tree, error if graph
* - Add sync wait

!103 TFrecord/Random Datasets schema problem
* - TfRecord/Random schem aproblem

!102 Added filter pybind switch
* Added Filter pybind switch

!104 Fix num_samples
* - TfRecord/Random schem aproblem

!105 Fix to_device hang
* Fix to_device hang

!94 Adds Cache support for CLUE dataset
* Added cache for all dataset ops
* format change
* Added CLUE cache support
* Added Cache conversion

Add save pybind

fix compile err

init modify concat_node

!107 Fix some tests cases
* Fix tests cases

Enable and fix more tests

!109 pybind switch for get dataset size
* pybind_get_dataset_size

some check-code fixes for pylint, cpplint and clang-format

!113 Add callback
* revert
* dataset_sz 1 line
* fix typo
* get callback to work

!114 Make Android compile clean
* Make Android Compile Clean

Fix build issues due to rebase

!115 Fix more tests
* Fix tests cases
* !93 Add getters to python API

fix test_profiling.py

!116 fix get dataset size
* fix get dataset size

!117 GetColumnNames pybind switch
* Added GetColumnNames pybind switch

code-check fixes: clangformat, cppcheck, cpplint, pylint

Delete duplicate test_c_api_*.py files; more lint fixes

!121 Fix cpp tests
* Remove extra call to getNext in cpp tests

!122 Fix Schema with Generator
* Fix Schema with Generator

fix some cases of csv & mindrecord

!124 fix tfrecord get_dataset_size and add some UTs
* fix tfrecord get dataset size and add some ut for get_dataset_size

!125 getter separation
* Getter separation

!126 Fix sampler.GetNumSamples
* Fix sampler.GetNumSampler

!127 Assign runtime getter to each get function
* Assign runtime getter to each get function

Fix compile issues

!128 Match master code
* Match master code

!129 Cleanup DeviceOp/save code
* Cleanup ToDevice/Save code

!130 Add cache fix
* Added cache fix for map and image folder

!132 Fix testing team issues
* Pass queue_name from python to C++
* Add Schema.from_json

!131 Fix Cache op issues and delete de_pipeline
* Roll back C++ change
* Removed de_pipeline and passing all cache tests.
* fixed cache tests

!134 Cleanup datasets.py part1
* Cleanup dataset.py part1

!133 Updated validation for SentencePieceVocab.from_dataset
* Added type_check for column names in SentencePieceVocab.from_dataset

Rebase on master 181120 10:20

fix profiling

temporary solution of catching stauts from Node.Build()

!141 ToDevice Termination
* ToDevice termination

pylint fixes

!137 Fix test team issues and add some corresponding tests
* Fix test team issues and add some corresponding tests

!138 TreeGetter changes to use OptPass
* Getter changes to use OptPass (Zirui)

Rebase fix

!143 Fix cpplint issue
* Fix cpplint issue

pylint fixes in updated testcases

!145 Reset exceptions testcase
* reset exception test to master

!146 Fix Check_Pylint Error
* Fix Check_Pylint Error

!147 fix android
* fix android

!148 ToDevice changes
* Add ToDevice to the iterator List for cleanup at exit

!149 Pylint issue
* Add ToDevice to the iterator List for cleanup at exit

!150 Pylint 2
* Add ToDevice to the iterator List for cleanup at exit

!152 ExecutionTree error
* ET destructor error

!153 in getter_pass, only remove callback, without deleting map op
* getter pass no longer removes map

!156 early __del__ of iterator/to_device
* early __del__ of iterator

!155 Address review comments Eric 1
* Added one liner fix to validators.py
* roll back signature fix
* lint fix
* Eric Address comments 2
* C++ lint fix
* Address comments Eric 1

!158 Review rework for dataset bindings - part 1
* Reorder nodes repeat and rename
* Review rework for dataset bindings - part 1

!154 Fixing minor problems in the comments (datasets.py, python_tree_consumer.cc, iterators_bindings.cc, and iterators.py)
* Fixing minor problems in the comments (datasets.py, python_tree_consum…

!157 add replace none
* Add replace_none to datasets.py, address comments in tests

Trying to resolve copy

Override the deepcopy method of deviceop

Create_ir_tree method

Create_ir_tree method 2

Create_ir_tree method 2

del to_device if already exists

del to_device if already exists

cache getters shapes and types

Added yolov3 relaxation, to be rolled back

Get shapes and types together

bypass yolo

NumWorkers for MapOp

revert Yolo

revert Thor

Print more info

Debug code: Update LOG INFO to LOG ERROR

do not remove epochctrl for getter pass

Remove repeat(1)

pritn batch size

add log to tree_consumer and device_queue op

Revert PR 8744

Signed-off-by: alex-yuyue <yue.yu1@huawei.com>

__del__ toDEvice

__del__ toDevice2

!165 add ifndef ENABLE_ANDROID to device queue print
* Add ifndef ENABLE_ANDROID to device queue print

revert some changes

!166 getter: get_data_info
* getter: get_data_info

!168 add back tree print
* revert info to warnning in one log
* add back the missed print tree log

Release GIL in GetDataInfo
 2020-11-25 15:46:59 -05:00
mindspore-ci-bot 979bb26cba !9031 Fix DatasetCache parameter check 
From: @lixiachen
Reviewed-by: @nsyca,@mikef
Signed-off-by: @nsyca
 2020-11-26 03:55:02 +08:00
Lixia Chen ab7427f1a9 Minor fix for DatasetCache param validation 2020-11-25 13:20:30 -05:00
peixu_ren 93d4ef428f Add Gamma distribution 2020-11-25 09:40:46 -05:00
mindspore-ci-bot 22d683a805 !8920 Adapt ops LinSpace for Ascend. 
From: @liu_xiao_93
Reviewed-by: @liangchenghui,@linqingke,@liangchenghui
Signed-off-by: @liangchenghui,@liangchenghui
 2020-11-25 12:03:56 +08:00
mindspore-ci-bot d9b4b5c750 !8954 Add SequenceMask operator. 
From: @liangzhibo
Reviewed-by: @chenfei52,@zh_qh
Signed-off-by: @zh_qh
 2020-11-25 11:41:59 +08:00
liuxiao93 584e241e29 Adapt ops LinSpace for Ascend. 2020-11-25 09:50:03 +08:00
peixu_ren 01f5da0a14 Add Poisson distribution 2020-11-24 11:55:39 -05:00
l00591931 17c0810f9e add SequenceMask operator 2020-11-24 19:47:28 +08:00
mindspore-ci-bot 3d6d820612 !8154 Add nn.MultiFieldEmbedding for the embedding lookup opearations 
From: @huangxinjing
Reviewed-by: 
Signed-off-by:
 2020-11-24 09:49:39 +08:00
mindspore-ci-bot d915fd9b96 !8592 change repeat_elements to a composite op 
From: @tom__chen
Reviewed-by: 
Signed-off-by:
 2020-11-23 23:15:23 +08:00
huangxinjing b0deb7a289 Add dense embedding 2020-11-23 20:21:58 +08:00
mindspore-ci-bot 2eee1c06f0 !8842 Change Ones/Zeros operator 
From: @liangzhibo
Reviewed-by: @chenfei52
Signed-off-by:
 2020-11-23 12:37:19 +08:00
mindspore-ci-bot 7f725b93a3 !8234 Remove expm1_generic and log1p_generic from PP utils 
From: @peixu_ren
Reviewed-by: 
Signed-off-by:
 2020-11-23 09:56:07 +08:00
l00591931 f1e92d0ea7 Change Ones/zeros 2020-11-23 09:33:38 +08:00
mindspore-ci-bot e3371a01d5 !8751 Fix minor bugs in bijector and distribution 
From: @shallydeng
Reviewed-by: @zichun_ye,@sunnybeike
Signed-off-by:
 2020-11-23 08:50:57 +08:00
mindspore-ci-bot cfb9fb40d0 !8794 Add nn.Interpolate() function. 
From: @liangzhibo
Reviewed-by: @chenfei52,@zh_qh
Signed-off-by: @zh_qh
 2020-11-20 14:55:21 +08:00
l00591931 05e26f4739 Add nn.interpolate() 2020-11-20 10:00:47 +08:00
mindspore-ci-bot 81dfd70ece !8785 Add Parallel Operator UnsortedSegmentMax 
From: @huangxinjing
Reviewed-by: @yangzhenzhang,@stsuteng,@kisnwang
Signed-off-by: @stsuteng
 2020-11-20 09:23:30 +08:00
tom__chen a52cd685fc change repeat_element op to a composite op 2020-11-19 15:42:22 -05:00
mindspore-ci-bot 8980bc3de7 !8675 support allreduce prod 
From: @yao_yf
Reviewed-by: @stsuteng,@kisnwang
Signed-off-by: @stsuteng
 2020-11-19 20:21:27 +08:00
mindspore-ci-bot 39352ca658 !8580 Add Operation AllSwap Primitive 
From: @huangxinjing
Reviewed-by: 
Signed-off-by:
 2020-11-19 19:41:06 +08:00
huangxinjing 89e7778497 Add UnsortedSegmentMax Operation 2020-11-19 17:41:54 +08:00
mindspore-ci-bot fa2185b8ef !8661 Add nn.Tril() and nn.Triu() 
From: @liangzhibo
Reviewed-by: 
Signed-off-by:
 2020-11-19 16:34:32 +08:00
mindspore-ci-bot f827c18f1d !8289 Add Parallel Implements of Slice Op 
From: @huangxinjing
Reviewed-by: 
Signed-off-by:
 2020-11-19 15:54:20 +08:00
mindspore-ci-bot a3ae3b9794 !8695 add AdamOffload optimizer 
From: @wangnan39
Reviewed-by: @stsuteng,@stsuteng,@kingxian
Signed-off-by: @kingxian
 2020-11-19 10:42:14 +08:00
l00591931 e1dba1337c Add nn.Tril function 2020-11-19 10:31:30 +08:00
Xun Deng b5e05472ce fix minor bugs in bijector and distribution utils, fix docs issues 2020-11-18 21:13:47 -05:00
mindspore-ci-bot f1ef84e1a6 !8714 dataset Python UT: Add Sampler Chain Tests, with get_dataset_size 
From: @cathwong
Reviewed-by: @nsyca,@mikef
Signed-off-by: @nsyca
 2020-11-19 03:26:44 +08:00
mindspore-ci-bot 8e1ce841b4 !8688 dataset: modify the error log msg in python layer to be more acceptable 
From: @ms_yan
Reviewed-by: 
Signed-off-by:
 2020-11-18 21:43:48 +08:00
huangxinjing 8129806475 Add slice parallel op 2020-11-18 20:20:33 +08:00
mindspore-ci-bot ee72de1db2 !8441 Add Parallel Implements of UniformCandidateSampler 
From: @huangxinjing
Reviewed-by: 
Signed-off-by:
 2020-11-18 18:59:31 +08:00
mindspore-ci-bot cd6236c0a0 !8712 update pipeline parallel interface 
From: @yangzhenzhang
Reviewed-by: @kisnwang
Signed-off-by:
 2020-11-18 18:59:04 +08:00
mindspore-ci-bot fb0e866ad1 !8269 forward unique dynamic shape 
From: @yao_yf
Reviewed-by: 
Signed-off-by:
 2020-11-18 18:53:46 +08:00
huangxinjing 23284f0b35 Add AllSwap Op 2020-11-18 18:35:28 +08:00
ms_yan 0cb5c47856 add err modify 2020-11-18 16:30:24 +08:00
wangnan39@huawei.com ab811fca8f add AdamOffload optimizer 2020-11-18 16:13:47 +08:00
yao_yf 31819bb4a7 support forward unique 2020-11-18 15:22:14 +08:00
yangzhenzhang 278e82a849 update pipeline parallel 2020-11-18 13:55:34 +08:00
yao_yf 1529d544b9 add allreduce prod 2020-11-18 11:08:56 +08:00
mindspore-ci-bot f40a4781e4 !8656 Adapt DynamicGRUV2Grad for Ascend new backend. 
From: @liu_xiao_93
Reviewed-by: @jjfeing,@liangchenghui
Signed-off-by: @liangchenghui
 2020-11-18 09:54:05 +08:00
huangxinjing 2730cef047 Uniform Sampler Base Update 2020-11-18 09:39:32 +08:00
Cathy Wong e5f62013f4 dataset Python UT: Add Sampler Chain Tests, with get_dataset_size 2020-11-17 15:24:44 -05:00
peixu_ren 4aa836dae1 Add Digamma op 2020-11-17 11:49:20 -05:00
liuxiao93 2aaf5e2e1b Adapt DynamicGRUV2Grad for Ascend new backend. 2020-11-17 20:27:18 +08:00
peixu_ren 65d50861ec Remove expm1_generic and log1p_generic from PP utils 2020-11-16 16:12:13 -05:00
peixu_ren 5e9178c5b6 Add IGamma operator 2020-11-16 15:40:09 -05:00
mindspore-ci-bot 52eb2d3401 !8477 Add Cauchy distribution 
From: @shallydeng
Reviewed-by: @zichun_ye
Signed-off-by:
 2020-11-16 23:24:00 +08:00
mindspore-ci-bot b411c05de0 !8495 Adapt DynamicGRUV2 forward for Ascend new backend. 
From: @liu_xiao_93
Reviewed-by: 
Signed-off-by:
 2020-11-16 19:13:16 +08:00
mindspore-ci-bot a321f402c8 !8579 Add view function for tensor 
From: @liangzhibo
Reviewed-by: @zh_qh,@chenfei52
Signed-off-by: @zh_qh
 2020-11-16 14:37:21 +08:00
l00591931 7a192973ff Add view function for tensor 2020-11-16 10:49:19 +08:00
mindspore-ci-bot 2bf165c0b4 !8557 run cast before allgather in parallel optimzier 
From: @gong_zi_yan
Reviewed-by: 
Signed-off-by:
 2020-11-16 09:55:44 +08:00
mindspore-ci-bot c11c79170e !8554 Add expand_as function to tensor 
From: @liangzhibo
Reviewed-by: @zh_qh,@chenfei52
Signed-off-by: @zh_qh
 2020-11-13 15:19:01 +08:00
liuxiao93 d471ac491e Adapt DynamicGRUV2 forward for Ascend new backend. 2020-11-13 14:54:40 +08:00
Ziyan 0ddb754edb run cast before parallel optimizer 2020-11-13 14:04:04 +08:00
l00591931 ba7ee2aa13 add expand_as function 2020-11-13 11:42:54 +08:00
mindspore-ci-bot d2427b6e89 !8538 fix get_num_class in imagefolder 
From: @ziruiwu
Reviewed-by: @robingrosman,@nsyca
Signed-off-by: @nsyca
 2020-11-13 05:07:11 +08:00
Zirui Wu 3555d19b07 fix get num_class in imagefolder 
address cmt

review cmts
 2020-11-12 14:26:54 -05:00
mindspore-ci-bot ffc5209c09 !8476 Merge CacheOp_dev fixes for HQ system test. 
From: @jkl_lee
Reviewed-by: 
Signed-off-by:
 2020-11-13 01:30:41 +08:00
Jesse Lee c795879313 CacheOp delivery for HQ tester 2020-11-12 08:48:29 -05:00
mindspore-ci-bot a442024604 !8510 Add Ones and Zeros operators 
From: @liangzhibo
Reviewed-by: @zh_qh,@chenfei52
Signed-off-by: @zh_qh
 2020-11-12 20:45:52 +08:00
l00591931 886ef520d7 Add Ones and Zeros operators 2020-11-12 16:26:28 +08:00
mindspore-ci-bot f16509388c !8409 Multi-dimensional list value assignment 
From: @liangzhibo
Reviewed-by: @chenfei52
Signed-off-by:
 2020-11-12 14:36:20 +08:00
Xun Deng 1a68ccb40b added Cauchy distribution 2020-11-11 22:36:34 -05:00
mindspore-ci-bot 156980778b !8416 Fix RealDiv Type Error when insert an VirtualDiv Operation 
From: @huangxinjing
Reviewed-by: @stsuteng
Signed-off-by: @stsuteng
 2020-11-11 17:24:19 +08:00
huangxinjing 12e9107162 Fix VirtualDiv Int32 error 2020-11-11 09:32:57 +08:00
l00591931 c5b5a6719c Enable multi-dimensional list value assignment 2020-11-11 09:25:12 +08:00
liuxiao93 92ba9d94df Adapt UnsortedSegmentMax for Ascend. 2020-11-10 14:12:00 +08:00
mindspore-ci-bot 4e07f43dff !8323 [Auto parallel] Supporting for-loop in strategy-searching 
From: @xiaoda_zh
Reviewed-by: 
Signed-off-by:
 2020-11-10 10:33:25 +08:00
mindspore-ci-bot 5a4af56c15 !8322 add parallel op for Range 
From: @yangzhenzhang
Reviewed-by: @xiaoda_zh,@cristoval
Signed-off-by:
 2020-11-10 09:18:56 +08:00
Xiaoda Zhang aa13d6b1cd support for-loop in auto-parallel 2020-11-09 17:18:30 +08:00
yangzhenzhang 9747bde861 add range op 2020-11-09 15:14:07 +08:00
HuangBingjian 265a6d61b6 reverse fix shape=0 2020-11-09 15:06:37 +08:00
mindspore-ci-bot 470027a3a2 !8318 Fix some bugs about API. 
From: @liu_xiao_93
Reviewed-by: @liangchenghui
Signed-off-by: @liangchenghui
 2020-11-09 11:26:32 +08:00
mindspore-ci-bot ec5c86c1bb !8191 redesigned bijector broadcast shape and bijector's dtype logic 
From: @shallydeng
Reviewed-by: @zichun_ye,@sunnybeike
Signed-off-by: @sunnybeike
 2020-11-09 09:47:08 +08:00
mindspore-ci-bot 027916cb5f !8315 Cache server stability 
From: @jkl_lee
Reviewed-by: @mikef,@nsyca
Signed-off-by: @nsyca
 2020-11-08 20:03:23 +08:00
liuxiao93 0a1155f938 Fix some bugs about API. 2020-11-07 17:06:25 +08:00
Lixia Chen f24a788eed Rebase up to 5792d50ca7 2020-11-06 18:39:05 -05:00
mindspore-ci-bot a9a9c45662 !8232 C++ api add Filter 
From: @tiancixiao
Reviewed-by: 
Signed-off-by:
 2020-11-07 00:32:15 +08:00
mindspore-ci-bot 8c2ed3bb80 !8138 Throw an exception when a tensor with 0 shape is constructed. 
Merge pull request !8138 from huangbingjian/fix_shape
 2020-11-06 16:26:58 +08:00
Xiao Tianci 4a5e287b92 add filter c api and ut 2020-11-06 15:49:23 +08:00
HuangBingjian 4477fcfe19 fix shape bug. 2020-11-06 12:59:03 +08:00
yangzhenzhang 0a79ab82ae add parallel ops 2020-11-06 12:09:19 +08:00
mindspore-ci-bot c253d874e0 !8280 add export lenet grad example 
Merge pull request !8280 from changzherui/add_export_grad_example
 2020-11-06 10:14:54 +08:00
changzherui 6b823282aa add export mindir lenet grad 2020-11-05 23:01:43 +08:00
Yi Huaijie d7faa77b5e support int64 shape 2020-11-05 21:15:49 +08:00
Xiaoda Zhang aa84484049 enabling approximation in DP algorithms 2020-11-05 16:07:26 +08:00
mindspore-ci-bot b3855530e3 !7838 Enumerate function enable tensor as input 
Merge pull request !7838 from LiangZhibo/master
 2020-11-05 11:33:02 +08:00
Xun Deng fb0263f869 redesigned bijector classes, changed bacth_shape calculation in transformed distribution and upgraded dtype logic of bijector class 2020-11-03 15:28:45 -05:00
mindspore-ci-bot 49eb4d3106 !8089 add antialias option for py reset 
Merge pull request !8089 from guozhijian/enhance_py_resize
 2020-11-03 16:25:21 +08:00
mindspore-ci-bot f3d7b32d56 !7855 Move backend opt pass ir files to the fold: verbose_ir_files 
Merge pull request !7855 from huanghui/move_ir_files
 2020-11-03 15:34:17 +08:00
mindspore-ci-bot e9cd12e904 !8114 rectify and optimize the type checking function 
Merge pull request !8114 from zhangbuxue/rectify_and_optimize_the_type_checking_function
 2020-11-03 14:48:12 +08:00
mindspore-ci-bot 00294473e3 !7976 [pynative] Add nested derivative feature 
Merge pull request !7976 from zjun/Add_nested_derivative
 2020-11-03 14:02:43 +08:00
buxue 346bcfa3fd Rectify and optimize the type checking function 2020-11-03 13:48:43 +08:00
jonyguo 1b78e34310 add ANTIALIAS support for python progress 2020-11-03 11:03:46 +08:00
mindspore-ci-bot bbfef6233a !8134 Add TBE op DynamicGRU for new and old backend. 
Merge pull request !8134 from liuxiao93/DynamicGRU-new-old-backend
 2020-11-03 09:53:08 +08:00
l00591931 6f165ee5e3 enumerate function and enumerate test case added 2020-11-02 21:11:52 +08:00
mindspore-ci-bot e909b9077c !7946 fix auto parallel optimizer weight shard 
Merge pull request !7946 from gziyan/fix_auto_optim_shard
 2020-11-02 20:51:56 +08:00
mindspore-ci-bot e99a8bd784 !8120 fix CI randomly fails 
Merge pull request !8120 from yihuaijie/master
 2020-11-02 20:08:33 +08:00
liuxiao93 45d343257b Add DynamicGRU. 2020-11-02 19:59:40 +08:00
zjun ccedf71de5 Add pynative bprop nested grad 
Signed-off-by: zjun <zhangjun0@huawei.com>
 2020-11-02 19:33:33 +08:00
mindspore-ci-bot ad930b30db !7891 add layer of clipbyglobalnorm 
Merge pull request !7891 from jiangzhenguang/add_clip_by_global_norm
 2020-11-02 19:18:33 +08:00
huanghui fa6c23358a Move some ir files which backend optpass dumped to the fold: verbose_ir_files 2020-11-02 19:18:24 +08:00
Yi Huaijie da29f232c6 fix CI random fails 2020-11-02 16:28:28 +08:00
Ziyan c33f2cd796 fix auto optimizer weight shard 2020-11-02 16:25:48 +08:00
jzg 4851a67bb5 add layer of clipbyglobalnorm. 2020-11-02 16:15:17 +08:00
mindspore-ci-bot 7e43eaf5e8 !8072 Revert changes to weighted_random_sampler in PR7866 
Merge pull request !8072 from luoyang/pylint
 2020-11-02 15:36:45 +08:00
mindspore-ci-bot 7092a33e87 !8039 support key ward way to pass arg for outermost net in graph mode 
Merge pull request !8039 from zhangbuxue/support_key_ward_way_to_pass_arg_for_outermost_net_in_graph_mode
 2020-10-31 14:58:40 +08:00
YangLuo 82cc7c3f63 [MD] Revert changes to weighted_random_sampler in PR7866 2020-10-31 12:56:17 +08:00
mindspore-ci-bot cacebd1211 !7933 Cache performance updates 
Merge pull request !7933 from Jamie/CacheOp_dev
 2020-10-31 04:25:47 +08:00
buxue 1364b5c301 support key ward way to pass arg for outermost net in graph mode 2020-10-30 16:55:53 +08:00
mindspore-ci-bot eb3b093686 !8013 [MD] fix minddataset padding bug 
Merge pull request !8013 from liyong126/fix_md_pad
 2020-10-30 16:44:45 +08:00
mindspore-ci-bot 015b244471 !7991 fix ReLUV2 error 
Merge pull request !7991 from yihuaijie/dev
 2020-10-30 14:16:33 +08:00
liyong 0d40abf5dd fix md padding bug 2020-10-30 12:00:44 +08:00
Lixia Chen 572c5e5f29 Rebase up to 542a52fbf8 2020-10-29 20:34:09 -04:00
Yi Huaijie 148d645915 fix ReLUV2 error 2020-10-29 20:29:01 +08:00
mindspore-ci-bot 870afe08f5 !7914 get keys and values from dictionary & set tuple to dictionary 
Merge pull request !7914 from Simson/push-to-opensource
 2020-10-29 19:58:35 +08:00
simson 3b21822824 get keys and values from dictionary & set tuple to dictionary 2020-10-29 18:06:06 +08:00
Zirui Wu ea97197311 fix tfrecord_op core dump 
add test case

fix ci

fix ci round 2

address review cmts
 2020-10-28 17:38:43 -04:00
mindspore-ci-bot 163544795f !7922 add params check for offset in distributed_sampler 
Merge pull request !7922 from xiaotianci/fix_distributed_sampler
 2020-10-28 20:57:50 +08:00
mindspore-ci-bot 376fa95717 !7771 Add Parallel SegmentOps 
Merge pull request !7771 from huangxinjing/segment_ops
 2020-10-28 17:19:35 +08:00
Xiao Tianci 823e52f1dc add params checking of offset in distributed_sampler 
add related comment to explain
add related UT
 2020-10-28 16:46:12 +08:00
mindspore-ci-bot 0d43e37f22 !7651 Add embedding and embedding_lookup 
Merge pull request !7651 from jiangzhenguang/add_embedding_and_enbedding_lookup
 2020-10-28 15:13:40 +08:00
huangxinjing bf5d21770a Add UnsortedSegmentSum and UnosrtedSemenMin For Oparallel Implements 2020-10-28 08:57:02 +08:00
Xun Deng d4df6f82ea support get_dist_args 2020-10-27 16:17:38 -04:00
mindspore-ci-bot d4142d682d !7437 auto parallel support dynamic 
Merge pull request !7437 from yao_yf/auto_parallel_support_dynamic_shape
 2020-10-27 21:02:28 +08:00
jzg 7cbd55e17d add embedding layer. 2020-10-27 20:51:49 +08:00
mindspore-ci-bot 08e6ac0b09 !7805 support split ValueList 
Merge pull request !7805 from yihuaijie/master
 2020-10-27 19:22:52 +08:00
yao_yf 0cfe72cd22 auto parallel dynamic 2020-10-27 19:17:27 +08:00
Yi Huaijie 3102c4ff8d support split ValueList 2020-10-27 17:58:36 +08:00
mindspore-ci-bot 2fac6d0595 !7794 Renamed ut test_invert.py to test_invert_bijector.py 
Merge pull request !7794 from XunDeng/pp_issue_branch
 2020-10-27 09:53:36 +08:00
Xun Deng 5ffc16c6db renamed test_invert_bijector 2020-10-26 10:51:07 -04:00
yao_yf 65d8e63580 set last node data parallel or repeat calculate in eval/predict 2020-10-26 20:05:00 +08:00
huanghui a9e781921a Support determine tensor in(not in) a list(tuple) 2020-10-26 14:41:04 +08:00
mindspore-ci-bot f711e01f61 !7719 refactor cnode strategy 
Merge pull request !7719 from gziyan/refactor_cnode
 2020-10-24 16:16:29 +08:00
Ziyan 069318899a refactor get cnode strategy 2020-10-24 15:06:26 +08:00
mindspore-ci-bot c5867d2d7e !7676 [MD] fix arm compile error 
Merge pull request !7676 from liyong126/fix_arm_env
 2020-10-24 14:43:39 +08:00
liyong 1e7f46c998 fix unorder_map hash 2020-10-24 11:03:06 +08:00
liyong ee042b90f7 fix num_sample in sequentialSampler and randomSampler 2020-10-23 19:26:10 +08:00
mindspore-ci-bot 2af6313f53 !7534 SummaryRecord support to record mindexplain data 
Merge pull request !7534 from ougongchang/feature_mindexplain
 2020-10-23 14:38:33 +08:00
mindspore-ci-bot d50736df2c !7607 modify_normal_seed 
Merge pull request !7607 from lilei/modify_normal
 2020-10-23 10:40:58 +08:00
mindspore-ci-bot 1795840436 !7581 Extension interface for dense 
Merge pull request !7581 from lilei/modify_bug
 2020-10-23 10:40:42 +08:00
mindspore-ci-bot dc1ecdab28 !7623 [Data]Modify the behavior of the lite dataset, the default setting is to compile the dataset and mindspore lite trainging together 
Merge pull request !7623 from xulei/lite_test0905
 2020-10-23 08:48:50 +08:00
lilei 0c043d18ef modify_normal 2020-10-22 21:35:44 +08:00
xulei2020 8f392204be minddata build with mindspore-lite train 2020-10-22 21:34:56 +08:00
lilei 127f70ce40 Extension interface for dense 2020-10-22 17:58:24 +08:00
mindspore-ci-bot 22bde4bd9b !7390 Add nonzero and moments 
Merge pull request !7390 from jiangzhenguang/add_nonzero_and_moments
 2020-10-22 17:10:41 +08:00
ougongchang 6072b25a07 SummaryRecord support to record mindexplain data 
The SummaryRecord.add_value() method is extended to record the data of
MindExplain.
 2020-10-22 15:52:54 +08:00
jzg 374e9e199d add moment and nonzero. 2020-10-22 14:53:26 +08:00
mindspore-ci-bot 1ee9c4d014 !6645 [MD] add unique op 
Merge pull request !6645 from liyong126/md_unique_op
 2020-10-22 14:43:37 +08:00
mindspore-ci-bot 8bfe141680 !7571 fix bug in reshape strategy search when reshape as the first operator 
Merge pull request !7571 from yao_yf/reshape_strategy_search_fix_when_reshape_is_first_op
 2020-10-22 10:16:33 +08:00
mindspore-ci-bot 3b55a25f8d !7463 move train.quant to compression module & add QuantizationAwareTraining 
Merge pull request !7463 from yuchaojie/quant2
 2020-10-22 09:19:44 +08:00
yao_yf f7189adb91 fix bug in reshape strategy search when reshape is first operator 2020-10-22 09:15:18 +08:00
liyong fb2bd156c9 add unique op 2020-10-22 09:12:37 +08:00
mindspore-ci-bot f487797694 !7495 [Auto-parallel] Overwrite strategies for star graph structures 
Merge pull request !7495 from Xiaoda/27-star-elimination-overload
 2020-10-22 09:10:52 +08:00
mindspore-ci-bot 20cd47b4d8 !7416 Support Gumbel Distribution 
Merge pull request !7416 from XunDeng/gumbel
 2020-10-22 01:55:25 +08:00
yuchaojie c8ec34d638 move train.quant to compression module & add QuantizationAwareTraining 2020-10-21 17:30:40 +08:00
mindspore-ci-bot b2b9016ddf !7429 modify normal seed 
Merge pull request !7429 from lilei/modify_bug
 2020-10-21 09:37:47 +08:00
Xun Deng ce170b2241 added Gumbel distribution 2020-10-20 10:26:04 -04:00
lilei 04075671cf modify_normal_seed 2020-10-20 22:06:17 +08:00
mindspore-ci-bot 620d8b99b6 !6760 sparse optimizer 
Merge pull request !6760 from lijiaqi/sparse_optimizer
 2020-10-20 20:19:06 +08:00
Jiaqi a30ccea62c sparse optimizer 2020-10-20 17:56:45 +08:00
Xiaoda Zhang fba2bfeb54 overwrite strategies for star graph structure 2020-10-20 13:40:24 +08:00
mindspore-ci-bot 3fd54fd58f !7361 Check whether the network args are tensors in the compile phase 
Merge pull request !7361 from YuJianfeng/master
 2020-10-19 14:32:15 +08:00
yujianfeng 18a76ff3c5 Check whether the network args are tensors in the compile phase 2020-10-19 11:46:10 +08:00
yangzhenzhang fc4ed975c4 handle repeated calculation 2020-10-19 10:47:01 +08:00
mindspore-ci-bot 7a45596593 !7373 Use MetaTensor instead of Initializer 
Merge pull request !7373 from lilei/modify_MetaTensor
 2020-10-17 20:54:13 +08:00
mindspore-ci-bot 7b060b2562 !7209 Add some fake-quant operators 
Merge pull request !7209 from jiangzhenguang/add_fake_quant_operator
 2020-10-17 14:14:35 +08:00
chenzomi acadb694aa [ME] delete reduant function in check_parameter 2020-10-16 16:22:28 +08:00
jzg 2c6a9c8486 add fake-quant operators. 2020-10-16 15:50:18 +08:00
chenzomi 5b769dfb20 [ME] Bug fix 2020-10-16 13:01:34 +08:00
lilei 7b135990e7 Use MetaTensor instead of Initializer 2020-10-16 09:38:11 +08:00
mindspore-ci-bot c68f36c81e !7311 [ME] change _check_parameter format 
Merge pull request !7311 from chenzhongming/zomi_master
 2020-10-15 20:52:29 +08:00
mindspore-ci-bot c967bf6846 !7339 fix for se-resnet50 accurancy 
Merge pull request !7339 from qujianwei/master
 2020-10-15 19:50:16 +08:00
mindspore-ci-bot a5e8c1eab3 !7345 fix a bug case in reshape redistribution 
Merge pull request !7345 from yao_yf/reshape_redistribution_all_scene_support_add
 2020-10-15 19:43:32 +08:00
yao_yf 022005b94a fix a bug cases in reshape redistribution 2020-10-15 16:58:09 +08:00
mindspore-ci-bot fc14f2f785 !7268 Support Invert and GumbelCDF Bijectors 
Merge pull request !7268 from XunDeng/gumbel_cdf
 2020-10-14 22:02:57 +08:00
mindspore-ci-bot 2801429db0 !7240 auto parallel support reshape redistribution in all scenes 
Merge pull request !7240 from yao_yf/reshape_redistribution_all_scene_support
 2020-10-14 10:09:12 +08:00
Xun Deng f2e8e143be added gumbel_cdf and invert bijectors 2020-10-13 15:41:43 -04:00
Zirui Wu c42a1b4a2f fix batch core dump when col name doesn't exist 
fix ci
 2020-10-13 10:50:07 -04:00
yao_yf f60d81a15f support reshape redistribution in all scenes 2020-10-13 21:21:17 +08:00
Lizhenglong 46667aac4f Transition tools for tensorrecord to mindrecord,support 1.13.0-rc1 and higher version 2020-10-12 16:06:34 +08:00
xsmq 6364d56ebe 回退 'Pull Request !6995 : Support the transition of datarecord from 1.x.x version Tensorflow to Mindspore ' 2020-10-12 14:16:04 +08:00
mindspore-ci-bot e62481845e !6995 Support the transition of datarecord from 1.x.x version Tensorflow to Mindspore 
Merge pull request !6995 from lizhenglong1992/TF_to_MR
 2020-10-12 11:52:36 +08:00
lizhenglong 16ef0977ee support_1.x.x tfrecord to mindrecord 2020-10-12 10:29:34 +08:00
buxue 559c741cce improve the way passing ags of partial 2020-10-12 09:40:20 +08:00
mindspore-ci-bot 55e369a125 !7144 [ME] change `check_integer` to format `check_positive_int` and `check_integeter` 
Merge pull request !7144 from chenzhongming/zomi_master
 2020-10-10 14:14:38 +08:00
chenzomi d471d32e87 [ME] change `check_integer` to format `check_positive_int` and `check_integeter` 2020-10-10 12:08:10 +08:00
mindspore-ci-bot 3d21c80e3b !7110 [ME] delete check_bool and replace with Validate.check_bool 
Merge pull request !7110 from chenzhongming/zomi_master
 2020-10-10 11:56:39 +08:00
mindspore-ci-bot fd0c03c493 !7090 implement parallel BroadcastTo 
Merge pull request !7090 from yihuaijie/master
 2020-10-09 19:10:20 +08:00
chenzomi d4e8e94981 [ME] delete check_bool and replace with Validate.check_bool 2020-10-09 16:46:07 +08:00
Yi Huaijie 45d373d40e implement parallel BroadcastTo 2020-10-09 15:17:37 +08:00
mindspore-ci-bot ab9cec0531 !7083 Support Categorical distribution 
Merge pull request !7083 from XunDeng/categorical
 2020-10-09 09:47:40 +08:00
mindspore-ci-bot b1dd00f3a9 !7092 Support Logistic Distribution 
Merge pull request !7092 from XunDeng/logistic
 2020-10-09 09:16:58 +08:00
Xun Deng 05a0dac125 add logistic distribution 2020-10-08 10:23:50 -04:00
Ziyan ddc0113058 enable parallel optimizer in auto parallel 2020-10-08 14:51:15 +08:00
Xun Deng 877b561e77 added categorical distribution 2020-10-07 11:49:44 -04:00
mindspore-ci-bot 6f77ec45f1 !6905 [MD] Enable cache for more leaf datasets 
Merge pull request !6905 from lixiachen/CacheOp_dev
 2020-09-30 16:49:23 +08:00
mindspore-ci-bot 86bbd1dc98 !6832 Add BCELoss 
Merge pull request !6832 from wanyiming/add_BCELoss
 2020-09-30 11:47:44 +08:00
mindspore-ci-bot 58610443cb !7023 modify endofsequence for multi-machine 
Merge pull request !7023 from HW_KK/master
 2020-09-30 08:40:57 +08:00
wuweikang a32811e160 modify endofsequence for multi-machine 2020-09-29 16:17:38 +08:00
wanyiming 4e93413c5a add_BCELoss 2020-09-29 10:23:38 +08:00
mindspore-ci-bot 2a799fe90e !6018 Set the number of epochs in mode.train() non-sink Mode 
Merge pull request !6018 from h.farahat/ms_nonsink_epochs
 2020-09-28 22:15:54 +08:00
xiefangqi 82bc278e26 minddata use new ps api 2020-09-27 17:38:22 +08:00
jonyguo 19ca9762db skip graphdata distributed test case when asan mode 2020-09-27 16:24:20 +08:00
mindspore-ci-bot 5171c90048 !6908 Added raise_not_implement_error functionality in distribution 
Merge pull request !6908 from XunDeng/not_impl_error
 2020-09-27 14:54:59 +08:00
mindspore-ci-bot 9bd34a1b29 !6673 Add stage information for ops and strategy 
Merge pull request !6673 from huangxinjing/stage_strategy
 2020-09-27 11:31:07 +08:00
Xun Deng ea57699ed1 added raise_not_implemented_error in distribution 2020-09-25 17:15:04 -04:00
Lixia Chen 477808e622 Enable cache for other leaf ops 2020-09-25 13:11:04 -04:00
mindspore-ci-bot 0d8015b043 !5300 [MD] Add nD Slice Support 
Merge pull request !5300 from nhussain/slice_op
 2020-09-25 20:38:19 +08:00
mindspore-ci-bot b785b7d0ff !6813 dataset UT: check PIL version, delete test_callback_2maps 
Merge pull request !6813 from cathwong/ckw_dataset_cleanup8
 2020-09-25 20:34:55 +08:00
hesham 9cee0d2143 Add num_epochs to non-sink training 2020-09-24 23:24:43 -04:00
huangxinjing 4ef439e27b Add stage information for ops and strategy 2020-09-25 10:42:43 +08:00
Cathy Wong f2b07d907a dataset UT: check PIL version, delete test_callback_2maps 2020-09-24 17:01:06 -04:00
mindspore-ci-bot 4c0b3c1bd3 !6017 per_batch_map needs to support x input columns and y output columns 
Merge pull request !6017 from ZiruiWu/per_batch_map_multi_col
 2020-09-25 04:08:01 +08:00
mindspore-ci-bot e88e114a50 !5930 Cache server phase 2 single node 
Merge pull request !5930 from Jamie/CacheOp_dev
 2020-09-25 03:54:55 +08:00
nhussain 77d507279c first working implementation 
add string implementation, can handle partial string slices

finish core implementation, added Index object

fix up the logic

add in new SliceOption object, cleaning up tests
 2020-09-24 15:39:28 -04:00
Lixia Chen 983827ec5c Rebase up to 88ded11f59 2020-09-24 14:09:08 -04:00
Zirui Wu 0cab373223 per_batch_map supports x num_columns to y num_columns 
decided to use project after batch as well

per_batch_map 1->x colunm works

add more test case

add test cases, project after map

col order hahaah

fix ci

add test cases

addr review cmts

ci

fix build err

fix test case failure

ci
 2020-09-24 12:01:22 -04:00
mindspore-ci-bot 2f3add4acd !6301 [MD] Combine c++ and python ops in map 
Merge pull request !6301 from nhussain/c_py_compose
 2020-09-24 23:10:47 +08:00
mindspore-ci-bot 55be3c42a5 !5875 Add IFMR op for new backend. 
Merge pull request !5875 from liuxiao93/IFMR-OpenSource-new-backend
 2020-09-24 15:01:08 +08:00
peixu_ren 23ff21edd8 Added lognormal distribuition 2020-09-23 16:57:33 -04:00
mindspore-ci-bot 39874d133f !6644 fix testcase running slowly 
Merge pull request !6644 from guozhijian/fix_testcase_slowly
 2020-09-23 14:53:32 +08:00
mindspore-ci-bot 9f84920f64 !6761 remove redundant check about IsInstance op 
Merge pull request !6761 from liangzelang/fix_isinstance_op_bug
 2020-09-23 14:18:38 +08:00
liangzelang 195d97ad46 Remove redundant check about IsInstance op 2020-09-23 10:53:02 +08:00
jonyguo 1c6c54ae0f fix: testcase test_cutmix_batch_op.py slowly 2020-09-23 10:24:39 +08:00
Yi Huaijie 6066b16838 implement parallel Pack 2020-09-23 09:22:21 +08:00
mindspore-ci-bot 9475f9a19a !6548 Implement parallel Split 
Merge pull request !6548 from yihuaijie/dev
 2020-09-22 19:41:04 +08:00
mindspore-ci-bot f72f2c22fb !6653 fix stream sync error for mixed precesion on pynative mode 
Merge pull request !6653 from chujinjin/fix_stream_sync_error_for_mixed_precision
 2020-09-22 10:56:55 +08:00
liuxiao93 0e02df812a Add IFMR op for new backend. 
(cherry picked from commit 17a5995e97)
 2020-09-22 10:12:12 +08:00
mindspore-ci-bot 091ee5085e !6651 Modify init interface to internal interface 
Merge pull request !6651 from lijiaqi/init
 2020-09-22 09:06:48 +08:00
nhussain fda9462682 embed python compose op 
Leaf ops do self-reset.

embed python compose op

add implicit compose op

more tests
 2020-09-21 11:24:55 -04:00
Jiaqi 4e3e6006b6 modify init 2020-09-21 21:49:28 +08:00
mindspore-ci-bot dfe77372f5 !6505 Set top graph parameters' name the same as original graph parameters. 
Merge pull request !6505 from 张清华/master2
 2020-09-21 20:06:59 +08:00
chujinjin 1cf8f3b777 fix stream sync error for mixed precision 2020-09-21 19:10:25 +08:00
mindspore-ci-bot 428927bdff !6554 fix pylint 
Merge pull request !6554 from jinyaohui/master
 2020-09-21 19:09:21 +08:00
mindspore-ci-bot dde9f5ac25 !6607 delete SoftmaxCrossEntropyExpand interface 
Merge pull request !6607 from ghzl/delete-SoftmaxCrossEntropyExpand
 2020-09-21 17:51:24 +08:00
Zhang Qinghua 6c72d88ba1 Set top graph parameters' name as original graph parameters. 2020-09-21 17:44:02 +08:00
jinyaohui 334a32d501 fix pylint 2020-09-21 16:24:04 +08:00
Wei Luning cdbd16de0c fix bug in parameter set & fix code style in pynative_executa.cc 2020-09-21 11:32:39 +08:00
guohongzilong a754dea90c delete SoftmaxCrossEntropyExpand 2020-09-20 21:17:24 +08:00
mindspore-ci-bot 861602bce9 !6512 Clean up the view code 
Merge pull request !6512 from shenwei41/sw_master
 2020-09-19 23:04:26 +08:00
mindspore-ci-bot 3aa07a4362 !6320 change mix_precision to c++ 
Merge pull request !6320 from vlne-v1/pynative_amp
 2020-09-19 21:29:34 +08:00
mindspore-ci-bot 4905de06bd !6545 improve the recognition of Parameter object and raise error when convert keywordarg to pydata 
Merge pull request !6545 from zhangbuxue/improve_the_recognition_of_Parameter_object_and_raise_error_when_convert_keywordarg_to_pydata
 2020-09-19 21:25:02 +08:00
shenwei41 f2e34b2eaf Clean up the view code 2020-09-19 19:02:04 +08:00
mindspore-ci-bot 53a82fa6e0 !6472 fix get_dataset_size error in CelebaDataset when usage is not 'all' 
Merge pull request !6472 from yanghaitao/yht_celeba_get_dataset_size
 2020-09-19 18:07:25 +08:00
buxue 483c8a179a improve the recognition of Parameter object and raise error when convert keywordarg to pydata 2020-09-19 18:01:00 +08:00
mindspore-ci-bot 5a20b11012 !6502 [AutoParallel]Fix auto parallel find loss bug 
Merge pull request !6502 from lichen/fix_auto_parallel_find_loss_bug
 2020-09-19 15:56:56 +08:00
mindspore-ci-bot 92aecf128f !6549 [MD] minddata add iterator parameter validation 
Merge pull request !6549 from xiefangqi/add_output_numpy_valid
 2020-09-19 14:30:10 +08:00
yanghaitao1 4ff4c17632 fix get_dataset_size in CelebADataset when usage is not all 2020-09-19 02:16:29 -04:00
Yi Huaijie 18ed2bec53 implement parallel Split 2020-09-19 12:35:56 +08:00