Commit Graph

44 Commits

Author SHA1 Message Date
mhmotallebi 349126edd7 [MD] add repeatability for failover reset 2022-09-22 17:27:38 -04:00
jonyguo b451122bf3 del mindspore:: LogLevel 2022-06-13 19:11:30 +08:00
zetongzhao ab5f79f522 move common helper function 2022-03-16 10:30:43 -04:00
chenx2ovo 77caf907c4 [feat][assistant][I3CEGR] add op random lighting 2021-10-19 20:38:01 +08:00
Guo Zhijian 4b413922ac fix: code review new 2021-09-08 09:10:54 +08:00
ms_yan 36a8886ca2 Revert "[feat] [assistant] [I3T96T] add new Dataset operator CMUARCTICDataset"
This reverts commit b077aa1cab.

Revert "[feat] [assistant] [I3T96X] add new Dataset operator LibriSpeechDataset"

This reverts commit 4e6f7dc97d.

delete pass_registry_test.cc

comment  hiai_nlu_model_multi.pb related  line
2021-08-23 01:46:38 +08:00
djc b077aa1cab [feat] [assistant] [I3T96T] add new Dataset operator CMUARCTICDataset 2021-08-22 16:26:45 +08:00
djc 4e6f7dc97d [feat] [assistant] [I3T96X] add new Dataset operator LibriSpeechDataset 2021-08-22 13:39:37 +08:00
xiefangqi 0e2efc2501 fix minddata code clean 2021-08-19 09:11:30 +08:00
liyong 5fea72473c fix HW1 issue 2021-08-06 14:07:26 +08:00
chenx2ovo 4191dde45f [feat][assistant][I3CEGM] add op adjust gamma 2021-08-04 02:32:13 +08:00
EricZ 16837a4639 Removing Builder from dataset ops phase 1 2021-06-03 09:09:29 +08:00
mindspore-ci-bot cefcf6c2ae !15931 Add eager tests for transform ops, and add a shape comparison in the EXPECT_MSTENSOR_EQ Macro
From: @alexyuyue
Reviewed-by: @nsyca,@robingrosman
Signed-off-by: @robingrosman
2021-04-30 06:15:12 +08:00
alex-yuyue 9ef4331f56 Add eager tests for transform ops
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
2021-04-29 13:19:24 -04:00
YangLuo bf48400c10 unify include file of minddata 2021-04-22 10:59:36 +08:00
luoyang 624511337c MindData Codespell correction 2021-04-07 10:20:29 +08:00
mindspore-ci-bot dd90f7f055 !13506 dataset UT: Reinstate INFO logging and data verification - part 3
From: @cathwong
Reviewed-by: @robingrosman,@liucunwei
Signed-off-by: @robingrosman
2021-03-18 09:35:22 +08:00
Cathy Wong 1775c4e83d dataset: Reinstate INFO logging and data verification - part 3
Updates: GetItemAt, CreateFromVector, CreateScalar.
Add TEST_MS_LOG_MSTENSOR.
Wrap ASSERT_OK around Tensor function calls.
2021-03-17 13:48:04 -04:00
Eric a7da38feeb Added example for ngram 2021-03-16 23:45:04 -04:00
Eric 4be0ffb9ba removing type_id.h from header files 2021-03-16 16:51:10 -04:00
Eric 9b921953f9 misc issues 2021-03-15 22:30:04 -04:00
mindspore-ci-bot 98a87ad969 !13220 Add data helper to C++ API
From: @ezphlow
Reviewed-by: 
Signed-off-by:
2021-03-13 09:52:54 +08:00
Eric 82f7c6f2c7 Moving data_helper
exposing json

WIP fix for removing templates

Removing templates part 1

replacing core/constants.h

removed template part 2

Changed fake data to filler data

Fixing CI

Fix CI part 2

CI fix part 2

Fix CI 3

Fixed lizard for data_util

Fixed clang

Fixing CI part 4
2021-03-12 15:30:34 -05:00
Cathy Wong 95bbaaf9f6 dataset: Reinstate INFO logging and data verification - part 2
for image/vision datasets
2021-03-12 10:07:45 -05:00
Zirui Wu 8022001450 Remove datasets.h dependency on tensor.h and other related dependencies
Replace std::function<TensorRow(TensorRow)> with std::function<MSTensorVec(MSTensor)> by using std::bind

Replace pad_info with MSTensor

Switch TensorShape/dataset::DataType to vector<int64> /mindspore::DataType

Change TypeId to mindspore::DataType in SchemaObj

address review cmts, add CreateFromMSTensor() in tensor.h/.cc
2021-03-05 16:26:58 -05:00
Cathy Wong 2f1f0c438d dataset: C++ API Vision support for Ops with TensorTransform op input
plus UTs
2021-02-26 16:25:30 -05:00
Cathy Wong 3e6e35d749 dataset: delete minddata/dataset/include/status.h 2021-02-04 10:19:08 -05:00
lixian 7d2fd6e76c cxx api refactor: tensor/status/model 2021-02-02 09:15:56 +08:00
Eric 394dbf50e1 Added testing macro and fix album_op test 2020-11-05 13:22:51 -05:00
tony_liu2 5e4c314130 rename dataset dir and image files
change references to use path original

revert folder name

revert graphengine
2020-08-27 16:49:23 -04:00
islam_amin 979111d0ef Added Posterize Op 2020-08-18 13:55:47 -04:00
avakh 477528de7f random sharpness cpp op support 2020-08-11 15:30:40 -04:00
nhussain 7766efd58e add files 2020-08-11 11:54:14 -04:00
islam_amin e52d85ba9d Added RandomAffine Op 2020-08-10 17:52:50 -04:00
liubuyu d81862a916 decoupling core and context 2020-08-05 08:15:14 +08:00
hesham adfbc891d3 - Add checks and testing for empty tensors
- cleanup work on createTensor and Tensor's constructors
2020-07-24 17:23:18 -04:00
liubuyu 43c79eb853 mindspore path adjust 2020-07-14 18:07:28 +08:00
islam_amin 284cc910d5 C++ UTs for RandomHorizontalFlipWithBBox and Bounding Box Augment 2020-07-08 14:36:27 -04:00
Danish Farid 78c370f72a First Commit - New Infrastructure - Python UT tests + Common Aug Files
fix accidental change overwrite

fix 2

updated inits from 0 to 0.0 for float

improvd python ut comments

updated macro
2020-07-07 14:50:34 -04:00
islam_amin 593ee1eb34 C++ UT common files for object detection tests 2020-06-30 17:54:35 -04:00
jonyguo 41d16a3c77 enhance: 1. fix api comment, 2. del dead code 2020-06-29 17:15:44 +08:00
hesham 0c5e47111b - Move MutableBuffer to be protected
- Add new CreateTensors
2020-06-11 17:32:03 -04:00
hesham e8ca243364 -Add DE_STRING
-replace switch'case by indexing

- Add test case
- Add constructors
- Add getItem string

- Fix bugs
- Add more tests

- Tensor iterator
- asNumpy
- TextFileDataset

- Tensor(Numpy)

- Super > 2D
- Add more test cases for GeneratorDataset

- Change StartAddr to GetBuffer and GetMutableNuffer

- Raise an error if batch is used with strings

Clean-up work
2020-05-15 20:33:28 -04:00
zhunaipan 930a1fb0a8 initial version
Signed-off-by: leonwanghui <leon.wanghui@huawei.com>
2020-03-27 22:54:54 +08:00