Commit Graph

605 Commits

Author SHA1 Message Date
mindspore-ci-bot ac18da3770 !13061 [MD][bugfix] Fix to_json error: can't pickle pyfunc
From: @xiefangqi
Reviewed-by: 
Signed-off-by:
2021-03-13 12:48:26 +08:00
Xiao Tianci 4a7100c7f9 fix RandomAffine degree error and some examples in docs 2021-03-12 17:39:38 +08:00
mindspore-ci-bot 682a8926bd !13176 fix minddata transform issue
From: @luoyang42
Reviewed-by: 
Signed-off-by:
2021-03-12 17:01:56 +08:00
xiefangqi 41f3e02e87 fix pyfunc pickle issue 2021-03-12 15:17:08 +08:00
YangLuo 74d7bb41a6 fix minddata transform issue 2021-03-12 11:37:14 +08:00
mindspore-ci-bot f7040ca134 !13198 Fix get_dataset_size error with PKSampler
From: @ziruiwu
Reviewed-by: 
Signed-off-by:
2021-03-12 06:11:26 +08:00
mindspore-ci-bot 1bb789278d !13200 Fix CI warnings and test team issues
From: @alexyuyue
Reviewed-by: @robingrosman,@nsyca
Signed-off-by: @robingrosman
2021-03-12 05:38:01 +08:00
Zirui Wu 2692e3cc3d fix pk sampler's get_dataset error due to num_class unavaiable at pre-runtime 2021-03-11 15:43:02 -05:00
alex-yuyue 2457f52596 Fix CI warning and test team issues
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
2021-03-11 13:34:51 -05:00
RobinGrosman a0e75b845a Increase default level of parallelism in mindddata pipeline to 8.
Adjust memory usage to not increase as parallelism increases.  it will
stay at same level it would be with 4 parallelism
2021-03-10 18:38:11 -08:00
mindspore-ci-bot 3c7463bf2c !12943 adding fix to sample script
From: @ezphlow
Reviewed-by: 
Signed-off-by:
2021-03-10 10:22:19 +08:00
Eric ed373f61ac Adding inheritance to user defined sampler
what if we just do nothing

trying wrapper approach

Fix yolo
2021-03-09 18:14:49 -05:00
YangLuo 74431ad117 Fix bugs of minddata transforms 2021-03-06 16:41:51 +08:00
mindspore-ci-bot fe53c71b3b !12843 Add more callable test and clean the input check for tensor ops
From: @alexyuyue
Reviewed-by: @robingrosman,@nsyca
Signed-off-by: @robingrosman
2021-03-05 22:59:45 +08:00
alex-yuyue 6d7be32614 Add more callable test and clean the input check
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
2021-03-03 17:30:36 -05:00
mindspore-ci-bot 1c191a65fb !12765 Fix numpy input to samplers
From: @hfarahat
Reviewed-by: 
Signed-off-by:
2021-03-04 04:57:40 +08:00
mindspore-ci-bot c07371f5c9 !12763 Fix C++ API testcases
From: @ezphlow
Reviewed-by: 
Signed-off-by:
2021-03-04 04:57:28 +08:00
Eric f9a2379a70 Fixing api leftover
Fixed compile error

Fixed more testcases
2021-03-03 09:37:06 -05:00
alex-yuyue 66aff93940 Fix test team issue: ToNumber in eager mode.
And support multiple tensor as input in call method

Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
2021-03-02 17:39:44 -05:00
hesham 616d1a1f3d Fix sampler supporting numpy input 2021-03-01 12:41:59 -05:00
hesham aa4298721a Fix sampler error messages 2021-02-23 23:58:19 -05:00
YangLuo d8ace8f041 fix minddata issues 2021-02-19 10:53:49 +08:00
mindspore-ci-bot c5df707b69 !12327 Block caching after random pyfunc cases
From: @lixiachen
Reviewed-by: 
Signed-off-by:
2021-02-17 08:56:10 +08:00
Lixia Chen 0667818d9a Block caching after random pyfunc 2021-02-12 14:10:00 -05:00
Mahdi 4b106f184c Fixed an issue with SequentialSampler 2021-02-10 12:55:10 -05:00
mindspore-ci-bot 260c77f4ad !12336 [MD] fix sampler log & transform log
From: @luoyang42
Reviewed-by: 
Signed-off-by:
2021-02-10 15:33:15 +08:00
luoyang 416ad23e9d fix resize & randomcoloradjust
fix sampler
2021-02-10 12:53:27 +08:00
mindspore-ci-bot 923dd47b0f !12331 Adding validators back to check method
From: @ezphlow
Reviewed-by: @robingrosman,@nsyca,@robingrosman
Signed-off-by: @robingrosman
2021-02-10 08:58:02 +08:00
Eric 5d91fa6d77 changed discription
Added validator checks

Added builtin sampler check

Added proper input check for samplers
2021-02-09 18:00:53 -05:00
hesham 58193bc469 User explicit deepcopy 2021-02-09 17:25:21 -05:00
luoyang cd86788cf3 fix bugs of execute & update doc description in minddata 2021-02-07 22:52:52 +08:00
TinaMengtingZhang ddab5ad417 Add support for vision op and py_transform op to serdes 2021-02-03 12:31:09 -05:00
mindspore-ci-bot e8f4cafd02 !11950 Overwrite default port/hostname from env variables for cache_admin
From: @lixiachen
Reviewed-by: 
Signed-off-by:
2021-02-03 23:38:48 +08:00
Lixia Chen 97cd142f8d Overwrite default port/hostname from env variables
update copyright

add examples to CacheClient docstring
2021-02-02 20:39:19 -05:00
hesham 1185218335 Support list of IDs as a sampler 2021-02-02 11:44:38 -05:00
luoyang fa4f67cbcd LookupOp: default value of unknown_token support NoneType 2021-02-02 16:17:02 +08:00
Nat Sutyanyong 5a7dc0accc Migrate repeat_pass.cc to IR optimizer and remove ExecTree optimizer 2021-02-01 12:30:16 -05:00
mindspore-ci-bot 320ea51308 !11853 Add call for decoupled image and text ops
From: @alexyuyue
Reviewed-by: 
Signed-off-by:
2021-02-01 19:47:00 +08:00
mindspore-ci-bot 794af6d094 !11834 [MD] Fix error msg description of dataset
From: @xiefangqi
Reviewed-by: @liucunwei,@heleiwang
Signed-off-by: @liucunwei
2021-01-30 14:49:24 +08:00
xiefangqi 3d72282f26 fix error msg issue 2021-01-30 11:03:53 +08:00
alex-yuyue 6fd58dc580 Add call for decoupled image and text ops
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
2021-01-29 21:36:31 -05:00
Mahdi 8f34faeb7a Changed bindings to SamplerObj 2021-01-29 14:20:05 -05:00
mindspore-ci-bot 20c1727b2c !11631 Add SubsetSampler
From: @hfarahat
Reviewed-by: 
Signed-off-by:
2021-01-29 03:48:45 +08:00
mindspore-ci-bot 8e4a6842ff !11681 gnn support edge weight sampling
From: @heleiwang
Reviewed-by: @liucunwei
Signed-off-by: @liucunwei
2021-01-28 19:15:37 +08:00
heleiwang 2dc9ba761c gnn support weight sampling neighbors. 2021-01-28 15:28:44 +08:00
hesham 7120c66998 Add SubsetSampler 2021-01-27 15:00:18 -05:00
mindspore-ci-bot 4cd6588af0 !11393 Migrating cache transform pass from execution tree to IR tree
From: @lixiachen
Reviewed-by: 
Signed-off-by:
2021-01-27 22:10:13 +08:00
mindspore-ci-bot f2fd357ffc !11623 fix issues of MD
From: @luoyang42
Reviewed-by: 
Signed-off-by:
2021-01-27 14:37:55 +08:00
luoyang 415c8b08a5 fix issues of MD:
1. description of num_shard in datasets.py
2. add param validation for sampler
3. add description for add_child in sampler.py
2021-01-27 09:30:42 +08:00
Lixia Chen 922e1f4f36 Migrate CacheTransformPass 2021-01-26 19:24:10 -05:00