Commit Graph

1299 Commits

Author SHA1 Message Date
deng jian d3c2378956 [feat] [assistant] [I4S2FA] add new data operator write_file 2022-10-28 04:42:21 -04:00
i-robot 281a8a8df5
!44491 fix: numpy slices dataset with diff shape datas
Merge pull request !44491 from guozhijian/fix_slice_dataset_with_diff_shape
2022-10-26 06:41:42 +00:00
jonyguo 2fecdedb1d fix: numpy slices dataset with diff shape 2022-10-25 14:49:38 +08:00
ZPaC e282ddfc01 Fix partition bug 2022-10-25 09:27:12 +08:00
jonyguo d05ed11ac3 enable set_seed for distributed 2022-10-23 19:13:35 +08:00
deng jian 832489a372 [feat] [assistant] [I4S2F8] add new data operator encode_jpeg 2022-10-20 11:38:58 -04:00
Xiao Tianci 560f3672c5 rectify terminology from operator to operation 2022-10-20 11:39:24 +08:00
Xiao Tianci 1b27a3f8f6 fix code examples 2022-10-19 18:12:44 +08:00
i-robot 0728f8ebb3
!42912 del map operation param column_order
Merge pull request !42912 from guozhijian/del_map_parameter
2022-10-19 01:53:03 +00:00
i-robot 15c2ba744b
!44102 Change the parameter of padding
Merge pull request !44102 from shenwei41/del_pad_parameter
2022-10-19 01:45:18 +00:00
jonyguo 911cbd7f6a del: column_order in map 2022-10-18 21:07:38 +08:00
i-robot aabf61a238
!44012 [MD] Fix adding user defined sampler with `add_sampler`
Merge pull request !44012 from xiaotianci/fix_add_sampler
2022-10-18 11:21:59 +00:00
shenwei41 a626dc1b90 Change the parameter of padding 2022-10-18 17:15:31 +08:00
i-robot ee7f194a58
!44013 del close_pool and to_device operation
Merge pull request !44013 from 刘勇琪/master
2022-10-18 06:39:46 +00:00
liu-yongqi-63 fa8891c68d Delete close_pool and to_device interface 2022-10-18 09:30:58 +08:00
Xiao Tianci fb910c4b12 fix adding user defined sampler with add_sampler 2022-10-17 17:37:57 +08:00
jonyguo 0571532873 del batch param: column_order & pad_info 2022-10-17 09:35:41 +08:00
lvyufeng 4724964e8a Revert "add value print for Parameter"
This reverts commit eff301e3e5.
2022-10-11 09:54:02 +08:00
i-robot 9351979564
!43300 [MD] support Python MP transforms in failover reset
Merge pull request !43300 from Mohammad Motallebi/reset_repeatability_python
2022-10-07 20:33:34 +00:00
mohammad 8c5a1cd772 [MD] fix repeatability with python MP + support in failover reset 2022-10-06 17:00:09 -04:00
i-robot dfcd89f1bf
!42593 add value print for Parameter
Merge pull request !42593 from 吕昱峰(Nate.River)/master
2022-10-04 13:25:55 +00:00
i-robot 9b6efdd903
!42986 [MD] Serialize Python UDFs - log a warning
Merge pull request !42986 from cathwong/ckw_serdes_pyfunc_warn
2022-09-29 20:31:41 +00:00
ccx f7c7da09cf RandomResizedCrop 2022-09-28 03:51:29 +08:00
i-robot 8257e6c4f7
!41900 [MD] Support repeatability when failover reset occurs
Merge pull request !41900 from Mohammad Motallebi/failover_randomness
2022-09-27 09:08:34 +00:00
Cathy Wong b9ac3f7b18 [MD] Serialize Python UDFs - log a warning 2022-09-26 22:48:12 -04:00
lvyufeng eff301e3e5 add value print for Parameter 2022-09-26 12:54:13 +08:00
jonyguo 0ae4a27bd8 fix: md asan error 2022-09-24 17:32:48 +08:00
i-robot 8fd7952b4b
!40774 [assistant][ops] Add new video operator HorizontalFlip
Merge pull request !40774 from Maeyon-Z/horizontalFlip_op
2022-09-24 07:51:50 +00:00
i-robot 2d3797a21a
!41027 [assistant][ops] Add new video operator VerticalFlip
Merge pull request !41027 from Maeyon-Z/verticalFlip_op
2022-09-24 06:45:04 +00:00
nefu-xiaobai 67b2034634 [feat] [assistant] [#I5EWHP] add new video operator VerticalFlip 2022-09-23 11:16:23 +08:00
nefu-xiaobai 0e0dcbfb3b [misc] [assistant] [#I5EWHP] modify the operator horizontalFlip 2022-09-23 10:58:06 +08:00
mhmotallebi 349126edd7 [MD] add repeatability for failover reset 2022-09-22 17:27:38 -04:00
i-robot d007a090ae
!42349 fix: generator dataset with multi-process use .skip error
Merge pull request !42349 from guozhijian/fix_generator_dataset_split
2022-09-20 10:58:23 +00:00
i-robot 243356fc4b
!42108 [MD] Fix some serdes bugs for Py UDFs, Py ops (w enum Inter & Border parms, fill_value). AutoTune scenarios impacted.
Merge pull request !42108 from cathwong/ckw_serdes_py_json_enum
2022-09-20 06:26:51 +00:00
jonyguo 489635fc84 fix: generator dataset with multi-process skip error 2022-09-19 20:53:29 +08:00
Cathy Wong 46d4608fe1 [MD] Fix some serdes bugs for Py UDFs, Py ops (w enum Inter & Border
parms, fill_value). AutoTune scenarios impacted.
2022-09-16 16:02:26 -04:00
David 5aa233878f Fixed batch type issue 2022-09-09 14:02:15 -04:00
luoyang 10a329d703 fix some validation and add some tips 2022-09-07 18:46:31 +08:00
i-robot 6fd2043884
!35430 [feat] [assistant] [I501QE] Add new operator Perspective
Merge pull request !35430 from EdisonLee/Perspective
2022-09-03 07:55:07 +00:00
jinzi 0091511fbc update operator Perspective 2022-09-02 15:12:55 +08:00
Xiao Tianci 3bc4288a75 fix TFReader coredump 2022-09-01 16:16:30 +08:00
lianlinghang 85de9687cb [feat][assistant][I4S2FN] add new data operator RandAugment 2022-08-31 09:43:04 +08:00
i-robot af4fba9d61
!40479 [feat] [assistant] [I501Q9] Add new operator Affine
Merge pull request !40479 from TBD1/Affine
2022-08-30 12:21:04 +00:00
i-robot 44317e86f1
!40572 [MD] Support processing bytes data in Dataset
Merge pull request !40572 from xiaotianci/support_bytes_data
2022-08-30 11:15:38 +00:00
jinzi f268721dc5 affine 2022-08-30 14:09:42 +08:00
David a18988c76f Fixed map test issue 2022-08-29 16:21:55 -04:00
YangLuo 87fd13c30d skip repeatability ut temporary and wait for fix 2022-08-27 16:34:46 +08:00
i-robot 45f24512f8
!30257 [assistant][ops] Add new video operator Normalize
Merge pull request !30257 from 杨旭华/Normalize
2022-08-27 07:18:14 +00:00
i-robot 451a39f9b4
!40847 [MD] Fixed Random Repeatability Issue (Cpp, Python MP)
Merge pull request !40847 from davidanugraha/map_batch_randomness
2022-08-27 00:56:46 +00:00
David daf348a5d1 Fix map and batch randomness 2022-08-26 13:35:26 -04:00