14 Commits

Author	SHA1	Message	Date
xuanyue	28c40b7b94	optimize arm-package size	2023-02-11 17:42:50 +08:00
yefeng	385ad6e354	add model parallel runner impl	2022-10-09 11:46:29 +08:00
yefeng	43d4d5d779	RunnerConfig add SetConfigPath api: C++ && python && java	2022-09-21 10:39:00 +08:00
zhaizhiqiang	47bf45d4d8	refine the delegate api	2022-09-06 12:24:39 +08:00
luoyuan	555f418bdf	[MS][API]code docs fix cxx api	2022-08-25 14:42:04 +08:00
yefeng	d2df86331d	model parallel runner add new api: init by buf	2022-08-02 15:56:49 +08:00
sunsuodong	698f8ca3a3	api_string_abi	2022-07-23 03:12:16 -07:00
yefeng	a336e2b6b6	add config info for python api	2022-06-22 12:31:15 +08:00
yefeng	eb05387052	add ConfigInfo for C++ api	2022-05-10 13:58:26 +08:00
yefeng	dfa0a9886a	parallel predict api	2022-05-07 12:21:35 +08:00
yefeng	63f1786356	parallel predict support GPU && one Runner bind one model pool	2022-03-14 10:22:25 +08:00
yefeng	4b06963e1f	parall predict remove param	2022-03-02 09:43:18 +08:00
yefeng	58756a44f9	parallel predict support numa	2022-03-01 12:29:41 +08:00
yefeng	c301bf16a2	copy from 1.6	2022-02-23 20:32:29 +08:00