4 Commits

Author	SHA1	Message	Date
yefeng	63f1786356	parallel predict support GPU && one Runner bind one model pool	2022-03-14 10:22:25 +08:00
yefeng	4b06963e1f	parall predict remove param	2022-03-02 09:43:18 +08:00
yefeng	58756a44f9	parallel predict support numa	2022-03-01 12:29:41 +08:00
yefeng	c301bf16a2	copy from 1.6	2022-02-23 20:32:29 +08:00