LocalAI/backend
fakezeta c9451cb604
Bump oneapi-basekit, optimum and openvino (#2139)
* Bump oneapi-basekit, optimum and openvino

* Changed PERFORMANCE HINT to CUMULATIVE_THROUGHPUT

Minor latency change for first token but about 10-15% speedup on token generation.
2024-04-26 16:20:43 +02:00
..
cpp feat(grpc): return consumed token count and update response accordingly (#2035) 2024-04-15 19:47:11 +02:00
go fix: security scanner dislikes `runCommand` function arguments (#2140) 2024-04-26 10:33:12 +02:00
python Bump oneapi-basekit, optimum and openvino (#2139) 2024-04-26 16:20:43 +02:00
backend.proto feat(rerankers): Add new backend, support jina rerankers API (#2121) 2024-04-25 00:19:02 +02:00