Apache Camel AI: Inference via Model Serving #1: TorchServe

, by

Introduction In the just released Apache Camel 4.10 LTS, AI-related components have been further enhanced. Among others, three new components related to AI model serving have been added. 1 TorchServe component TensorFlow Serving component KServe component My previous article Apache Camel AI: Leverage power of AI with DJL component demonstrated how the DJL component can be used to perform AI model inference within the Camel routes. Starting from 4.10, in addition to the in-route inference by DJL, these new components will allow the Camel routes to invoke external model servers to perform inference.

Continue reading ❯

AI

Resolving LangChain4j AI services by name

, by

Introduction In a previous blog post related to Artificial Intelligence with Camel, we introduced the resolution of AI services by interface. This feature brings Camel and Quarkus LangChain4j closer than ever so that it takes less code to invoke a LangChain4j AI service from a route. In this blog post, we would like to introduce a related feature that should be released in the next Camel Quarkus version. This time, we’ll do the same kind of operation, except that we will resolve the bean by its name.

Continue reading ❯

AI

Camel 2024 in Numbers

, by

It’s the time of the year when we take a look back at 2024, and compile a brief summary (by numbers) of the Apache Camel project(s). You can find previous year 2023 numbers here. Camel 2024 in Numbers Number of Camel Core / Camel Spring Boot releases in 2024: 20 Number of Camel Quarkus releases in 2024: 16 Number of Camel Karavan releases in 2024: 5 Number of Camel K releases in 2024: 7

Continue reading ❯

ROADMAP