Change Details

We deploy an embeddings inference service for Qwen3. This service will be used in semantic search mvp by the users who query in search bar. https://huggingface.co/Qwen/Qwen3-Embedding-0.6B - Non functional requirements: clarify with David Causse and Peter Fischer. - number of request per second. - query context lengths average, max, min - SLO - Api input/output parameters: Same as Openai standard. - Implementation. choose one of the followings: - sentence embeddings. - vllm (Clarify with Kevin and Dawid) - investigate more options. - Which gpus to occupy (Clarify with the team.) - Locust tests based on the requirements. - Iterate if locust tests are not successful.

We deploy an embeddings inference service for Qwen3. This service will be used in semantic search mvp by the users who query in search bar. https://huggingface.co/Qwen/Qwen3-Embedding-0.6B [ ] Non functional requirements: clarify with David Causse and Peter Fischer. - number of request per second. - query context lengths average, max, min - SLO [x] Api input/output parameters: Same as Openai standard. [ ] Implementation. choose one of the followings: - sentence embeddings. - vllm (Clarify with Kevin and Dawid) - investigate more options. [ ] Which gpus to occupy (Clarify with the team.) [ ] Locust tests based on the requirements. [ ] Iterate if locust tests are not successful.

We deploy an embeddings inference service for Qwen3. This service will be used in semantic search mvp by the users who query in search bar. https://huggingface.co/Qwen/Qwen3-Embedding-0.6B -[ ] Non functional requirements: clarify with David Causse and Peter Fischer. - number of request per second. - query context lengths average, max, min - SLO -[x] Api input/output parameters: Same as Openai standard. -[ ] Implementation. choose one of the followings: - sentence embeddings. - vllm (Clarify with Kevin and Dawid) - investigate more options. -[ ] Which gpus to occupy (Clarify with the team.) -[ ] Locust tests based on the requirements. -[ ] Iterate if locust tests are not successful.