Package ai.vespa.llm

Interface LanguageModel

All Known Implementing Classes:

MockLanguageModel, OpenAiClient

public interface LanguageModel

Interface to language models.

Author:

bratseth

Method Summary

Modifier and Type	Method	Description
List<Completion>	complete(Prompt prompt, InferenceParameters options)
CompletableFuture<Completion.FinishReason>	completeAsync(Prompt prompt, InferenceParameters options, Consumer<Completion> consumer)

Method Details

complete

List<Completion> complete(Prompt prompt,
 InferenceParameters options)

Throws:

RejectedExecutionException - – if the completion task cannot be scheduled for execution or timeouts

LanguageModelException - – if the completion task fails

completeAsync

CompletableFuture<Completion.FinishReason> completeAsync(Prompt prompt,
 InferenceParameters options,
 Consumer<Completion> consumer)