Package ai.vespa.llm.client.openai

Class OpenAiClient

java.lang.Object

ai.vespa.llm.client.openai.OpenAiClient

All Implemented Interfaces:

LanguageModel

public class OpenAiClient
extends Object
implements LanguageModel

A client to the OpenAI language model API. Refer to https://platform.openai.com/docs/api-reference/. Currently, only completions are implemented.

Author:

bratseth, lesters

Field Summary

Fields

Modifier and Type	Field	Description
static final String	OPTION_MAX_TOKENS
static final String	OPTION_MODEL
static final String	OPTION_TEMPERATURE

Constructor Summary

Constructors

Constructor	Description
OpenAiClient()

Method Summary

Modifier and Type	Method	Description
List<Completion>	complete(Prompt prompt, InferenceParameters options)
CompletableFuture<Completion.FinishReason>	completeAsync(Prompt prompt, InferenceParameters options, Consumer<Completion> consumer)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

OPTION_MODEL

public static final String OPTION_MODEL

See Also:

• Constant Field Values

OPTION_TEMPERATURE

public static final String OPTION_TEMPERATURE

See Also:

• Constant Field Values

OPTION_MAX_TOKENS

public static final String OPTION_MAX_TOKENS

See Also:

• Constant Field Values

Constructor Details

OpenAiClient

public OpenAiClient()

Method Details

complete

public List<Completion> complete(Prompt prompt,
 InferenceParameters options)

Specified by:

complete in interface LanguageModel

completeAsync

public CompletableFuture<Completion.FinishReason> completeAsync(Prompt prompt,
 InferenceParameters options,
 Consumer<Completion> consumer)

Specified by:

completeAsync in interface LanguageModel