Package ai.vespa.llm

Class InferenceParameters

java.lang.Object

ai.vespa.llm.InferenceParameters

public class InferenceParameters
extends Object

Parameters for inference to language models. Parameters are typically supplied from searchers or processors and comes from query strings, headers, or other sources. Which parameters are available depends on the language model used. author lesters

Constructor Summary

Constructors

Constructor	Description
InferenceParameters(String apiKey, String endpoint, Function<String,String> options)
InferenceParameters(String apiKey, Function<String,String> options)
InferenceParameters(Function<String,String> options)

Method Summary

Modifier and Type	Method	Description
Optional<String>	get(String option)
Optional<String>	getApiKey()
Optional<Double>	getDouble(String option)
Optional<String>	getEndpoint()
Optional<Integer>	getInt(String option)
void	ifPresent(String option, Consumer<String> func)
void	setApiKey(String apiKey)
void	setEndpoint(String endpoint)
InferenceParameters	withDefaultOptions(Function<String,String> defaultOptions)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

InferenceParameters

public InferenceParameters(Function<String,String> options)

InferenceParameters

public InferenceParameters(String apiKey,
 Function<String,String> options)

InferenceParameters

public InferenceParameters(String apiKey,
 String endpoint,
 Function<String,String> options)

Method Details

setApiKey

public void setApiKey(String apiKey)

getApiKey

public Optional<String> getApiKey()

setEndpoint

public void setEndpoint(String endpoint)

getEndpoint

public Optional<String> getEndpoint()

get

public Optional<String> get(String option)

getDouble

public Optional<Double> getDouble(String option)

getInt

public Optional<Integer> getInt(String option)

ifPresent

public void ifPresent(String option,
 Consumer<String> func)

withDefaultOptions

public InferenceParameters withDefaultOptions(Function<String,String> defaultOptions)