Package ai.vespa.embedding.config
Class GgufEmbedderConfig.Builder
java.lang.Object
ai.vespa.embedding.config.GgufEmbedderConfig.Builder
- All Implemented Interfaces:
com.yahoo.config.ConfigBuilder,com.yahoo.config.ConfigInstance.Builder
- Enclosing class:
- GgufEmbedderConfig
public static final class GgufEmbedderConfig.Builder
extends Object
implements com.yahoo.config.ConfigInstance.Builder
-
Constructor Summary
Constructors -
Method Summary
Modifier and TypeMethodDescriptionbatchThreads(double __value) build()contextSize(int __value) continuousBatching(boolean __value) final booleandispatchGetConfig(com.yahoo.config.ConfigInstance.Producer producer) embeddingModel(com.yahoo.config.ModelReference __value) final booleanfinal Stringfinal Stringfinal StringgpuLayers(int __value) logicalMaxBatchSize(int __value) maxPromptTokens(int __value) normalize(boolean __value) parallel(int __value) physicalMaxBatchSize(int __value) prependDocument(String __value) prependQuery(String __value) seed(int __value) final voidsetApplyOnRestart(boolean applyOnRestart) threads(double __value)
-
Constructor Details
-
Builder
public Builder() -
Builder
-
-
Method Details
-
embeddingModel
-
gpuLayers
-
poolingType
-
physicalMaxBatchSize
-
logicalMaxBatchSize
-
continuousBatching
-
contextSize
-
maxPromptTokens
-
seed
-
parallel
-
threads
-
batchThreads
-
prependQuery
-
prependDocument
-
normalize
-
dispatchGetConfig
public final boolean dispatchGetConfig(com.yahoo.config.ConfigInstance.Producer producer) - Specified by:
dispatchGetConfigin interfacecom.yahoo.config.ConfigInstance.Builder
-
getDefMd5
- Specified by:
getDefMd5in interfacecom.yahoo.config.ConfigInstance.Builder
-
getDefName
- Specified by:
getDefNamein interfacecom.yahoo.config.ConfigInstance.Builder
-
getDefNamespace
- Specified by:
getDefNamespacein interfacecom.yahoo.config.ConfigInstance.Builder
-
getApplyOnRestart
public final boolean getApplyOnRestart()- Specified by:
getApplyOnRestartin interfacecom.yahoo.config.ConfigInstance.Builder
-
setApplyOnRestart
public final void setApplyOnRestart(boolean applyOnRestart) - Specified by:
setApplyOnRestartin interfacecom.yahoo.config.ConfigInstance.Builder
-
build
-