Class HuggingFaceTokenizerConfig.Builder
java.lang.Object
com.yahoo.language.huggingface.config.HuggingFaceTokenizerConfig.Builder
- All Implemented Interfaces:
com.yahoo.config.ConfigBuilder,com.yahoo.config.ConfigInstance.Builder
- Enclosing class:
- HuggingFaceTokenizerConfig
public static final class HuggingFaceTokenizerConfig.Builder
extends Object
implements com.yahoo.config.ConfigInstance.Builder
-
Field Summary
Fields -
Constructor Summary
Constructors -
Method Summary
Modifier and TypeMethodDescriptionaddSpecialTokens(boolean __value) build()final booleandispatchGetConfig(com.yahoo.config.ConfigInstance.Producer producer) final booleanfinal Stringfinal Stringfinal StringmaxLength(int __value) model(HuggingFaceTokenizerConfig.Model.Builder __builder) Add the given builder to this builder's list of Model buildersMake a new builder and run the supplied function on it before adding it to the listmodel(List<HuggingFaceTokenizerConfig.Model.Builder> __builders) Set the given list as this builder's list of Model buildersfinal voidsetApplyOnRestart(boolean applyOnRestart)
-
Field Details
-
model
-
-
Constructor Details
-
Builder
public Builder() -
Builder
-
-
Method Details
-
model
Add the given builder to this builder's list of Model builders- Parameters:
__builder- a builder- Returns:
- this builder
-
model
public HuggingFaceTokenizerConfig.Builder model(Consumer<HuggingFaceTokenizerConfig.Model.Builder> __func) Make a new builder and run the supplied function on it before adding it to the list- Parameters:
__func- lambda that modifies the given builder- Returns:
- this builder
-
model
public HuggingFaceTokenizerConfig.Builder model(List<HuggingFaceTokenizerConfig.Model.Builder> __builders) Set the given list as this builder's list of Model builders- Parameters:
__builders- a list of builders- Returns:
- this builder
-
addSpecialTokens
-
maxLength
-
truncation
public HuggingFaceTokenizerConfig.Builder truncation(HuggingFaceTokenizerConfig.Truncation.Enum __value) -
padding
-
dispatchGetConfig
public final boolean dispatchGetConfig(com.yahoo.config.ConfigInstance.Producer producer) - Specified by:
dispatchGetConfigin interfacecom.yahoo.config.ConfigInstance.Builder
-
getDefMd5
- Specified by:
getDefMd5in interfacecom.yahoo.config.ConfigInstance.Builder
-
getDefName
- Specified by:
getDefNamein interfacecom.yahoo.config.ConfigInstance.Builder
-
getDefNamespace
- Specified by:
getDefNamespacein interfacecom.yahoo.config.ConfigInstance.Builder
-
getApplyOnRestart
public final boolean getApplyOnRestart()- Specified by:
getApplyOnRestartin interfacecom.yahoo.config.ConfigInstance.Builder
-
setApplyOnRestart
public final void setApplyOnRestart(boolean applyOnRestart) - Specified by:
setApplyOnRestartin interfacecom.yahoo.config.ConfigInstance.Builder
-
build
-