Package ai.vespa.feed.client.impl

Class DynamicThrottler

java.lang.Object

ai.vespa.feed.client.impl.StaticThrottler

ai.vespa.feed.client.impl.DynamicThrottler

public class DynamicThrottler
extends StaticThrottler

Samples latency as a function of inflight requests, and regularly adjusts to the optimal value.

Author:

jonmv

Field Summary

Fields inherited from class ai.vespa.feed.client.impl.StaticThrottler

maxInflight, minInflight

Constructor Summary

Constructors

Constructor	Description
DynamicThrottler(FeedClientBuilderImpl builder)

Method Summary

Modifier and Type	Method	Description
void	sent(long __, CompletableFuture<ai.vespa.feed.client.HttpResponse> ___)
void	success()
long	targetInflight()

Methods inherited from class ai.vespa.feed.client.impl.StaticThrottler

throttled

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

DynamicThrottler

public DynamicThrottler(FeedClientBuilderImpl builder)

Method Details

sent

public void sent(long __,
 CompletableFuture<ai.vespa.feed.client.HttpResponse> ___)

Overrides:

sent in class StaticThrottler

success

public void success()

Overrides:

success in class StaticThrottler

targetInflight

public long targetInflight()

Overrides:

targetInflight in class StaticThrottler