Package org.apache.bookkeeper.common.util

Class OrderedExecutor

java.lang.Object

org.apache.bookkeeper.common.util.OrderedExecutor

All Implemented Interfaces:

Executor, ExecutorService

Direct Known Subclasses:

OrderedScheduler

public class OrderedExecutor
extends Object
implements ExecutorService

This class supports submitting tasks with an ordering key, so that tasks submitted with the same key will always be executed in order, but tasks across different keys can be unordered. This retains parallelism while retaining the basic amount of ordering we want (e.g. , per ledger handle). Ordering is achieved by hashing the key objects to threads by their Object.hashCode() method.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	OrderedExecutor.AbstractBuilder<T extends OrderedExecutor>	Abstract builder class to build OrderedScheduler.
static class	OrderedExecutor.Builder	A builder class for an OrderedExecutor.
(package private) static class	OrderedExecutor.ContextPreservingCallable<T>	Decorator class for a callable that preserves MDC context.
(package private) static class	OrderedExecutor.ContextPreservingRunnable	Decorator class for a runnable that preserves MDC context.
protected class	OrderedExecutor.TimedCallable<T>	Decorator class for a callable that measure the execution time.
protected class	OrderedExecutor.TimedRunnable	Decorator class for a runnable that measure the execution time.

Field Summary

Fields

Modifier and Type	Field	Description
(package private) final boolean	enableBusyWait
(package private) final boolean	enableThreadScopedMetrics
(package private) final int	maxTasksInQueue
(package private) final String	name
static final int	NO_TASK_LIMIT
(package private) final boolean	preserveMdcForTaskExecution
(package private) final Random	rand
(package private) final OpStatsLogger	taskExecutionStats
(package private) final OpStatsLogger	taskPendingStats
(package private) final long[]	threadIds
(package private) final ExecutorService[]	threads
(package private) final boolean	traceTaskExecution
protected static final long	WARN_TIME_MICRO_SEC_DEFAULT
(package private) final long	warnTimeMicroSec

Constructor Summary

Constructors

Modifier	Constructor	Description
protected	OrderedExecutor(String baseName, int numThreads, ThreadFactory threadFactory, StatsLogger statsLogger, boolean traceTaskExecution, boolean preserveMdcForTaskExecution, long warnTimeMicroSec, int maxTasksInQueue, boolean enableBusyWait, boolean enableThreadScopedMetrics)	Constructs Safe executor.

Method Summary

Modifier and Type	Method	Description
protected ExecutorService	addExecutorDecorators(ExecutorService executor)
boolean	awaitTermination(long timeout, TimeUnit unit)
ExecutorService	chooseThread()
ExecutorService	chooseThread(long orderingKey)	skip hashcode generation in this special case.
ExecutorService	chooseThread(Object orderingKey)
protected static int	chooseThreadIdx(long orderingKey, int numThreads)
protected ExecutorService	createSingleThreadExecutor(ThreadFactory factory)
void	execute(Runnable command)
void	executeOrdered(int orderingKey, Runnable r)	Schedules a one time action to execute with an ordering guarantee on the key.
void	executeOrdered(long orderingKey, Runnable r)	Schedules a one time action to execute with an ordering guarantee on the key.
void	executeOrdered(Object orderingKey, Runnable r)	Schedules a one time action to execute with an ordering guarantee on the key.
void	forceShutdown(long timeout, TimeUnit unit)	Force threads shutdown (cancel active requests) after specified delay, to be used after shutdown() rejects new requests.
protected ExecutorService	getBoundedExecutor(ExecutorService executor)
long	getThreadID(long orderingKey)
<T> List<Future<T>>	invokeAll(Collection<? extends Callable<T>> tasks)
<T> List<Future<T>>	invokeAll(Collection<? extends Callable<T>> tasks, long timeout, TimeUnit unit)
<T> T	invokeAny(Collection<? extends Callable<T>> tasks)
<T> T	invokeAny(Collection<? extends Callable<T>> tasks, long timeout, TimeUnit unit)
boolean	isShutdown()
boolean	isTerminated()
static OrderedExecutor.Builder	newBuilder()
boolean	preserveMdc()	Flag describing executor's expectation in regards of MDC.
void	shutdown()
List<Runnable>	shutdownNow()
Future<?>	submit(Runnable task)
<T> Future<T>	submit(Runnable task, T result)
<T> Future<T>	submit(Callable<T> task)
<T> com.google.common.util.concurrent.ListenableFuture<T>	submitOrdered(long orderingKey, Callable<T> task)
protected <T> Callable<T>	timedCallable(Callable<T> c)
protected <T> Collection<? extends Callable<T>>	timedCallables(Collection<? extends Callable<T>> tasks)
protected Runnable	timedRunnable(Runnable r)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

NO_TASK_LIMIT

public static final int NO_TASK_LIMIT

See Also:

• Constant Field Values

WARN_TIME_MICRO_SEC_DEFAULT

protected static final long WARN_TIME_MICRO_SEC_DEFAULT

name

final String name

threads

final ExecutorService[] threads

threadIds

final long[] threadIds

rand

final Random rand

taskExecutionStats

final OpStatsLogger taskExecutionStats

taskPendingStats

final OpStatsLogger taskPendingStats

traceTaskExecution

final boolean traceTaskExecution

preserveMdcForTaskExecution

final boolean preserveMdcForTaskExecution

warnTimeMicroSec

final long warnTimeMicroSec

maxTasksInQueue

final int maxTasksInQueue

enableBusyWait

final boolean enableBusyWait

enableThreadScopedMetrics

final boolean enableThreadScopedMetrics

Constructor Details

OrderedExecutor

protected OrderedExecutor(String baseName,
 int numThreads,
 ThreadFactory threadFactory,
 StatsLogger statsLogger,
 boolean traceTaskExecution,
 boolean preserveMdcForTaskExecution,
 long warnTimeMicroSec,
 int maxTasksInQueue,
 boolean enableBusyWait,
 boolean enableThreadScopedMetrics)

Constructs Safe executor.

Parameters:

numThreads - - number of threads

baseName - - base name of executor threads

threadFactory - - for constructing threads

statsLogger - - for reporting executor stats

traceTaskExecution - - should we stat task execution

preserveMdcForTaskExecution - - should we preserve MDC for task execution

warnTimeMicroSec - - log long task exec warning after this interval

maxTasksInQueue - - maximum items allowed in a thread queue. -1 for no limit

Method Details

newBuilder

public static OrderedExecutor.Builder newBuilder()

createSingleThreadExecutor

protected ExecutorService createSingleThreadExecutor(ThreadFactory factory)

getBoundedExecutor

protected ExecutorService getBoundedExecutor(ExecutorService executor)

addExecutorDecorators

protected ExecutorService addExecutorDecorators(ExecutorService executor)

preserveMdc

public boolean preserveMdc()

Flag describing executor's expectation in regards of MDC. All tasks submitted through executor's submit/execute methods will automatically respect this.

Returns:

true if runnable/callable is expected to preserve MDC, false otherwise.

executeOrdered

public void executeOrdered(Object orderingKey,
 Runnable r)

Schedules a one time action to execute with an ordering guarantee on the key.

Parameters:

orderingKey -

r -

executeOrdered

public void executeOrdered(long orderingKey,
 Runnable r)

Schedules a one time action to execute with an ordering guarantee on the key.

Parameters:

orderingKey -

r -

executeOrdered

public void executeOrdered(int orderingKey,
 Runnable r)

Schedules a one time action to execute with an ordering guarantee on the key.

Parameters:

orderingKey -

r -

submitOrdered

public <T>
com.google.common.util.concurrent.ListenableFuture<T> submitOrdered(long orderingKey,
 Callable<T> task)

getThreadID

public long getThreadID(long orderingKey)

chooseThread

public ExecutorService chooseThread()

chooseThread

public ExecutorService chooseThread(Object orderingKey)

chooseThread

public ExecutorService chooseThread(long orderingKey)

skip hashcode generation in this special case.

Parameters:

orderingKey - long ordering key

Returns:

the thread for executing this order key

chooseThreadIdx

protected static int chooseThreadIdx(long orderingKey,
 int numThreads)

timedRunnable

protected Runnable timedRunnable(Runnable r)

timedCallable

protected <T> Callable<T> timedCallable(Callable<T> c)

timedCallables

protected <T> Collection<? extends Callable<T>> timedCallables(Collection<? extends Callable<T>> tasks)

submit

public <T> Future<T> submit(Callable<T> task)

Specified by:

submit in interface ExecutorService

submit

public <T> Future<T> submit(Runnable task,
 T result)

Specified by:

submit in interface ExecutorService

submit

public Future<?> submit(Runnable task)

Specified by:

submit in interface ExecutorService

invokeAll

public <T> List<Future<T>> invokeAll(Collection<? extends Callable<T>> tasks)
                              throws InterruptedException

Specified by:

invokeAll in interface ExecutorService

Throws:

InterruptedException

invokeAll

public <T> List<Future<T>> invokeAll(Collection<? extends Callable<T>> tasks,
 long timeout,
 TimeUnit unit)
                              throws InterruptedException

Specified by:

invokeAll in interface ExecutorService

Throws:

InterruptedException

invokeAny

public <T> T invokeAny(Collection<? extends Callable<T>> tasks)
                throws InterruptedException,
ExecutionException

Specified by:

invokeAny in interface ExecutorService

Throws:

InterruptedException

ExecutionException

invokeAny

public <T> T invokeAny(Collection<? extends Callable<T>> tasks,
 long timeout,
 TimeUnit unit)
                throws InterruptedException,
ExecutionException,
TimeoutException

Specified by:

invokeAny in interface ExecutorService

Throws:

InterruptedException

ExecutionException

TimeoutException

execute

public void execute(Runnable command)

Specified by:

execute in interface Executor

shutdown

public void shutdown()

Specified by:

shutdown in interface ExecutorService

shutdownNow

public List<Runnable> shutdownNow()

Specified by:

shutdownNow in interface ExecutorService

isShutdown

public boolean isShutdown()

Specified by:

isShutdown in interface ExecutorService

awaitTermination

public boolean awaitTermination(long timeout,
 TimeUnit unit)
                         throws InterruptedException

Specified by:

awaitTermination in interface ExecutorService

Throws:

InterruptedException

isTerminated

public boolean isTerminated()

Specified by:

isTerminated in interface ExecutorService

forceShutdown

public void forceShutdown(long timeout,
 TimeUnit unit)

Force threads shutdown (cancel active requests) after specified delay, to be used after shutdown() rejects new requests.