|
Infinispan Distribution 5.2.6.Final-redhat-2 | |||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Objectorg.infinispan.distexec.mapreduce.MapReduceManagerImpl
public class MapReduceManagerImpl
Default implementation of MapReduceManager
.
This is an internal class, not intended to be used by clients.
Nested Class Summary | |
---|---|
static class |
MapReduceManagerImpl.IntermediateCompositeKey<V>
IntermediateCompositeKey |
Method Summary | ||
---|---|---|
protected
|
combine(MapCombineCommand<KIn,VIn,KOut,VOut> mcc,
org.infinispan.distexec.mapreduce.MapReduceManagerImpl.CollectableCollector<KOut,VOut> collector)
|
|
protected
|
filterLocalPrimaryOwner(Set<KIn> nodeLocalKeys,
DistributionManager dm)
|
|
ExecutorService |
getExecutorService()
ExecutorService provided for local task execution |
|
void |
init(EmbeddedCacheManager cacheManager,
CacheLoaderManager cacheLoaderManager,
ExecutorService asyncTransportExecutor)
|
|
protected
|
loadAllKeysFromCacheLoaderUsingFilter(Set<KIn> filterOutSet)
|
|
protected
|
loadValueFromCacheLoader(KIn key)
|
|
protected
|
map(MapCombineCommand<KIn,VIn,KOut,VOut> mcc)
|
|
|
mapAndCombineForDistributedReduction(MapCombineCommand<KIn,VIn,KOut,VOut> mcc)
Invoked when MapCombineCommand arrives to a target Infinispan node and returns set of intermediate keys that needs to be reduced. |
|
|
mapAndCombineForLocalReduction(MapCombineCommand<KIn,VIn,KOut,VOut> mcc)
Invoked when MapCombineCommand arrives to a target Infinispan node and returns map of resulting values that need to be reduced. |
|
|
mapKeysToNodes(DistributionManager dm,
String taskId,
Collection<T> keysToMap,
boolean useIntermediateCompositeKey)
Maps Map/Reduce task intermediate or input keys to nodes on Infinispan cluster |
|
|
reduce(ReduceCommand<KOut,VOut> reduceCommand)
Invoked when ReduceCommand arrives to a target Infinispan node. |
|
protected CacheLoader |
resolveCacheLoader()
|
Methods inherited from class java.lang.Object |
---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Method Detail |
---|
public void init(EmbeddedCacheManager cacheManager, CacheLoaderManager cacheLoaderManager, ExecutorService asyncTransportExecutor)
public ExecutorService getExecutorService()
MapReduceManager
getExecutorService
in interface MapReduceManager
ExecutorService
for local taskspublic <KIn,VIn,KOut,VOut> Map<KOut,List<VOut>> mapAndCombineForLocalReduction(MapCombineCommand<KIn,VIn,KOut,VOut> mcc) throws InterruptedException
MapReduceManager
Unlike
MapReduceManager.mapAndCombineForDistributedReduction(MapCombineCommand)
implementations should return a map Map
mapAndCombineForLocalReduction
in interface MapReduceManager
mcc
- MapCombineCommand sent from MapReduceTask
InterruptedException
public <KIn,VIn,KOut,VOut> Set<KOut> mapAndCombineForDistributedReduction(MapCombineCommand<KIn,VIn,KOut,VOut> mcc) throws InterruptedException
MapReduceManager
mapAndCombineForDistributedReduction
in interface MapReduceManager
mcc
- MapCombineCommand sent from MapReduceTask
InterruptedException
public <KOut,VOut> Map<KOut,VOut> reduce(ReduceCommand<KOut,VOut> reduceCommand) throws InterruptedException
MapReduceManager
reduce
in interface MapReduceManager
reduceCommand
- ReduceCommand sent from MapReduceTask
InterruptedException
protected <KIn,VIn,KOut,VOut> org.infinispan.distexec.mapreduce.MapReduceManagerImpl.CollectableCollector<KOut,VOut> map(MapCombineCommand<KIn,VIn,KOut,VOut> mcc) throws InterruptedException
InterruptedException
protected <KIn,VIn,KOut,VOut> Set<KOut> combine(MapCombineCommand<KIn,VIn,KOut,VOut> mcc, org.infinispan.distexec.mapreduce.MapReduceManagerImpl.CollectableCollector<KOut,VOut> collector) throws Exception
Exception
protected <KIn> Set<KIn> loadAllKeysFromCacheLoaderUsingFilter(Set<KIn> filterOutSet)
protected <KIn,KOut> KOut loadValueFromCacheLoader(KIn key)
protected CacheLoader resolveCacheLoader()
public <T> Map<Address,List<T>> mapKeysToNodes(DistributionManager dm, String taskId, Collection<T> keysToMap, boolean useIntermediateCompositeKey)
MapReduceManager
mapKeysToNodes
in interface MapReduceManager
dm
- distribution manager to use for locating keys on hash wheeltaskId
- id of the map/reduce taskkeysToMap
- list of input keys to locate in the clusteruseIntermediateCompositeKey
- if true use composite keys for shared intermediate cache
protected <KIn> Set<KIn> filterLocalPrimaryOwner(Set<KIn> nodeLocalKeys, DistributionManager dm)
|
Infinispan Distribution 5.2.6.Final-redhat-2 | |||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |