Developer API

org.apache.spark.broadcast

Interface BroadcastFactory

All Known Implementing Classes:

HttpBroadcastFactory, TorrentBroadcastFactory

public interface BroadcastFactory

An interface for all the broadcast implementations in Spark (to allow multiple broadcast implementations). SparkContext uses a user-specified BroadcastFactory implementation to instantiate a particular broadcast for the entire Spark job.

Method Summary

Methods

Modifier and Type	Method and Description
void	initialize(boolean isDriver, SparkConf conf, org.apache.spark.SecurityManager securityMgr)
<T> Broadcast<T>	newBroadcast(T value, boolean isLocal, long id, scala.reflect.ClassTag<T> evidence$1) Creates a new broadcast variable.
void	stop()
void	unbroadcast(long id, boolean removeFromDriver, boolean blocking)

Method Detail

initialize

void initialize(boolean isDriver,
              SparkConf conf,
              org.apache.spark.SecurityManager securityMgr)

newBroadcast

<T> Broadcast<T> newBroadcast(T value,
                            boolean isLocal,
                            long id,
                            scala.reflect.ClassTag<T> evidence$1)

Creates a new broadcast variable.

Parameters:

value - value to broadcast

isLocal - whether we are in local mode (single JVM process)

id - unique id representing this broadcast variable

evidence$1 - (undocumented)

Returns:

(undocumented)

unbroadcast

void unbroadcast(long id,
               boolean removeFromDriver,
               boolean blocking)

stop

void stop()