public static class HdfsState.HdfsFileOptions extends HdfsState.Options
| Modifier and Type | Field and Description |
|---|---|
protected RecordFormat |
format |
configKey, fileNameFormat, fs, fsUrl, hdfsConfig, rotation, rotationActions, rotationPolicy| Constructor and Description |
|---|
HdfsFileOptions() |
| Modifier and Type | Method and Description |
|---|---|
HdfsState.HdfsFileOptions |
addRotationAction(RotationAction action)
Deprecated.
|
void |
doCommit(Long txId) |
void |
execute(List<TridentTuple> tuples) |
long |
getCurrentOffset() |
HdfsState.HdfsFileOptions |
withBufferSize(int sizeInBytes)
Set the size of the buffer used for hdfs file copy in case of recovery.
|
HdfsState.HdfsFileOptions |
withConfigKey(String configKey) |
HdfsState.HdfsFileOptions |
withFileNameFormat(FileNameFormat fileNameFormat) |
HdfsState.HdfsFileOptions |
withFsUrl(String fsUrl) |
HdfsState.HdfsFileOptions |
withRecordFormat(RecordFormat format) |
HdfsState.HdfsFileOptions |
withRotationPolicy(FileRotationPolicy rotationPolicy) |
rotateOutputFile, rotateOutputFileprotected RecordFormat format
public HdfsState.HdfsFileOptions withFsUrl(String fsUrl)
public HdfsState.HdfsFileOptions withConfigKey(String configKey)
public HdfsState.HdfsFileOptions withFileNameFormat(FileNameFormat fileNameFormat)
public HdfsState.HdfsFileOptions withRecordFormat(RecordFormat format)
public HdfsState.HdfsFileOptions withRotationPolicy(FileRotationPolicy rotationPolicy)
public HdfsState.HdfsFileOptions withBufferSize(int sizeInBytes)
Set the size of the buffer used for hdfs file copy in case of recovery. The default value is 131072.
Note: The lower limit for the parameter is 4096, below which the option is ignored.
sizeInBytes - the buffer size in bytesHdfsState.HdfsFileOptions@Deprecated public HdfsState.HdfsFileOptions addRotationAction(RotationAction action)
public long getCurrentOffset()
public void doCommit(Long txId) throws IOException
IOExceptionpublic void execute(List<TridentTuple> tuples) throws IOException
IOExceptionCopyright © 2021 The Apache Software Foundation. All rights reserved.