翔子 发表于 2015-1-22 10:26:54

Flume内置channel,source,sink汇总

由于经常会使用到Flume的一些channel,source,sink,于是为了方便将这些channel,source,sink汇总出来。

Component InterfaceType AliasImplementation Class
OAF.ChannelmemoryOAF.channel.MemoryChannel
OAF.ChanneljdbcOAF.channel.jdbc.JdbcChannel
OAF.ChannelfileOAF.channel.file.FileChannel
OAF.Channel–OAF.channel.PseudoTxnMemoryChannel
OAF.Channel–org.example.MyChannel
OAF.SourceavroOAF.source.AvroSource
OAF.SourcenetcatOAF.source.NetcatSource
OAF.SourceseqOAF.source.SequenceGeneratorSource
OAF.SourceexecOAF.source.ExecSource
OAF.SourcesyslogtcpOAF.source.SyslogTcpSource
OAF.Sourcemultiport_syslogtcpOAF.source.MultiportSyslogTCPSource
OAF.SourcesyslogudpOAF.source.SyslogUDPSource
OAF.SourcespooldirOAF.source.SpoolDirectorySource
OAF.SourcehttpOAF.source.http.HTTPSource
OAF.SourcethriftOAF.source.ThriftSource
OAF.SourcejmsOAF.source.jms.JMSSource
OAF.Source–OAF.source.avroLegacy.AvroLegacySource
OAF.Source–OAF.source.thriftLegacy.ThriftLegacySource
OAF.Source–org.example.MySource
OAF.SinknullOAF.sink.NullSink
OAF.SinkloggerOAF.sink.LoggerSink
OAF.SinkavroOAF.sink.AvroSink
OAF.SinkhdfsOAF.sink.hdfs.HDFSEventSink
OAF.SinkhbaseOAF.sink.hbase.HBaseSink
OAF.SinkasynchbaseOAF.sink.hbase.AsyncHBaseSink
OAF.SinkelasticsearchOAF.sink.elasticsearch.ElasticSearchSink
OAF.Sinkfile_rollOAF.sink.RollingFileSink
OAF.SinkircOAF.sink.irc.IRCSink
OAF.SinkthriftOAF.sink.ThriftSink
OAF.Sink–org.example.MySink
OAF.ChannelSelectorreplicatingOAF.channel.ReplicatingChannelSelector
OAF.ChannelSelectormultiplexingOAF.channel.MultiplexingChannelSelector
OAF.ChannelSelector–org.example.MyChannelSelector
OAF.SinkProcessordefaultOAF.sink.DefaultSinkProcessor
OAF.SinkProcessorfailoverOAF.sink.FailoverSinkProcessor
OAF.SinkProcessorload_balanceOAF.sink.LoadBalancingSinkProcessor
OAF.SinkProcessor–
OAF.interceptor.InterceptortimestampOAF.interceptor.TimestampInterceptor$Builder
OAF.interceptor.InterceptorhostOAF.interceptor.HostInterceptor$Builder
OAF.interceptor.InterceptorstaticOAF.interceptor.StaticInterceptor$Builder
OAF.interceptor.Interceptorregex_filterOAF.interceptor.RegexFilteringInterceptor$Builder
OAF.interceptor.Interceptorregex_extractorOAF.interceptor.RegexFilteringInterceptor$Builder
OAF.channel.file.encryption.
KeyProvider$BuilderjceksfileOAF.channel.file.encryption.JCEFileKeyProvider
OAF.channel.file.encryption.
KeyProvider$Builder–org.example.MyKeyProvider
OAF.channel.file.encryption.CipherProvideraesctrnopaddingOAF.channel.file.encryption.AESCTRNoPaddingProvider
OAF.channel.file.encryption.CipherProvider–org.example.MyCipherProvider
OAF.serialization.EventSerializer$BuildertextOAF.serialization.BodyTextEventSerializer$Builder
OAF.serialization.EventSerializer$Builderavro_eventOAF.serialization.FlumeEventAvroEventSerializer$Builder
OAF.serialization.EventSerializer$Builder–org.example.MyEventSerializer$Builder

由于表格太大了,所以这里将org.apache.flume.替换为OAF.,读者在阅读的时候,直接将OAF.理解成org.apache.flume.即可!


Sinks
accumulator
agentBEChain
agentBESink
agentBestEffortSink
agentDFOChain
agentDFOSink
agentE2EChain
agentE2ESink
agentFailoverSink
agentSink
attr2hbase
autoBEChain
autoDFOChain
autoE2EChain
avroSink
collectorSink
console
counter
counterHistory
customdfs
dfs
escapedCustomDfs
escapedFormatDfs
fail
failChain
flightbookinghbase
flightsearchhbase
formatDfs
ganglia
hbase
irc
logicalSink
multigrep
multigrepspec
null
regexhisto
regexhistospec
rpcSink
seqfile
syslogTcp
text
thriftSink

Sources
asciisynth
autoCollectorSource
avroSource
collectorSource
console
exec
execPeriodic
execStream
fail
irc
log4jfile
logicalSource
multitail
nonlsynth
null
report
rpcSource
scribe
seqfile
stdin
synth
synthrndsize
syslogTcp
syslogTcp1
syslogUdp
tail
tailDir
text
thriftSource
tpriosource
twitter

Decorators
AccessIpFormatFilter
AmendAccessLogNew
AmendNginxErrorLog
ApacheFilter
CatalinaFormat
CatalinaLogExceptionFilter2
CatalinaLogExceptionFilter3
CatalinaLogFilter2
CatalinaLogFilter3
FieldEqValueFilter
Filter
FormatAccessLog
FormatDate
LogExceptionFilter
LogFilter
PhpFilter
ackChecker
ackInjector
ackedWriteAhead
amendAccessLog
batch
benchinject
benchreport
bloomCheck
bloomGen
choke
delay
digest
diskFailover
exDate
flakeyAppend
format
gunzip
gzip
inmem
insertBefore
insistentAppend
insistentOpen
intervalDroppyAppend
intervalFlakeyAppend
intervalSampler
lazyOpen
mask
mult
nullDeco
probSampler
regex
regexAll
reservoirSampler
select
split
splitCompare
stubbornAppend
unbatch
value




页: [1]
查看完整版本: Flume内置channel,source,sink汇总