使用flume收集日志到hbase，flume配置如下：
agent.sources = source1 agent.sinks = hbase1 agent.channels = channel1 agent.sources.source1.type = spooldir agent.sources.source1.spoolDir = f:/logs/backup agent.sources.source1.fileHeader = true agent.sources.source1.channels = channel1 agent.sinks.hbase1.channel = channel1 # Configure Hbase Sink hbase1 agent.sinks.hbase1.type = hbase agent.sinks.hbase1.batchSize = 5 agent.sinks.hbase1.table = log agent.sinks.hbase1.columnFamily = info agent.sinks.hbase1.serializer = org.apache.flume.sink.hbase.RegexHbaseEventSerializer agent.sinks.hbase1.serializer.regex = (.*?\\s.*?) (.*?) (.*?) (.*?) (.*?) (.*?) (.*?) (.*?) (.*?) (.*?) (.*?) agent.sinks.hbase1.serializer.colNames = log_time,project,module,level,mid,session_id,remote_ip,server_ip,location,message,debug_flag agent.sinks.hbase1.zookeeperQuorum = 192.168.1.203:2181,192.168.1.204:2181,192.168.1.205:2181 #agent.sinks.hbase1.znodeParent = /master # Use a channel which buffers events in memory agent.channels.channel1.type = memory agent.channels.channel1.capacity = 300 agent.channels.channel1.transactionCapacity = 300 agent.channels.channel1.keep-alive = 60
日志格式：
2017-03-10 14:24:45,539 项目名 Home INFO - u7qodevkvugv7u9dnon3pilgu4 127.0.0.1 127.0.0.1 Home\Controller\IndexController.testAmqp(D:\workspace_php\TestPHP\Application\Home\Controller\IndexController.class.php:37) 测试 123456
