当前位置: 移动技术网 > 网络运营>服务器>虚拟主机 > Docker容器中运行flume及启动不输出运行日志问题

Docker容器中运行flume及启动不输出运行日志问题

2019年04月18日  | 移动技术网网络运营  | 我要评论
flume配置文件如下: # name the components on this agent app1.sources = r1 app1.sinks

flume配置文件如下:

# name the components on this agent 
app1.sources = r1 
app1.sinks = k1 
app1.channels = c1 
# describe/configure the source 
app1.sources.r1.type = avro 
app1.sources.r1.bind = 0.0.0.0 
app1.sources.r1.port = 44444 
# describe the sink 
#a1.sinks.k1.type = logger 
app1.sinks.k1.type = file_roll 
app1.sinks.k1.sink.directory = /var/log/my/app1 
app1.sinks.k1.sink.rollinterval=86400 
app1.sinks.k1.sink.batchsize=100 
app1.sinks.k1.sink.serializer=text 
app1.sinks.k1.sink.serializer.appendnewline = false 
# use a channel which buffers events in memory 
app1.channels.c1.type = memory 
app1.channels.c1.capacity = 1000 
app1.channels.c1.transactioncapacity = 100 
app1.channels.c1.bytecapacity = 100000000 
app1.channels.c1.bytecapacitybufferpercentage = 10 
# bind the source and sink to the channel 
app1.sources.r1.channels = c1 
app1.sinks.k1.channel = c1 
# name the components on this agent 
app2.sources = r2 
app2.sinks = k2 
app2.channels = c2 
# describe/configure the source 
app2.sources.r2.type = avro 
app2.sources.r2.bind = 0.0.0.0 
app2.sources.r2.port = 44445 
# describe the sink 
#a1.sinks.k1.type = logger 
app2.sinks.k2.type = file_roll 
app2.sinks.k2.sink.directory = /var/log/my/app2 
app2.sinks.k2.sink.rollinterval=86400 
app2.sinks.k2.sink.batchsize=100 
app2.sinks.k2.sink.serializer=text 
app2.sinks.k2.sink.serializer.appendnewline = false 
# use a channel which buffers events in memory 
app2.channels.c2.type = memory 
app2.channels.c2.capacity = 1000 
app2.channels.c2.transactioncapacity = 100 
app2.channels.c2.bytecapacity = 100000000 
app2.channels.c2.bytecapacitybufferpercentage = 10 
# bind the source and sink to the channel 
app2.sources.r2.channels = c2 
app2.sinks.k2.channel = c2 

dockerfile如下:

from ubuntu:16.04 
maintainer xxx "xxx@xxxxx.com" 
run apt-get update 
add jdk-8u77-linux-x64.tar.gz /usr/local/java 
run cp /etc/profile /etc/profile.bak 
env java_home /usr/local/java/jdk1.8.0_77 
env path $java_home/bin:$path 
env classpath .:$java_home/lib 
add apache-flume-1.7.0-bin.tar.gz /usr/local/flume 
run apt-get install -y tzdata 
run ln -sf /usr/share/zoneinfo/asia/shanghai /etc/localtime 
run echo "asia/shanghai" > /etc/timezone 
run dpkg-reconfigure -f noninteractive tzdata 
env lang c.utf-8 
workdir /var/log 
run mkdir my 
workdir /var/log/my 
run mkdir app1 
run mkdir app2 
expose 44444 
expose 44445 
entrypoint (/usr/local/flume/apache-flume-1.7.0-bin/bin/flume-ng agent --conf /usr/local/flume/apache-flume-1.7.0-bin/conf -conf-file /usr/local/flume/apache-flume-1.7.0-bin/conf/flume-conf.properties --name app1 &) && (/usr/local/flume/apache-flume-1.7.0-bin/bin/flume-ng agent --conf /usr/local/flume/apache-flume-1.7.0-bin/conf -conf-file /usr/local/flume/apache-flume-1.7.0-bin/conf/flume-conf.properties --name app2 &) && /bin/bash 

下面看下flume 启动不输出运行日志

问题

以前碰到的一个问题,算是一个小问题,flume 用命令

./flume-ng agent -c /opt/apps/flume/conf -f /opt/apps/flume/conf/syslog_tcp.conf -n a1 -dflume.root.logger=info,console

启动的时候,flume使用的log4j不起效,不会输出日志到日志文件。

解决

在启动时去掉

-dflume.root.logger=info,console

这个命令就好了。flume的log4j就正常工作了。也算是一个坑。

加上这个命令会将运行的日志在控制台输出。

总结

以上所述是小编给大家介绍的 docker容器中运行flume及启动不输出运行日志问题,希望对大家有所帮助

如您对本文有疑问或者有任何想说的,请点击进行留言回复,万千网友为您解惑!

相关文章:

验证码:
移动技术网