一、flume的官方网站
https://flume.apache.org
二、下载flume
https://mirrors.tuna.tsinghua.edu.cn/apache/flume/1.9.0/apache-flume-1.9.0-bin.tar.gz
三、通过xftp工具传到linux的/root目录
四、解压
cd /root
tar zxvf apache-flume-1.9.0-bin.tar.gz
mv apache-flume-1.9.0-bin /usr/local/flume
五、配置
cd /usr/local/flume/conf
cp flume-conf.properties.template flume-conf.properties
cp flume-env.sh.template flume-env.sh
vim flume-env.sh
export JAVA_HOME=/usr
六、启动hadoop
/usr/local/hadoop3/sbin/start-all.sh
七、将nginx_memory_hdfs.properties文件放置在/usr/local目录下
八、将jar包复制到/usr/local/flume/lib目录下
find /usr/local/hadoop3/share/hadoop/ -name \*.jar | xargs -i cp {} /usr/local/flume/lib/
九、安装nginx
yum install -y nginx
启动nginx: nginx
十、启动flume
/usr/local/flume/bin/flume-ng agent -n a1 -c /usr/local/flume/conf -f /usr/local/nginx_memory_hdfs.properties -Dflume.root.logger=INFO,console
十一、查看HDFS是否有data/log目录
http://192.168.30.126:9870
版权归原作者 py8585 所有, 如有侵权,请联系我们删除。