现在的位置: 首页 > 综合 > 正文

Flume 学习笔记(1) 单节点安装与简单实用

2018年04月09日 ⁄ 综合 ⁄ 共 1246字 ⁄ 字号 评论关闭

1.下载flume的tar包并解压

https://ccp.cloudera.com/display/SUPPORT/CDH3+Downloadable+Tarballs

2.配置FLUME_HOME和FLUME_CONF_DIR变量

vim /etc/profile.d/cluster.sh
export FLUME_HOME=/home/eryk/soft/flume
export FLUME_CONF_DIR=/home/eryk/data/flume/conf
export PATH=$FLUME_HOME/bin:$PATH

使变量生效

source /etc/profile.d/cluster.sh

输入flume,返回如下结果:

eryk@eryk-Inspiron-1520:~$ flume
usage: flume command [args...]
commands include: 
  dump            Takes a specified source and dumps to console
  source          Takes a specified source and dumps to console
  node            Start a Flume node/agent (with watchdog)
  master          Start a Flume Master server (with watchdog)
  version         Dump flume build version information 
  node_nowatch    Start a flume node/agent (no watchdog)
  master_nowatch  Start a Flume Master server (no watchdog)
  class <class>   Run specified fully qualified class using Flume environment (no watchdog)
                   ex: flume com.cloudera.flume.agent.FlumeNode 
  classpath       Dump the classpath used by the java executables
  shell           Start the flume shell
  killmaster      Kill a running master
  dumplog         Takes a specified WAL/DFO log file and dumps to console
  sink            Start a one-shot flume node with console source and specified sink

3."hello flume"

flume dump console

这样就启动了一个从命令行接收数据的flume node,运行时生成的文件在/tmp/flume下(通过flume.agent.logdir参数修改文件路径),请确认当前用户对/tmp目录有操作权限。启动完成后,在当前命令行输入“hello flume”,返回如下结果:

hello flume
eryk-Inspiron-1520 [INFO Sun Apr 22 20:18:15 CST 2012] hello flume

抱歉!评论已关闭.