This is a how to on installing the Cloudera Flume project from tarball and Ubuntu package


Installing Flume from tarball



  • sudo mkdir /var/log/flume

  • cd /usr/local

  • sudo wget http://archive.cloudera.com/cdh/3/flume-0.9.3-cdh3u0.tar.gz

  • sudo tar -xzvf flume-0.9.3-cdh3u0.tar.gz

  • sudo ln -s flume-0.9.3-cdh3u0 flume

  • cd /usr/local/flume




TO START THE MASTER


export FLUME_CONF_DIR=/usr/local/flume/conf; export FLUME_HOME=/usr/local/flume; sudo -E bin/flume-daemon.sh start master



TO START THE NODE


export FLUME_CONF_DIR=/usr/local/flume/conf; export FLUME_HOME=/usr/local/flume; sudo -E bin/flume-daemon.sh start node




Installing Flume from a Deb apt-get package



check the ubuntu version you're running:

lsb_release -c



add the repository for the cloudera distro

sudo vim /etc/apt/sources.list.d/cloudera.list



paste the two lines in below

deb http://archive.cloudera.com/debian jaunty-cdh3 contrib

deb-src http://archive.cloudera.com/debian jaunty-cdh3 contrib




add the private key

curl -s http://archive.cloudera.com/debian/archive.key | sudo apt-key add -





update your packages:

sudo apt-get update




install flume:

sudo apt-get install flume





GET MASTER UP


setup and start the flume master server:

sudo apt-get install flume-master




to restart the master:

/etc/init.d/flume-master restart




you should be able to access the master node as such:

http://yourhost:35871/flumemaster.jsp

Ready for More?

Follow Me @jimplush