This is a how to on installing the Cloudera Flume project from tarball and Ubuntu package
Installing Flume from tarball
- sudo mkdir /var/log/flume
- cd /usr/local
- sudo wget http://archive.cloudera.com/cdh/3/flume-0.9.3-cdh3u0.tar.gz
- sudo tar -xzvf flume-0.9.3-cdh3u0.tar.gz
- sudo ln -s flume-0.9.3-cdh3u0 flume
- cd /usr/local/flume
TO START THE MASTER
export FLUME_CONF_DIR=/usr/local/flume/conf; export FLUME_HOME=/usr/local/flume; sudo -E bin/flume-daemon.sh start master
TO START THE NODE
export FLUME_CONF_DIR=/usr/local/flume/conf; export FLUME_HOME=/usr/local/flume; sudo -E bin/flume-daemon.sh start node
Installing Flume from a Deb apt-get package
check the ubuntu version you're running:
lsb_release -c
add the repository for the cloudera distro
sudo vim /etc/apt/sources.list.d/cloudera.list
paste the two lines in below
deb http://archive.cloudera.com/debian jaunty-cdh3 contrib
deb-src http://archive.cloudera.com/debian jaunty-cdh3 contrib
add the private key
curl -s http://archive.cloudera.com/debian/archive.key | sudo apt-key add -
update your packages:
sudo apt-get update
install flume:
sudo apt-get install flume
GET MASTER UP
setup and start the flume master server:
sudo apt-get install flume-master
to restart the master:
/etc/init.d/flume-master restart
you should be able to access the master node as such:
http://yourhost:35871/flumemaster.jsp