Flume

Flume is a useful tool to import real-time data into hadoop. For example, most software systems and engines have a running log file to indicate the activity. Using flume, the log records can be gathered and inserted into hdfs as they are produced by source systems