ElasticSearch, LogStash, and Kibana - Beginners guide

If you don't know what ElasticSearch, LogStash, and Kibana are, go HERE to read more. If you know what it is but aren't sure where to start, keep reading.

I'm going to make this hopefully short and sweet but I don't guarantee that.

So what I'll try to hit on is Installing and Configuring the following:

• Beaver
• Redis
• LogStash
• ElasticSearch (and plugins)
• Kibana
• Curator
• Small monitoring script

It will be easiest to break these up in to a post for each so I'll try to set them as links above as they get written.


Here is a picture of how I run this set up. The bash script labeled is a custom script that imports and formats off-server logs. i won't be going over that though since it's beyond the scope of ELK. All you need to know is that it downloads scripts, does some format adjustment and then dumps the text files to a directory that Beaver is looking at. Beaver sends to redis, LogStash does its thing with Redis as a source, and then sends it to ElasticSearch.