Logging

From Things and Stuff Wiki
Jump to navigation Jump to search


General



logrotate

  • logrotate is designed to ease administration of systems that generate large numbers of log files. It allows automatic rotation, compression, removal, and mailing of log files. Each log file may be handled daily, weekly, monthly, or when it grows too large.


Systems

syslog

  • logger - a shell command interface to the syslog(3) system log module

syslog-ng

rsyslog

  • Rsyslog is an enhanced syslogd supporting, among others, MySQL, PostgreSQL, failover log destinations, syslog/tcp, fine grain output format control, high precision timestamps, queued operations, the ability to filter on any message part and encryption protected syslog relay chains. It is quite compatible to stock sysklogd and can be used as a drop-in replacement.

journald

systemd's journal service

lnav

  • lnav - The Log File Navigator, An advanced log file viewer for the small-scale. Watch and analyze your log files from a terminal. No server. No setup. Still featureful. [2]

Aggregation

swatch

  • swatch - swatchdog.pl started out as swatch, the "simple watchdog" for activity monitoring log files produced by UNIX's syslog facility. It has since been evolving into a utility that can monitor just about any type of log. The name has been changed to satisfy a request made by the old Swiss watch company.

MultiTail

Logwatch

Logcheck

  • Logcheck is a simple utility which is designed to allow a system administrator to view the logfiles which are produced upon hosts under their control. It does this by mailing summaries of the logfiles to them, after first filtering out "normal" entries.

logstash

  • logstash is a tool for managing events and logs. You can use it to collect logs, parse them, and store them for later use (like, for searching). Speaking of searching, logstash comes with a web interface for searching and drilling into all of your logs.

Dendrite

l2met

Graylog2

  • Graylog2 enables you to unleash the power that lays inside your logs. Use it to run analytics, alerting, monitoring and powerful searches over your whole log base. Need to debug a failing request? Just run a quick filter search to find it and see what errors it produced. Want to see all messages a certain API consumer is consuming in real time? Create streams for every consumer and have them always only one click away.

GoAccess

  • GoAccess is an open source real-time web log analyzer and interactive viewer that runs in a terminal in *nix systems. It provides fast and valuable HTTP statistics for system administrators that require a visual server report on the fly.

lnav

  • lnav - An advanced log file viewer for the small-scale. Watch and analyze your log files from a terminal. No server. No setup. Still featureful.

Flume

  • Flume is a distributed, reliable, and available service for efficiently collecting, aggregating, and moving large amounts of log data. It has a simple and flexible architecture based on streaming data flows. It is robust and fault tolerant with tunable reliability mechanisms and many failover and recovery mechanisms. It uses a simple extensible data model that allows for online analytic application.

Fluentd

  • Fluentd is an open-source tool to collect events and logs. 150+ plugins instantly enables you to store the massive data for Log Search, Big Data Analytics, and Archiving (MongoDB, S3, Hadoop).

Kibana

log.io

  • log.io - Real-time log monitoring in your browser. Powered by node.js + socket.io

http://www.vanheusden.com/multitail/

glTail.rb

  • glTail.rb - Real-time visualization of server log traffic, events and statistics with Ruby, SSH and OpenGL.

logstalgia

The Log File Navigator

  • The Log File Navigator - An advanced log file viewer for the small-scale. Watch and analyze your log files from a terminal. No server. No setup. Still featureful.

slit


loki

Access Watch

Telegraf

  • https://github.com/influxdata/telegraf - an agent for collecting, processing, aggregating, and writing metrics.Design goals are to have a minimal memory footprint with a plugin system so that developers in the community can easily add support for collecting metrics.Telegraf is plugin-driven and has the concept of 4 distinct plugin types: Input Plugins collect metrics from the system, services, or 3rd party APIs. Processor Plugins transform, decorate, and/or filter metrics. Aggregator Plugins create aggregate metrics (e.g. mean, min, max, quantiles, etc.). Output Plugins write metrics to various destinations.

to sort

RRDtool

  • RRDtool is the OpenSource industry standard, high performance data logging and graphing system for time series data. RRDtool can be easily integrated in shell scripts, perl, python, ruby, lua or tcl applications.


Systems


Services


  • Datadog - Cloud Monitoring as a Service
Retrieved from "https://wiki.thingsandstuff.org/index.php?title=Logging&oldid=62614"