Server
General
SSH
- https://wiki.archlinux.org/index.php/Secure_Shell
- SSH Can Do That? Productivity Tips for Working with Remote Servers
- Tips for Remote Unix Work (SSH, screen, and VNC) [1]
- http://www.semicomplete.com/articles/ssh-security/
SSH keys
Basic key setup:
ssh-keygen -t rsa ssh-copy-id [-i [identity_file]] [user@]remote default identity_file is ~/.ssh/id_rsa.pub
SCP
- scp -P [port] file.txt user@remotehose:~/file.txt
When scp on remote is initiated, it done so with -t flag, which is undocumented but might be required for precise command persmission configuration.
SSHFS
Rsync
- Rsync over alt SSH port: --rsh='ssh -p8023'
Continuous Integration
- Jenkins CI is the leading open-source continuous integration server. Built with Java, it provides over 400 plugins to support building and testing virtually any project.
Provision
- Puppet Labs
- Puppet Master - Central management daemon.
- Puppet Agent - Runs on each managed node.
- Puppet Apply - For local use.
- http://docs.puppetlabs.com/guides/tools.html etc.
- Puppet Wiki: Core Types Cheat Sheet
- Puppet Wiki: Simple Text edits
- Ubuntu puppet info
- AUR: puppet
- AUR: puppet dashboard
- Fabric - Python SSH library
Logging
Basics
- Linux log files location and how do I view logs files? - Jul 17, 2006
- 20 Linux Log Files that are Located under /var/log Directory - Aug 1, 2011
- HowTo: The Ultimate Logrotate Command Tutorial with 10 Examples - Jul 14, 2010
- logrotate is designed to ease administration of systems that generate large numbers of log files. It allows automatic rotation, compression, removal, and mailing of log files. Each log file may be handled daily, weekly, monthly, or when it grows too large.
- Using logrotate to rotate and archive log - Aug 05, 2010
Systems
- syslog
- syslogd
- /etc/syslog.conf
- How To Set Up A Debian Linux Syslog Server
- logger - a shell command interface to the syslog(3) system log module
- syslog-ng is a high-performance syslog server with advanced log processing services and direct database access. syslog-ng clients collect the log messages from the various applications, files, and other sources then send important log messages to the remote syslog-ng server which sorts and stores them.
- Rsyslog is an enhanced syslogd supporting, among others, MySQL, PostgreSQL, failover log destinations, syslog/tcp, fine grain output format control, high precision timestamps, queued operations, the ability to filter on any message part and encryption protected syslog relay chains. It is quite compatible to stock sysklogd and can be used as a drop-in replacement.
- glTail.rb - Real-time visualization of server traffic, events and statistics with Ruby, SSH and OpenGL.
- log.io Real-time log monitoring in your browser. Powered by node.js + socket.io
Monitoring
If it's up... | A.K.A... | It's down... per year |
---|---|---|
90% | n/a | 876 hours |
95% | n/a | 438 hours |
99% | two 9s | 87 hours, 36 minutes |
99.9% | three 9s | 8 hours, 45 minutes, 36 seconds |
99.99% | four 9s | 52 minutes, 33.6 seconds |
99.999% | five 9s | 5 minutes, 15.36 seconds |
99.9999% | six 9s | 31.68 seconds |
- Nagios is a powerful monitoring system that enables organizations to identify and resolve IT infrastructure problems before they affect critical business processes. Designed with scalability and flexibility in mind, Nagios gives you the peace of mind that comes from knowing your organization's business processes won't be affected by unknown outages.
- Splunk is powerful and versatile IT search software that takes the pain out of tracking and utilizing the information in your data center. If you have Splunk, you won't need complicated databases, connectors, custom parsers or controls--all that's required is a web browser and your imagination. Splunk handles the rest.
- YouTube: Splunk 4.3 Overview
Backup
- Backup - Scripts and apps
Virtualisation
VirtualBox config;
- Enable host Linux modules: vboxnetflt and vboxnetadp
- Enable host-only adapter 'virtualbox0' in VB Preferences > Network if not previously enabled, then select in guest preferences
- https://github.com/milkmiruku/boxbootstrap
- Keep VM names lowercase and no spaces for easier command-line stuff
Provisioning VirtualBoxes for local dev work;
- Vagrant - VirtualBox provisioning with Puppet, etc.
vagrant package --vagrantfile Vagrantfile.pkg --include README.txt stored in ~/.vagrant.d/boxes vagrant box add lucid32 http://files.vagrantup.com/lucid32.box vagrant box remove lucid32 vagrant box list
Filesystem
IaaS
Knowledge management
Video streaming
Hosting
- http://blog.pinboard.in/2012/01/the_five_stages_of_hosting/
- http://blog.maclawran.ca/96882258
- http://blog.pinboard.in/2012/06/going_colo/
- http://www.ec2instances.info/
- An always-on reserved EC2 micro instance works out to £5.54 a month (3 year), or £7.08 a month (1 year)
- http://www.rackspace.co.uk/cloud-servers/
- http://www.servwise.com/en/
- http://www.5quidhost.co.uk/
- https://www.vidahost.com/
- http://www.equiphase.net/
- http://www.nativespace.co.uk/
- http://www.heroku.com/ - Ruby, Node.js, Clojure, Java, Python, and Scala
- http://www.engineyard.com/ - PHP, Ruby
- http://www.appfog.com/ - Java, Python, Node, .Net, Ruby, PHP, MySQL, Mongo, PostgreSQL, and more
GitHub Pages & Jekyll
- https://help.github.com/articles/using-jekyll-with-pages
- https://github.com/mojombo/jekyll/blob/master/README.textile
- https://github.com/rfelix/jekyll_ext/wiki/extensions
GitHub Gist
- http://bl.ocks.org/ - run code (html+css+js)
- http://gist.io/ - display posts (markdown)
Google Cloud
GoDaddy
Dropbox
- scriptogr.am - A simple online tool that converts static Markdown text files located in your Dropbox, into a beautiful web log.
Storage
WebDAV
- WebDAV stands for Web Distributed Authoring and Versionin, see RFC 2518
"Linux users can mount WebDAV shares using the davfs2 and the fusedav file system modules which mount them as Coda or FUSE filesystems. KDE has native WebDAV support as part of kio_http. This enables Dolphin, Konqueror, and every other KDE application to interact directly with WebDAV servers. Nautilus also has WebDAV support built in. Many Linux distributions also include the cadaver command-line client interface, which provides an FTP-like command set. The Apache HTTP Server provides WebDAV modules based on both davfs and Apache Subversion (svn)."
- WebDAV Resources - This site is being produced for the WebDAV community as a central resource for documentation, specifications, software, mailing lists, and other useful items.
- Use Linux and WebDAV to Facilitate Online Collaboration - Apache method
- http://linuxsagas.digitaleagle.net/2008/09/09/webdav-and-fstab/
- davfs2 provides the ability to access such resources like a typical filesystem, allowing for use by standard applications with no built-in support for WebDAV.
- fusedav is a Linux userspace file system driver for mounting WebDAV shares. It makes use of FUSE as userspace file system API and neon as WebDAV API.
- http://owncloud.org/ - Version 5.0 Expected August 2012
- https://github.com/mikedeboer/jsDAV - node.js