File sharing
to sort and reorder
See also Network, SSH, HTTP, WebDev#WebRTC, Rsync, Backup
General
- https://en.wikipedia.org/wiki/File_transfer
- https://en.wikipedia.org/wiki/List_of_file_transfer_protocols
Encrypted
Tor
- https://torproject.org/ - "The Onion Router" - Developed by the US Navy and EFF, widely used.
- https://www.antagonism.org/anon/ssh-tor.shtml
- http://www.howtoforge.com/anonymous-ssh-sessions-with-tor
Usage
sudo systemctl start tor chromium --proxy-server="socks://localhost:9050"
Software
- https://www.torproject.org/projects/torbrowser.html.en - Easy to use, for USB sticks.
- https://www.torproject.org/projects/vidalia - gui
Exit nodes
- https://blog.torproject.org/running-exit-node
- https://trac.torproject.org/projects/tor/wiki/doc/ReducedExitPolicy
- http://raidersec.blogspot.co.uk/2013/09/mapping-tor-relays-and-exit-nodes.html
Hidden services
- https://www.torproject.org/docs/hidden-services.html.en
- http://en.wikipedia.org/wiki/List_of_Tor_hidden_services
- http://resources.infosecinstitute.com/tor-hidden-services/
Search
- https://kbhpodhnfxl3clb4.onion.to/ - torsearch
Social
I2P
- http://i2p2.de/ - "Invisible Internet Protocol" - Uses 'garlic' routing.
- http://syndie.i2p2.de - Software for blogging on a I2P network
Other
File systems
Network
- https://en.wikipedia.org/wiki/Category:Network_file_systems
- https://en.wikipedia.org/wiki/Category:Distributed_file_systems
Daemons
- inosync daemon leverages the inotify service available in recent linux kernels to monitor and synchronize changes within directories to remote nodes.
Cloud
- https://objectivefs.com/ - Amazon
Client-server
See Network#FTP
DCC
- https://en.wikipedia.org/wiki/Direct_Client-to-Client - IRC channel, manual and scripted bots.
- http://www.irchelp.org/irchelp/rfc/dccspec.html
Napster
- https://en.wikipedia.org/wiki/Napster - central hub, p2p transfer
Direct Connect
- https://en.wikipedia.org/wiki/Direct_Connect_(file_sharing) - central hub, p2p transfer
Cloud
See Hosting#Storage
- Volafile.io aims to provide a simple real-time filesharing service. Users share files in so called 'rooms', which each consist of a chat and a list of uploaded files. The list of files automatically shows new files as they are uploaded. [2]
P2P
- https://en.wikipedia.org/wiki/Friend-to-friend
- https://en.wikipedia.org/wiki/Anonymous_P2P
- https://en.wikipedia.org/wiki/Private_peer-to-peer
DHT
- http://en.wikipedia.org/wiki/Kademli
- http://xlattice.sourceforge.net/components/protocol/kademlia/specs.html
- https://en.wikipedia.org/wiki/Kad_network
- pydht - Python implementation of the Kademlia DHT data store.
- https://www.torproject.org/docs/hidden-services.html.en
- http://donncha.is/2013/05/trawling-tor-hidden-services/
- http://www.infoanarchy.org/en/The_Circle - based on Chord
- P-Grid is a truly decentralized structured P2P system which does not require central coordination or knowledge. It is based purely on randomized algorithms and local interactions and targeted at environments with low online probabilities of peers. P-Grid differs from other approaches such as Chord, CAN, Pastry, etc. in terms of practical applicability (especially in respect to dynamic network environments), algorithmic foundations (randomized algorithms with probabilistic guarantees), robustness, and flexibility.
- TomP2P is an advanced DHT, which stores multiple values for a key. Each peer has a table (either disk-based or memory-based) to store its values. A single value can be queried / updated with a secondary key. The underlying communication framework uses Java NIO to handle many concurrent connections.
- Tonika is an administration-free platform for large-scale open-membership (social) networks with robust security, anonymity, resilience and performance guarantees.
- SIPDHT project is to provide a library to be used in applications for creating and using SIP based distributed hash tables. The algorithm implemented is loosely based on P2P SIP work (draft-bryan-sipping-p2p-02) and its primary intent is to be a work bench for the specification process.
- http://sipdht.sourceforge.net/sipdht2/
- sinchana is a scalable and stable DHT implementation written using Apache Thrift. The communication protocol of the DHT is implemented using Thrift. The advantage of Thrift service protocol is it's small message size and the less usage of CPU.
File networks
- Forban - a simple link-local opportunistic p2p free software (or how to share files with your local neighbors)
Gnutella
FastTrack
- https://en.wikipedia.org/wiki/FastTrack - used by Kazaa, Grokster, iMesh, and Morpheus
eDonkey network
Overnet
Perfect Dark
- https://en.wikipedia.org/wiki/Perfect_Dark_(P2P) - closed source, japanese
Advanced Direct Connect
Multi-network Software
giFT
- giFT is a collection of various software components geared towards improving the overall usability of a multitude of peer-to-peer file-sharing networks. This goal is accomplished by unifying the components such that a user of the software may choose any of the available interfaces to access any of the available networks. The central application, giftd, uses a plugin-based architecture capable of using multiple networks simultaneously through a single user interface.
MLDonkey
BitTorrent
Libraries
Servers
- XBT is high-performance low-overhead BitTorrent software.
- Gazelle is a web framework geared towards private BitTorrent trackers. Although naturally focusing on music, it can be modified for most needs. Gazelle is written in PHP, JavaScript, and MySQL.
Clients
- Tribler Tribler is an application that enables its users to find, enjoy and share content. With content we mean video, audio, pictures, and much more.
Extensions
Trackers
Anonymous/encrypted files/social
- https://en.wikipedia.org/wiki/Deep_Web - sites/services on tor/i2p, etc.
- https://en.wikipedia.org/wiki/Darknet_(file_sharing) - WASTE, Freenet, etc.
WASTE
- WASTE is an anonymous, secure, and encryped collaboration tool which allows users to both share ideas through the chat interface and share data through the download system.
The suggested size for a WASTE network (referred to as a "mesh" by users) is 10-50 nodes, though it has been suggested that the size of the network is less critical than the ratio of nodes willing to route traffic to those that are not.
Freenet
- Freenet - Share files, chat on forums, browse and publish, anonymously and without fear of blocking or censorship! While users can insert data into the network, there is no way to delete data. Due to the anonymity, no node knows who is the 'owner' of a piece of data. The only way data can be removed is if users don't request the data.
- RetroShare is a Open Source cross-platform, Friend-2-Friend and secure decentralised communication platform. It lets you to securely chat and share files with your friends and family, using a web-of-trust to authenticate peers and OpenSSL to encrypt all communication. RetroShare provides filesharing, chat, messages, forums and channels
MUTE
- MUTE File Sharing is a peer-to-peer network that provides easy search-and-download functionality while also protecting your privacy.
OneSwarm
- OneSwarm is a P2P file sharing service that protects your privacy. It's fast, BitTorrent-compatible, and free!
OFF
- OFF is a highly connected peer-to-peer distributed file system. The unique feature of this system is that it stores all of its internal data as meaningless multi-use data blocks. In other words there is not a one to one mapping between a stored block and its use in a accessed file. Each stored block is simultaneously used to access many different files. Individually however, each block is nothing but arbitrary digital white noise.
Free Haven Project
- Free Haven Project aims to deploy a system for distributed, anonymous, persistent data storage which is robust against attempts by powerful adversaries to find and destroy any stored data. This model of decentralized system has been classified as peer-to-peer by recent popular media.
Tahoe-LAFS
- Tahoe-LAFS is a Free and Open cloud storage system. It distributes your data across multiple servers. Even if some of the servers fail or are taken over by an attacker, the entire filesystem continues to function correctly, preserving your privacy and security.
Osiris
Ori
File sync
- https://en.wikipedia.org/wiki/File_synchronization
- https://en.wikipedia.org/wiki/Comparison_of_file_synchronization_software
- git-annex allows managing files with git, without checking the file contents into git. While that may seem paradoxical, it is useful when dealing with files larger than git can currently easily handle, whether due to limitations in memory, time, or disk space. git-annex is designed for git users who love the command line. For everyone else, the git-annex assistant turns git-annex into an easy to use folder synchroniser.
- lipsync! - an open source, commandline service that securely syncronizes your data. Powered by lsyncd, unison, ssh and fak3r. Think of it as a lightweight commandline version of Dr0pb0x that gives control back to you; the user and owner of the data.
- SparkleShare creates a special folder on your computer. You can add remotely hosted folders (or "projects") to this folder. These projects will be automatically kept in sync with both the host and all of your peers when someone adds, removes or edits a file.
- Seafile is a next-generation open source cloud storage system, with advanced support for file syncing, privacy protection and teamwork. Collections of files are called libraries, and each library can be synced separately. A library can be encrypted with a user chosen password. This password is not stored on the server, so even the server admin can't view your file contents. Seafile lets you create groups with file syncing, wiki, and discussion -- enabling easy collaboration around documents within a team.
- Pydio is an open source software that turns instantly any server (on premise, NAS, cloud IaaS or PaaS) into a file sharing platform for your company. It is an alternative to SaaS Boxes and Drives, with more control, safety and privacy, and favorable TCOs.
- bitpocket is a small but smart script that does 2-way directory synchronization. It uses rsync to do efficient data transfer and tracks local file creation/removal to avoid known rsync problem when doing 2-way syncing with deletion. bitpocket can use any server which you have ssh access to for its central storage. If you have gigabytes of free disk space on your hosting server you can finally make use of it.
- iFolder is a safe and secure way to share and synchronize files across computers and within teams.
- gist: Build your own private, encrypted, open-source Dropbox-esque sync folder
- Set up your own truly secure, encrypted and shared file synchronization, aka Dropbox clone
- remoteStorage - An open protocol for per-user storage
- sharebox - a project of a distributed synchronizing filesystem.