P2P caching
Encyclopedia
Peer-to-peer caching is a computer network
traffic management technology used by Internet Service Providers (ISPs) to accelerate content delivered over peer-to-peer
(P2P) networks while reducing related bandwidth costs.
P2P caching
is similar in principle to the content caching long used by ISPs to accelerate Web (HTTP) content. P2P caching temporarily stores popular content that is flowing into an ISP’s network. If the content requested by a subscriber is available from a cache
, the cache satisfies the request from its temporary storage, eliminating data transfer through expensive transit links and reducing network congestion.
P2P content responds well to caching because it has high reuse patterns. An estimated 75% of P2P content is requested multiple times.
Some P2P caching devices can also accelerate HTTP video streaming traffic from YouTube
, Facebook
, RapidShare
, MegaUpload
, Google
, AOL Video, MySpace
and other web video-sharing sites.
or temporary storage space for P2P data, using specialized communications hardware, disk storage and associated software. This cache is placed in the ISP’s network, either co-located with the Internet transit links or placed at key aggregation points or at each cable head-end.
Once a P2P cache is established, the network will transparently redirect P2P traffic to the cache, which either serves the file directly or passes the request on to a remote P2P user and simultaneously caches that data for the next user. It is estimated that 4 of 5 files requested via P2P can be served by the cache. This ratio is significantly higher than HTTP/Web caching.
P2P caching typically works with a network traffic-mitigation technology called Deep Packet Inspection
(DPI). DPI technology is used by service providers to understand what traffic is running across their networks and to separate it and treat it for the most efficient delivery. DPI products identify and pass P2P packets to the P2P caching system so it can cache the traffic and accelerate it.
Peerapp Ltd. holds the first patent for P2P caching technology, which was filed in 2000.
traffic accounts for upwards of 60% of all Internet traffic. However, P2P traffic is expected to quadruple between 2006 and 2011, reaching 3 exabytes per month – or the equivalent of 750 million DVDs each month.
Increasing P2P traffic has created problems for ISPs. Networks can become saturated with P2P traffic, creating congestion for other types of Internet use. The cost of P2P traffic is disproportionate to the amount of revenue ISPs make from these customers because of the flat-rate packages of bandwidth commonly sold. To prevent P2P traffic from degrading service for all subscribers, ISPs typically face three choices:
Caching releases the bandwidth demand on critical Internet links and improves the experience for all users – P2P users whose file sharing is improved through using the cache, and non-P2P users who experience better performance from networks un-congested from P2P traffic.
The initial adopters of P2P caching have been ISPs in Asia, the Pacific Rim, Latin America, the Caribbean and the Middle East, whose subscribers are heavy users of P2P networks and where providing the additional bandwidth to handle P2P data is very costly due to the expense of international transit links.
P2P caching is expected to become an increasingly essential technology for ISPs and MSOs (multiple system operators) worldwide, particularly with the growing popularity of P2P content among broadband subscribers and the adoption of P2P as a content-distribution strategy by mainstream content providers such as the BBC
.
Computer network
A computer network, often simply referred to as a network, is a collection of hardware components and computers interconnected by communication channels that allow sharing of resources and information....
traffic management technology used by Internet Service Providers (ISPs) to accelerate content delivered over peer-to-peer
Peer-to-peer
Peer-to-peer computing or networking is a distributed application architecture that partitions tasks or workloads among peers. Peers are equally privileged, equipotent participants in the application...
(P2P) networks while reducing related bandwidth costs.
P2P caching
Cache
In computer engineering, a cache is a component that transparently stores data so that future requests for that data can be served faster. The data that is stored within a cache might be values that have been computed earlier or duplicates of original values that are stored elsewhere...
is similar in principle to the content caching long used by ISPs to accelerate Web (HTTP) content. P2P caching temporarily stores popular content that is flowing into an ISP’s network. If the content requested by a subscriber is available from a cache
Cache
In computer engineering, a cache is a component that transparently stores data so that future requests for that data can be served faster. The data that is stored within a cache might be values that have been computed earlier or duplicates of original values that are stored elsewhere...
, the cache satisfies the request from its temporary storage, eliminating data transfer through expensive transit links and reducing network congestion.
P2P content responds well to caching because it has high reuse patterns. An estimated 75% of P2P content is requested multiple times.
Some P2P caching devices can also accelerate HTTP video streaming traffic from YouTube
YouTube
YouTube is a video-sharing website, created by three former PayPal employees in February 2005, on which users can upload, view and share videos....
Facebook
Facebook is a social networking service and website launched in February 2004, operated and privately owned by Facebook, Inc. , Facebook has more than 800 million active users. Users must register before using the site, after which they may create a personal profile, add other users as...
, RapidShare
RapidShare
RapidShare is a one-click hosting service that offers both free and commercial services. Operating from Switzerland, it is financed by the subscriptions of paying users...
, MegaUpload
Megaupload
Megaupload is an online Hong Kong-based company established in 2005 for the use of uploading and downloading files. It includes a video browsing section in the site Megavideo, MegaLive, MegaPix and Megabox as well as a sister company called Megaporn which hosts user uploaded pornographic content...
Google
Google Inc. is an American multinational public corporation invested in Internet search, cloud computing, and advertising technologies. Google hosts and develops a number of Internet-based services and products, and generates profit primarily from advertising through its AdWords program...
, AOL Video, MySpace
MySpace
Myspace is a social networking service owned by Specific Media LLC and pop star Justin Timberlake. Myspace launched in August 2003 and is headquartered in Beverly Hills, California. In August 2011, Myspace had 33.1 million unique U.S. visitors....
and other web video-sharing sites.
How P2P caching works
P2P caching involves creating a cacheCache
In computer engineering, a cache is a component that transparently stores data so that future requests for that data can be served faster. The data that is stored within a cache might be values that have been computed earlier or duplicates of original values that are stored elsewhere...
or temporary storage space for P2P data, using specialized communications hardware, disk storage and associated software. This cache is placed in the ISP’s network, either co-located with the Internet transit links or placed at key aggregation points or at each cable head-end.
Once a P2P cache is established, the network will transparently redirect P2P traffic to the cache, which either serves the file directly or passes the request on to a remote P2P user and simultaneously caches that data for the next user. It is estimated that 4 of 5 files requested via P2P can be served by the cache. This ratio is significantly higher than HTTP/Web caching.
P2P caching typically works with a network traffic-mitigation technology called Deep Packet Inspection
Deep packet inspection
Deep Packet Inspection is a form of computer network packet filtering that examines the data part of a packet as it passes an inspection point, searching for protocol non-compliance, viruses, spam, intrusions or predefined criteria to decide if the packet can...
(DPI). DPI technology is used by service providers to understand what traffic is running across their networks and to separate it and treat it for the most efficient delivery. DPI products identify and pass P2P packets to the P2P caching system so it can cache the traffic and accelerate it.
Peerapp Ltd. holds the first patent for P2P caching technology, which was filed in 2000.
The P2P bandwidth problem
It is estimated that peer-to-peerPeer-to-peer
Peer-to-peer computing or networking is a distributed application architecture that partitions tasks or workloads among peers. Peers are equally privileged, equipotent participants in the application...
traffic accounts for upwards of 60% of all Internet traffic. However, P2P traffic is expected to quadruple between 2006 and 2011, reaching 3 exabytes per month – or the equivalent of 750 million DVDs each month.
Increasing P2P traffic has created problems for ISPs. Networks can become saturated with P2P traffic, creating congestion for other types of Internet use. The cost of P2P traffic is disproportionate to the amount of revenue ISPs make from these customers because of the flat-rate packages of bandwidth commonly sold. To prevent P2P traffic from degrading service for all subscribers, ISPs typically face three choices:
- Invest in additional bandwidth and equipment. Unfortunately, increasing bandwidth often does not solve the problem, because P2P applications inherently tend to consume as much bandwidth as available.
- Implement stricter byte caps, policies, or P2P traffic-shaping, limiting the speed of P2P traffic. The difficulty is that P2P packets are becoming harder and harder to identify, especially with the introduction of encryption (such as BitTorrent protocol encryptionBitTorrent protocol encryptionProtocol encryption , message stream encryption , or protocol header encrypt are related features of some peer-to-peer file-sharing clients, including BitTorrent clients. They attempt to enhance privacy and confidentiality...
). Traffic shaping can also generate negative publicity and customer reactions. - Implement a form of P2P caching.
Caching releases the bandwidth demand on critical Internet links and improves the experience for all users – P2P users whose file sharing is improved through using the cache, and non-P2P users who experience better performance from networks un-congested from P2P traffic.
The initial adopters of P2P caching have been ISPs in Asia, the Pacific Rim, Latin America, the Caribbean and the Middle East, whose subscribers are heavy users of P2P networks and where providing the additional bandwidth to handle P2P data is very costly due to the expense of international transit links.
P2P caching is expected to become an increasingly essential technology for ISPs and MSOs (multiple system operators) worldwide, particularly with the growing popularity of P2P content among broadband subscribers and the adoption of P2P as a content-distribution strategy by mainstream content providers such as the BBC
BBC
The British Broadcasting Corporation is a British public service broadcaster. Its headquarters is at Broadcasting House in the City of Westminster, London. It is the largest broadcaster in the world, with about 23,000 staff...
.
P2P caching implementations
- DalesaDalesaDalesa is a peer-to-peer web cache designed for Local Area Networks . Dalesa is a free and opensource software developed by Lanka Software Foundation under GPL license.-Introduction:...
http://dalesa.sourceforge.net is an opensource P2P web cache designed for local area networks. Any browser attached to a computer within the LAN can participate in P2P caching process by using Dalesa P2P application. It uses IP multicasting based protocol to perform distributed cache lookups. A peer-to-peer cache lookup protocol based on Distributed Hash Tables (DHTs) is scheduled to be delivered in a forthcoming release. The DHT protocol will become an alternative to the current IP-multicasting-based lookup protocol which was introduced in version 0.1. - PeerApp UltraBand Media Caching Software http://www.peerapp.com/Technology/VideoCaching.aspx
- Corelli is a community-based P2P caching system that operates in a decentralised way across multiple peers. This allows a caching service to be realised in environments that do not possess fixed caching infrastructure, e.g. a Wireless ad hoc network.