Yahoo! Pipes
Encyclopedia
Yahoo! Pipes is a web application
from Yahoo!
that provides a graphical user interface for building data mashups that aggregate web feeds, web page
s, and other services, creating Web-based apps from various sources, and publishing those apps. The application works by enabling users to "pipe" information from different sources and then set up rules for how that content should be modified (for example, filtering). A typical example is New York Times through Flickr, a pipe which takes The New York Times
RSS feed and adds a photo from Flickr
based on the keywords of each item. Other than the pipe edition page, the website has a documentation page and a discussion page. Documentation page contains information about pipes, a user guide on pipe edition and a troubleshooting guide. The discussion page enables users to discuss the pipes with other users. The site is currently in beta.
is a Web application that combines data from more than one Web data source into a single integrated Web application. Just as Unix pipes
are often used to quickly combine several different data sources but are generally not sufficient to create a useful application, Yahoo! Pipes is a data mashup tool rather than a complete Mashup editor.
Web application
A web application is an application that is accessed over a network such as the Internet or an intranet. The term may also mean a computer software application that is coded in a browser-supported language and reliant on a common web browser to render the application executable.Web applications are...
from Yahoo!
Yahoo!
Yahoo! Inc. is an American multinational internet corporation headquartered in Sunnyvale, California, United States. The company is perhaps best known for its web portal, search engine , Yahoo! Directory, Yahoo! Mail, Yahoo! News, Yahoo! Groups, Yahoo! Answers, advertising, online mapping ,...
that provides a graphical user interface for building data mashups that aggregate web feeds, web page
Web page
A web page or webpage is a document or information resource that is suitable for the World Wide Web and can be accessed through a web browser and displayed on a monitor or mobile device. This information is usually in HTML or XHTML format, and may provide navigation to other web pages via hypertext...
s, and other services, creating Web-based apps from various sources, and publishing those apps. The application works by enabling users to "pipe" information from different sources and then set up rules for how that content should be modified (for example, filtering). A typical example is New York Times through Flickr, a pipe which takes The New York Times
The New York Times
The New York Times is an American daily newspaper founded and continuously published in New York City since 1851. The New York Times has won 106 Pulitzer Prizes, the most of any news organization...
RSS feed and adds a photo from Flickr
Flickr
Flickr is an image hosting and video hosting website, web services suite, and online community that was created by Ludicorp in 2004 and acquired by Yahoo! in 2005. In addition to being a popular website for users to share and embed personal photographs, the service is widely used by bloggers to...
based on the keywords of each item. Other than the pipe edition page, the website has a documentation page and a discussion page. Documentation page contains information about pipes, a user guide on pipe edition and a troubleshooting guide. The discussion page enables users to discuss the pipes with other users. The site is currently in beta.
History
Yahoo! Pipes was released to the public in beta on 7 February 2007. It was built by Pasha Sadri, Ed Ho, Jonathan Trevor, Kevin Cheng and Daniel Raffel of Yahoo! It is described by its creators as:Purpose
The purpose of Yahoo! Pipes is to create new pages by aggregating RSS feeds from different sources. Yahoo! Pipes has many modules which can be used either to grab data from sources or to edit the data that is grabbed from the sources. These modules are grouped into categories. These categories are sources, user inputs, operators, URL, string, date, location and number.Creating and Editing a Pipe
To create or edit a pipe, user has to sign up with a Yahoo! ID. After signing up, user doesn't download a plug-in or a program. Creation and edition of the pipes are compeletely online. User selects the "Create a pipe" option to open the Pipe Editor. Pipe editor is composed of three panes which are the canvas, the library and the debugger. The pipe is created using these panes. After creation, pipe is saved and run. Then user gives a name to the pipe and writes a short description of it. If creator of the pipe decides to publish the pipe, pipe becomes visible for everyone. Other users can clone the pipe. Then they can use and edit their copy for their own use.The Canvas
Canvas is the main pan where the edition of pipes is done. It is in the center of the page. Modules that are selected from the Library pane are dragged on this pane and connected together. After that all the modules are wired in the desired order the pipe is ready to be used.The Library
The Library is the place where the modules are selected to be dragged on the Canvas. These modules are grouped by their functions. The library pane is on the left hand side.Sources
In this category, there are modules which are used to grab data from one or multiple sources on internet.User Inputs
The modules in this category enables user to add an input in the pipe. By using the modules in this category, user can add date, location, number, text or URL input to the pipe.Operators
The modules in this category are used either to filter or to transform the data that is flowing in the pipe. It contains filter, count, location extractor, loop, regex, rename, reverse, sort, split, sub-element, tail, truncate, union, unique and web service modules.URL
There is only URL builder module in this category. Pipes need to have URLs of RSS to get the content. This URL builder enables users to create URLs instead of typing the URL address. It uses a base URL and query parameters to generate other URLs.String
The modules in this category are used to either to change or combine the strings. String builder, string regex, string replace, sub string, term extractor, and translate are the modules of this category.Date
There are only two modules in this category. They are date builder and date formatter. Date builder module converts a text to a date when there is text in the date format such as "yesterday" or "tomorrow". Date formatter module takes a date as input date and changes it to the desired format.Location
This category contains only location builder module. This module recognizes the strings which are the description of a location and converts them to geographical location. Its input is in string form and output in location form.Number
This category only has the simple math module. It applies simple math operations to the number input it takes and outputs the result of math operation. Both the input and the output are numbers.The Debugger
This is the pane which shows the output of the selected module on the pipe. While designing a pipe, when user clicks on a module on the canvas, the debugger pane shows the output of the selected module. It shows both the title and the content of each item.Mashups
A Web MashupMashup (web application hybrid)
In Web development, a mashup is a Web page or application that uses and combines data, presentation or functionality from two or more sources to create new services...
is a Web application that combines data from more than one Web data source into a single integrated Web application. Just as Unix pipes
Pipeline (Unix)
In Unix-like computer operating systems , a pipeline is the original software pipeline: a set of processes chained by their standard streams, so that the output of each process feeds directly as input to the next one. Each connection is implemented by an anonymous pipe...
are often used to quickly combine several different data sources but are generally not sufficient to create a useful application, Yahoo! Pipes is a data mashup tool rather than a complete Mashup editor.
See also
- MashupMashup (web application hybrid)In Web development, a mashup is a Web page or application that uses and combines data, presentation or functionality from two or more sources to create new services...
- Google Mashup EditorGoogle Mashup EditorGoogle Mashup Editor was an online mashup creation service created by Google that is now deprecated.-History:On January 15, 2009, Vic Gundotra, Google's VP of Engineering, announced that the Mashup Editor would be migrated to the Google App Engine: "Existing Mashup Editor applications will stop...
(Deprecated, since January 14, 2009) - Mozilla UbiquityUbiquity (Firefox)Ubiquity, an add-on for Mozilla Firefox, is an abandonware collection of quick and easy natural-language-derived commands that act as mashups of web services, thus allowing users to get information and relate it to current and other webpages...
- Yahoo! query languageYahoo! query languageYahoo! query language is an SQL-like query language created by Yahoo! as part of their Developer Network. YQL is designed to retrieve and manipulate data from APIs through a single Web interface, thus allowing mashups that enable developers to create their own applications.Initially launched in...
- Scratch programming languageScratch programming languageScratch is an educational programming language that allows people of any experience, background and age to experiment with the concepts of fully versatile computer programming by snapping together visual programming blocks to control images, music and sound...
- EMMLEMMLEMML, or Enterprise Mashup Markup Language, is an XML markup language for creating enterprise mashups, which are software applications that consume and mash data from variety of sources, often performing logical or mathematical operations as well as presenting data. Mashed data produced by...
- Open Mashup AllianceOpen Mashup AllianceThe Open Mashup Alliance is a non-profit consortium that promotes the adoption of mashup solutions in the enterprise through the evolution of enterprise mashup standards like EMML. Enterprise mashup usage is expected to grow tenfold in the next five years...
- WSO2 Mashup ServerWSO2 Mashup ServerThe WSO2 Mashup Server is an open source mashup platform that hosts JavaScript based mashups. It is based on Apache Axis2 and other open source projects, and provides JavaScript authors the ability to consume, compose and emit web services, feeds, scraped web pages, email, and instant messages. The...
- Mozilla JetpackMozilla JetpackJetpack is a project that develops tools and frameworks to ease development of Firefox add-ons. The project has produced the Add-on SDK, a set of APIs, a runtime, and a command-line tool for creating and running add-ons, and the Add-on Builder, a Web-based integrated development environment which...
External links
- Pipes Official Site
- Tim O'Reilly blog article
- Yahoo! Pipes Adds Geo Data Support - including export of data in KMLKeyhole Markup LanguageKeyhole Markup Language is an XML notation for expressing geographic annotation and visualization within Internet-based, two-dimensional maps and three-dimensional Earth browsers. KML was developed for use with Google Earth, which was originally named Keyhole Earth Viewer. It was created by...