TATP Benchmark
Encyclopedia
The Telecommunication Application Transaction Processing Benchmark (TATP) is a benchmark designed to measure performance of in-memory database transaction systems.
As database and microprocessor architectures change, so must the benchmarks that are employed to measure the combined performance of these critical components. While other industry standard
throughput workloads already exist, none was designed specifically to exercise the relationship between in-memory database software
and the memory processing subsystem in which it transacts. The Telecommunication Application Transaction Processing
(TATP) Benchmark is a new open source
workload designed specifically for high-throughput
applications, well suited for in-memory database performance analysis
and system comparison.
The TATP benchmark simulates a typical Home Location Register
(HLR) database used by a mobile carrier. The HLR is an application mobile network
operators use to store all relevant information about valid subscribers, including the mobile phone number
, the services to which they have subscribed, access privileges, and the current location of the subscriber's handset. Every call to and from a mobile phone involves look ups against the HLRs of both parties, making it is a perfect example of a demanding, high-throughput environment where the workloads are pertinent to all applications requiring extreme speed: telecommunications, financial services
, gaming, event processing and alerting, reservation systems, software as a service
(SaaS), and so on.
The benchmark generates a flooding load on a database server
. This means that the load is generated up to the maximum throughput point that the server can sustain. The load is generated by issuing pre-defined transactions run against a specified target database. The target database schema
is made to resemble a typical HLR database in a mobile phone network
. The algorithm of what is known as the TATP Benchmark was originally published in a Master's Thesis . The benchmark was modeled after a real test program that was used by a telecom equipment manufacturer to evaluate the applicability of various relational database
systems to service control programming in mobile networks. Another derivative of the original test is the Network Database Benchmark . TATP executes seven pre-defined transactions that insert, update, delete and query the data in the database. The TATP results show Mean Qualified Throughput (MQTh) of the target database system, and the response time
distributions per transaction types for all seven types of transactions.
The TATP benchmark has been used in industry and research .
As database and microprocessor architectures change, so must the benchmarks that are employed to measure the combined performance of these critical components. While other industry standard
Standardization
Standardization is the process of developing and implementing technical standards.The goals of standardization can be to help with independence of single suppliers , compatibility, interoperability, safety, repeatability, or quality....
throughput workloads already exist, none was designed specifically to exercise the relationship between in-memory database software
Database management system
A database management system is a software package with computer programs that control the creation, maintenance, and use of a database. It allows organizations to conveniently develop databases for various applications by database administrators and other specialists. A database is an integrated...
and the memory processing subsystem in which it transacts. The Telecommunication Application Transaction Processing
Transaction processing
In computer science, transaction processing is information processing that is divided into individual, indivisible operations, called transactions. Each transaction must succeed or fail as a complete unit; it cannot remain in an intermediate state...
(TATP) Benchmark is a new open source
Open source
The term open source describes practices in production and development that promote access to the end product's source materials. Some consider open source a philosophy, others consider it a pragmatic methodology...
workload designed specifically for high-throughput
High-throughput
High-throughput may refer to:* High-throughput computing - a computer science concept * High-throughput screening - a bioinformatics concept* Measuring data throughput - a communications concept...
applications, well suited for in-memory database performance analysis
Performance analysis
In software engineering, profiling is a form of dynamic program analysis that measures, for example, the usage of memory, the usage of particular instructions, or frequency and duration of function calls...
and system comparison.
The TATP benchmark simulates a typical Home Location Register
Network Switching Subsystem
Network switching subsystem is the component of a GSM system that carries out call switching and mobility management functions for mobile phones roaming on the network of base stations...
(HLR) database used by a mobile carrier. The HLR is an application mobile network
Mobile phone
A mobile phone is a device which can make and receive telephone calls over a radio link whilst moving around a wide geographic area. It does so by connecting to a cellular network provided by a mobile network operator...
operators use to store all relevant information about valid subscribers, including the mobile phone number
Telephone number
A telephone number or phone number is a sequence of digits used to call from one telephone line to another in a public switched telephone network. When telephone numbers were invented, they were short — as few as one, two or three digits — and were given orally to a switchboard operator...
, the services to which they have subscribed, access privileges, and the current location of the subscriber's handset. Every call to and from a mobile phone involves look ups against the HLRs of both parties, making it is a perfect example of a demanding, high-throughput environment where the workloads are pertinent to all applications requiring extreme speed: telecommunications, financial services
Financial services
Financial services refer to services provided by the finance industry. The finance industry encompasses a broad range of organizations that deal with the management of money. Among these organizations are credit unions, banks, credit card companies, insurance companies, consumer finance companies,...
, gaming, event processing and alerting, reservation systems, software as a service
Software as a Service
Software as a service , sometimes referred to as "on-demand software," is a software delivery model in which software and its associated data are hosted centrally and are typically accessed by users using a thin client, normally using a web browser over the Internet.SaaS has become a common...
(SaaS), and so on.
The benchmark generates a flooding load on a database server
Database server
A database server is a computer program that provides database services to other computer programs or computers, as defined by the client–server model. The term may also refer to a computer dedicated to running such a program...
. This means that the load is generated up to the maximum throughput point that the server can sustain. The load is generated by issuing pre-defined transactions run against a specified target database. The target database schema
Database schema
A database schema of a database system is its structure described in a formal language supported by the database management system and refers to the organization of data to create a blueprint of how a database will be constructed...
is made to resemble a typical HLR database in a mobile phone network
Cellular network
A cellular network is a radio network distributed over land areas called cells, each served by at least one fixed-location transceiver known as a cell site or base station. When joined together these cells provide radio coverage over a wide geographic area...
. The algorithm of what is known as the TATP Benchmark was originally published in a Master's Thesis . The benchmark was modeled after a real test program that was used by a telecom equipment manufacturer to evaluate the applicability of various relational database
Relational database
A relational database is a database that conforms to relational model theory. The software used in a relational database is called a relational database management system . Colloquial use of the term "relational database" may refer to the RDBMS software, or the relational database itself...
systems to service control programming in mobile networks. Another derivative of the original test is the Network Database Benchmark . TATP executes seven pre-defined transactions that insert, update, delete and query the data in the database. The TATP results show Mean Qualified Throughput (MQTh) of the target database system, and the response time
Response time
In technology, response time is the time a system or functional unit takes to react to a given input.- Data processing :In data processing, the response time perceived by the end user is the interval between the instant at which an operator at a terminal enters a request for a response from a...
distributions per transaction types for all seven types of transactions.
The TATP benchmark has been used in industry and research .
External links
- SourceForge.net: Telecommunication Application Transaction Processing (TATP) Benchmark
- IBM solidDB on Intel Xeon 5500 - doubling database performance
- Antoni Wolski and Vilho Raatikka: "Performance Measurement and Tuning of Hot-Standby Databases", Third International Service Availability Symposium (ISAS 2006), May 15–16, 2006, Helsinki, Finland.