Rexer's Annual Data Miner Survey
Encyclopedia
Rexer Analytics’s Annual Data Miner Survey is the largest survey
of data mining
professionals in the industry. It consists of approximately 50 multiple choice
and open-ended questions that cover seven general areas of data mining science and practice: (1) Field and goals, (2) Algorithm
s, (3) Model
s, (4) Tools (software packages used), (5) Technology, (6) Challenges, and (7) Future. This independent survey is published by Rexer Analytics, a data mining consulting firm based in Boston
, Massachusetts
; it is conducted as a service (without corporate sponsorship) to the data mining
community, and the results are usually announced at the PAW (Predictive Analytics World) conferences. This past year (2010), 735 data miners from 60 countries participated.
s, consultant
s, vendors, academics
, and government
and non-government organizations.
This latest survey encompassed:
Statistical survey
Survey methodology is the field that studies surveys, that is, the sample of individuals from a population with a view towards making statistical inferences about the population using the sample. Polls about public opinion, such as political beliefs, are reported in the news media in democracies....
of data mining
Data mining
Data mining , a relatively young and interdisciplinary field of computer science is the process of discovering new patterns from large data sets involving methods at the intersection of artificial intelligence, machine learning, statistics and database systems...
professionals in the industry. It consists of approximately 50 multiple choice
Multiple choice
Multiple choice is a form of assessment in which respondents are asked to select the best possible answer out of the choices from a list. The multiple choice format is most frequently used in educational testing, in market research, and in elections-- when a person chooses between multiple...
and open-ended questions that cover seven general areas of data mining science and practice: (1) Field and goals, (2) Algorithm
Algorithm
In mathematics and computer science, an algorithm is an effective method expressed as a finite list of well-defined instructions for calculating a function. Algorithms are used for calculation, data processing, and automated reasoning...
s, (3) Model
Statistical model
A statistical model is a formalization of relationships between variables in the form of mathematical equations. A statistical model describes how one or more random variables are related to one or more random variables. The model is statistical as the variables are not deterministically but...
s, (4) Tools (software packages used), (5) Technology, (6) Challenges, and (7) Future. This independent survey is published by Rexer Analytics, a data mining consulting firm based in Boston
Boston
Boston is the capital of and largest city in Massachusetts, and is one of the oldest cities in the United States. The largest city in New England, Boston is regarded as the unofficial "Capital of New England" for its economic and cultural impact on the entire New England region. The city proper had...
, Massachusetts
Massachusetts
The Commonwealth of Massachusetts is a state in the New England region of the northeastern United States of America. It is bordered by Rhode Island and Connecticut to the south, New York to the west, and Vermont and New Hampshire to the north; at its east lies the Atlantic Ocean. As of the 2010...
; it is conducted as a service (without corporate sponsorship) to the data mining
Data mining
Data mining , a relatively young and interdisciplinary field of computer science is the process of discovering new patterns from large data sets involving methods at the intersection of artificial intelligence, machine learning, statistics and database systems...
community, and the results are usually announced at the PAW (Predictive Analytics World) conferences. This past year (2010), 735 data miners from 60 countries participated.
Surveys
- 2007 Survey: 27-item survey; 314 responses from individuals in 35 countries.
- 2008 Survey: 34-item survey; 348 responses from individuals in 44 countries.
- 2009 Survey: 40-item survey; 710 participants from 58 countries.
- 2010 Survey: 50-item survey; 735 participants from 60 countries.
- 2011 Survey: To be launched in March 2011.
Fourth annual survey
Results from the most recent survey were unveiled at the October 2010 Predictive Analytics World (PAW) conference held in Washington, DC. Survey participants included corporationCorporation
A corporation is created under the laws of a state as a separate legal entity that has privileges and liabilities that are distinct from those of its members. There are many different forms of corporations, most of which are used to conduct business. Early corporations were established by charter...
s, consultant
Consultant
A consultant is a professional who provides professional or expert advice in a particular area such as management, accountancy, the environment, entertainment, technology, law , human resources, marketing, emergency management, food production, medicine, finance, life management, economics, public...
s, vendors, academics
Academia
Academia is the community of students and scholars engaged in higher education and research.-Etymology:The word comes from the akademeia in ancient Greece. Outside the city walls of Athens, the gymnasium was made famous by Plato as a center of learning...
, and government
Government agency
A government or state agency is a permanent or semi-permanent organization in the machinery of government that is responsible for the oversight and administration of specific functions, such as an intelligence agency. There is a notable variety of agency types...
and non-government organizations.
This latest survey encompassed:
- IndustriesIndustryIndustry refers to the production of an economic good or service within an economy.-Industrial sectors:There are four key industrial economic sectors: the primary sector, largely raw material extraction industries such as mining and farming; the secondary sector, involving refining, construction,...
Applying Data Mining - Most-Used Data Mining Algorithms
- Text MiningText miningText mining, sometimes alternately referred to as text data mining, roughly equivalent to text analytics, refers to the process of deriving high-quality information from text. High-quality information is typically derived through the devising of patterns and trends through means such as...
Trends - Computing Environments
- Evaluations of Analytic Capability & Data Quality
- Top Challenges & Best Practices
- Usage of Data Mining Software Tools
- Satisfaction with Data Mining Tools
- Data Mining and the EconomyEconomyAn economy consists of the economic system of a country or other area; the labor, capital and land resources; and the manufacturing, trade, distribution, and consumption of goods and services of that area...
- Future Trends in Data Mining
External links
- Rexer Analytics Home Page
- 2010 Webcast and Talk at Bentley University Virtual Analytics Symposium: Data Mining Industry Trends
- Data Miner Survey Shows Positive Signs
- Interview of Karl Rexer, President of Rexer AnalyticsRexerRexer Ltd. is an automobile manufacturing company in Estonia. Their first model was the Rex R-10 and that managed to get national type approval. They currently produce the R-12, an AC Cobra replica. It uses the double wishbones from the Lada Niva and a 5.7 litre Chevrolet engine and transmission...
- The Popularity of Data Analysis Software
- 2010 Predictive Analytic World Conference - agenda & session videos
- [ftp://public.dhe.ibm.com/common/ssi/ecm/en/ytw03103usen/YTW03103USEN.PDF Smart teaching: Why data analytics ranks with reading, writing and arithmetic]