Subscribe to Dr. Granville's Weekly Digest

Featured Blog Posts (1,464)

Article: MORE Frequently-Asked Questions about Data Mining

Another recent article from Discovery Corps, Inc. president Tim Graettinger:   Grab Bag 2:  More Frequently-Asked Questions about Data Mining.  

"While helping present a monthly webinar on Data Mining, I'm asked some challenging and really pivotal questions about DM and predictive analytics:  

  1. How much data do I need? 
  2. Why doesn't my predictive model perform as well on new data as it did on the training data?
  3. Are new DM algorithms needed to…

Added by Daniel Graettinger on January 23, 2012 at 1:26pm — 1 Comment

The Rapleaf Personalization Fund: $1MM available to analytic startups

Have a cool idea for a product related to data or personalization? We’ll help you build it! The Rapleaf Personalization Fund is $1 million of cash and in-kind awards (plus invaluable support from our partners) for cool startups that integrate with our data. We’re looking for awesome start-ups based on Rapleaf data that will take personalization to the next level.

Start your Application:…


Added by Vincent Granville on January 22, 2012 at 3:30pm — No Comments

Another idea to help Amazon increase ROI

When you do a book search on Amazon using keywords, in the search result page you see 16 results. If you've bought one (or more) of these books, it still shows up on the search result page. It would be easy to eliminate that book that you already purchased (e.g. by showing it at the bottom of the page), and replacing it by another book that you haven't purchased yet. Sounds to me like an obvious, simple optimization trick. Maybe Amazon's statisticians use very complex models that change…


Added by Marcel Remon on January 21, 2012 at 10:06pm — No Comments

God vs. Analytics

Traditional religions have existed for more than a thousand years, and are usually based on a system of illogical, incompatible dogmas, which can't be modified without killing the whole concept. This is especially true for more conservative flavors such as integrism.

One of the concepts that has resisted time, in many religions, is God: it is traditionally presented as good guy (except that He is bad with those believing in the wrong religion), personified as an old,…


Added by Marcel Remon on January 21, 2012 at 10:31pm — 8 Comments

Big Data is the Answer - What was the Question?

Interesting blog post by SmartAnalytics


  • Big Data, Little Data
  • Big Data Use Cases
  • E-tailing – E-Commerce – Online Retailing Use Cases (Interesting Use Case – Amazon Will Pay Shoppers $5 to Walk Out of Stores Empty-Handed)
  • Retail/Consumer Use Cases
  • Financial Services Use Cases (example: Trade Surveillance Use Case)
  • Web & Digital Media Services Use Cases
  • Government Use…

Added by Vincent Granville on January 21, 2012 at 7:12pm — No Comments

The crisis in the socio-economic continuum of modern civilization - as a historic challenge to...

The crisis in the socio-economic continuum of modern civilization - as a historic challenge to a qualitatively new role of socio-technologies for the expansion of consumption and market diversification is not so much a real possibility - but there is a historical inevitability ... .

Modern civilization has undoubtedly in many respects, the main product of the market economy and market relations. And the social foundations of the…


Added by Oleg Mazukabzov on January 21, 2012 at 10:03am — No Comments

StatSoft's STATISTICA Achieves SAP-Certified Integration With SAP NetWeaverR

StatSoft announced its STATISTICA  has achieved certified integration with the SAP NetWeaver® technology platform. STATISTICA, StatSoft’s flagship analytics software platform, works with SAP NetWeaver®  for data exchange.

Tulsa, OK – January 19, 2012 - StatSoft announced that its STATISTICA release has achieved certified integration with the SAP NetWeaver® technology platform.  STATISTICA, StatSoft’s flagship analytics software platform, works with…


Added by Vincent Granville on January 20, 2012 at 9:00am — No Comments

The value of 'Point in Time' Talent Data

It's interesting when I read dismissive blogs about 'Point in Time' data suggesting it's no longer relevant. I would like to introduce one fundamental data type that does not change and directly impacts business performance: talent analytics. These are numbers representing stable characteristics about how we work naturally and what we are driven by. Think of them as your strengths in numbers form.

Since we all have people in our lives, I don't need to post 10 links…


Added by Mike Kennedy on January 19, 2012 at 10:30am — No Comments

'Point in Time' versus 'Through the Cycle'

Point in Time (PiT) v Through the Cycle (TTC)

There used to be an argument about this; its clear to me now that this is more than an arithmetic conundrum about Ratings and RWAs its a philosophical matter applicable to wider aspects of life & thus any arguments for PiT are just lazy and myopic. Here are some good recent references; I have selected recent papers since the debate has evolved towards a conclusion since it first developed 2 or so years ago. The game has…


Added by John A Morrison on January 19, 2012 at 5:17am — No Comments

A great statistical model for weather forecasts

For places such as the Pacific Northwest, UK or Germany, where weather is highly volatile, I believe that my mentor's model (when I did my PhD) might actually be the best one. In places where weather is easy to predict by looking at satellite images, you might be able to do well without any model.

The model described below is based on data from the Puget Sound (Seattle) area. For many years, weather forecasts for the Seattle area have been notoriously erroneous.…


Added by Analytic Girl on January 18, 2012 at 9:58pm — 2 Comments

A bank offering more than 60% interest rate on saving accounts

You read correctly, not 0.6%, not 6%, but 60%. This is yearly interest, and it requires some fair amount of work, but if you have between $10,000 and $100,000 in savings and can't find a job, this could be worth the effort. Indeed if you have $100,000 in savings you might just be able to survive thanks to the interest paid to you. The way it works is by leveraging new saving account products that banks offer. The more long-term deposits a bank receive, the more leverage it gets, the more…


Added by Analytic Girl on January 18, 2012 at 9:02pm — 4 Comments

Northwestern, IBM collaborate on business analytics courses

Northwestern University and IBM are collaborating on new business and technology curricula to help students gain the latest skills in business analytics. The new courses of study, Masters of Science degree programs with analytics concentrations in the McCormick School of Engineering and Applied Science and the School of Continuing Studies, will better prepare students and current professionals who are seeking new analytics skills for today’s competitive job market.

The U.S. Bureau of…


Added by Vincent Granville on January 17, 2012 at 8:51pm — No Comments

Innovating Performance Models: Start with the Data You Own First

The recent "bigdata" phenomenon has introduced lots of trendy external data types like unstructured social media data. While this data is extremely valuable, IIA Faculty Member Greta Roberts makes the case that performance models should always include a fundamental, obvious, and readily accessible data…


Added by Mike Kennedy on January 17, 2012 at 4:00pm — No Comments

Extract meta concepts through co-occurrences analysis and graph theory

So what I did is the following (be aware that is not the formal implementation of LSA!):
  1. Filter and take the base form of the words as usual.
  2. Build the multidimensional sparse matrix of the co-occurrences;
  3. I calculated for each instance the frequency to find it in the corpus;
  4. I calculated for each instance the frequency to find it in the doc;
  5. I weighted such TF-IDF considering also the distance among the…

Added by Cristian Mesiano on January 13, 2012 at 9:04am — No Comments

Using Analytics to Connect Talent Characteristics with Enterprise Performance

Economic pressure drives businesses to find every advantage for increased business performance. While enterprises have carefully chosen key performance indicators, they are housed separately from key performance indicators of the people who do the work, missing an opportunity to quantitatively link a company's talent characteristics to business operations and outcomes.

IIA's January Office Hours call will discuss the connections between innate talent characteristics and enterprise…


Added by Mike Kennedy on January 10, 2012 at 1:30pm — No Comments

Social media to determine the next President of United States: Flawed Poll, Intrinsic Bias in Social Media

See below Attensity's poll. Using Yahoo users, and Yahoo users only, as participants in the survey will result in a significant bias. This is bad from a design of experiments point of view, and no statistician would run a poll this way. Yahoo users (and social media users in general) are more liberal than other people. For instance, many older people or very poor immigrants who have no Internet account are quite conservative. This reminds me the famous poll 80 years ago when everybody…


Added by Analytic Girl on January 8, 2012 at 10:52am — 2 Comments

Latest Article: Data Mining Lessons from the Movie "Moneyball"

My company (Discovery Corps, Inc.)  president Tim Graettinger has released a new article I think you'll like:

"If you’re a data miner, there’s a good chance you saw the movie Moneyball.  For me, the movie was entertaining, but the book was really enlightening.  I found it to be a source of numerous and familiar lessons about data mining - while couched in the intriguing context of major league baseball.  In this article, I’d like to share some of…


Added by Daniel Graettinger on January 6, 2012 at 1:30pm — No Comments

Business Technology: So, What's Your Algorithm? | Wall Street Journal

We are ruined by our own biases. When making decisions, we see what we want, ignore probabilities, and minimize risks that uproot our hopes.

What's worse, "we are often confident even when we are wrong," writes Daniel Kahneman, in his masterful new book on psychology and economics called "Thinking, Fast and Slow."

An objective…


Added by Vincent Granville on January 4, 2012 at 3:00pm — No Comments

Great apes think analytically | ScienceDaily

Great Apes Make Sophisticated Decisions: Research Suggests That Great Apes Are Capable of Calculating the Odds Before Taking Risks

ScienceDaily (Dec. 29, 2011) — Chimpanzees, orangutans, gorillas and bonobos make more sophisticated decisions than was previously thought. Great apes weigh their chances of success, based on what they know and the likelihood to…


Added by Vincent Granville on January 4, 2012 at 3:00pm — No Comments

Missing Values Imputation with Bayesian Networks

A New Approach to Missing Values Processing with Bayesian Networks

Download the white paper here (39.5 MB).

With the abundance of “big data” in the field of analytics, and all the challenges today’s immense data volume is causing, it may not be particularly fashionable or pressing to discuss missing values. After all, who cares…


Added by Vincent Granville on January 4, 2012 at 2:39pm — No Comments

Featured Monthly Archives









© 2015 is a subsidiary and dedicated channel of Data Science Central LLC

Badges  |  Report an Issue  |  Terms of Service