Subscribe to DSC Newsletter

Featured Blog Posts (1,427)

Radoop and RapidMiner are partners now!

Read below more about this disruptive technology for Big Data Analytics.

This is probably the most exciting announcement of the last months: Radoop and RapidMiner are partners now! Read below more about this disruptive technology for Big Data Analytics.…

Continue

Added by Vincent Granville on March 3, 2012 at 12:00pm — No Comments

What is a Data Scientist?

Interesting article posted in The Guardian (see below). Here's my answer to this question:

A data scientist (I like the term data wizard better) is someone who can consistently derive money out of data, e.g. working as an employee, consultant or in an other capacity, by providing value to clients or extracting…

Continue

Added by Vincent Granville on March 2, 2012 at 9:30am — 2 Comments

Visualization Databases for the Analysis of Large Complex Datasets

Saptarshi Guha / Paul Kidwell / Ryan P. Hafen / William S. Cleveland

Abstract



Comprehensive visualization that preserves the information in a large complex dataset requires a visualization database (VDB): many displays, some with many pages, and with one or more panels per page. A single display using a specific display method results from partitioning the data into subsets, sampling the subsets, and applying the method to each sample, typically one per panel.…

Continue

Added by John A Morrison on March 2, 2012 at 2:39am — No Comments

Social Media Analytics Expert Interview Series: Part 3

What Is Social Media Analytics? - 4 Experts Debate

February 28, 2011Expert Speakers

As a lead-up to the Social Media Analytics Summit, Text Analytics News has partnered with Useful Social Media to publish a series of expert interviews with top Social Media Analytics…

Continue

Added by Vincent Granville on March 1, 2012 at 7:36pm — 1 Comment

Big Data for the Public Good - Seminar Series

We are generating more data than ever before. Thanks to the data scientists who organize and analyze this information, this abundance of Big Data can be harnessed to serve the public interest in innovative ways.

Big Data for the Public Good is a four-part seminar series hosted by Code for America in San…

Continue

Added by Vincent Granville on February 29, 2012 at 10:00pm — No Comments

Features Extraction: Co-occurrences and Graph clustering

In the last two post we have discussed about co - occurrences analysis to extract features  in order to classify documents and extract "meta concepts" from the corpus.

We have also noticed that this approach doesn't return better than the traditional bag of words.

I would now explore some derivation of this approach, taking advantage of the graph theory.

the graph of the co occurrences is really huge and complex, how could we reduce its complexity without big information…

Continue

Added by Cristian Mesiano on February 29, 2012 at 1:59pm — No Comments

STATISTICA Decisioning Platform™ Profiled in Review of Decision Management Solutions

StatSoft’s (www.statsoft.comSTATISTICA Decisioning Platform™ is the only enterprise predictive analytics and decision management software platform to…

Continue

Added by Vincent Granville on February 29, 2012 at 9:55pm — No Comments

New Article on Data Mining: Classifiers & the ROC Curve

Many customer behaviors have the flavor of a choice between two alternatives:  Yes or no.  Buy or sell.  Renew or cancel.  Suppose software called a “classifier” is available to predict customer choices in advance.  Would you use it?  Perhaps you’d like to test it to see how well it performs before you commit.  In this installment of my series on the nuts and bolts of data mining, I discuss the use of classifiers and questions about their performance.  Regarding performance, we specifically…

Continue

Added by Daniel Graettinger on February 27, 2012 at 10:29am — No Comments

Quantifying of Extreme Events

Quantifying of Extreme Events



Vicky Fasen Claudia Kluppelberg Annette Menzel



September 28, 2011

abstract / summary



Understanding and managing risks due extreme events is one of the most demanding topics of our society. We consider this problem as a statistical problem and present some of the probabilistic and statistical theory, which was developed to model and quantify extreme events. By the very nature of an extreme event…

Continue

Added by John A Morrison on February 24, 2012 at 9:10am — No Comments

Attensity, Teradata and Anderson Analytics talk on the future of text analytics

The text analytic market is set to exceed £635mln as businesses look to capture customer sentiment to gain competitive advantage.

Companies from industries as diverse as financial services, pharmaceuticals and online retail are today looking to harness the voice of the customer across social networks to improve their services.

The technology to capture customer sentiment is becoming increasingly sophisticated, responsive, and flexible to distinct business needs. Despite the…

Continue

Added by Vincent Granville on February 21, 2012 at 5:23pm — No Comments

Are 4% mortgage interest rates a mirage?

I believe so. Here are some interesting thoughts on this:

You talk to a mortgage adviser at (say) Wells Fargo bank. You are interested in financing, own > 50%, have 2 salaries (your wife + yourself) that represents more than 50% of the amount you want to refinance,  can make a 30% down payment and have an external income…

Continue

Added by Vincent Granville on February 21, 2012 at 6:30pm — 4 Comments

Detecting Economic Events Using a Semantics-Based Pipeline

Detecting Economic Events Using a Semantics-Based Pipeline

http://people.few.eur.nl/fhogenboom/papers/dexa11-speed.pdf

Alexander Hogenboom, Frederik Hogenboom, Flavius Frasincar, Uzay Kaymak, Otto van der Meer, and Kim Schouten

Erasmus University Rotterdam

Abstract.

In today's information-driven global economy, breaking news on economic…

Continue

Added by John A Morrison on February 21, 2012 at 8:10am — No Comments

From Semantic Search & Integration to Analytics

From Semantic Search & Integration to Analytics

Amit Sheth 

LSDIS lab, University of Georgia, 415 Graduate Studies Research Center,

Athens, GA 30602-7404

Semagix Inc., 297 Prince Avenue,

Athens, GA 30601

Abstract.

Semantics is seen as the key ingredient in the next phase of the Web infrastructure as well as the next generation of enterprise content management. Ontology is the centerpiece of the most prevalent semantic technologies…

Continue

Added by John A Morrison on February 21, 2012 at 6:30am — No Comments

Document Classification: latent semantic vs bag of words. Who is the best?

We have seen few posts ago an approach to extract meta "concepts" from text based on latent semantic paradigm.

In this post we apply this approach to classify documents, and we do a comparison between this approach and the canonical bag of words.

The comparison test will be done through the ensemble method already showed in the last post.

To read the entire post click …

Continue

Added by Cristian Mesiano on February 20, 2012 at 7:22am — No Comments

Example of Bad Analytics and How to Remedy it

This came in my mailbox as a sales pitch by Autobox, however I thought that it is interesting:

Since we are always interested in learning about how others do time series and testing how our approaches work vis-à-vis other dated procedures, we pursued the data and would like to share our results. 



Sometimes in an…

Continue

Added by Vincent Granville on February 16, 2012 at 10:00pm — No Comments

10+ Great Metrics and Strategies for Email Campaign Optimization

This is our first article in a series about good actionable KPI's to optimize various ROI. Future articles will focuse on metrics for fraud detection, user engagement etc. This one focuses on newsletter optimization.

If you run an online newsletter, here are a number of metrics you need to track:…

Continue

Added by Vincent Granville on February 12, 2012 at 8:00pm — 1 Comment

The Age of Big Data | New York Times

By . GOOD with numbers? Fascinated by data? The sound you hear is opportunity knocking.…

Continue

Added by Vincent Granville on February 12, 2012 at 10:29am — No Comments

J.D. Opdyke, Author: Bootstraps, Permutation Tests, and Sampling With and Without Replacement Orders of Magnitude Faster Using SAS®

A very efficient approach to random sampling in SAS® achieves speed increases orders of magnitude faster than the relevant "built-in" SAS® procedures. For sampling with replacement as applied to bootstraps, seven algorithms are compared, and the fastest ("OPDY"), based on the new approach, achieves speed increases over 220x faster than Proc SurveySelect. OPDY also handles datasets many times larger than those on which two hashing algorithms crash. For sampling without replacement as applied…

Continue

Added by J.D. Opdyke on February 12, 2012 at 9:30am — No Comments

Estimating Operational Risk Capital: the Challenges of Truncation, the Hazards of MLE, and the Promise of Robust Statistics

J.D. Opdyke and Alex Cavallo

In operational risk measurement, the estimation of severity distribution parameters is the main driver of capital estimates, yet this remains a non-trivial challenge for many reasons.  Maximum likelihood estimation (MLE) does not adequately meet this challenge because of its well-documented non-robustness to modest violations of idealized textbook model assumptions, specifically that the data are independent and identically distributed (i.i.d.), which is…

Continue

Added by J.D. Opdyke on February 10, 2012 at 3:56pm — No Comments

Monitoring Financial Stability in a Complex World

Monitoring Financial Stability in a Complex World



Mark D. Flood Allan

Office of Financial Research

I. Mendelowitz

Committee to Establish the Office of Financial Research

William Nichols 

National Institute of Finance



Version 10 / January 19, 2012



Copyright 2012, M. Flood, A. Mendelowitz and W. Nichols

Abstract



We offer a tour d’horizon of the data management issues facing…

Continue

Added by John A Morrison on February 9, 2012 at 10:54pm — No Comments

Featured Monthly Archives

2016

2015

2014

2013

2012

2011

2010

2009

2008

Follow Us

On Data Science Central

On DataViz

On Hadoop

© 2016   AnalyticBridge.com is a subsidiary and dedicated channel of Data Science Central LLC   Powered by

Badges  |  Report an Issue  |  Terms of Service