AnalyticBridge

Social Network For Analytic Professionals

I'm thinking of developing an application to be run on thousands of individual computers, in the background, a bit like a botnet, but a friendly version of a botnet. Each participant would accept to install a script on their machine, and they would know exactly what the script is doing - essentially information retrieval with a (distributed) web crawler to identify online fraud, browsing web sites and using text mining techniques to identify associations.

For instance, a user would have his/her machine check 200 web pages every day (in the background), and report statistics to us about the domains being visited. This information would be used to score domains, and eliminate fraud.

Are there any products currently offering this functionality?

Reply to This

Replies to This Discussion

I don't know of any for web crawling specifically, but it sounds a lot like SETI -- getting lots of small computers to do data analysis.

Reply to This

SETI

Reply to This

how about creating a wordpress plugin to host this on idle processing power of servers

Reply to This

RSS

Featured


Advertisement

© 2010   Created by Vincent Granville

Badges  |  Report an Issue  |  Privacy  |  Terms of Service