AnalyticBridge

Data Intelligence, Business Analytics

size constraints in rapidminer and R

Hi all.

I understand that Rapidminer and R has its limitation in size constraints (number of rows or records) since it is a community software. However is there any estimation on how many rows can these softwares take? Millions of rows? 1 million , 2million?

I need this information. Thanks in advance.

Tags: and, constraints, in, r, rapidminer, size

Replies to This Discussion

Permalink Reply by Balázs Bárány on June 27, 2012 at 4:19am

Hi!

Their status as open source, community software doesn't have anything to do with dataset size limitations.

Both work with data in memory. So the limit is the available memory. On a notebook with 2 GB of RAM the limit is smaller than on a 64 bit server with 16 GB of RAM.

The limitations don't depend on rows only but what is in those rows. One row with 10 string fields takes more memory than 100 rows of a few integer values.

So you can say: Both software packages can easily cope with millions of rows as long as they fit into the computer's RAM.

RSS

Welcome to
AnalyticBridge

Sign Up
or Sign In

Or sign in with:

Top Content

1	Map of Data Science University Programs
2	Use PRESS, not R squared to judge predictive power of regression
3	Text mining: alternative to Wordflex?
4	Audience expansion
5	How to develop churn prediction model for telecom company?
6	Strategy for building a “good” predictive model
7	The End of Theory: The Data Deluge Makes the Scientific Method Obsolete \| Wired
8	Identifying the number of clusters: finally a solution
9	Can we automate data mining?
10	The application of Propensity Score Matching