Skip to main content

What VFP 9's Removal of Array Limits Really Means

Interesting post by John K. about how the limits in VFP 9 have been substantially removed and yet may still rear their ugly head because of machine constraints.

But it explains very well how and why you may want to rethink how your applications may be built.

A great example is the removal of the limitations of an array.

Let's say you have 1,000,000 records in a table named X.

I created this table by listing all of the files in a folder showing two columns: one for the file name and another for the size.
CFIELD1 C(30)
NSIZE N(10)

=ADIR(la,"C:\windows\system32\*.*")
CREATE TABLE x (cField1 C(30), nsize N(10))
lnRow = 1
FOR lni = 1 TO 1000000
IF lnRow+lni>ALEN(la,1)
lnRow = 1
ELSE
lnRow = lnRow+lni
ENDIF
INSERT INTO X VALUES (la(lnRow,1),la(lnRow,2))
ENDFOR

This ensured I had at least some variety of data in my results.

In VFP 7, you couldn't do

SELECT * FROM x INTO ARRAY la

You would run out of memory.

However you CAN do it in VFP 9 which means that even though VFP is super fast with tables, it's even faster with memory.

Examples
Sorting Data
ASORT(la,2) took .698 seconds on a P IV with 512MB RAM.
INDEX ON nSize TAG t took 4.355 seconds in VFP 9

(note: ASORT(la,1) - which is the field name took approximately 2.5 seconds, the Index took 7 seconds)

Interestingly, not doing the index to a tag but to its own IDX took 1.6 seconds

Looking for Data
ASCAN(la,"WRITE.EXE") took .329 seconds
LOCATE FOR cField1="WRITE.EXE" took close to 1 second

(Note: If you do a SELECT * FROM X INTO CURSOR y and try the same things, the locate statement only takes about .600 seconds)

See where this is leading? If you have to process data in memory, it makes far more sense to put it into a cursor or better yet into an array.

And you can even put these arrays into objects for quick retrieval:

loCustomers = CREATEOBJECT("Custom")
loCustomers.AddProperty("myData(1,2)")
SELECT * FROM X INTO ARRAY loCustomers.myData

All the same performance benefits apply.

As database developers, we often think of things as tables for storing temporary data, but now with VFP 9, we can store them as memory variables and wow! the performance gets instantly better.

If performance is your thing, then VFP 9 is definitely king.


The Limits of Architecture vs. The Architecture of Limits (by John Koziol)

Comments

Popular posts from this blog

Merry Christmas

Whether you celebrate now, have already celebrated your past holiday, are planning to, or not, I hope you find yourself surrounded by family and those you love during this holiday season and are able to remember fondly those who are not with you. We often find ourselves buried in work, or too distracted by other problems, to share and remember a few moments with those closest to us. So many of us are separated by huge distances, we often find it easier to focus on those who are out of arm's reach yet so easy to connect with online, instead of those who are right beside us. So do yourself a favour, put down the keyboard (stylus, mouse, etc) and spend that time. I know I will. Merry Christmas. Powered by ScribeFire .

Who Wants To Be Logical? I Do! I Don't! (with Claude)

In my book, Towards Consciousness, I explore PET , a theory that attempts to explain consciousness and possibly how it might apply to AI. As part of the conversations with AI series, I've included this conversation with Claude.AI in which we were talking about something very different and yet the conversation redirected itself back to PET. For the record, there is no such thing as "Colfsity". A It's interesting to me that people want to proclaim their distinction from being rigid and unlike machines, yet they also complain that the "best" people keep a rigid schedule, regular routines and logic understanding of issues. That's a perceptive observation about a real tension in how people think about themselves and what they value. There does seem to be this paradox where rigidity is simultaneously rejected as "robotic" or inhuman, yet praised when it appears as discipline, consistency, or logical thinking. I think part of what's happening is t...

Comparing education systems based on their technology

(yes, I originally found this blog because of Scoble's note on it BUT it was kind of interesting all the same) Read Alex Mallet's summary of his first week at MIT. Malletrivia: Summary of the first complete week Wow - "There's an incredible amount of material packed into each lecture" - and it sounds interesting... Compared to some of the lecture content I have seen at our universities, you really must get what you pay for. While it sounds like Alex is writing frantically down notes in his classes, at least he's finding something worth writing about in them. Case in point: one of our local universities ( Carleton ) puts some lecture classes on the TV (like many universities do) - but you would think they purposely find the most boring professors to teach them. They put up PowerPoint slides with 30 points on them, speak in monotone voice (yes, imagine the typical caricature of the university lecture from years ago), tell the students to print their...