Skip to main content

When is a Beta a Beta

This has been discussed numerous times before but Windows Vista brings it up once again.

I went on a rant on this on this week's FoxShow related to user interface design but I agree.

"As I pointed out last week, it's not a beta until it's feature-complete. Microsoft is showing off a prototype, a demo. When they have the new UI in place, and lock down the features they plan to actually ship, then it is time for beta evaluation and testing."


Ted's Radio Weblog

Comments

Anonymous said…
I have to dissagree with this. The primary purpose of beta testing, at least as my company does it, is to get feedback from real world users in real world situtations on feature sets and usability. Secondary would be performance and stress testing in a live environment. Finding "bugs" is only a minor reason to send a beta version to customers.

So, if you have locked down functionality and design you might as well call it a release candidate.
August 15, 2005 at 11:45 AM
Andrew MacNeill said…
Bob,

The piece in "quotes" were from Ted's original post - I was quoting as opposed to giving my entire view (which was done on the Rant )

I agree with you that it's certainly needed to get feedback from real world users but wouldn't you agree that you should generally be interface-complete for the beta stage?

Agreed that for the an Alpha stage, the interface shouldn't be locked down but by the time you get to beta, the interface should be pretty much set.

I completely agree with the performance and stress comment.
August 15, 2005 at 12:03 PM
Lorena said…
This is a great bllog
January 13, 2025 at 5:03 AM
Post a Comment

Popular posts from this blog

Elevating Project Specifications with Three Insightful ChatGPT Prompts

For developers and testers, ChatGPT, the freely accessible tool from OpenAI, is game-changing. If you want to learn a new programming language, ask for samples or have it convert your existing code. This can be done in Visual Studio Code (using GitHub CoPilot) or directly in the ChatGPT app or web site.  If you’re a tester, ChatGPT can write a test spec or actual test code (if you use Jest or Cypress) based on existing code, copied and pasted into the input area. But ChatGPT can be of huge value for analysts (whether system or business) who need to validate their needs. There’s often a disconnect between developers and analysts. Analysts complain that developers don’t build what they asked for or ask too many questions. Developers complain that analysts haven’t thought of obvious things. In these situations, ChatGPT can be a great intermediary. At its worst, it forces you to think about and then discount obvious issues. At best, it clarifies the needs into documented requirements. ...
Post a Comment
Read more

Respect

Respect is something humans give to each other through personal connection. It’s the bond that forms when we recognize something—or someone—as significant, relatable, or worthy of care. This connection doesn’t have to be limited to people. There was an  article  recently that described the differing attitudes towards AI tools such as ChatGPT and Google Gemini (formerly Bard). Some people treat them like a standard search while others form a sort of personal relationship — being courteous, saying “please” and “thank you”. Occasionally, people share extra details unrelated to their question, like, ‘I’m going to a wedding. What flower goes well with a tuxedo?’ Does an AI “care” how you respond to it? Of course not — it reflects the patterns it’s trained on. Yet our interaction shapes how these tools evolve, and that influence is something we should take seriously. Most of us have all expressed frustration when an AI “hallucinates”. Real or not, the larger issue is that we have hi...
Post a Comment
Read more

When A Machine Starts To Care

“Any sufficiently advanced technology is indistinguishable from magic.” Arthur C. Clarke (1962)  I first used that quote when I was starting out in the tech industry. Back then, it was a way to illustrate just how fast and powerful computers had become. Querying large datasets in seconds felt magical—at least to those who didn’t build them.  Today, we’re facing something even more extraordinary. Large Language Models (LLMs) can now carry on conversations that approach human-level fluency. Clarke’s quote applies again. And just as importantly, many researchers argue that LLMs meet—or at least brush up against—the criteria of the Turing Test.  We tend to criticize LLMs for their “hallucinations,” their sometimes-confident inaccuracies. But let’s be honest: we also complain when our friends misremember facts or recount things inaccurately. This doesn’t excuse LLMs—it simply highlights that the behavior isn’t entirely alien. In some ways, it mirrors our own cognitive limits....
Post a Comment
Read more