Pre-Release User Testing

Mike's cross-platform FreeEMS tuning application, written in C++ using QT. With Mike's natural coding talent and Fred's intimate requirement knowledge it went from concept to full tuning capability in just 8 weeks!
Post Reply
malcom2073
LQFP112 - Up with the play
Posts: 211
Joined: Tue May 01, 2012 4:17 pm
Location: Shrewsbury PA
Contact:

Pre-Release User Testing

Post by malcom2073 »

So, in an effort to curb the number of introduced bugs in core features, I'm going to start a list here of things that will be manually tested before each build.
just throwing out ideas here, this list is by no means complete. If you think of something else, please post it and I'll add it to the list. Some of this will eventually be unit-testable.

Tables:
Increment/Decrement (Normal, and large)
Multi-selection increment/decrement (normal and large)
Multi-selection set value (set single value across a wide selection
Copy/Paste individual values
Copy/Paste Multiple Values
Copy to a spreadsheet, paste from a spreadsheet
Ensure copy/paste and increment/decrement work across axis properly (throwing errors where appropriate and rolling back data)
Save to flash/Load from flash/load from ram testing
Edit a parent and make sure a child location updates.
Edit a child and make sure a parent location updates

Hex Data:
Copy/Paste
Save to flash, load from flash as appropriate.
Edit a parent and make sure a child location updates.
Edit a child and make sure a parent location updates

Settings:
Change com port and baud rate, save and reload to ensure it's saving.

Logging:
Enable/Disable logging, while connected, while not connected, with restarts.
Change log directory, again while connected, while not connected, with restarts
Set to invalid log directory, again ^^
Proper naming of logs based on date and time


Command Line:
Test each startup parameter individually, then in combonation with others.
./emstudio --help
Last edited by malcom2073 on Sat Oct 12, 2013 8:48 pm, edited 2 times in total.
User avatar
Fred
Moderator
Posts: 15431
Joined: Tue Jan 15, 2008 2:31 pm
Location: Home sweet home!
Contact:

Re: Pre-Release User Testing

Post by Fred »

Thanks for taking this initiative! :-)

Log file behaviour, combinations of directories/defaults/customised/changed on fly/out of fresh start, lack of naming, over writing, content of files, corruption of files, this sort of thing. At least 2 regressions here in the past.

Different test routines for 2D and 3D tables.

Window ordering/size behaviour consistent.

Different startup modes, with/without options (you and Dave have both screwed up here in the past).

That's all I've got for now.

Fred.
DIYEFI.org - where Open Source means Open Source, and Free means Freedom
FreeEMS.org - the open source engine management system
FreeEMS dev diary and its comments thread and my turbo truck!
n00bs, do NOT PM or email tech questions! Use the forum!
The ever growing list of FreeEMS success stories!
malcom2073
LQFP112 - Up with the play
Posts: 211
Joined: Tue May 01, 2012 4:17 pm
Location: Shrewsbury PA
Contact:

Re: Pre-Release User Testing

Post by malcom2073 »

Added some items about save to flash/load from flash/ram, as well as parent/child updates as appropriate.
Post Reply