We have dozens of ancient benchmarks, which mainly test I/O operations, or basic tasks. Or your typical Quake 3 ones.
We really should somehow promote development (maybe as a bounty) for a new benchmark (or benchmark framework) that can push modern hardware (similar to 3Dmark). Whilst it may not seem important, many computer guys use 3Dmark normally as a way to test their overclocking, and compare to other people.
If we design it in a modular fashion, as a framework, where every test is a plugin, the community will help making good plugins. Surely a framework would not take much effort to code.
After we have a proper framework, you could expect members of the community to code:
- I/O tests
- Shader tests
- OpenGL tests
- Even directX tests on windows (we have the advantage though of being able to plugin to winelib too to benchmark wine).
Its a project with a little time needed at the beginning, but it will take on a life of its own. And, since we are in total control, it will give us the ability to accurately test our performance with other OS's, to work out what we can improve (or where we pwn them).
Current benchmarks like 3Dmark are coded in Directx, so are unlikely to be ported to other platforms, and we have the advantage of having a modular system.
In the future, we could use it to test for default installed programs. ie, test automatically if the system is good enough for compwiz. and enable if it runs it well, allow users to only list games for install they can run well, etc.
From #16560 merge:
It would tell user how much ubuntu has improved (or not), which drivers are better, also which hardware (if he changed anything)
It should contain test for:
- It should store information on xml files, including hardware info (in case user changes something)
- It should store information about most important packages - like kernel versions, graphical driver etc
- This tool should also create graphs with combination with all other info from xml's, like:
- Compare system performance with recent kernels
- Compare GPU performance before and after enabling different driver
- Compare overall performance with next releases
- Compare disk performance with different hardware - file systems