<?xml version="1.0"?>
<rss version="2.0">
  <channel>
    <title><![CDATA[Promote development of modern benchmarking program]]></title>
    <link>http://brainstorm.ubuntu.com/item/5407/</link>
    <description><![CDATA[We have dozens of ancient benchmarks, which mainly test I/O operations, or basic tasks. Or your typical Quake 3 ones.<br /><br />We really should somehow promote development (maybe as a bounty) for a new benchmark (or benchmark framework) that can push modern hardware (similar to 3Dmark). Whilst it may not seem important, many computer guys use 3Dmark normally as a way to test their overclocking, and compare to other people. <br /><br />If we design it in a modular fashion, as a framework, where every test is a plugin, the community will help making good plugins. Surely a framework would not take much effort to code. <br /><br />After we have a proper framework, you could expect members of the community to code:<br />- I/O tests<br />- Shader tests<br />- OpenGL tests <br />- Even directX tests on windows (we have the advantage though of being able to plugin to winelib too to benchmark wine).<br /><br />Its a project with a little time needed at the beginning, but it will take on a life of its own. And, since we are in total control, it will give us the ability to accurately test our performance with other OS's, to work out what we can improve (or where we pwn them). <br /><br />Current benchmarks like 3Dmark are coded in Directx, so are unlikely to be ported to other platforms, and we have the advantage of having a modular system. <br /><br />In the future, we could use it to test for default installed programs. ie, test automatically if the system is good enough for compwiz. and enable if it runs it well, allow users to only list games for install they can run well, etc. <br /><br />----<br />From #16560 merge:<br />It would tell user how much ubuntu has improved (or not), which drivers are better, also which hardware (if he changed anything)<br />It should contain test for:<br />CPU<br />Graphics card<br />Disk(s)<br />etc<br /> - It should store information on xml files, including hardware info (in case user changes something)<br /> - It should store information about most important packages - like kernel versions, graphical driver etc<br /> - This tool should also create graphs with combination with all other info from xml's, like:<br /> - Compare system performance with recent kernels<br /> - Compare GPU performance before and after enabling different driver<br /> - Compare overall performance with next releases<br /> - Compare disk performance with different hardware - file systems<br />
<br />


<b>[453 votes] Solution #1: Auto-generated solution of idea #5407</b>
<br />

<br />
<br />



]]></description>

    <language>en-us</language>
    <pubDate>Sat, 22 Mar 2008 14:26:22 +0000</pubDate>
    <lastBuildDate>Wed, 09 Sep 2009 06:57:06 +0000</lastBuildDate>
    <generator>QAPoll module</generator>
    <guid isPermaLink="true">http://brainstorm.ubuntu.com/idea/5407/</guid>
        <item>
  <title>Comment from Auzy</title>
  <description><![CDATA[And happy easter all :)]]></description>
  <pubDate>Sat, 22 Mar 2008 14:27:36 +0000</pubDate>
</item>
        <item>
  <title>Comment from neon</title>
  <description><![CDATA[+1000. xD And happy easter to you too. ^^]]></description>
  <pubDate>Sat, 22 Mar 2008 17:54:52 +0000</pubDate>
</item>
        <item>
  <title>Comment from Vadim P.</title>
  <description><![CDATA[I believe the Phoronix Test Suite will take care of this, when it's finished.<br /><br />http://www.phoronix-test-suite.com/]]></description>
  <pubDate>Sun, 23 Mar 2008 04:05:53 +0000</pubDate>
</item>
        <item>
  <title>Comment from Lutz_Ifer</title>
  <description><![CDATA[absolutely +1]]></description>
  <pubDate>Wed, 26 Mar 2008 00:01:20 +0000</pubDate>
</item>
        <item>
  <title>Comment from andrewfenn</title>
  <description><![CDATA[I would be willing to help begin coding if you start by providing some high poly artwork as the 3dMark test suite has. If you start by scripting out a scene and then have at least one done to 3dMark quality then I'll start coding.<br /><br />andrew fenn at gmail dot com, with no spaces.]]></description>
  <pubDate>Sat, 29 Mar 2008 19:43:44 +0000</pubDate>
</item>
        <item>
  <title>Comment from Auzy</title>
  <description><![CDATA[Well, i can guarentee a lot of polygons.. Cant guarentee that they are anything more then a teapot or sphere though :P<br /><br /><br />Never really been into art, always been more a coder. But we could always start by plugging into free games ]]></description>
  <pubDate>Tue, 01 Apr 2008 13:40:56 +0000</pubDate>
</item>
        <item>
  <title>Comment from mahjongg</title>
  <description><![CDATA[In my humble opinion the most important thing this code should do is to show a user that his open GL hardware is running, and the drivers are working.<br /><br />At the moment it's very hard to find out if your freshly installed Ubuntu has all the ingredients to support a 3D game, or even compiz fusion, what this code should primarily do is to do a basic test of the functionality of 3D hardware and software, and give pointers when something is failing, for example the hint to install "restricted drivers", when needed.<br /><br />Testing the performance of the 3D hardware is also nice, but just providing the basic knowledge that everything is working, and assisting the user to get it working, is more important, and should be the primary focus.]]></description>
  <pubDate>Tue, 08 Apr 2008 15:25:30 +0000</pubDate>
</item>
        <item>
  <title>Comment from Vadim P.</title>
  <description><![CDATA[This is already done: http://phoronix-test-suite.com/]]></description>
  <pubDate>Thu, 17 Jul 2008 12:23:31 +0000</pubDate>
</item>
        <item>
  <title>Comment from notyetroot</title>
  <description><![CDATA[+0. This would be nice, but we have more pressing issues, like the sub-10% market share to deal with first.]]></description>
  <pubDate>Sun, 10 Aug 2008 15:32:07 +0000</pubDate>
</item>
        <item>
  <title>Comment from notyetroot</title>
  <description><![CDATA[Nvm, +1.]]></description>
  <pubDate>Tue, 12 Aug 2008 19:00:44 +0000</pubDate>
</item>
        <item>
  <title>Comment from Eldmannen</title>
  <description><![CDATA[There has been suspicions about cheating in closed-source benchmark software. Example, developers optimized for a vendor, etc.<br />Having a open-source cross-platform benchmark software would be great.]]></description>
  <pubDate>Tue, 12 Aug 2008 23:58:51 +0000</pubDate>
</item>
        <item>
  <title>Comment from Vadim P.</title>
  <description><![CDATA[There is one already available: http://phoronix-test-suite.com/]]></description>
  <pubDate>Wed, 13 Aug 2008 02:10:40 +0000</pubDate>
</item>
        <item>
  <title>Comment from zoubidoo</title>
  <description><![CDATA[GLMark is a 3D benchmark comparing the different features / extensions of OpenGL. Made for the Linux operating system, but is portable to any other OS that SDL supports.<br /><br />https://sourceforge.net/projects/glmark]]></description>
  <pubDate>Wed, 03 Sep 2008 12:21:16 +0000</pubDate>
</item>
        <item>
  <title>Comment from stoobers</title>
  <description><![CDATA[We don't need more benchmark tools.  What we need are STANDARDIZED tools, and a central database so we can see how specific computers compare while running the same benchmarks.<br /><br />To compare performance, I do a google search for "bogomips".  Some folks post this value.  Its nice, but what i really want to know is:<br /><br />How will mini-itx motherbord QFRP perform while adding integers? floating point multiplication?  How fast will a computer access a simple database with 1 million rows of non-indexed data vs. indexed data?  Which is faster, the QFRP or the XFRP etc.<br /><br />A small handful of test stats will suffice.  Maybe 4 or 5 tests that everyone runs.  Very much like phorenix, but rolled into ubuntu, and (an optional) part of the install / update process.<br /><br />Phoronix comes close, but it emphasizes allowing people to run their own test suites, which doesn't help in a comparison.  We need a standardized, centralized repository.]]></description>
  <pubDate>Wed, 03 Sep 2008 15:57:04 +0000</pubDate>
</item>
      </channel>
</rss>

