Ubuntu QA:
BlogBrainstormPackage status
Log in
Ubuntu QA
The Ubuntu community has contributed 15664 ideas, 77393 comments, 1416168 votes

Idea #7364: applet that visually shows mouse buttons used (useful in screencasts)



up
52
down
Written by subharo the 21 Apr 08 at 17:15. Category: Education.
Related to: Nothing/Others. Status: New
Description
Preliminary Note: this brainstorm idea is complimentary to another: "idea #7359: applet that visually shows keyboard shortcuts used (useful in screencasts)": http://brainstorm.ubuntu.com/idea/7359/
So if you vote for this idea, consider voting for the other one also!

I would like a Gnome applet that allows me to see visually whenever mouse buttons are pressed. For instance, a left-click could produce a semi-transparent, slowly-fading red "aura" around the mouse, which is known to represent a left-click. And a right-click could produce a blue aura. And a middle-click could produce a green aura. And rolling the mousewheel down could make a purple streaking arrow moving down, and rolling the mouse wheel up could produce an orange streaking arrow upwards. (In a preference menu, other colours could be selected instead).

This would be an indispensable teaching aid (say, in a Screencast, or when a teacher is teaching a classroom full of kids how to use Gnome, showing the Gnome Desktop on a data video projector).

Most of us use the mouse (plus additional keystrokes sometimes, like adding "Shift" to a click) instantly and automatically. Most of us would not pause to think that perhaps the people we are explaining things to might not know that way of using the mouse (+ optionally keyboard) yet. When we "bust a move" with more advanced mouse usage, without our audience/student knowing the trick we pulled, it can disorient and confuse them ("what the hell did he just do?"). And many of our audience and students have egos too large to pause us for clarification, thereby admitting they don't know that shortcut, thereby exposing themselves as being ignorant of something that is obvious to us.

So there's a lot of human nature and sociology wrapped up in this idea: this applet eases the sociological divide between the uber-linux-geeks who know all the mouse shortcuts, and those who are still learning, but aren't quite ready to openly admit it. Just think of all the hoardes of computer novices out there who would love to know about these shortcuts, and can only learn about them one at time over the years through slow, painful osmosis from their more-skilled peers. Especially think of all the newcomers to Linux (or Ubuntu) who are hungry for such new skills, and could learn much faster if a tool like this existed. There are tons of users (ie. almost all Baby Boomers I know personally, no offence to them) who don't even know what right-clicking is useful for, nor that it is even *possible* to middle-click the mouse by pressing the mousewheel down carefully, and not rotating it. Don't laugh, it's all too common.

For example, if the Teacher uses Shift-click, the kids may not know which mouse + shortcut key sequence the teacher used (unless the teacher states verbally "and now I'll just press Shift-click to resize this object, maintaining its aspect ratio"). Thanks to the hypothetical implementation of brainstorm idea #7359 http://brainstorm.ubuntu.com/idea/7359/), the word "Shift" could appear on the Gnome panel in bold, white text with a vivid red background, then slowly fade away after a few seconds, plus a red aura appears around the mouse pointer, also slowly fading away.

In this way, students can see each shortcut the teacher knows and uses (but doesn't bother to slow down and explain, which is usually the case).

This feature would also be really useful for anyone who is making video documentation about how to use the Gnome desktop (like is seen at Ubuntu ScreenCasts: http://screencasts.ubuntu.com/). Any fancy mouse usage would be self-evident. The screencast could also be smaller in size because the speaker doesn't have to waste time explaining the mouse usage verbally. In fact, just by watching the mouse move around, and seeing the shortcuts used, that could be documentation enough, without even hearing the voice of the person giving the demonstration.

This is especially useful when your native language is NOT English, thereby making all screencasts far more self-explanatory to those who cannot speak English.

Just think of all these other really useful mouse + keyboard shortcuts that would ideally appear in the same way, and how super useful it would be to the novice user if they could learn these:

- Ctrl + Click (To make a copy of a file as you drag its copy to some new place)

- Alt + Click (to move a window by grabbing it in the center, not by the titlebar, which is indispensable when the titlebar goes off the top of the screen, which sometimes happens on a small display)

- Right click (to show context menus)

- Middle Click (say, when opening new tabs in Firefox)
Tags: (none)

Attachments
No attachments.


Duplicates


Comments
Wikzo wrote on the 21 Apr 08 at 19:08
Interesting idea. It would make Ubuntu even more human, so you get a vote from me.

Eldmannen wrote on the 21 Apr 08 at 19:24
Cool idea.

subharo wrote on the 21 Apr 08 at 20:39
And oh yeah, a double-click could make a doubly-thick red aura around the mouse, the outer layer being even thicker and brighter than the first to distinguish it.

subharo wrote on the 22 Apr 08 at 03:43
A couple of refinements to this idea:

-the "aura" should emanate from the tip of the mouse pointer (the "hotspot"), to help show the exact spot that got clicked on. And that aura should be left behind on the spot that got clicked on, even if the mouse pointer moves away. This will help the viewer continue to easily see the spot that got clicked on as the "aura" fades away.

-Maybe this shouldn't be a Gnome applet, but rather a Compiz special effect: i.e. one of the special effects turned on using the CompizConfig tool ("System" Menu -> Preferences -> Advanced Desktop Effects Settings)

pimlottc wrote on the 16 May 08 at 15:59
This is an excellent idea. It might be useful for some users from an accessibility point of view as well.

subharo wrote on the 22 May 08 at 21:39
A feature request thread for a compiz plugin implementing this idea has been created at the compiz forums:
http://forum.compiz-fusion.org/showthread.php?p=58509#post58509

subharo wrote on the 25 May 08 at 22:10
My post at the Compiz forum elicited responses with links, and there is a compiz plugin that accomplishes this brainstorm idea! Yay! The plugin is called "Visual Event," however it doesn't seem that this plugin is included in Gutsy Gibbon (at least not included with all the standard Compiz plugins you get from a default install).

subharo wrote on the 25 May 08 at 22:44
There is a script that installs the latest compiz plugins for you, but this tool is not in the universe/multiverse, so I'm not sure I trust it...

http://compiz.org/Compiz_GIT_Ubuntu_Repository

subharo wrote on the 3 Jun 08 at 16:18
Ah hah! :D Now this is an example of almost EXACTLY what I'm talking about: see this awesome screencast:

http://files.jnewland.com/firebug.mov

It's a screencast demo of the "Firebug" Firefox Plugin, recorded in OS X. The screencast author is using some kind of tool to highlight his mouse with an "aura", and show the keyboard buttons used. Perfect! Ubuntu people, I beseech you to please rip this off big time!

As of yet, the author of the screencast doesn't reveal the name of this tantalizing tool, although the comments in his blog post here repeatedly beg him to:

http://soylentfoo.jnewland.com/articles/2006/12/08/firebug-10-screencast


Post your comment