2 |
Research Plan: Theoretical issues in Fenfire |
Research Plan: Theoretical issues in Fenfire |
3 |
============================================ |
============================================ |
4 |
|
|
|
.. JVK, HH, TJL = locks (tjl on train) |
|
|
|
|
5 |
Abstract |
Abstract |
6 |
======== |
======== |
7 |
|
|
56 |
texture filtering for rendering text, |
texture filtering for rendering text, |
57 |
and new types of controllers. |
and new types of controllers. |
58 |
|
|
59 |
The questions whose answers would benefit the project currently include ... |
.. The questions whose answers would benefit the project currently include ... |
60 |
|
|
61 |
.. (abstract no longer than one page) |
.. (abstract no longer than one page) |
62 |
|
|
63 |
.. raw:: latex |
.. raw:: latex |
64 |
|
|
65 |
\setlength{\parindent}{\fooparindent} |
\setlength{\parindent}{\fooparindent} |
66 |
|
\clearpage |
67 |
|
|
68 |
Table of contents |
Table of contents |
69 |
================= |
================= |
71 |
.. contents:: |
.. contents:: |
72 |
|
|
73 |
.. raw:: latex |
.. raw:: latex |
74 |
|
|
75 |
\tableofcontents |
\tableofcontents |
76 |
|
|
77 |
Background |
Background |
120 |
as the central item and peripherally the connected locations. |
as the central item and peripherally the connected locations. |
121 |
Several of the new technologies in fenfire are related to user interfaces, |
Several of the new technologies in fenfire are related to user interfaces, |
122 |
in particular to showing the context visibly yet nonintrusively. |
in particular to showing the context visibly yet nonintrusively. |
123 |
|
Some of the ideas aiming to maintain continuity in the Fenfire user |
124 |
|
interface (such as focus-context) have already been proved to be efficient by |
125 |
|
earlier researchers. Several ideas presented in this research plan are, however, |
126 |
|
genuinely new and thus need to be subjected to rigorous experimenting and testing. |
127 |
|
|
128 |
Permanent data and peer-to-peer (P2P) information sharing |
Permanent data and peer-to-peer (P2P) information sharing |
129 |
Collaboration with even only |
Collaboration with even only |
241 |
In addition, several manuscripts about various aspects of Fenfire are in preparation. |
In addition, several manuscripts about various aspects of Fenfire are in preparation. |
242 |
|
|
243 |
|
|
244 |
- postgraduate studies performed in the research team |
.. - postgraduate studies performed in the research team |
245 |
|
|
246 |
Janne Kujala |
.. Janne Kujala |
247 |
Marketta Niemelä |
.. Marketta Niemelä |
248 |
|
|
249 |
|
|
250 |
Significance of the research |
Significance of the research |
323 |
Objectives, hypotheses, and methods per sub-project |
Objectives, hypotheses, and methods per sub-project |
324 |
--------------------------------------------------- |
--------------------------------------------------- |
325 |
|
|
|
TJL |
|
|
|
|
326 |
Because of the nature of this project, there are a number |
Because of the nature of this project, there are a number |
327 |
of essentially separate subprojects with distinct objectives and |
of essentially separate subprojects with distinct objectives and |
328 |
results, but with some underlying themes. The separate subprojects are |
results, but with some underlying themes. The separate subprojects are |
331 |
Fillets |
Fillets |
332 |
''''''' |
''''''' |
333 |
|
|
334 |
TJL |
One of the basic principles of the Fenfire user interface is continuity. |
335 |
|
Continuity helps the user to perceive the interface as cognitively |
336 |
|
coherent - things are related to each other, not disconnected. This reduces |
337 |
|
load in the user's working memory. |
338 |
|
|
339 |
Fillets[lukka02fillets] for graph rendering were invented |
Fillets[lukka02fillets] for graph rendering were invented |
340 |
in the Fenfire project at the time when we were |
in the Fenfire project at the time when we were |
341 |
still working with Ted Nelson's ZigZag structure. |
still working with Ted Nelson's ZigZag structure. |
342 |
|
|
343 |
|
Originally the term filleting is used in mechanical engineering |
344 |
|
to denote or rounding corners of surfaces in order to improve |
345 |
|
the properties of cast objects. |
346 |
|
|
|
Filleting, or rounding corners of surfaces, is |
|
|
used in mechanical engineering to improve |
|
|
the properties of cast objects. |
|
347 |
Our use of the filleting for connections in graph-like diagrams |
Our use of the filleting for connections in graph-like diagrams |
348 |
is motivated by the Gestalt principle of good |
is motivated by the Gestalt principle of good |
349 |
continuation. Smoothly changing contours enable more efficient perceptual |
continuation. Smoothly changing contours enable more efficient perceptual |
350 |
grouping of visual elements, in this case, |
grouping of visual elements, in this case, |
351 |
grouping of the node and the connection. |
grouping of the node and the connection. |
352 |
|
|
353 |
In situations where the graph layout is constrained, |
Especially in situations where the graph layout is constrained |
354 |
e.g.~Focus+Context views or views where the coordinates of the nodes |
e.g.~Focus+Context views or views where the coordinates of the nodes |
355 |
are informative, fillets can clarify the relationships considerably without |
are informative, fillets can clarify the relationships considerably without |
356 |
altering the layout. |
altering the layout. |
357 |
|
|
358 |
|
Fillets are already in use in the Fenfire project, but our earlier |
359 |
|
research [lukka02fillets]_ has only scratched the surface; the idea has |
360 |
|
opened several new possible directions for basic research. |
361 |
|
There are several possible extensions of the basic idea: for example, |
362 |
|
using some texturing to express the stretching of the filleted |
363 |
|
connection to the user, or lighting and shadows to provide a sense |
364 |
|
3D shape of the smooth surface. |
365 |
|
|
366 |
One of the basic principles of the Fenfire user interface is continuity. |
One of the basic principles of the Fenfire user interface is continuity. |
367 |
Continuity helps the user to perceive the interface as cognitively |
Continuity helps the user to perceive the interface as cognitively |
368 |
coherent - things are related to each other, not disconnected. This |
coherent - things are related to each other, not disconnected. This |
369 |
reduces load in the user's working memory. |
reduces load in the user's working memory. |
370 |
|
|
371 |
Some of the ideas aiming to maintain continuity in the Fenfire user |
We plan to test the usability of the ideas first in basic cognitive tasks |
372 |
interface (such as focus-context) have been proved to be efficient by |
before implementing and testing them in a larger context. |
|
earlier researchers. Several ideas presented here are, however, genuinely |
|
|
new and thus need to be subjected to rigor experimenting and testing. We |
|
|
plan to test the usability of the ideas first in basic cognitive tasks |
|
|
before implementing and testing them in a larger context. |
|
|
|
|
373 |
The first-phase experiments include tasks varying from very simple |
The first-phase experiments include tasks varying from very simple |
374 |
perceptual tasks (such as visual search and recognition) to more complex |
perceptual tasks (such as visual search and recognition) to more complex |
375 |
problem-solving tasks. The experiments will be conducted with about ten |
problem-solving tasks. The experiments will be conducted with about ten |
386 |
phase, fillets will be tested in a more realistic situation requiring the |
phase, fillets will be tested in a more realistic situation requiring the |
387 |
user to trace visual connections between information items. |
user to trace visual connections between information items. |
388 |
|
|
|
Textured backgrounds implement continuity by providing unique, permanent |
|
|
visual context for interface elements to facilitate search and recognition |
|
|
of the elements in prolonged use. Textures will be tested to show that the |
|
|
user can implicitly memorize textures during interaction with the |
|
|
interface elements and use this information to recognize the elements |
|
|
faster and more accurately. We will also conduct readibility tests on |
|
|
textures to show that a textured background of text does not necessarily |
|
|
impair either the legibility or the readability of the text. |
|
|
|
|
389 |
Finally, we will carry usability tests on a simulated interface, in which |
Finally, we will carry usability tests on a simulated interface, in which |
390 |
several ideas are implemented simultaneously. The users will be observed |
several ideas are implemented simultaneously. The users will be observed |
391 |
in realistic use situations. Behavioral data will be gathered in verbal |
in realistic use situations. Behavioral data will be gathered in verbal |
392 |
protocols, videotaping, and surveys. |
protocols, videotaping, and surveys. |
393 |
|
|
394 |
|
|
395 |
Our earlier reseach has shown that filleting significantly |
.. Generalizing filleting to three dimensions ... |
396 |
improves the perceivability of certain graph layouts. |
.. - quantitative experimental results from general graphs layout |
|
We plan to obtain experimental justification and |
|
|
to formulate principles of filleting |
|
|
in more general layouts including curved connections |
|
|
and smooth animation. |
|
|
Generalizing filleting to three dimensions ... |
|
|
|
|
|
- quantitative experimental results from general graphs layout |
|
|
|
|
|
Goals??? |
|
397 |
|
|
398 |
|
|
399 |
Buoys |
Buoys |
456 |
|
|
457 |
.. make sure about the concrete stuff |
.. make sure about the concrete stuff |
458 |
|
|
459 |
*Break lines* are a technique used in technical drawing |
Break lines are another one of Fenfire's user interface techniques |
460 |
for indicating |
that have been influenced by technical drawing. In technical drawing, break |
461 |
where an object extends beyond what is drawn in the current |
lines are used for indicating where an object extends beyond what |
462 |
diagram. It is visually clear since it uses a shape that |
is drawn in the current diagram. It is visually clear since it uses a shape that |
463 |
is obviously not a part of the object's own shape |
is obviously not a part of the object's own shape |
464 |
(wiggly freehand line, see Fig. [ref-fignasa]_). |
(wiggly freehand line, see Fig. [ref-fignasa]_). |
465 |
We apply this technique by drawing the buoys as |
We apply this technique by drawing the buoys as |
466 |
non-photorealistical pieces torn off the target document. |
non-photorealistic pieces torn off the target document. |
467 |
|
In the software engineering part of the Fenfire project, we have |
468 |
To allow for fluid animation, |
just accepted that this type of animation |
469 |
the shapes of the break lines need to be carefully designed. |
seems to work and moved on; however, this has opened a number of |
470 |
For example, animating a fragment to a full document |
interesting questions for basic research. |
471 |
|
|
472 |
|
An important part of the design of break lines in Fenfire |
473 |
|
is the fluid animation: |
474 |
|
for example, animating a fragment to a full document |
475 |
should not look like the edge just gliding |
should not look like the edge just gliding |
476 |
over the document, but rather as if larger and |
over the document, but rather as if larger and |
477 |
larger parts were magically torn off the original document. |
larger parts were magically torn off the original document. |
478 |
|
In the software engineering part of the Fenfire project, we |
479 |
|
have just accepted that this type of animation seems to work and moved on; |
480 |
|
however, this has opened a number of interesting questions for basic research. |
481 |
|
|
482 |
.. figure:: ../../manuscripts/xupdf/mercury5part2 |
.. figure:: ../../manuscripts/xupdf/mercury5part2 |
483 |
:width: 8.45cm |
:width: 8.45cm |
492 |
The concrete research goals are to evaluate the practical value of |
The concrete research goals are to evaluate the practical value of |
493 |
break lines as implemented in the Fenfire project and |
break lines as implemented in the Fenfire project and |
494 |
to study more formally the perceptual properties |
to study more formally the perceptual properties |
495 |
of different types of torn edges. |
of different types of break lines. |
496 |
Especially the properties of the animation are interesting, |
Especially the properties of the animation are interesting, |
497 |
because it looks quite natural even though |
because the motion appears quite natural even though |
498 |
there is no real-world analogue. |
there is no real-world analogue. |
499 |
|
|
500 |
|
|
523 |
This flexibility allows us to overcome the restrictions in the |
This flexibility allows us to overcome the restrictions in the |
524 |
texture filtering. |
texture filtering. |
525 |
|
|
526 |
|
--- |
527 |
|
However, designing such filters in an *ad hoc* fashion is |
528 |
|
extremely cumbersome and error-prone; a more |
529 |
|
formal approach for evaluating the results of |
530 |
|
different filtering methods is needed. |
531 |
|
|
532 |
|
The goals in this area are the development of a mathematical framework |
533 |
|
for modeling the *perceptual* qualities of rendered text |
534 |
|
as well as experimental evaluation of the models. |
535 |
|
|
536 |
|
As one theoretical approach for the readability modeling |
537 |
|
we plan to use the correlation function of the rendered text. |
538 |
|
There have not been much research on this approach in |
539 |
|
graphics context. |
540 |
|
However, we hope to be able to apply our earlier experience |
541 |
|
on Bayesian methods and similar models. |
542 |
|
--- |
543 |
|
|
544 |
However, designing such filters in an *ad hoc* fashion is |
However, designing such filters in an *ad hoc* fashion is |
545 |
extremely cumbersome and error-prone. What is needed is a suitable |
extremely cumbersome and error-prone. What is needed is a suitable |
546 |
mathematical framework for modeling the |
mathematical framework for modeling the |
705 |
include TEKES, COMAS postgraduate school, Sonera and Nokia. |
include TEKES, COMAS postgraduate school, Sonera and Nokia. |
706 |
|
|
707 |
|
|
708 |
- other projects of the research leader and their funding (also other |
.. - other projects of the research leader and their funding (also other |
709 |
than Academy projects) |
than Academy projects) |
710 |
|
|
|
? |
|
711 |
|
|
712 |
- researcher training, including arrangements for postgraduate |
|
713 |
|
.. - researcher training, including arrangements for postgraduate |
714 |
instruction and supervision |
instruction and supervision |
715 |
|
|
716 |
Currently, there are three COMAS postgraduate students in |
Currently, there are three COMAS postgraduate students in |
723 |
More detailed information about the research trainees' postgraduate studies |
More detailed information about the research trainees' postgraduate studies |
724 |
can be found from their personal postgraduate research plan. |
can be found from their personal postgraduate research plan. |
725 |
|
|
726 |
- Finnish and foreign co-operation within the project |
.. - Finnish and foreign co-operation within the project |
|
|
|
|
? |
|
|
|
|
727 |
|
|
728 |
|
|
729 |
Research environment |
Research environment |
730 |
-------------------- |
-------------------- |
731 |
|
|
770 |
|
|
771 |
|
|
772 |
|
|
773 |
- financial plan for the project, including also funding other than |
.. - financial plan for the project, including also funding other than |
774 |
Academy funding |
Academy funding |
|
|
|
775 |
|
|
|
Funding from industry companies |
|
|
|
|
|
To get funding, show off what we do etc, we need to make |
|
|
showy demos every once in a while. |
|
776 |
|
|
777 |
- detailed grounds for Academy funding applied for (in particular the |
|
778 |
item "other costs") |
.. - detailed grounds for Academy funding applied for (in particular the |
779 |
|
item "other costs") |
780 |
|
|
781 |
Results |
Results |
782 |
======= |
======= |