Re: Statistics dialog upgrade

Hi Stefan,

thanks for the report. I'll use the KDE repo for further testing - seems
to be big enough :-)

> Yesterday, I tried it with the KDE repository (>723k revisions) under
> x64.
> My results:
>
> * load cache & query data : ~ 2s, 150MB
> * pass data to log dialog : ~60s, 1130MB (1.3G total)
> * fill grid (auto-colwith?): ~75s, <20MB
> * sort grid : ~85s
>
> * open statistics: ~10s

Here we probably need something like a data-view model to speed this up.
Placing always all data in the grid will make it naturally slow. Instead,
only the relevant data, meaning the data that is actually shown should be
requested. Sorting indices could be created once the data was read and
instead of resorting all data in the grid, it could just use a different
sorting index and update the current view.

Problem is: can this be done with the current GUI classes? Or does this
require a partial rewrite of the grid? Essentially what's needed by the
data model is:
- return (quickly) the data for a given range of rows (first and last
visible row) and sort index
- return total number of rows
The view would have to be a fairly simple grid - without a vertical
scrollbar, though. Because the grid itself will only contain the actual
visible data, so the about 30 lines or so that fit into the grid. The
vertical scrollbar must be a separate window control.

(If someone knows the Qt toolkit, it provides such a data-view-model and
is blazing fast even for billions of cells shown in a grid, so this could
be used as inspiration).

Well, while this feature will probably boost performance, it requires lots
of implementation work. The model could be written fairly quickly, but the
view code... :-(

Just my thoughts on the matter,
Andreas

-- 
Andreas Nicolai                         anicolai@syr.edu
PhD Candidate, M.A.M.E                  (315) 443-2641
Syracuse University
151 Link Hall
Syracuse, NY, 13244
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@tortoisesvn.tigris.org
For additional commands, e-mail: dev-help@tortoisesvn.tigris.org