Re: ImageJ benchmarks

[Gabriel Landini]

Curtis wrote:
> I thought it was worthwhile to preserve these numbers in some form, so I
> created a FAQ entry on the wiki:
>
http://imagejdocu.tudor.lu/imagej-documentation-wiki/faq/are-there-performance-statistics-to-compare-against-my-system

> If you create a better benchmark, it should be easy enough to update the
>information there, too.

I do not have a "better" benchmark, but running this macro gives almost all
the info necessary to fill the FAQ (it runs 10 times and gives the best and
worst times).
The worst time tends to be the first one, I guess that this is because of the
classes loading.

Fell free to add it to the wiki page if you think it is useful.

Regards,

Gabriel


//---------------------8<---------------------
// benchmark test macro
//
print("- - - ");
run("Mandrill (70K)");
print("ImageJ: "+getVersion());
print("OS : "+getInfo("os.name")+" "+getInfo("os.version"));
print("Java: "+getInfo("java.vm.version")+" "+ getInfo("java.vm.vendor"));

best=100000;
worst=-1;

for(i=0;i<10;i++){
  selectWindow("baboon.jpg");
  run("Duplicate...", "title=test");
  t=getTime();
  run("Benchmark ");
  thisrun= getTime()-t;
  if (thisrun<best) best=thisrun;
  if (thisrun>worst) worst=thisrun;
  close();
}
print("Benchmark best: "+best/1000);
print("Benchmark worst: "+worst/1000);

selectWindow("baboon.jpg");
close();
//---------------------8<---------------------

[Joachim Wesner]

Hi Gabriel,

it does not work as is on my system ("Benchmark" is not found), IJ 139q/Win
2000,
I need to remove the extra space in

      run("Benchmark ");

Mit freundlichen Grüßen / Best regards

Joachim Wesner

Leica Microsystems CMS GmbH | GmbH mit Sitz in Wetzlar | Amtsgericht
Wetzlar  HRB 2432
Geschäftsführer:  Dr. Stefan Traeger | Dr. Wolf-Otto Reuter | Dr. David Roy
Martyr | Colin Davis


                                                                           
             Gabriel Landini                                              
             <[hidden email]                                            
             C.UK>                                                      An
             Gesendet von:              [hidden email]                
             ImageJ Interest                                         Kopie
             Group                                                        
             <[hidden email].                                       Thema
             GOV>                       Re: ImageJ benchmarks              
                                                                           
                                                                           
             07.02.2008 13:58                                              
                                                                           
                                                                           
              Bitte antworten                                              
                    an                                                    
              ImageJ Interest                                              
                   Group                                                  
             <[hidden email].                                            
                   GOV>                                                    
                                                                           
                                                                           




Curtis wrote:
> I thought it was worthwhile to preserve these numbers in some form, so I
> created a FAQ entry on the wiki:
>
http://imagejdocu.tudor.lu/imagej-documentation-wiki/faq/are-there-performance-statistics-to-compare-against-my-system


> If you create a better benchmark, it should be easy enough to update the
>information there, too.

I do not have a "better" benchmark, but running this macro gives almost all

the info necessary to fill the FAQ (it runs 10 times and gives the best and

worst times).
The worst time tends to be the first one, I guess that this is because of
the
classes loading.

Fell free to add it to the wiki page if you think it is useful.

Regards,

Gabriel


//---------------------8<---------------------
// benchmark test macro
//
print("- - - ");
run("Mandrill (70K)");
print("ImageJ: "+getVersion());
print("OS : "+getInfo("os.name")+" "+getInfo("os.version"));
print("Java: "+getInfo("java.vm.version")+" "+ getInfo("java.vm.vendor"));

best=100000;
worst=-1;

for(i=0;i<10;i++){
  selectWindow("baboon.jpg");
  run("Duplicate...", "title=test");
  t=getTime();
  run("Benchmark ");
  thisrun= getTime()-t;
  if (thisrun<best) best=thisrun;
  if (thisrun>worst) worst=thisrun;
  close();
}
print("Benchmark best: "+best/1000);
print("Benchmark worst: "+worst/1000);

selectWindow("baboon.jpg");
close();
//---------------------8<---------------------



______________________________________________________________________
This email has been scanned by the MessageLabs Email Security System.
For more information please visit http://www.messagelabs.com/email 
______________________________________________________________________

[ctrueden]

Hi Gabriel,

Thanks for the macro. The ImageJ documentation wiki site is acting up for me
right now, but I will add it to the FAQ page (with Joachim Wesner's
correction) once it works again.

Cheers,
Curtis

On Feb 7, 2008 6:58 AM, Gabriel Landini <[hidden email]> wrote:

> Curtis wrote:
> > I thought it was worthwhile to preserve these numbers in some form, so I
> > created a FAQ entry on the wiki:
> >
>
> http://imagejdocu.tudor.lu/imagej-documentation-wiki/faq/are-there-performance-statistics-to-compare-against-my-system
>
> > If you create a better benchmark, it should be easy enough to update the
> >information there, too.
>
> I do not have a "better" benchmark, but running this macro gives almost
> all
> the info necessary to fill the FAQ (it runs 10 times and gives the best
> and
> worst times).
> The worst time tends to be the first one, I guess that this is because of
> the
> classes loading.
>
> Fell free to add it to the wiki page if you think it is useful.
>
> Regards,
>
> Gabriel
>
>
> //---------------------8<---------------------
> // benchmark test macro
> //
> print("- - - ");
> run("Mandrill (70K)");
> print("ImageJ: "+getVersion());
> print("OS : "+getInfo("os.name")+" "+getInfo("os.version"));
> print("Java: "+getInfo("java.vm.version")+" "+ getInfo("java.vm.vendor"));
>
> best=100000;
> worst=-1;
>
> for(i=0;i<10;i++){
>  selectWindow("baboon.jpg");
>  run("Duplicate...", "title=test");
>  t=getTime();
>  run("Benchmark ");
>  thisrun= getTime()-t;
>  if (thisrun<best) best=thisrun;
>  if (thisrun>worst) worst=thisrun;
>  close();
> }
> print("Benchmark best: "+best/1000);
> print("Benchmark worst: "+worst/1000);
>
> selectWindow("baboon.jpg");
> close();
> //---------------------8<---------------------
>

[Gabriel Landini]

On Thursday 07 February 2008 21:02:54 Curtis Rueden wrote:
> Thanks for the macro. The ImageJ documentation wiki site is acting up for
> me right now, but I will add it to the FAQ page (with Joachim Wesner's
> correction) once it works again.

I see. I recorded the benchmark with the macro recorder... After Joachim's
mail I realised that I also have installed this jar:

http://rsbweb.nih.gov/ij/plugins/benchmarks.html

So, there are 2 of such commands: "Benchmark" and "Benchmark ".
Obviously the one without the space is better as it is installed by default in
IJ.

By the way, I the Plasma benchmark from the Benchmarks.jar does not work
anymore (show the plasma image and 0 fps in the status bar).

I also noted that the built in benchmark restores the original image, so one
does not need to duplicate, etc. Below is a simplified version.

Regards,
Gabriel


// benchmark test macro
//
print("- - - ");
run("Mandrill (70K)");
print("ImageJ: "+getVersion());
print("OS : "+getInfo("os.name")+" "+getInfo("os.version"));
print("Java: "+getInfo("java.vm.version")+" "+ getInfo("java.vm.vendor"));

best=100000;
worst=-1;

for(i=0;i<10;i++){
  t=getTime();
  run("Benchmark");
  thisrun= getTime()-t;
  if (thisrun<best) best=thisrun;
  if (thisrun>worst) worst=thisrun;
}
print("Benchmark best: "+best/1000);
print("Benchmark worst: "+worst/1000);

selectWindow("baboon.jpg");
close();
//---