Posted by
Jimmy Su on
Apr 07, 2011; 3:16pm
URL: http://imagej.273.s1.nabble.com/Parallel-image-processing-using-ImageJ-in-the-Cloud-tp3685113p3685115.html
On Wed, Apr 6, 2011 at 3:24 AM, Johannes Schindelin
<
[hidden email]> wrote:
> Hi Jimmy,
>
> On Mon, 4 Apr 2011, Jimmy Su wrote:
>
>> We recently completed a Phase 1 SBIR project with OSD on the topic of
>> analytic tools in the Cloud.
>
> I only understood half the words in that sentence, but I'm quite used to
> that :-)
>
>> To demonstrate our tool's ability to construct image processing workflow
>> and deploy the generated code to the Cloud, we took ImageJ and added
>> some Cloud processing capabilities by using the MapReduce framework.
>
> What exactly did you do in terms of image processing? Some Gaussian Blur,
> or Find Edges, or some advanced plug-in? From a technical point of view,
> there are huge differences there.
>
We used some operations from the ImageProcessor type such as shifting,
histogram, and edge detection and applied them to images. The
parallelism comes from applying the same set of operations to many
images at the same time. In parallel computing, this would be
classified as data parallelism. We lack the expertise in image
processing, so the set of operations we used may not actually
represent correct ImageJ usage. We look forward to learning more
about this domain as we get involved.
>> We added Cloud processing capability to ImageJ by adding a Hadoop
>> InputFormat to handle image types in HDFS (Hadoop Distributed File
>> System) and encapsulating ImageJ operations in map and reduce methods.
>
> That is _very_ interesting. For a long time I have been wanting to play
> with Hadoop now.
>
>> This significantly increases ImageJ's throughput in processing
>> images. Attached is the running time chart showing processing time
>> decreases from over 5 hours on two nodes to 15 minutes on 64 nodes on
>> Amazon EC2. Are there any interests in the ImageJ community for
>> parallel processing in the Cloud? What kind of applications are you
>> developing that needs ImageJ processing in the Cloud? We would love
>> to hear your feedback.
>
> Two feedbacks from my side:
>
> 1) fantastic!
Thank you.
> 2) where can I get it?
>
At its current state, it is not likely to be useful to the whole
ImageJ community yet, as we only have a few operations from
ImageProcessor running in the Cloud. We would need to learn more
about which operations are most likely to benefit from
parallelization, and add the right interface for using them. We will
definitely contribute our modifications back to ImageJ source tree
when that is done.
Jimmy
> Ciao,
> Johannes
>
>