Yongping Gao will defend his Master thesis on December 12 at 10am in EV 3.309

28 Nov 2017

A New Algorithm to Split and Merge Ultra-High Resolution 3D Images

Splitting and merging ultra-high resolution 3D images is a requirement for parallel or distributed processing operations. Naive algorithms to split and merge 3D blocks from ultra-high resolution images perform very poorly, due to the number of seeks required to reconstruct spatially-adjacent blocks from linear data organizations on disk. The current solution to deal with this problem is to use file formats that preserve spatial proximity on disk, but this comes with additional complexity. We introduce a new algorithm called Multiple reads/writes to split and merge ultra-high resolution 3D images efficiently from simple file formats. Multiple reads/writes write contiguously in the reconstructed image, which leads to substantial performance improvements compared to existing algorithms. We parallelize our algorithm using multi-threading, which further improves the performance for data stored on a Hadoop cluster. We also show that on-the-fly lossless compression with the lz4 algorithm reduces the split and merge time further.

New preprint: Boutiques: a flexible framework for automated application integration in computing platforms

7 Nov 2017

We present Boutiques, a system to automatically publish, integrate and execute applications across computational platforms. Boutiques applications are installed through software containers described in a rich and flexible JSON language. A set of core tools facilitate the construction, validation, import, execution, and publishing of applications. Boutiques is currently supported by several distinct virtual research platforms, and it has been used to describe dozens of applications in the neuroinformatics domain. We expect Boutiques to improve the quality of application integration in computational platforms, to reduce redundancy of effort, to contribute to computational reproducibility, and to foster Open Science.

Presentation at BigBrain workshop

3 Nov 2017

See complete workshop schedule here.

Neurostorm Hackathon

24-27 Oct 2017

Valérie Hayot participated to the Neurostorm hackathon in Woodshole.

New paper accepted!

12 Oct 2017

To be presented at IEEE Big Data 2017: Sequential algorithms to split and merge ultra-high resolution 3D images, Valérie Hayot-Sasson, Yongping Gao, Yuhong Yan, Tristan Glatard.

Colloquium: Towards a Sustainable Digital Society: From Clouds to Connected Objects

06 Oct 2017

Towards a Sustainable Digital Society: From Clouds to Connected Objects

Organized at Concordia as part of the Entretiens Jacques Cartier event. The aim of the symposium is to allow interactions between researchers working on different perspectivesin communication networks, terminal equipment, connected object and data centers, but sharing a common concern to design the digital society of tomorrow in a development perspective Sustainable development.

Register here


September 2017

Valérie Hayot-Sasson and Lalet Scaria have been selected to participate to Neurohackweek 2017, congratulations!

Stanford CRN coding sprint

28 Aug 2017

Lalet Scaria, Greg Kiar, Valérie Hayot-Sasson and Tristan Glatard participate to the Coding Sprint organized by the Stanford Center for Reproducible Neuroscience.

Neuroinformatics 2017

20-21 Aug 2017

Lalet Scaria presented an abstract at Neuroinformatics 2017: Reproducibility of Human Connectome Project pipelines across operating systems.

New preprint

20 Aug 2017

New pre-print available: Sequential algorithms to split and merge ultra-high resolution 3D images.