Light microscopy applications in systems biology: opportunities and challenges
Cell Communication and Signalingvolume 11, Article number: 24 (2013)
Biological systems present multiple scales of complexity, ranging from molecules to entire populations. Light microscopy is one of the least invasive techniques used to access information from various biological scales in living cells. The combination of molecular biology and imaging provides a bottom-up tool for direct insight into how molecular processes work on a cellular scale. However, imaging can also be used as a top-down approach to study the behavior of a system without detailed prior knowledge about its underlying molecular mechanisms. In this review, we highlight the recent developments on microscopy-based systems analyses and discuss the complementary opportunities and different challenges with high-content screening and high-throughput imaging. Furthermore, we provide a comprehensive overview of the available platforms that can be used for image analysis, which enable community-driven efforts in the development of image-based systems biology.
Humans are essentially a visual species. Most of our sensory neocortex is engaged in the processing of visual inputs that we gather from our surroundings. Not surprisingly, visualization techniques are at the heart of science and engineering . One of the ultimate goals of systems biology is to elucidate relationships between molecular system states and higher order phenotypic traits. However, light scattering and other optical properties of living matter complicate the acquisition of informative images. For many decades, chemical fixation and the slicing of biological matter have been used to improve the stability and optical properties of samples. However, understanding living dynamic biological systems by examining fixed specimens is, at the best, a heuristic process.
The main challenge of the post-genomic era is understanding the rules governing dynamic biological systems. Current genomic tools in combination with advances in microscopy and computation facilitate in vivo observations of any genetic entity of interest. Recent progress in biotechnology, technology, and interdisciplinary cooperation provides more realistic insights into biological processes than ever before. With regard to systems biology, microscopy is a tool that connects multiple scales of biological complexity, ranging from molecules to populations. Recent progress in light microscopy allows for unprecedented insights into nanostructures, as well as unprecedented experimental throughput. In addition, high-resolution three-dimensional (3D) imaging of small, whole organisms is now feasible across time . In turn, the progress in imaging technologies requires computer vision techniques for automated image analysis.
Light microscopy opportunities in systems biology
Groundbreaking progress in technology during recent decades has leveraged the development of high-resolution microscopy [3–9]. In addition, improved understanding of chemical and physical properties of genetically encoded fluorescence markers has led to the optimization of live cell imaging applications and limited undesired experimental side effects . Furthermore, the growing palette of available fluorescent proteins [11, 12] and other fluorescent labels [13–16] has facilitated the imaging of a broad range of sample types, ranging from single molecules to whole organisms. On the other hand, most microscopes are highly specialized devices. Therefore, the selection of appropriate microscopes and data analysis tools requires the consideration of biological questions and sample properties (Figure 1). In the following sections we introduce biological systems ranging from single protein complexes to cell culture models and organisms of increasing complexity and give illustrative examples of appropriate light microscopy applications. In many cases, however, the shown techniques can be used for a whole range of sample types.
Molecular imaging is a discipline at the intersection between molecular biology and in vivo imaging. Optical molecular imaging can be used as a powerful tool for studying the temporal and spatial dynamics of biomolecules and their interactions , in vitro as well as in vivo.
On a purely molecular scale, imaging has for example provided an understanding of the rotational movement of F1-ATPase within ATP synthase . The analysis of such highly structured macromolecular complexes of sizes and dynamics within nanometer and microsecond ranges, respectively, requires preliminary knowledge about molecular players. To observe the rotation under a microscope, Yasuda et al.  fixed subcomplexes of F1 on surface-bound beads and attached a fluorescently labeled actin filament to each γ subunit of ATP synthase. These structures were mounted on cover glasses. The in vitro addition of ATP finally triggered the continuous rotation of a few percentage of fluorescent actin filaments. At the time, these high-speed images obtained at single-molecule resolution were recorded on an 8-mm videotape. Since this work was published, new technologies have been developed to obtain even higher temporal and spatial data resolution . However, sample preparations for such studies remain to be a manual and time-intensive endeavor .
Single molecule imaging in living matter provides the ability to study the molecular organization in cells and tissues by localizing specific molecules, such as RNA and proteins, in a native cellular context. However, many subcellular structures have dimensions lying below the diffraction limit of the visible light. Therefore superresolution microscopy techniques, allowing to look beyond the diffraction limit, such as PALM and STORM, are increasingly used for analyzing the organizational principles of molecular complexes and single molecules within living cells . A central paradigm in systems biology is the aim for understanding biological networks including many different molecular factors. In classical fluorescence microscopy, however, the number of channels, which can be measured simultaneously, is limited by the spectral overlap between fluorophores. In this context it is important to note that recent developments have succeeded in increasing the number of molecular species that can be measured simultaneously. For example, Lubeck et al.  reported a method that drastically increases the number of simultaneously measurable molecular species by combining super-resolution microscopy and combinatorial labeling using mRNA barcodes with adjacent emitter/activator pairs. As a proof of concept, the authors analyzed the mRNA levels of 32 genes within a single yeast cell. Further improvements of this barcoding technology could potentially be used to perform -omics experiments at single-cell resolution, which could be a major milestone for systems biology.
From a holistic perspective, the mechanistic understanding of single molecular machines does, however, not allow for a complete understanding of higher level systems. Instead, it is important to study multiple scales of biological systems and identify potential signal transduction chains between molecules, cells, organs, and complex traits such as clinical syndromes. A major aim of modern systems biology and systems biomedicine is translational research, which develops clinical applications for improving patients’ quality of life . However, before finding a clinical application, findings of in vitro experiments need to be validated in a more physiological context, such as molecular imaging in cell culture, live tissue culture , or a living brain [25–27].
The in vitro imaging of biophysical processes at the molecular scale requires time-intensive sample preparation, whereas the imaging of higher-scale processes (Figure 2) is often feasible at higher throughput, which is an important advantage in terms of statistical power and network analysis. Cell-based screening for biological or chemical compounds with biological effects is at the core of modern translational systems biology. High content screening (HCS) combines high-throughput microscopy with the automated extraction of a multitude of single-cell physiological features . Automated microscopes equipped with an autofocus system [29, 30] can be used to perform high-throughput experiments, in which the effects of hundreds of thousands of compounds or genetic perturbations are analyzed. The classical readouts of such image-based high-throughput screenings are fixed endpoints that can gather data from multiple image channels. While the lack of dynamical information is a constraint of endpoint measurements, both the possible high-throughput of endpoint measurements and the possibility to use antibodies that target intracellular antigens in fixed samples are valid arguments for choosing an endpoint analysis strategy . In contrast to many biochemical assays, the resulting images of cell populations circumvent the limitations of population averages  by analyzing image data at the single-cell level . However, the large volume of images produced by such high-throughput screening requires automated image analysis, including the identification and isolation of regions or objects of interest (segmentation) as well as the extraction of numerical intensity and morphology features.
In addition to single-cell information, light microscopy provides a path from rough static models to more refined dynamic models. Low- and medium-throughput automated microscopy can be used to acquire sequential image series of multiple samples and analyze the resulting kinetic data. The greatest strength of live cell imaging is its potential to assess the dynamics of cellular and even subcellular events. One example is a study by Chao et al. , in which the local translation of specific mRNAs was analyzed in single cells. With regard to cell populations, live cell imaging enables assessment of cellular heterogeneity and synchrony, which are important for understanding cellular differentiation [40–42], as well as local and global control mechanisms of transcription factors such as NF-kappaB [43, 44].
Modern live cell imaging can build upon a whole arsenal of fluorescence-based methods that can be used to quantify the subcellular distribution of proteins, dynamics of subcellular shuttling processes, and molecular binding rates . Using a highly tuned setup such as Förster resonance energy transfer (FRET) and fluorescence lifetime imaging microscopy, the dynamics of fast spatiotemporal protein-protein interactions can be observed at a molecular resolution . However, the adequate interpretation of spatially resolved dynamic information requires more advanced analysis than steady-state images. In addition to segmentation, live cell imaging applications often require object tracking. Dynamic information can be highly relevant for translational research. For example, determining a correlation between hydrogel substrate elasticity and the migration of muscle stem cells could lead to the development of cell-based therapies for muscle-wasting diseases . Classical tracking algorithms segment and track cells in a sequential approach by connecting neighboring time points. However, in contrast to classical tracking and cell lineage identification algorithms, improved algorithms that consider the entire image sequence, and prior knowledge (e.g., about mitosis and apoptosis) for annotating the best track and identifying the most likely cell lineage can be achieved .
The possibility of simultaneous measurement of a multitude of cellular properties or features gives HCS tremendous power and challenging complexity. Typical applications include screening for potential leads, molecules that are potential drug candidates, and genetic screening. Both approaches detect changes in cellular morphology resulting from molecular factors. While multiscale analysis in systems biology aims to connect molecular factors and phenotypic outcomes, HCS can be used for both top-down and bottom-up approaches . Using HCS it is possible to analyze the effects of untested molecular factors on well-defined phenotypic outcomes or to classify multifactorial phenotypic traits for predicting underlying network states and pathways. Using HCS to predict potential pathways or the molecular targets of compounds identified in phenotypic screens is a hypothesis-generating approach that can provide new perspectives for understanding complex diseases with undiscovered pathogenic processes. In contrast, using HCS to validate potential drug targets is a more classical, hypothesis-driven approach, which requires more specific prior knowledge about phenotypic traits. One common example is RNA interference screening, which often focuses on a precisely defined phenotype .
The most advanced form of HCS combines bottom-up and top-down approaches. For example, HCS can combine genome-wide screening with a holistic view on a broad range of phenotypic features. A genome-wide RNA interference screen with highly advanced computational image processing performed by Neumann and Walter et al., used large-scale multifactorial phenotypic profiling from 2-day live cell imaging to successfully identify hundreds of human genes involved in diverse biological functions, including cell division, migration, and survival [48, 49]. Importantly, this study also demonstrated the value of single-cell event-order analysis for investigations that aim to understand correlation and causality on a cellular scale.
The imaging of rare events such as cell division remains to be a challenging endeavor. One way to circumvent the manual selection of rare events is to use machine learning approaches to identify cellular events of interest. To fill this gap, Conrad et al.  developed Micropilot, a software that automates the identification of cell states and decision making for targeted image acquisition. Pre-filtering at the image acquisition level can lead to a loss of valuable information; hence, the applicability of pre-filtering depends on the type of pre-filtering and biological questions asked. For example, pre-filtering removes information from prior time points but allows for increased throughput of downstream event-order analysis at selected regions of interest.
One primary goal of systems biology is to achieve a systems level of understanding of cellular genetics and physiology. The budding yeast, a simple and genetically tractable eukaryotic system, is a premier model organism for such functional genomic study . Classical genomic screens in yeast have focused on specific morphological features such as cell size, cell shape, or bud site pattern [52, 53]. In addition, the short lifespan of this model organism presents an interesting feature for research on aging. However, yeast cells in liquid culture are suspension cells. Budding results in an exponential increase in the number of daughter cells. The classical analysis of aging in short-lived budding yeast by taking snapshots of a single yeast cell throughout its entire lifespan [54, 55] involves laborious manual dissections of daughter cells from larger mother cells. Recently, Lee et al.  described a microfluidics-based solution, in which cells were immobilized throughout their lifespan without accumulating daughter cells. As a result, the combination of microfluidics with microscopy drastically improved the workflow for image-based analysis of aging. Microscope-based cytometry is also a powerful tool with freely available software that quantifies fluorescence intensities in cellular resolution time series .
Similar to mammalian cell culture, yeast projects need to maximize the multiplicity of phenotypic readouts. The ready to use solution for multiparametric morphological analysis of yeast cells, CalMorph, is an image processing program that quantifies 501 cell morphology parameters in triple-stained yeast cells [58–60]. The automated phenotyping of subcellular events has successfully been used to identify drug targets based on morphological phenotypes of a reference mutant panel .
A pure cell culture-based analysis of gene regulatory networks is not sufficient for understanding signal transduction pathways, which can involve multiple regulatory mechanisms at different scales of biological complexity. Compared to yeast, the worm Caenorhabditis elegans has the advantage of being a multicellular animal model with higher genetic homology to humans. Furthermore, drug discovery screens with whole animals have the advantage of identifying compounds that modulate systemic phenotypes. Animal screens also have the potential to eliminate compounds with systemic toxicity earlier in the discovery process. The ability to conduct forward and reverse genetic screens in animal models such as C. elegans remains to be one of the most powerful experimental paradigms for understanding molecular pathways underlying human disease phenotypes . The potential to analyze large numbers of isogenic animals through high-throughput and HCS for accessing different aspects of human disease phenotypes will certainly ensure an important role for this model organism in future oriented translational research [62–67]. With regard to imaging, its small size of only approximately 1 mm for adults and transparency at all stages of development are advantageous features. Finally, the possibility of flow sorting of worms by both size and fluorescence enables high-throughput experiments to be conducted .
One example of advanced image analysis in C. elegans is behavioral motility analysis. C. elegans can move through a wide range of environments, including crawling on substrates, swimming in fluids, and locomotion through microfluidic substrates. For classical locomotion analysis, each environment requires customized state-of-the-art image processing tools that rely on heuristic parameter tuning [69–80]. Sznitman et al.  recently proposed a so-called multi-environment model estimation framework that is versatile within various environments. In this image analysis process, statistical models for the background environment and nematode appearance are explicitly learned from a single image, which includes a nematode in its environment, and are used to accurately segment target nematodes.
Locomotive movements and complex morphological structures of the worms are of interest for multiscale approaches in systems biology, which aim to connect molecular events and organic states. Complete organisms such as C. elegans have more morphological features than simple cellular models. Green et al.  showed that steady-state phenotypic profiles of complex tissues such as gonads were sufficient for reconstructing a high-resolution genetic network of C. elegans. However, the relatively complex morphology presents a challenge for the comparative analysis of different worms. Image registration is a classical tool for resolving such problems. Recent developments in image processing can straighten C. elegans images, create an annotated 3D body atlas of the worm [35, 83], and perform high-throughput morphological phenotyping of individual worms .
Advances in Bessel-beam technology and structured illumination microscopy promise even deeper insights, beyond the diffraction limit, into complex biological phenomena that require extended high-resolution time series in a multicellular context [7, 84].
In contrast to C. elegans, the zebrafish, also known as Danio rerio, belongs to the class of vertebrates, which is an advantage in the context of translational research. The zebrafish system with its small transparent larva can be used in diverse screening assays, including the analysis of development and organ function in living animals. In addition, genetic and chemical perturbation methods are well established [85, 86]. Zebrafish can be used in small molecule screening, genetic screens, drug discovery, drug lead identification, and target identification [87, 88]. However, the throughput of such screens decreases with the age and size of the fish. The main strength of this model lies in developmental biology applications  rather than applications related to aging.
In the context of imaging the central nervous system, high-resolution images of brain cells need to be acquired. Hence, blindly chosen fixed-field-views that lead to the potential omission of features of interest or low-resolution data of whole objects lacking cellular detail cannot fulfill this need. Stitching is an alternative of acquiring multiple fields of view at a high resolution for subsequent reassembling that can significantly increase imaging times and produce excessive and redundant data volumes. The problem of untargeted image acquisition patterns is a widespread issue that generally limits the efficiency of HCS assays. However, custom algorithms can solve this problem by automatically identifying predefined regions such as the fish brain, and triggering targeted high-resolution captures . However, for interpreting brain phenotypes, the data from single fish need to be mapped to a standard brain map to facilitate the statistical evaluation of replicate zebrafish brains. This registration problem can be solved with the Virtual Brain Explorer (ViBE-Z), which is a software tool that maps cellular gene expression data to a 3D standard larval zebrafish by using a fluorescent stain of cell nuclei for image registration .
Compared to previously described animal models, mouse models only enable moderate experimental throughput. Due to the optical properties of mice, immunohistochemistry remains a gold standard method in this field. One common strategy for increasing the experimental throughput is the use of tissue arrays . Notably, modern image analysis tools can assist in the evaluation of the resulting colored tissue images [92, 93].
Recently, evolved imaging techniques and image analysis tools have enabled non-invasive experimental workflows providing statistically relevant amounts of data. Near-infrared fluorescent optical imaging agents, which maximize the depth of tissue penetration, can be used for non-invasive whole mouse imaging, thus enabling the analysis of the presence and evolution of internal markers for disease progression [38, 94]. Recent progress in image analysis has also been useful in the behavioral studies of mice; video tracking can be used to analyze the explorative behavior of mice . For example, MiceProfiler is an open-source software that tracks and models the behavior of untagged mice .
The in vivo observation of live neurons is a useful approach because these cells perform their basic function of information processing by connecting with their neighbors. One way of monitoring the cellular dynamics of living neurons in mouse tissue is to use hippocampal slices of 5- to 7-day-old mice [97, 98]. However, observing cellular dynamics in living mice is a more challenging endeavor. Berning et al.  used custom stimulated emission depletion microscopy to observe neurons and the movement of dendritic spines in the cerebral cortex of a living mouse . This method was very invasive as optical access was provided by a glass-sealed hole in the skull of the anaesthetized and immobilized mouse. However, intravital microscopy is relevant for translational research, and significant technological progress has been made in recent years [99–101]. Two major limitations of classical intravital microscopy are the limited optical penetration depth and immobilization of mice; however, these limitations can be overcome by using miniaturized implantable microscopes [37, 102–108].
The challenge of quantitative image analysis
A central goal of image analysis is the conversion of microscopic images into biologically meaningful quantitative data. However, the amounts of image data produced using modern systems biology are very vast for manual analysis; hence, the development of automated image analysis tools is essential. Due to the complexity and size of modern imaging data, the computational analysis of biological imaging data has already become a vital emerging sub-discipline of bioinformatics and computer vision . Research using multiparametric imaging data relies heavily on computational approaches for image acquisition, data management, visualization, and correct data interpretation [110–112]. The typical functions of dedicated computer vision systems are data pre-processing, image segmentation, feature extraction, and decision making [113, 114]. Over the past 20 years, a myriad of commercial (Table 1) and open-source (Table 2) image analysis and data management tools have evolved [112, 114]. In this review, we focus on open-source solutions, which facilitate community-driven efforts in the development of image analysis.
Examples of microscopy developments requiring custom computational workflows for image acquisition include structured-illumination microscopy , super resolution microscopy [161–163], and Bessel-beam microscopy . Some modern microscopes can produce up to 30 TiB of data per day . However, the volume of images generated in systems biology is growing rapidly. As a result, the scalability of storage solutions and awareness for the need of image repositories and common file formats for imaging projects are increasing.
Research on image analysis has developed an entire ecosystem of image analysis tools. ImageJ [137–139], formerly known as NIH image, is a role model in the landscape of open-source tools for image analysis. Since its beginnings it has always been free and it became the most popular and widespread multipurpose image analysis tool. ImageJ has become successful because the scientific community can freely use it to focus on image analysis rather than on application programming. The concept of software extensibility by adding plugins is also useful for developers and end users. Furthermore, this concept has been adopted by more recently evolved platforms such as Fiji  and Icy [134, 135]. The success story of ImageJ is continuing as the next-generation ImageJ2 software is currently under development (Table 2).
The 2 main challenges in image analysis in systems biology are the analysis of complex high-level structures such as whole organisms and the rise of experiments with ever increasing throughput. Imagery of large-scale biological systems such as embryos and brains requires state of the art algorithms for stitching, registration, and mapping to anatomical atlases. In addition to the extensible Vaa3D  and Fiji software packages, which are both established in this field, new tools such as TeraStitcher that can handle TiB-scale datasets have now emerged . While the imaging of such high-level structures is typically conducted in a rather low throughput, partially automated workflows requiring a significant amount of user input are still quite common. In contrast, the amounts of images produced in high-throughput experiments are often increased by several orders of magnitude and cannot be manually analyzed. The challenge is to analyze data from HCS sets to a meaningful extent and in a reasonable amount of time. Several open-source packages for image analysis include functionality for machine learning-based cell classification. Some of these packages are CellProfiler [125, 127], CellClassifier , and the R package EBImage , which provide workflows for fixed cell images.
CellProfiler can be used to address several application areas, including intensity and morphology measurements. In contrast to tools designed for fixed objects, CellProfiler can perform two-dimensional (2D) object tracking. Information about temporal coupling between cellular events is highly relevant for understanding the physiology of biological systems. Time-lapse imaging has emerged as a powerful tool for investigating dynamic cellular processes such as cell division or intracellular trafficking of labeled targets of interest. However, for the analysis of such high-throughput cinematography, only a few tools are currently available. CellCognition  is a freely available software platform that includes high-throughput batch processing and annotation of complex cellular dynamics such as the progression of single cells through distinct cell division states. In this platform, temporal hidden Markov modeling is used to reduce classification noise at state transitions and to distinguish different states with similar morphology. Briefly, CellCognition provides an analysis platform for live imaging-based screening with assays that directly score cellular dynamics . BioImageXD , which is written in Python and C++, is leveraging the libraries VTK  and ITK . As a result, BioImageXD, unlike CellProfiler and CellCognition, can offer options for 2D and 3D analyses by providing advanced batch-processing functions for multidimensional fluorescence image sets, including time series. In addition to built-in tools for visualization, colocalization analysis, segmentation, and tracking, the graphical user interface of BioImageXD facilitates the assembly of custom image analysis pipelines. The open-source design of the project, as well as the use of Python and gold standard file formats such as OME-TIFF, should further facilitate the evolution of this project for the community working on spatio-temporally resolved data .
An open-source software can foster productive collaborations between programming biologists and computer scientists interested in biology. However, an important challenge is to ensure the availability of analysis tools to the entire community of microscope users. The timely public availability of professionally programmed, easy-to-use, open-source tools for image analysis will depend on career opportunities for talented image analysis code writers , and the quality of these emerging tools will depend on good programming practices. Recently, Carpenter et al.  described usability criteria for image analysis software and advocated for usability as a more highly valued goal in broad-impact image analysis research. The authors emphasized that image analysis software should be user-friendly, modular, developer friendly, validated, and interoperable. Typically, the development of usable open-source software requires close collaborations between users and programmers, such that the resulting software does not suffer from the lack of software engineering expertise or real world applicability. An outstanding example of an open-source image informatics platform with very good usability is the most recently developed generalist image analysis platform Icy [134, 135]. The main aim of this platform is to be developer friendly and facilitate timely and efficient collaborations as well as reproducible research. The software is built on Java but can also be used with the originally C++-based VTK and ITK libraries for native 3D visualization. The modern and well-organized user interface provides access to state-of-the-art image analysis tools and μManager-based  microscope control for live acquisitions with feedback. Furthermore, the writing of complete protocols is facilitated by a so-called workflow design tool, which represents individual processes as graphical blocks, and does not require any Java programming knowledge .
The creativity of researchers asking unprecedented scientific questions will continue to present challenges in image analysis that cannot be solved with a single software tool. Due to the common use of a variety of different software tools to acquire and analyze data, the connectivity and interoperability between these tools are crucial. Fortunately, many developers already understand this, and the most successful open-source image analysis platforms are explicitly developing ways to share data and code . Finally, image analysis, with extraction of desired features, is needed but will not be sufficient for making biologically relevant conclusions. The extracted image-based features need to undergo further high-level data analysis. In turn, the analysis of extracted features and identification of relevant features can greatly improve with machine learning.
The increasing information content in image-based research poses new challenges for data interpretation. Multiparametric phenotype descriptors defined by a whole set of features, also known as phenoprints , can be used to cluster information contained in single pixels, single images, or whole screening datasets. However, machine learning-based classification can be used for image segmentation and high-level analysis of image-derived features .
Ilastik is an open-source tool based on user defined examples that train a machine-learning algorithm for identifying pixels of an image that belong to a class of interest [93, 136]. This highly advanced segmentation approach is especially useful for images in which classical model-based segmentation gives poor results.
Machine learning can help classify image-based features obtained on image processing into biologically meaningful patterns. The following 3 general categories of tasks can be performed using image features: statistical comparisons, supervised learning, and unsupervised learning. In supervised learning, the user inputs prior knowledge by giving information, such as an annotation of an experimental condition, or indicating the concentration of a compound. In these cases, supervised machine learning can determine the most informative features for distinguishing the annotated biological patterns. Some examples are dose–response curves  and time points in time series .
CellCognition  was developed in the context of a genome wide screen for mitotic modulators. This tool utilizes a combination of explicitly coded image segmentation and supervised machine learning to automate the identification and annotation of mitotic stages. Considering the annotation of mitotic states in single cells, supervised learning means that the annotation of mitotic states must be performed manually for a small set of cells. This annotated training set is given to the learning algorithm to find a way of performing annotations on the remaining cells. For every cell in the training set and main dataset, the algorithm is given a set of input variables using which it labels the mitotic states. Formally, the learning stage consists of finding a mathematical function that maps input variables to the correct decision. Some readily available classifiers, including the support vector machine in its basic form, use linear decision functions. In CellCognition, however, support vector machines with a non-linear radial kernel are used. The main challenge in the setup of working classification algorithms is to define adequate features as input variables. Considering the type of attributes humans can use to perform the classification task may be helpful. Shape is an important attribute for classifying mitotic states (Figure 2B). However, shape cannot be readily quantified. Instead, CellCognition utilizes a set of quantitative features such as roundness for the classification process. The example of CellCognition illustrates that supervised machine learning can leverage the human interpretation of complex traits like shape and mathematical abstraction of such complex traits, which is needed for automated classification workflows in high-throughput projects.
In contrast to supervised machine learning, unsupervised learning such as cluster analysis can be used independently of prior knowledge to find groups within data. One example of unsupervised learning is the clustering of drugs by their effects . Combinations of supervised and unsupervised learning are typically known as semi-supervised learning. A classical approach is to start with supervised learning to determine if the given features can be used to distinguish some major classes before using unsupervised learning to discover unknown subclasses of biological relevance .
Workflow systems are recently beginning to emerge in image-based systems biology and give users more flexibility. These tools call applications such as image analysis tools and machine learning tools as components of an analysis pipeline. Workflow systems can be used to build virtual systems for image acquisition and can perform feature extraction and high-level data analysis without writing complex scripts. With the increasing need in sophisticated processing, image analysis, and high-level data interpretation, open-source workflow systems are gaining popularity. KNIME  is an open-source workflow system with a very broad set of domains that connects image analysis tools and other bioinformatics tools to create complex image processing and analysis workflows.
Some of the open-source image analysis tools can also be combined without using a workflow system. For example, CellProfiler, with its empowering integrative ability, can run an ImageJ macro or Ilastic machine-learning algorithm within the context of an automated image analysis pipeline. In the context of image-based systems biology, the main advantage of KNIME is that it can construct workflows beyond the direct interoperability of available image analysis tools. For example, KNIME can integrate the library ImgLib for n-dimensional image analysis from Fiji  into a workflow which was as yet missing this functionality.
The vast amounts of experiments, images, metadata, and extractable features in systems biology require relational databases. In HCS, there is an intrinsic need for user-friendly, scalable, and powerful information management systems. Data management platforms should enable users to collect, integrate, share, and publish data. In the scope of interoperability, these platforms should also be able to connect to data processing pipelines and workflow systems. The benefit of using open source databases is extendibility and the possibility of platform customization.
The Bio-Image Semantic Query User Environment (Bisque)  was developed for the exchange and exploration of biological images. The Bisque system supports several areas from image capture to image analysis and query. This platform is centered on a database of images and metadata. The integrated analysis tools allow high-level semantic queries to be made as well as comparisons of image content. Bisque was specifically designed to provide researchers with organizational and quantitative analysis tools for time-resolved multichannel 3D screening data. Images and metadata are organized with tags (i.e., name–value pairs) associated with an image. Typically, users locate images of interest by browsing through collections or searching with specific queries. The system has an integrated web image browser for the filtering, sorting, and ordering of images. The image organizer performs advanced sorting by hierarchical tag ordering. In addition, users can extend Bisque with data model and analysis extensions in order to adapt the system to local needs. The extensibility of Bisque stems from the following 2 core concepts: flexible metadata facility and an open web-based architecture.
The Open Microscopy Environment (OME) project [121, 144, 145] leverages imaging projects by focusing on the underlying need for common file formats. OME provides Bio-Formats, a tool that fully parses more than 120 proprietary image formats and converts proprietary metadata to the OME-XML data model. The OME-TIFF format is a container format for Tiff images with OME-XML metadata and the most widely used image format in community-driven projects. To ensure data integrity, Bio-Formats converts the proprietary file format metadata into a table of key-value pairs that is subsequently stored as an annotation on the imported image in the relational database OMERO . OMERO was created to provide a single unified data management platform for image data generators and users. Briefly, OMERO uses a number of storage mechanisms for images and metadata and provides an application programming interface for using remoting image analysis tools that are based on C++, Python, Matlab, or Java. Recently added functionality also allows for organizing quantitative features in tables.
In HCS, it is crucial to keep track of quantitative features. OpenBIS  is a framework for constructing user-friendly, scalable, and powerful information systems for HCS data and metadata. OpenBIS allows users to collect, integrate, share, and publish image-based data and connect to data processing pipelines. This framework, which is built on a hierarchical structure ranging from project management layers to sample specific datasets, is easily extensible and specialized but not limited to imaging projects. OpenBIS is a flexible platform for handling images, structured metadata (e.g., sample annotations), and unstructured data (e.g., attached files), and is scalable to very large data.
A combination of databases with workflow systems such as KNIME can enable the integration of functionalities beyond the scope of classical image databases. For example, the KNIME node 1Click1View (1C1V) was developed to facilitate a link between large-scale image data sets from HCS and numeric data . At the level of screening plates, 1C1V can be used to visualize quantitative features in form of heatmaps. Phaedra , another informatics tool connecting to KNIME, has been developed to support workflows for drug screening and target discovery. This tool can be used to plot dose–response curves, manage exclusion and annotation options, and perform cell classification, statistical quality controls, and reporting.
Historically, microscopy has been a qualitative technique. However, due to advances in labeling and imaging methods, as well as computer vision and informatics, modern microscopy has widely improved the extraction of meaningful quantitative data from biological samples. Despite technological advances, a balance between experimental throughput, which is required for statistical significance, and the potential output of new biological knowledge needs to be found. Clear research plans and prior knowledge are key requisites for the progress of translational systems biomedicine. In many cases, image-based approaches can make major contributions. However, it is crucial to choose an adequate experimental model and use imaging technology that optimally fits with the chosen methods and properties of the sample. Given the vast variety of light microscopy applications in systems biology, the search for a universal image analysis tool that covers all the needs is often illusive. The correct approach is to focus on the production of high-quality raw data and use the flexibility of existing image analysis tools for integrating required image analysis and data processing workflows.
Yuste R: Fluorescence microscopy today. Nat Methods. 2005, 2: 902-904. 10.1038/nmeth1205-902.
Megason SG, Fraser SE: Imaging in systems biology. Cell. 2007, 130: 784-795. 10.1016/j.cell.2007.08.031.
Conchello J, Lichtman JW: Optical sectioning microscopy. Nat Methods. 2005, 2: 920-931. 10.1038/nmeth815.
Sung M-H, McNally JG: Live cell imaging and systems biology. Wiley Interdiscip Rev Syst Biol Med. 2010, 3: 167-182.
Planchon TA, Gao L, Milkie DE, Davidson MW, Galbraith JA, Galbraith CG, Betzig E: Rapid three-dimensional isotropic imaging of living cells using Bessel beam plane illumination. Nat Methods. 2011, 8: 417-423. 10.1038/nmeth.1586.
Weber M, Huisken J: Light sheet microscopy for real-time developmental biology. Curr Opin Genet Dev. 2011, 21: 566-572. 10.1016/j.gde.2011.09.009.
Gao L, Shao L, Higgins CD, Poulton JS, Peifer M, Davidson MW, Wu X, Goldstein B, Betzig E: Noninvasive Imaging beyond the Diffraction Limit of 3D Dynamics in Thickly Fluorescent Specimens. Cell. 2012, 151: 1370-1385. 10.1016/j.cell.2012.10.008.
Wicker K, Heintzmann R: Interferometric resolution improvement for confocal microscopes. Opt Express. 2007, 15: 12206-12216. 10.1364/OE.15.012206.
Abrahamsson S, Chen J, Hajj B, Stallinga S, Katsov AY, Wisniewski J, Mizuguchi G, Soule P, Mueller F, Darzacq CD, Darzacq X, Wu C, Bargmann CI, Agard DA, Dahan M, Gustafsson MGL: Fast multicolor 3D imaging using aberration-corrected multifocus microscopy. Nat Methods. 2013, 10: 60-63.
Wiedenmann J, Oswald F, Nienhaus GU: Fluorescent proteins for live cell imaging: opportunities, limitations, and challenges. IUBMB Life. 2009, 61: 1029-1042. 10.1002/iub.256.
Day RN, Davidson MW: The fluorescent protein palette: tools for cellular imaging. Chem Soc Rev. 2009, 38: 2887-2921. 10.1039/b901966a.
Shcherbo D, Shemiakina II, Ryabova AV, Luker KE, Schmidt BT, Souslova EA, Gorodnicheva TV, Strukova L, Shidlovskiy KM, Britanova OV, Zaraisky AG, Lukyanov KA, Loschenov VB, Luker GD, Chudakov DM: Near-infrared fluorescent proteins. Nat Methods. 2010, 7: 827-829. 10.1038/nmeth.1501.
Jaiswal JK, Goldman ER, Mattoussi H, Simon SM: Use of quantum dots for live cell imaging. Nat Methods. 2004, 1: 73-78. 10.1038/nmeth1004-73.
Thompson MA, Lew MD, Moerner WE: Extending microscopic resolution with single-molecule imaging and active control. Annu Rev Biophys. 2012, 41: 321-342. 10.1146/annurev-biophys-050511-102250.
Wysocki LM, Lavis LD: Advances in the chemistry of small molecule fluorescent probes. Curr Opin Chem Biol. 2011, 15: 752-759. 10.1016/j.cbpa.2011.10.013.
Lukinavičius G, Johnsson K: Switchable fluorophores for protein labeling in living cells. Curr Opin Chem Biol. 2011, 15: 768-774. 10.1016/j.cbpa.2011.10.015.
Du W, Wang Y, Luo Q, Liu B-F: Optical molecular imaging for systems biology: from molecule to organism. Anal Bioanal Chem. 2006, 386: 444-457. 10.1007/s00216-006-0541-z.
Yasuda R, Noji H, Kinosita K, Yoshida M: F1-ATPase is a highly efficient molecular motor that rotates with discrete 120 degree steps. Cell. 1998, 93: 1117-1124. 10.1016/S0092-8674(00)81456-7.
Ueno H, Nishikawa S, Iino R, Tabata KV, Sakakihara S, Yanagida T, Noji H: Simple dark-field microscopy with nanometer spatial precision and microsecond temporal resolution. Biophys J. 2010, 98: 2014-2023. 10.1016/j.bpj.2010.01.011.
Okuno D, Iino R, Noji H: Rotation and structure of FoF1-ATP synthase. J Biochem. 2011, 149: 655-664. 10.1093/jb/mvr049.
Sengupta P, Van Engelenburg S, Lippincott-Schwartz J: Visualizing cell structure and function with point-localization superresolution imaging. Dev Cell. 2012, 23: 1092-1102. 10.1016/j.devcel.2012.09.022.
Lubeck E, Cai L: Single-cell systems biology by super-resolution imaging and combinatorial labeling. Nat Methods. 2012, 9: 743-748. 10.1038/nmeth.2069.
Antony PMA, Balling R, Vlassis N: From systems biology to systems biomedicine. Curr Opin Biotechnol. 2012, 23: 604-608. 10.1016/j.copbio.2011.11.009.
Cirillo C, Tack J, Vanden Berghe P: Nerve activity recordings in routine human intestinal biopsies. Gut. 2012, 65: 227-235.
Berning S, Willig KI, Steffens H, Dibaj P, Hell SW: Nanoscopy in a living mouse brain. Science. 2012, 335: 551-10.1126/science.1215369.
Perron A, Akemann W, Mutoh H, Knöpfel T: Genetically encoded probes for optical imaging of brain electrical activity. Prog Brain Res. 2012, 196: 63-77.
Akemann W, Mutoh H, Perron A, Rossier J, Knöpfel T: Imaging brain electric signals with genetically targeted voltage-sensitive fluorescent proteins. Nat Methods. 2010, 7: 643-649. 10.1038/nmeth.1479.
Buchser W: Assay development guidelines for image-based high content screening, high content analysis and high content imaging. Assay Guidance Manual. 2012, Bethesda, MD: National Center for Advancing Translational Sciences (NCATS), 1-69.
Conrad C, Gerlich DW: Automated microscopy for high-content RNAi screening. J Cell Biol. 2010, 188: 453-461. 10.1083/jcb.200910105.
Shen F, Hodgson L, Hahn K: Digital autofocus methods for automated microscopy. Methods Enzymol. 2006, 414: 620-632.
Ankers JM, Spiller DG, White MR, Harper CV: Spatio-temporal protein dynamics in single living cells. Curr Opin Biotechnol. 2008, 19: 375-380. 10.1016/j.copbio.2008.07.001.
Fuchs F, Pau G, Kranz D, Sklyar O, Budjan C, Steinbrink S, Horn T, Pedal A, Huber W, Boutros M: Clustering phenotype populations by genome-wide RNAi and multiparametric imaging. Mol Syst Biol. 2010, 6: 370-
Held M, Schmitz MHA, Fischer B, Walter T, Neumann B, Olma MH, Peter M, Ellenberg J, Gerlich DW: Cell Cognition: time-resolved phenotype annotation in high-throughput live cell imaging. Nat Methods. 2010, 7: 747-754. 10.1038/nmeth.1486.
Wählby C, Kamentsky L, Liu ZH, Riklin-Raviv T, Conery AL, O’Rourke EJ, Sokolnicki KL, Visvikis O, Ljosa V, Irazoqui JE, Golland P, Ruvkun G, Ausubel FM, Carpenter AE: An image analysis toolbox for high-throughput C. elegans assays. Nat methods. 2012, 9: 714-716. 10.1038/nmeth.1984.
Long F, Peng H, Liu X, Kim SK, Myers E: A 3D digital atlas of C. elegans and its application to single-cell analyses. Nat Methods. 2009, 6: 667-672. 10.1038/nmeth.1366.
Ronneberger O, Liu K, Rath M, Rueβ D, Mueller T, Skibbe H, Drayer B, Schmidt T, Filippi A, Nitschke R, Brox T, Burkhardt H, Driever W: ViBE-Z: a framework for 3D virtual colocalization analysis in zebrafish larval brains. Nat Methods. 2012, 9: 735-742. 10.1038/nmeth.2076.
Ghosh KK, Burns LD, Cocker ED, Nimmerjahn A, Ziv Y, Gamal AE, Schnitzer MJ: Miniaturized integration of a fluorescence microscope. Nat Methods. 2011, 8: 871-878. 10.1038/nmeth.1694.
Savidge TC, Newman P, Pothoulakis C, Ruhl A, Neunlist M, Bourreille A, Hurst R, Sofroniew MV: Enteric glia regulate intestinal barrier function and inflammation via release of S-nitrosoglutathione. Gastroenterology. 2007, 132: 1344-1358. 10.1053/j.gastro.2007.01.051.
Chao JA, Yoon YJ, Singer RH: Imaging Translation in Single Cells Using Fluorescent Microscopy. Cold Spring Harb Perspect Biol. 2012, 4: 1-2.
Loo L-H, Lin H-J, Singh DK, Lyons KM, Altschuler SJ, Wu LF: Heterogeneity in the physiological states and pharmacological responses of differentiating 3 T3-L1 preadipocytes. J Cell Biol. 2009, 187: 375-384. 10.1083/jcb.200904140.
Zaretsky I, Polonsky M, Shifrut E, Reich-Zeliger S, Antebi Y, Aidelberg G, Waysbort N, Friedman N: Monitoring the dynamics of primary T cell activation and differentiation using long term live cell imaging in microwell arrays. Lab Chip. 2012, 12: 5007-5015. 10.1039/c2lc40808b.
Watmuff B, Pouton CW, Haynes JM: In vitro maturation of dopaminergic neurons derived from mouse embryonic stem cells: implications for transplantation. PLoS One. 2012, 7: e31999-10.1371/journal.pone.0031999.
Tay S, Hughey JJ, Lee TK, Lipniacki T, Quake SR, Covert MW: Single-cell NF-kappaB dynamics reveal digital activation and analogue information processing. Nature. 2010, 466: 267-271. 10.1038/nature09145.
Lee TK, Covert MW: High-throughput, single-cell NF-κB dynamics. Curr Opin Genet Dev. 2010, 20: 677-683. 10.1016/j.gde.2010.08.005.
Padilla-Parra S, Tramier M: FRET microscopy in the living cell: different approaches, strengths and weaknesses. Bioessays. 2012, 34: 369-376. 10.1002/bies.201100086.
Gilbert PM, Havenstrite KL, Magnusson KEG, Sacco A, Leonardi NA, Kraft P, Nguyen NK, Thrun S, Lutolf MP, Blau HM: Substrate elasticity regulates skeletal muscle stem cell self-renewal in culture. Science. 2010, 329: 1078-1081. 10.1126/science.1191035.
Magnusson K, Jaldén J: A batch algorithm using iterative application of the Viterbi algorithm to track cells and construct cell lineages. Biomed Imaging (ISBI). 2012, 2012: 382-385.
Walter T, Held M, Neumann B, Hériché J-K, Conrad C, Pepperkok R, Ellenberg J: Automatic identification and clustering of chromosome phenotypes in a genome wide RNAi screen by time-lapse imaging. J Struct Biol. 2010, 170: 1-9. 10.1016/j.jsb.2009.10.004.
Neumann B, Walter T, Hériché J, Bulkescher J, Erfle H, Conrad C, Rogers P, Poser I, Held M, Liebel U, Cetin C, Sieckmann F, Pau G, Kabbe R, Wünsche A, Satagopam V, Schmitz MHA, Chapuis C, Gerlich DW, Schneider R, Eils R, Huber W, Peters J, Hyman AA, Durbin R, Pepperkok R, Ellenberg J: Phenotypic profiling of the human genome by time-lapse microscopy reveals cell division genes. Nature. 2010, 464: 721-727. 10.1038/nature08869.
Conrad C, Wünsche A, Tan TH, Bulkescher J, Sieckmann F, Verissimo F, Edelstein A, Walter T, Liebel U, Pepperkok R, Ellenberg J: Micropilot: automation of fluorescence microscopy-based imaging for systems biology. Nat Methods. 2011, 8: 246-249. 10.1038/nmeth.1558.
Giaever G, Chu AM, Ni L, Connelly C, Riles L, Véronneau S, Dow S, Lucau-Danila A, Anderson K, André B, Arkin AP, Astromoff A, El-Bakkoury M, Bangham R, Benito R, Brachat S, Campanaro S, Curtiss M, Davis K, Deutschbauer A, Entian K-D, Flaherty P, Foury F, Garfinkel DJ, Gerstein M, Gotte D, Güldener U, Hegemann JH, Hempel S, Herman Z: Functional profiling of the Saccharomyces cerevisiae genome. Nature. 2002, 418: 387-391. 10.1038/nature00935.
Ni L, Snyder M: A genomic study of the bipolar bud site selection pattern in Saccharomyces cerevisiae. Mol Biol Cell. 2001, 12: 2147-2170.
Yang Yu B, Elbuken C, Ren CL, Huissoon JP: Image processing and classification algorithm for yeast cell morphology in a microfluidic chip. J Biomedical Optics. 2011, 16: 1-9.
Mortimer RK, JOHNSTON JR: Life span of individual yeast cells. Nature. 1959, 183: 1751-1752. 10.1038/1831751a0.
Steffen KK, Kennedy BK, Kaeberlein M: Measuring replicative life span in the budding yeast. J Vis Exp. 2009, 1-5.
Lee SS, Avalos Vizcarra I, Huberts DHEW, Lee LP, Heinemann M: Whole lifespan microscopic observation of budding yeast aging through a microfluidic dissection platform. Proc Natl Acad Sci U S A. 2012, 109: 4916-4920. 10.1073/pnas.1113505109.
Gordon A, Colman-Lerner A, Chin TE, Benjamin KR, Yu RC, Brent R: Single-cell quantification of molecules and rates using open-source microscope-based cytometry. Nat Methods. 2007, 4: 175-181. 10.1038/nmeth1008.
Ohya Y, Sese J, Yukawa M, Sano F, Nakatani Y, Saito TL, Saka A, Fukuda T, Ishihara S, Oka S, Suzuki G, Watanabe M, Hirata A, Ohtani M, Sawai H, Fraysse N, Latgé J-P, François JM, Aebi M, Tanaka S, Muramatsu S, Araki H, Sonoike K, Nogami S, Morishita S: High-dimensional and large-scale phenotyping of yeast mutants. Proc Natl Acad Sci U S A. 2005, 102: 19015-19020. 10.1073/pnas.0509436102.
Ohtani M, Saka A, Sano F, Ohya Y, Morishita S: Development of image processing program for yeast cell morphology. J Bioinform Comput Biol. 2004, 1: 695-709. 10.1142/S0219720004000363.
Saito TL, Ohtani M, Sawai H, Sano F, Saka A, Watanabe D, Yukawa M, Ohya Y, Morishita S: SCMD: Saccharomyces cerevisiae Morphological Database. Nucleic Acids Res. 2004, 32: D319-D322. 10.1093/nar/gkh113.
Ohnuki S, Oka S, Nogami S, Ohya Y: High-content, image-based screening for drug targets in yeast. PLoS One. 2010, 5: e10177-10.1371/journal.pone.0010177.
Artal-Sanz M, De Jong L, Tavernarakis N: Caenorhabditis elegans: a versatile platform for drug discovery. Biotechnol J. 2006, 1: 1405-1418. 10.1002/biot.200600176.
Silverman GA, Luke CJ, Bhatia SR, Long OS, Vetica AC, Perlmutter DH, Pak SC: Modeling molecular and cellular aspects of human disease using the nematode Caenorhabditis elegans. Pediatr Res. 2009, 65: 10-18. 10.1203/PDR.0b013e31819009b0.
Rankin CH: From gene to identified neuron to behaviour in Caenorhabditis elegans. Nat Rev Genet. 2002, 3: 622-630.
Jorgensen EM, Mango SE: The art and design of genetic screens: caenorhabditis elegans. Nat Rev Genet. 2002, 3: 356-369. 10.1038/nrg794.
Gosai SJ, Kwak JH, Luke CJ, Long OS, King DE, Kovatch KJ, Johnston PA, Shun TY, Lazo JS, Perlmutter DH, Silverman GA, Pak SC: Automated high-content live animal drug screening using C. elegans expressing the aggregation prone serpin α1-antitrypsin Z. PloS one. 2010, 5: e15460-10.1371/journal.pone.0015460.
Brignull HR, Morley JF, Morimoto RI: The stress of misfolded proteins: C. elegans models for neurodegenerative disease and aging. Adv Exp Med Biol. 2007, 594: 167-189. 10.1007/978-0-387-39975-1_15.
Crane MM, Stirman JN, Ou C-Y, Kurshan PT, Rehg JM, Shen K, Lu H: Autonomous screening of C. elegans identifies genes implicated in synaptogenesis. Nat Methods. 2012, 9: 977-980. 10.1038/nmeth.2141.
Baek J-H, Cosman P, Feng Z, Silver J, Schafer WR: Using machine vision to analyze and classify Caenorhabditis elegans behavioral phenotypes quantitatively. J Neurosci Methods. 2002, 118: 9-21. 10.1016/S0165-0270(02)00117-6.
Cronin CJ, Mendel JE, Mukhtar S, Kim Y-M, Stirbl RC, Bruck J, Sternberg PW: An automated system for measuring parameters of nematode sinusoidal movement. BMC Genet. 2005, 6: 5-
Feng Z, Cronin CJ, Wittig JH, Sternberg PW, Schafer WR: An imaging system for standardized quantitative analysis of C. elegans behavior. BMC bioinformatics. 2004, 5: 115-10.1186/1471-2105-5-115.
Geng W, Cosman P, Berry CC, Feng Z, Schafer WR: Automatic tracking, feature extraction and classification of C elegans phenotypes. IEEE Trans Biomed Eng. 2004, 51: 1811-1820. 10.1109/TBME.2004.831532.
Huang K-M, Cosman P, Schafer WR: Machine vision based detection of omega bends and reversals in C. elegans. J Neurosci Methods. 2006, 158: 323-336. 10.1016/j.jneumeth.2006.06.007.
Huang K-M, Cosman P, Schafer WR: Automated detection and analysis of foraging behavior in Caenorhabditis elegans. J Neurosci Methods. 2008, 171: 153-164. 10.1016/j.jneumeth.2008.01.027.
Ramot D, Johnson BE, Berry TL, Carnell L, Goodman MB: The Parallel Worm Tracker: a platform for measuring average speed and drug-induced paralysis in nematodes. PLoS One. 2008, 3: e2208-10.1371/journal.pone.0002208.
Buckingham SD, Sattelle DB: Strategies for automated analysis of C. elegans locomotion. Invert Neurosci. 2008, 8: 121-131. 10.1007/s10158-008-0077-3.
Hoshi K, Shingai R: Computer-driven automatic identification of locomotion states in Caenorhabditis elegans. J Neurosci Methods. 2006, 157: 355-363. 10.1016/j.jneumeth.2006.05.002.
Tsibidis GD, Tavernarakis N: Nemo: a computational tool for analyzing nematode locomotion. BMC Neurosci. 2007, 8: 86-10.1186/1471-2202-8-86.
Buckingham SD, Sattelle DB: Fast, automated measurement of nematode swimming (thrashing) without morphometry. BMC Neurosci. 2009, 10: 84-10.1186/1471-2202-10-84.
Tsechpenakis G, Bianchi L, Metaxas D, Driscoll M: A novel computational approach for simultaneous tracking and feature extraction of C. elegans populations in fluid environments. IEEE Trans Biomed Eng. 2008, 55: 1539-1549.
Sznitman R, Gupta M, Hager GD, Arratia PE, Sznitman J: Multi-environment model estimation for motility analysis of Caenorhabditis elegans. PLoS One. 2010, 5: e11631-10.1371/journal.pone.0011631.
Green RA, Kao H-L, Audhya A, Arur S, Mayers JR, Fridolfsson HN, Schulman M, Schloissnig S, Niessen S, Laband K, Wang S, Starr DA, Hyman AA, Schedl T, Desai A, Piano F, Gunsalus KC, Oegema K: A high-resolution C. elegans essential gene network based on phenotypic profiling of a complex tissue. Cell. 2011, 145: 470-482. 10.1016/j.cell.2011.03.037.
Peng H, Long F, Liu X, Kim SK, Myers EW: Straightening Caenorhabditis elegans images. Bioinformatics. 2008, 24: 234-242. 10.1093/bioinformatics/btm569.
Olarte OE, Licea-Rodriguez J, Palero JA, Gualda EJ, Artigas D, Mayer J, Swoger J, Sharpe J, Rocha-Mendoza I, Rangel-Rojo R, Loza-Alvarez P: Image formation by linear and nonlinear digital scanned light-sheet fluorescence microscopy with Gaussian and Bessel beam profiles. Biomed Opt express. 2012, 3: 1492-1505. 10.1364/BOE.3.001492.
Patton EE, Zon LI: The art and design of genetic screens: zebrafish. Nat Rev Genet. 2001, 2: 956-966. 10.1038/35103567.
Zon LI, Peterson RT: In vivo drug discovery in the zebrafish. Nat Rev Drug Discov. 2005, 4: 35-44. 10.1038/nrd1606.
Pardo-Martin C, Chang T-Y, Koo BK, Gilleland CL, Wasserman SC, Yanik MF: High-throughput in vivo vertebrate screening. Nat Methods. 2010, 7: 634-636. 10.1038/nmeth.1481.
Taylor KL, Grant NJ, Temperley ND, Patton EE: Small molecule screening in zebrafish: an in vivo approach to identifying new chemical tools and drug leads. Cell Commun signal. 2010, 8: 11-10.1186/1478-811X-8-11.
Kimmel CB, Ballard WW, Kimmel SR, Ullmann B, Schilling TF: Stages of embryonic development of the zebrafish. Dev Dyn. 1995, 203: 253-310. 10.1002/aja.1002030302.
Peravali R, Gehrig J, Giselbrecht S, Lütjohann DS, Hadzhiev Y, Müller F, Liebel U: Automated feature detection and imaging for high-resolution screening of zebrafish embryos. Biotechniques. 2011, 50: 319-324.
Eguíluz C, Viguera E, Millán L, Pérez J: Multitissue array review: a chronological description of tissue array techniques, applications and procedures. Pathol Res Pract. 2006, 202: 561-568. 10.1016/j.prp.2006.04.003.
Wang C-W, Fennell D, Paul I, Savage K, Hamilton P: Robust automated tumour segmentation on histological and immunohistochemical tissue images. PLoS One. 2011, 6: e15818-10.1371/journal.pone.0015818.
Sommer C, Straehle C, Kothe U, Hamprecht FA: Ilastik: Interactive learning and segmentation toolkit. IEEE Int Symp Biomed Imaging. 2011, 2011: 230-233.
Kovar JL, Simpson MA, Schutz-Geschwender A, Olive DM: A systematic approach to the development of fluorescent contrast agents for optical imaging of mouse cancer models. Anal Biochem. 2007, 367: 1-12. 10.1016/j.ab.2007.04.011.
Baker M: Animal models: inside the minds of mice and men. Nature. 2011, 475: 123-128. 10.1038/475123a.
De Chaumont F, Coura RD-S, Serreau P, Cressant A, Chabout J, Granon S, Olivo-Marin J-C: Computerized video analysis of social interactions in mice. Nat Methods. 2012, 9: 410-417. 10.1038/nmeth.1924.
Nägerl UV, Willig KI, Hein B, Hell SW, Bonhoeffer T: Live-cell imaging of dendritic spines by STED microscopy. Proc Natl Acad Sci U S A. 2008, 105: 18982-18987. 10.1073/pnas.0810028105.
Urban NT, Willig KI, Hell SW, Nägerl UV: STED nanoscopy of actin dynamics in synapses deep inside living brain slices. Biophys J. 2011, 101: 1277-1284. 10.1016/j.bpj.2011.07.027.
Masedunskas A, Milberg O, Porat-Shliom N, Sramkova M, Wigand T, Amornphimoltham P, Weigert R: Intravital microscopy: A practical guide on imaging intracellular structures in live animals. Bioarchitecture. 2012, 2: 143-157. 10.4161/bioa.21758.
Gavins FN: Intravital microscopy: new insights into cellular interactions. Curr Opin Pharmacol. 2012, 12: 601-607. 10.1016/j.coph.2012.08.006.
Farrar MJ, Bernstein IM, Schlafer DH, Cleland TA, Fetcho JR, Schaffer CB: Chronic in vivo imaging in the mouse spinal cord using an implanted chamber. Nat Methods. 2012, 9: 297-302. 10.1038/nmeth.1856.
Barretto RPJ, Schnitzer MJ: In vivo microendoscopy of the hippocampus. Cold Spring Harb Protoc. 2012, 2012: 1092-1099.
Barretto RPJ, Schnitzer MJ: In Vivo Optical Microendoscopy for Imaging Cells Lying Deep within Live Tissue. Cold Spring Harb Protoc. 2012, 2012: 1029-1034.
Lecoq J, Schnitzer MJ: An infrared fluorescent protein for deeper imaging. Nat Biotechnol. 2011, 29: 715-716. 10.1038/nbt.1941.
Barretto RPJ, Ko TH, Jung JC, Wang TJ, Capps G, Waters AC, Ziv Y, Attardo A, Recht L, Schnitzer MJ: Time-lapse imaging of disease progression in deep brain areas using fluorescence microendoscopy. Nat Med. 2011, 17: 223-228. 10.1038/nm.2292.
Piyawattanametha W, Cocker ED, Burns LD, Barretto RP, Jung JC, Ra H, Solgaard O, Schnitzer MJ: In vivo brain imaging using a portable 2.9 g two-photon microscope based on a microelectromechanical systems scanning mirror. Opt Lett. 2009, 34: 2309-2311. 10.1364/OL.34.002309.
Barretto RPJ, Messerschmidt B, Schnitzer MJ: In vivo fluorescence imaging with high-resolution microlenses. Nat Methods. 2009, 6: 511-512. 10.1038/nmeth.1339.
Flusberg BA, Nimmerjahn A, Cocker ED, Mukamel EA, Barretto RPJ, Ko TH, Burns LD, Jung JC, Schnitzer MJ: High-speed, miniaturized fluorescence microscopy in freely moving mice. Nat Methods. 2008, 5: 935-938. 10.1038/nmeth.1256.
Myers G: Why bioimage informatics matters. Nat Methods. 2012, 9: 659-660. 10.1038/nmeth.2024.
Swedlow JR, Eliceiri KW: Open source bioimage informatics for cell biology. Trends Cell Biol. 2009, 19: 656-660. 10.1016/j.tcb.2009.08.007.
Peng H: Bioimage informatics: a new area of engineering biology. Bioinformatics. 2008, 24: 1827-1836. 10.1093/bioinformatics/btn346.
Eliceiri KW, Berthold MR, Goldberg IG, Ibáñez L, Manjunath BS, Martone ME, Murphy RF, Peng H, Plant AL, Roysam B, Stuurmann N, Swedlow JR, Tomancak P, Carpenter AE: Biological imaging software tools. Nat Methods. 2012, 9: 697-710. 10.1038/nmeth.2084.
Davies ER: Computer and Machine Vision: Theory, Algorithms, Practicalities. 2012, New York, NY: Academic Press, 1-912.
Walter T, Shattuck DW, Baldock R, Bastin ME, Carpenter AE, Duce S, Ellenberg J, Fraser A, Hamilton N, Pieper S, Ragan MA, Schneider JE, Tomancak P, Hériché J-K: Visualization of image data from cells to organisms. Nat methods. 2010, 7: S26-S41. 10.1038/nmeth.1431.
Zwolinski L, Kozak M, Kozak K: 1Click1View: Interactive Visualization Methodology for RNAi Cell-Based Microscopic Screening. BioMed Res Int. 2013, 2013: 1-11.
Schmid B, Schindelin J, Cardona A, Longair M, Heisenberg M: A high-level 3D visualization API for Java and ImageJ. BMC Bioinformatics. 2010, 11: 274-10.1186/1471-2105-11-274.
Mosaliganti KR, Noche RR, Xiong F, Swinburne IA, Megason SG: ACME: Automated Cell Morphology Extractor for Comprehensive Reconstruction of Cell Membranes. PLoS Comput Biol. 2012, 8: e1002780-10.1371/journal.pcbi.1002780.
Horvath P, Wild T, Kutay U, Csucs G: Machine Learning Improves the Precision and Robustness of High-Content Screens: Using Nonlinear Multiparametric Methods to Analyze Screening Results. J Biomol Screen. 2011, 16: 1059-1067. 10.1177/1087057111414878.
Kvilekval K, Fedorov D, Obara B, Singh A, Manjunath BS: B: A platform for bioimage analysis and management. Bioinformatics (Oxford, England). 2010, 26: 544-552. 10.1093/bioinformatics/btp699.
Goff SA, Vaughn M, McKay S, Lyons E, Stapleton AE, Gessler D, Matasci N, Wang L, Hanlon M, Lenards A, Muir A, Merchant N, Lowry S, Mock S, Helmke M, Kubach A, Narro M, Hopkins N, Micklos D, Hilgert U, Gonzales M, Jordan C, Skidmore E, Dooley R, Cazes J, McLay R, Lu Z, Pasternak S, Koesterke L, Piel WH: The iPlant Collaborative: Cyberinfrastructure for Plant Biology. Front plant sci. 2011, 2: 34-
Linkert M, Rueden CT, Allan C, Burel J-M, Moore W, Patterson A, Loranger B, Moore J, Neves C, Macdonald D, Tarkowska A, Sticco C, Hill E, Rossner M, Eliceiri KW, Swedlow JR: Metadata matters: access to image data in the real world. J Cell Biol. 2010, 189: 777-782. 10.1083/jcb.201004104.
Kankaanpää P, Paavolainen L, Tiitta S, Karjalainen M, Päivärinne J, Nieminen J, Marjomäki V, Heino J, White DJ: BioImageXD: an open, general-purpose and high-throughput image-processing platform. Nat Methods. 2012, 9: 683-689. 10.1038/nmeth.2047.
Rämö P, Sacher R, Snijder B, Begemann B, Pelkmans L: CellClassifier: supervised learning of cellular phenotypes. Bioinformatics. 2009, 25: 3028-3030. 10.1093/bioinformatics/btp524.
Boutros M, Brás LP, Huber W: Analysis of cell-based RNAi screens. Genome Biol. 2006, 7: R66-10.1186/gb-2006-7-7-r66.
Carpenter AE, Jones TR, Lamprecht MR, Clarke C, Kang IH, Friman O, Guertin DA, Chang JH, Lindquist RA, Moffat J, Golland P, Sabatini DM: CellProfiler: image analysis software for identifying and quantifying cell phenotypes. Genome biology. 2006, 7: R100-10.1186/gb-2006-7-10-r100.
Kamentsky L, Jones TR, Fraser A, Bray M-A, Logan DJ, Madden KL, Ljosa V, Rueden C, Eliceiri KW, Carpenter AE: Improved structure, function and compatibility for CellProfiler: modular high-throughput image analysis software. Bioinformatics . 2011, 27: 1179-1180. 10.1093/bioinformatics/btr095.
Jones TR, Carpenter AE, Lamprecht MR, Moffat J, Silver SJ, Grenier JK, Castoreno AB, Eggert US, Root DE, Golland P, Sabatini DM: Scoring diverse cellular morphologies in image-based screens with iterative feedback and machine learning. Proc Natl Acad Sci U S A. 2009, 106: 1826-1831. 10.1073/pnas.0808843106.
Jones TR, Kang IH, Wheeler DB, Lindquist RA, Papallo A, Sabatini DM, Golland P, Carpenter AE: CellProfiler Analyst: data exploration and analysis software for complex image-based screens. BMC bioinformatics. 2008, 9: 482-10.1186/1471-2105-9-482.
Pau G, Fuchs F, Sklyar O, Boutros M, Huber W: EBImage--an R package for image processing with applications to cellular phenotypes. Bioinformatics. 2010, 26: 979-981. 10.1093/bioinformatics/btq046.
Bjornsson CS, Lin G, Al-Kofahi Y, Narayanaswamy A, Smith KL, Shain W, Roysam B: Associative image analysis: a method for automated quantification of 3D multi-parameter images of brain tissue. J Neurosci Methods. 2008, 170: 165-178. 10.1016/j.jneumeth.2007.12.024.
Schindelin J, Arganda-Carreras I, Frise E, Kaynig V, Longair M, Pietzsch T, Preibisch S, Rueden C, Saalfeld S, Schmid B, Tinevez J-Y, White DJ, Hartenstein V, Eliceiri K, Tomancak P, Cardona A: Fiji: an open-source platform for biological-image analysis. Nat Methods. 2012, 9: 676-682. 10.1038/nmeth.2019.
Hamilton NA, Teasdale RD: Visualizing and clustering high throughput sub-cellular localization imaging. BMC Bioinformatics. 2008, 9: 81-10.1186/1471-2105-9-81.
Hamilton NA, Wang JTH, Kerr MC, Teasdale RD: Statistical and visual differentiation of subcellular imaging. BMC Bioinformatics. 2009, 10: 94-10.1186/1471-2105-10-94.
De Chaumont F, Dallongeville S, Olivo-Marin J-C ICY: A new open-source community image processing software. 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro. 2011, Chicago, IL: IEEE, 234-237.
De Chaumont F, Dallongeville S, Chenouard N, Hervé N, Pop S, Provoost T, Meas-Yedid V, Pankajakshan P, Lecomte T, Le Montagner Y, Lagache T, Dufour A, Olivo-Marin J-C: Icy: an open bioimage informatics platform for extended reproducible research. Nat Methods. 2012, 9: 690-696. 10.1038/nmeth.2075.
Kreshuk A, Straehle CN, Sommer C, Koethe U, Cantoni M, Knott G, Hamprecht FA: Automated detection and segmentation of synaptic contacts in nearly isotropic serial electron microscopy images. PLoS One. 2011, 6: e24899-10.1371/journal.pone.0024899.
Abràmoff MD, Hospitals I, Magalhães PJ, Abràmoff M: Image Processing with ImageJ. Biophotonics Int. 2004, 11: 36-42.
Schneider CA, Rasband WS, Eliceiri KW: NIH Image to ImageJ: 25 years of image analysis. Nat Methods. 2012, 9: 671-675. 10.1038/nmeth.2089.
Collins T: ImageJ for microscopy. BioTechniques. 2007, 43: S25-S30.
Pietzsch T, Preibisch S, Tomancák P, Saalfeld S: ImgLib2--generic image processing in Java. Bioinformatics. 2012, 28: 3009-3011. 10.1093/bioinformatics/bts543.
Schroeder W: The ITK Software Guide Second Edition Updated for ITK version 2. 4. 2005
Berthold MR, Cebron N, Dill F, Gabriel TR, Kötter T, Meinl T, Ohl P, Thiel K, Wiswedel B: KNIME - the Konstanz information miner. ACM SIGKDD Explorations Newsletter. 2009, 11: 26-10.1145/1656274.1656280.
Peng H, Long F, Ding C: Feature selection based on mutual information: criteria of max-dependency, max-relevance, and min-redundancy. IEEE Trans Pattern Anal Mach Intell. 2005, 27: 1226-1238.
Goldberg IG, Allan C, Burel J-M, Creager D, Falconi A, Hochheiser H, Johnston J, Mellen J, Sorger PK, Swedlow JR: The Open Microscopy Environment (OME) Data Model and XML file: open tools for informatics and quantitative analysis in biological imaging. Genome Biol. 2005, 6: R47-10.1186/gb-2005-6-5-r47.
Swedlow JR, Goldberg IG, Eliceiri KW: Bioimage informatics for experimental biology. Annu Rev Biophys. 2009, 38: 327-346. 10.1146/annurev.biophys.050708.133641.
Allan C, Burel J, Moore J, Blackburn C, Linkert M, Loynton S, Macdonald D, Moore WJ, Neves C, Patterson A, Porter M, Tarkowska A, Loranger B, Avondo J, Lagerstedt I, Lianas L, Leo S, Hands K, Hay RT, Patwardhan A, Best C, Kleywegt GJ, Zanetti G, Swedlow JR: OMERO: flexible, model-driven data management for experimental biology. Nat Methods. 2012, 9: 245-253. 10.1038/nmeth.1896.
Moore J, Allan C, Burel J-M, Loranger B, MacDonald D, Monk J, Swedlow JR: Open tools for storage and management of quantitative image data. Methods Cell Biol. 2008, 85: 555-570.
Cho BH, Cao-Berg I, Bakal JA, Murphy RF: OMERO.searcher: content-based image search for microscope images. Nat Methods. 2012, 9: 633-634. 10.1038/nmeth.2086.
Bauch A, Adamczyk I, Buczek P, Elmer F-J, Enimanev K, Glyzewski P, Kohler M, Pylak T, Quandt A, Ramakrishnan C, Beisel C, Malmström L, Aebersold R, Rinn B: openBIS: a flexible framework for managing and analyzing complex data in biology research. BMC Bioinformatics. 2011, 12: 468-10.1186/1471-2105-12-468.
Vaccarella A, Enquobahrie A, Ferrigno G, De ME: Modular multiple sensors information management for computer-integrated surgery. Int J Med Robot. 2012, 8: 253-260. 10.1002/rcs.1412.
Zhao T, Velliste M, Boland MV, Murphy RF: Object type recognition for automated analysis of protein subcellular location. IEEE Trans Image Process. 2005, 14: 1351-1359.
Peng T, Bonamy GMC, Glory-Afshar E, Rines DR, Chanda SK, Murphy RF: Determining the distribution of probes between different subcellular locations through automated unmixing of subcellular patterns. Proc Natl Acad Sci U S A. 2010, 107: 2944-2949. 10.1073/pnas.0912090107.
Rajaram S, Pavie B, Wu LF, Altschuler SJ: PhenoRipper: software for rapidly profiling microscopy images. Nat Methods. 2012, 9: 635-637. 10.1038/nmeth.2097.
Peng H, Ruan Z, Long F, Simpson JH, Myers EW: V3D enables real-time 3D visualization and quantitative analysis of large-scale biological image data sets. Nat Biotechnol. 2010, 28: 348-353. 10.1038/nbt.1612.
Peng H, Long F, Myers EW: VANO: a volume-object image annotation system. Bioinformatics. 2009, 25: 695-697. 10.1093/bioinformatics/btp046.
Rueden C, Eliceiri KW, White JG: VisBio: a computational tool for visualization of multidimensional biological image data. Traffic. 2004, 5: 411-417. 10.1111/j.1600-0854.2004.00189.x.
Schroeder W, Martin KW, LORENSEN B: The Visualization Toolkit An Object-Oriented Approach to 3-D Graphics. 1996, N.J.: Prentice Hall PTR - Upper Saddle River, 1-826.
Engel K, Bauer M, Greiner G, Ertl T, Group CG, Group IS: Interactive Volume Rendering on Standard PC Graphics Hardware Using Multi-Textures and Multi-Stage Rasterization. ACM SIGGRAPH/Eurographics Workshop on Graphics Hardware. 2001, 2000: 109-118.
Orlov N, Shamir L, Macura T, Johnston J, Eckley DM, Goldberg IG: WND-CHARM: Multi-purpose image classification using compound image transforms. Pattern Recognit Lett. 2008, 29: 1684-1693. 10.1016/j.patrec.2008.04.013.
Gustafsson MGL: Nonlinear structured-illumination microscopy: wide-field fluorescence imaging with theoretically unlimited resolution. Proc Natl Acad Sci U S A. 2005, 102: 13081-13086. 10.1073/pnas.0406877102.
Huang B, Wang W, Bates M, Zhuang X: Three-dimensional super-resolution imaging by stochastic optical reconstruction microscopy. Science. 2008, 319: 810-813. 10.1126/science.1153529.
Hess ST, Girirajan TPK, Mason MD: Ultra-high resolution imaging by fluorescence photoactivation localization microscopy. Biophys J. 2006, 91: 4258-4272. 10.1529/biophysj.106.091116.
Jones SA, Shim S-H, He J, Zhuang X: Fast, three-dimensional super-resolution imaging of live cells. Nat Methods. 2011, 8: 499-508. 10.1038/nmeth.1605.
Keller PJ, Schmidt AD, Wittbrodt J, Stelzer EHK: Digital scanned laser light-sheet fluorescence microscopy (DSLM) of zebrafish and Drosophila embryonic development. Cold Spring Harb Protoc. 2011, 2011: 1235-1243.
Bria A, Iannello G: TeraStitcher - A Tool for Fast Automatic 3D-Stitching of Teravoxel-Sized Microscopy Images. BMC Bioinformatics. 2012, 13: 316-10.1186/1471-2105-13-316.
Cardona A, Tomancak P: Current challenges in open-source bioimage informatics. Nat Methods. 2012, 9: 661-665. 10.1038/nmeth.2082.
Carpenter AE, Kamentsky L, Eliceiri KW: A call for bioimaging software usability. Nat Methods. 2012, 9: 666-670. 10.1038/nmeth.2073.
Edelstein A, Amodaj N, Hoover K, Vale R, Stuurman N: Computer control of microscopes using μManager. Current protocols in molecular biology. Edited by: Ausubel FM. 2010, Chapter 14:Unit14.20
Shamir L, Delaney JD, Orlov N, Eckley DM, Goldberg IG: Pattern recognition software and techniques for biological image analysis. PLoS Comput Biol. 2010, 6: e1000974-10.1371/journal.pcbi.1000974.
Loo L-H, Wu LF, Altschuler SJ: Image-based multivariate profiling of drug responses from single cells. Nat Methods. 2007, 4: 445-453.
Johnston J, Iser WB, Chow DK, Goldberg IG, Wolkow CA: Quantitative image analysis reveals distinct structural transitions during aging in Caenorhabditis elegans tissues. PLoS One. 2008, 3: e2821-10.1371/journal.pone.0002821.
Perlman ZE, Slack MD, Feng Y, Mitchison TJ, Wu LF, Altschuler SJ: Multidimensional drug profiling by automated microscopy. Science. 2004, 306: 1194-1198. 10.1126/science.1100709.
Cornelissen F, Cik M, Gustin E: Phaedra, a protocol-driven system for analysis and validation of high-content imaging and flow cytometry. J Biomol Screen. 2012, 17: 496-506. 10.1177/1087057111432885.
The authors declare that they have no competing interests.
PA wrote the first version of the manuscript and incorporated all the contributions of the coauthors. CT prepared the tables of the manuscript, AS focused on the machine learning part, AB on microscopes, and KK helped to improve the review of workflow systems and databases. All authors read and approved the final manuscript.