- Original article
- Open Access

# Mapping molecular statistics with balanced super-resolution optical fluctuation imaging (bSOFI)

- Stefan Geissbuehler
^{1}Email author, - Noelia L Bocchio
^{1}, - Claudio Dellagiacoma
^{1}, - Corinne Berclaz
^{1}, - Marcel Leutenegger
^{1}and - Theo Lasser
^{1}

**1**:4

https://doi.org/10.1186/2192-2853-1-4

© Geissbuehler et al.; licensee Springer. 2012

**Received:**28 January 2012**Accepted:**25 April 2012**Published:**25 April 2012

## Abstract

### Background

Super-resolution optical fluctuation imaging (SOFI) achieves 3D super-resolution by computing temporal cumulants or spatio-temporal cross-cumulants of stochastically blinking fluorophores. In contrast to localization microscopy, SOFI is compatible with weakly emitting fluorophores and a wide range of blinking conditions. The main drawback of SOFI is the nonlinear response to brightness and blinking heterogeneities in the sample, which limits the use of higher cumulant orders for improving the resolution.

Balanced super-resolution optical fluctuation imaging (bSOFI) analyses several cumulant orders for extracting molecular parameter maps, such as molecular state lifetimes, concentration and brightness distributions of fluorophores within biological samples. Moreover, the estimated blinking statistics are used to balance the image contrast, i.e. linearize the brightness and blinking response and to obtain a resolution improving linearly with the cumulant order.

### Results

Using a widefield total-internal-reflection (TIR) fluorescence microscope, we acquired image sequences of fluorescently labelled microtubules in fixed HeLa cells. We demonstrate an up to five-fold resolution improvement as compared to the diffraction-limited image, despite low single-frame signal-to-noise ratios. Due to the TIR illumination, the intensity profile in the sample decreases exponentially along the optical axis, which is reported by the estimated spatial distributions of the molecular brightness as well as the blinking on-ratio. Therefore, TIR-bSOFI also encodes depth information through these parameter maps.

### Conclusions

bSOFI is an extended version of SOFI that cancels the nonlinear response to brightness and blinking heterogeneities. The obtained balanced image contrast significantly enhances the visual perception of super-resolution based on higher-order cumulants and thereby facilitates the access to higher resolutions. Furthermore, bSOFI provides microenvironment-related molecular parameter maps and paves the way for functional super-resolution microscopy based on stochastic switching.

## Keywords

- Fluorescence microscopy
- Super-resolution
- Stochastic switching
- Sofi
- Cumulants
- Balanced contrast
- molecular statistics
- Functional imaging

## Background

The spatial resolution in classical optical microscopes is limited by diffraction to about half the wavelength of light. During the last two decades, several super-resolution concepts have been developed. Based on the on-off-switching of fluorescent probes, these concepts overcome the diffraction limit by up to an order of magnitude (Huang et al. 2009). A straightforward method consists of digitally post-processing an image sequence of stochastically blinking emitters acquired with a standard wide-field fluorescence microscope. Densely packed single fluorophores can be distinguished in time by using high-precision localization algorithms, used for instance in photo-activation localization microscopy (PALM) (Betzig et al. 2006; Hess et al. 2006) and stochastic optical reconstruction microscopy (STORM) (Heilemann et al. 2008; Rust et al. 2006), or by analysing the statistics of the temporal fluctuations as exploited in super-resolution optical fluctuation imaging (SOFI) (Dertinger et al. 2009; Dertinger et al. 2010). SOFI is based on a pixel-wise auto- or cross-cumulant analysis, which yields a resolution enhancement growing with the cumulant order in all three dimensions (Dertinger et al. 2009). Uncorrelated noise, stationary background, as well as out-of-focus light are greatly reduced by the cumulants analysis. While PALM and STORM are commonly based on a frame-by-frame analysis of images of individual fluorophores, SOFI processes the entire image sequence at once and therefore presents significant advantages in terms of the number of required photons per fluorophore and image, as well as in acquisition time (Geissbuehler et al. 2011). Localization microscopy requires a meta-stable dark state for imaging individual fluorophores (van de Linde et al. 2010). In contrast, SOFI relies solely on stochastic, reversible and temporally resolvable fluorescence fluctuations almost regardless of the on-off duty cycle (Geissbuehler et al. 2011). The main drawback of SOFI is the amplification of heterogeneities in molecular brightness and blinking statistics which limits the use of higher-order cumulants and therefore resolution. In this article, we revisited the original SOFI concept and propose a reformulation called balanced super-resolution optical fluctuation imaging (bSOFI), which in addition to improving structural details opens a new functional dimension to stochastic switching-based super-resolution imaging. bSOFI allows the extraction of the super-resolved spatial distribution of molecular statistics, such as the on-time ratio, the brightness and the concentration of fluorophores by combining several cumulant orders. Moreover, this information can be used to balance the image contrast in order to compensate for the nonlinear brightness and blinking response of conventional SOFI images. Consequently, bSOFI enables higher-order cumulants to be used and thereby achieves higher resolutions.

## Methods

### Theory and algorithm

SOFI is based on the computation of temporal cumulants or spatio-temporal cross-cumulants. Cumulants are a statistical measure related to moments. Because cumulants are additive, the cumulant of a sum of independently fluctuating fluorophores corresponds to the sum of the cumulant of each individual fluorophore. This leads to a point-spread function raised to the power of the cumulant order *n* and therefore a resolution improvement of
$\sqrt{n}$, respectively almost *n* with subsequent Fourier filtering (Dertinger et al.
2010). So far, SOFI has been used exclusively to improve structural details in an image (Dertinger et al.
2009; Dertinger et al.
2010). Information about the on-time ratio, the molecular brightness and the concentration has to our knowledge never been exploited before and therefore represents a new potential for super-resolved imaging.

*n*of a pixel set $\mathbb{P}=\{{\overrightarrow{r}}_{1},{\overrightarrow{r}}_{2},\dots ,{\overrightarrow{r}}_{n}\}$ with time lags $\overrightarrow{\tau}=\{{\tau}_{1},{\tau}_{2},\dots ,{\tau}_{n}\}$ can be calculated as (Leonov and Shiryaev 1959)

where
${\left.\right)"\; close=">">\dots}_{}t$ stands for averaging over the time *t*. *P* runs over all partitions of a set
$\mathbb{S}=\{1,2,\dots ,n\}$, which means all possible divisions of
$\mathbb{S}$ into non-overlapping and non-empty subsets or parts that cover all elements of
$\mathbb{S}$. |*P*| denotes the number of parts of partition *P* and *p* enumerates these parts.
$I({\overrightarrow{r}}_{i},t)$ is the intensity distribution measured over time on a detector pixel
${\overrightarrow{r}}_{i}$. We used the cross-cumulant approach without repetitions to increase the pixel grid density and eliminate any bias arising from noise contributions in auto-cumulants (Geissbuehler et al.
2011). A 4x4 neighborhood around every pixel was considered to compute all possible *n*-pixel combinations excluding pixel repetitions. For computational reasons, we kept only a single combination featuring the shortest sum of distances with respect to the corresponding output pixel
$\overrightarrow{r}=\frac{1}{n}\sum _{i=1}^{n}{\overrightarrow{r}}_{i}$. For even better signal-to-noise ratios, it would be beneficial to average over multiple combinations per output pixel. The heterogeneity in output pixel weighting arising from the different pixel combinations has been accounted for by the distance factor as described in (Dertinger et al.
2010).

*M*independently fluctuating fluorophores and assuming a simple two-state blinking model (with characteristic lifetimes

*τ*

_{on},

*τ*

_{off}) with slowly varying molecular parameters compared to the size of the point-spread function (PSF), the cumulant of order

*n*without time-lags can be interpreted as

*n*-th order cumulant of a Bernoulli distribution with probability

*ρ*

_{on}:

*V*centered at $\overrightarrow{r}$, we may further approximate

*n*-th moment of $U\left(\overrightarrow{x}\right)$ (see (Kask et al. 1997) for some examples) and $N\left(\overrightarrow{r}\right)$ denotes the number of molecules within the detection volume

*V*. Finally, we can write

The spatial resolution of the estimation is limited by the lowest order cumulant, i.e. the second order in this case. However, the presented solution is not unique. Basically any three distinct cumulant orders could have provided a solution. Furthermore, the method is not limited to a two-state system; it can be extended to more states as long as the differences in fluorescence emission are detectable. Additional details on the analytical developments as well as a theoretical investigation of the estimation accuracy of the different parameters under different conditions are given in the Additional file 1.

Taking then the *n*-th root linearizes the brightness response without cancelling the resolution improvement of the cumulant. To reduce the amplified noise and masking residual deconvolution artefacts, small values (typically 1-5% of the maximum value) are truncated and the image is reconvolved with
$U\left(n\overrightarrow{r}\right)$. This leads to a final resolution improvement of almost *n*-fold compared to the diffraction-limited image, which is physically reasonable since the frequency support of the cumulant-equivalent optical transfer function (OTF) is *n*-times the support of the system’s OTF (cf. (Dertinger et al.
2010)). In contrast to Fourier reweighting (Dertinger et al.
2010), which is equivalent to a Wiener filter deconvolution and reconvolution with
$U\left(n\overrightarrow{r}\right)$, we explicitly split these two steps and use an improved but computationally more expensive deconvolution algorithm that is appropriate for the subsequent linearization.

*n*roots for ${\rho}_{\mathrm{on}}\in \left[0,1\right]$, there might still be hidden image features in these brightness-linearized cumulants (result after deconvolution,

*n*-th root and reconvolution with $U\left(n\overrightarrow{r}\right)$). However, using the on-ratio map ${\rho}_{\mathrm{on}}\left(\overrightarrow{r}\right)$, it is straightforward to identify the structural gaps around the roots of

*f*

_{ n }and fill them in with the brightness-linearized cumulant of order n-1. To this end, the locations where

*f*

_{ n }approaches zero are translated into a weighting mask with smoothed edges around these locations. The thresholds have been defined by computing the crossing points of ${\left|{f}_{n}\right|}^{1/n}$ and ${\left|{f}_{n-1}\right|}^{1/(n-1)}$. This mask is then applied on the

*n*-th order brightness-linearized cumulant and its negation is applied on order n-1 (see Additional file 1 for further details). The result is a balanced cumulant image. It should be noted that the cancellation of ${f}_{n}\left(\overrightarrow{r}\right)$ by division is possible but not recommended, because it amplifies noisy structures in the vicinity of the roots of

*f*

_{ n }. The combination of multiple cumulant orders in a balanced cumulant image results in a better overall image quality. However, it is also possible that the on-ratio varies only slightly throughout the field of view, such that a combination of multiple cumulant orders is not necessary. Figure 1 illustrates the different steps of the algorithm based on a simulation of randomly blinking fluorophores, arranged in a grid of increasing density from right to left, increasing brightness from left to right and increasing on-time ratio from top to bottom.

### Experiments

In order to verify the concept experimentally, we used a custom-designed objective-type total internal reflection (TIR) fluorescence microscope with a high-NA oil-immersion objective (Olympus, APON 60XOTIRFM, NA 1.49, used at 100x magnification), blue (490nm, 8mW, epi-illumination) and red (632nm, 30mW, TIR illumination) laser excitation and an EMCCD detector (Andor Luca S). We imaged fixed HeLa cells with Alexa647-labelled alpha tubulin and used a chemical buffer containing cysteamine and an oxygen-scavenging system (Heilemann et al. 2008) (see Additional file 1 for further details) to generate reversible blinking and an increased bleaching stability. The blue laser excitation was used to accelerate the reactivation of dark fluorophores and to reduce the acquisition time. For data processing, 5000 images acquired at 69 frames per second (fps) were divided into 10 subsequences significantly shorter than the bleaching lifetime to avoid correlated dynamics among the fluorophores (Dertinger et al. 2010). The final bSOFI images are obtained by averaging over the processed subsequences.

## Results and discussion

Although the used Lucy-Richardson deconvolution performed well on our measurements, it is not specifically adapted for cumulant images, because it assumes a Poisson-distributed noise model and an underlying signal that is strictly positive. For the *n*-th order cumulant, the signal on a single image can vary between positive and negative values according to the underlying on-ratios. Furthermore, initially Poisson-distributed noise leads to a modified noise distribution in the cumulant image. In our experiments, the local on-ratio variations were small, which proves to be unproblematic for a deconvolution with a positivity constraint, when the negative and the positive parts are considered separately. However, a deconvolution algorithm specifically adapted for cumulant images using an appropriate noise model may improve the results of balanced cumulants in the future.

*τ*(corresponding to a centred second-order cross-correlation) before it approaches zero yields an estimate on the blinking period, provided that the timeframe of the measurement includes many blinking periods. In our case however, with only 10 to 20 blinking periods within a measurement window of 500 frames (@69fps) and a low on-ratio, the temporal extent of the correlation curve rather corresponds to the characteristic on-time. Figure 3a,b show the resulting on- and off-time maps overlaid with a 5th order balanced cumulant as a transparency mask. The reported on-times correspond to the time position where the curve decreased to

*e*

^{-1}of the value at zero time lag. The off-time map is obtained by calculating ${\tau}_{\text{off}}={\tau}_{\mathrm{on}}\left({\rho}_{\mathrm{on}}^{-1}-1\right)$. The off-time map hardly shows a dependency on the illumination intensity, which is in line with the deep penetration into the sample of the blue activation light. In the present case, the lifetime of the off-state is influenced mainly by the chemical composition of the microenvironment surrounding the probe (van de Linde et al. 2011).

For estimating the average on-time, we computed the second-order cross-cumulant as a function of time lag and averaged it over the x-y-plane and 10 subsequences of 500 frames (Figure 3c). The fitted exponential curve has a characteristic time constant of $\overline{{\tau}_{\text{on}}}=31\text{ms}$.

## Conclusions

bSOFI is an extended version of SOFI and shares its advantages of simplicity, speed, rejection of noise and background, and compatibility with various blinking conditions. Since the bSOFI-PSF shrinks in all three dimensions with increasing cumulant orders, bSOFI can easily be extended to the axial dimension by acquiring multiple depth planes and performing the analysis in three dimensions. In contrast to SOFI, the bSOFI response to brightness and blinking heterogeneities in the sample is nearly linear, which allows higher resolutions to be obtained by computing higher cumulant orders. The additional information on the spatial distribution of molecular statistics may be used to monitor static differences and/or dynamic changes of the probe-surrounding microenvironments within cells and thus may enable functional super-resolution imaging with minimum equipment requirements.

## Declarations

### Acknowledgements

This research was supported by the Swiss National Science Foundation (SNSF) under grants CRSII3-125463/1 and 205321-138305/1. The authors would like to thank Prof. Anne Grapin-Botton for the provided infrastructures used for the preparation of the samples and acknowledge Arno Bouwens, Dr. Matthias Geissbuehler, and Dr. Erica Martin-Williams for their constructive comments on the manuscript.

## Authors’ Affiliations

## References

- Betzig E, Patterson G, Sougrat R, Lindwasser O, Olenych S, Bonifacino J, Davidson M, Lippincott-Schwartz J, Hess H:
**Imaging Intracellular Fluorescent Proteins at Nanometer Resolution.***Science*2006,**313**(5793):1642. 10.1126/science.1127344View ArticlePubMedGoogle Scholar - Dertinger T, Colyer R, Iyer G, Weiss S, Enderlein J:
**Fast, background-free, 3D super-resolution optical fluctuation imaging (SOFI).***Proc Nat Acad Sci USA*2009,**106**(52):22287–22292. 10.1073/pnas.0907866106PubMed CentralView ArticlePubMedGoogle Scholar - Dertinger T, Colyer R, Vogel R, Enderlein J, Weiss S:
**Achieving increased resolution and more pixels with Superresolution Optical Fluctuation Imaging (SOFI).***Opt Express*2010,**18**(18):18875–18885. 10.1364/OE.18.018875PubMed CentralView ArticlePubMedGoogle Scholar - Dertinger T, Heilemann M, Vogel R, Sauer M, Weiss S:
**Superresolution optical fluctuation imaging with organic dyes.***Angew Chem Int Ed*2010,**49**(49):9441–9443. 10.1002/anie.201004138View ArticleGoogle Scholar - Geissbuehler S, Dellagiacoma C, Lasser T:
**Comparison between SOFI and STORM.***Biomed Opt Express*2011,**2**(3):408–420. 10.1364/BOE.2.000408PubMed CentralView ArticlePubMedGoogle Scholar - Heilemann M, Van De Linde S, Schüttpelz M, Kasper R, Seefeldt B, Mukherjee A, Tinnefeld P, Sauer M:
**Subdiffraction-resolution fluorescence imaging with conventional fluorescent probes.***Angew Chem Int Ed*2008,**47**(33):6172–6176. 10.1002/anie.200802376View ArticleGoogle Scholar - Hess S, Girirajan T, Mason M:
**Ultra-high resolution imaging by fluorescence photoactivation localization microscopy.***Biophys J*2006,**91**(11):4258–4272. 10.1529/biophysj.106.091116PubMed CentralView ArticlePubMedGoogle Scholar - Huang B, Bates M, Zhuang X:
**Super-Resolution Fluorescence Microscopy.***Annu Rev Biochem*2009,**78:**993–1016. 10.1146/annurev.biochem.77.061906.092014PubMed CentralView ArticlePubMedGoogle Scholar - Kask P, Gunther R, Axhausen P:
**Statistical accuracy in fluorescence fluctuation experiments.***Eur Biophys J Biophys Lett*1997,**25**(3):163–169. 10.1007/s002490050028View ArticleGoogle Scholar - Leonov V, Shiryaev A:
**On a Method of Calculation of Semi-Invariants.***Theory Probability App*1959,**4**(3):319–329. 10.1137/1104031View ArticleGoogle Scholar - Lucy L:
**Iterative Technique for Rectification of Observed Distributions.***Astron J*1974,**79**(6):745–754.View ArticleGoogle Scholar - Richardson W:
**Bayesian-Based Iterative Method of Image Restoration.***J Opt Soc Am*1972,**62:**55. 10.1364/JOSA.62.000055View ArticleGoogle Scholar - Rust M, Bates M, Zhuang X:
**Sub-diffraction-limit imaging by stochastic optical reconstruction microscopy (STORM).***Nat Methods*2006,**3**(10):793–795. 10.1038/nmeth929PubMed CentralView ArticlePubMedGoogle Scholar - van de Linde S, Löschberger A, Klein T, Heidbreder M, Wolter S, Heilemann M, Sauer M:
**Direct stochastic optical reconstruction microscopy with standard fluorescent probes.***Nat Protoc*2011,**6**(7):991. 10.1038/nprot.2011.336View ArticlePubMedGoogle Scholar - van de Linde S, Wolter S, Heilemann M, Sauer M:
**The effect of photoswitching kinetics and labeling densities on super-resolution fluorescence imaging.***J Biotechnol*2010,**149**(4):260–266. 10.1016/j.jbiotec.2010.02.010View ArticlePubMedGoogle Scholar

## Copyright

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License ( http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.