Research Articles

Download PDF (1.2 MB)

TOMOGRAPHY, March 2019, Volume 5, Issue 1:36-43
DOI: 10.18383/j.tom.2018.00030

Multicenter Repeatability Study of a Novel Quantitative Diffusion Kurtosis Imaging Phantom

Dariya I. Malyarenko1, Scott D. Swanson1, Amaresha S. Konar2, Eve LoCastro2, Ramesh Paudyal2, Michael Z. Liu3, Sachin R. Jambawalikar3, Lawrence H. Schwartz3, Amita Shukla-Dave2, Thomas L. Chenevert1

1Department of Radiology, University of Michigan Medical School, Ann Arbor, MI;2Departments of Medical Physics and4Radiology, Memorial Sloan Kettering Cancer Center, New York, NY; and3Department of Radiology, Columbia University Irving Medical Center, New York, NY


Quantitative kurtosis phantoms are sought by multicenter clinical trials to establish accuracy and precision of quantitative imaging biomarkers on the basis of diffusion kurtosis imaging (DKI) parameters. We designed and evaluated precision, reproducibility, and long-term stability of a novel isotropic (i)DKI phantom fabricated using four families of chemicals based on vesicular and lamellar mesophases of liquid crystal materials. The constructed iDKI phantoms included negative control monoexponential diffusion materials to independently characterize noise and model-induced bias in quantitative kurtosis parameters. Ten test–retest DKI studies were performed on four scanners at three imaging centers over a six-month period. The tested prototype phantoms exhibited physiologically relevant apparent diffusion, Dapp, and kurtosis, Kapp, parameters ranging between 0.4 and 1.1 (×10−3 mm2/s) and 0.8 and 1.7 (unitless), respectively. Measured kurtosis phantom Kapp exceeded maximum fit model bias (0.1) detected for negative control (zero kurtosis) materials. The material-specific parameter precision [95% CI for Dapp: 0.013–0.022(×10−3 mm2/s) and for Kapp: 0.009–0.076] derived from the test–retest analysis was sufficient to characterize thermal and temporal stability of the prototype DKI phantom through correlation analysis of inter-scan variability. The present study confirms a promising chemical design for stable quantitative DKI phantom based on vesicular mesophase of liquid crystal materials. Improvements to phantom preparation and temperature monitoring procedures have potential to enhance precision and reproducibility for future multicenter iDKI phantom studies.


Diffusion-weighted imaging (DWI) is extensively used in clinical radiology studies to monitor changes in water mobility that reflect altered tissue cellularity (13). These alterations often arise from malignancy (46) or in response to treatment (79). Quantitative parametric maps are derived on the basis of physical models for DWI signal dependence on diffusion gradient-weighting strength (denoted by b-value). A single-component diffusion model, most widely used by clinical oncology trials (7, 9, 10), assumes monoexponential DWI signal decay with increasing b-value, where the decay rate is quantified by apparent diffusion coefficient (ADC).

Diffusion kurtosis (11, 12) is a heuristic extension of the single-component model that introduces an additional quantitative parameter (apparent kurtosis coefficient, Kapp) to describe the degree of non-Gaussian deviation from monoexponential signal decay in tissue observed for certain in vivo structures and malignancies with increasing b-values (5, 1315). These deviations are typically caused by the presence of cellular structures that substantially impede water mobility, leading to sustained DWI signal at high b-values (1, 11). Because typical diffusion kurtosis imaging (DKI) parameter fit is performed over a limited range of b-values (bmax < 3000 s/mm2), the derived diffusion and kurtosis values are “apparent” rather than absolute characteristics.

Recently there has been a surge of interest in the diffusion imaging community to evaluate Kapp as a noninvasive, surrogate biomarker of tissue microstructure (5, 13, 1517). Unlike classic diffusion kurtosis in anisotropic brain tissue (11, 12), for nominally isotropic cancerous parenchyma, observed relatively high apparent kurtosis (0.8–1.7, for example, in head and neck or prostate and bladder cancers [5, 1315]) is typically associated with tumor potency. To use DKI parameters as quantitative imaging biomarkers (QIBs) of tumor response to therapy in multicenter oncology trials (16, 17), the precision (repeatability) and accuracy (bias) of the potential QIBs need to be evaluated (18, 19) across multiple scanner platforms using a common scan protocol (20, 21). Construction of a novel phantom, one that provides true parameter values in the physiologically relevant ranges (5, 1315), is the first step for the development of a repeatable multisite study protocol and the only means for the absolute bias estimate (20, 21).

The search for a viable DKI phantom has been ongoing for over a decade. The “natural” phantoms based on cream and asparagus (12, 13, 22) provide single “untunable” kurtosis parameter value and perish quickly. Synthetic phantoms comprising the polyethylene particle suspensions (23) and most recently suggested microbead impregnated gels (24) are more stable, but still suffer from limited range of provided kurtosis parameters (Kapp < 0.7) and limited precision owing to microscopic sample inhomogeneity, chemical shift (23), and/or low signal-to-noise ratio (SNR) (short T2) (24). Our recent pilot study (25) proposed the development of novel kurtosis phantoms based on lamellar (amorphous layers) and vesicular (fluid-filled microsacs) phases of liquid crystal systems. These molecular constructs are composed of hydrophobic long-chain fatty alcohols and surfactants that mimic tissue cellularity by forming regularly spaced membranous mesostructures that impede water diffusion. Altering relative concentrations of restricted and free water pools allows a broad range of tunable apparent kurtosis parameters (25) with sufficient SNR for easy quantitative DKI scan protocol testing.

The purpose of the present multi-site study was to evaluate precision, reproducibility, and long-term stability of a novel (prototype) isotropic (i)DKI phantom, fabricated using four families of chemicals based on select combinations of vesicular and lamellar mesophases of liquid crystal materials with adjustable restricted diffusion fraction. The desired iDKI phantom characteristics included long-term temporal stability and homogeneous iDKI model parameters, tunable over physiologically relevant ranges.


To guide design of the next-generation phantom toward improved stability and reproducibility, this study included the following four steps: [1] development and fabrication of the prototype iDKI phantom using four families of liquid crystal materials and three negative controls, [2] implementation of a common quantitative iDKI test–retest scan protocol, [3] parametric map generation and intra-scan test–retest repeatability analysis to establish measurement precision, and [4] apparent (water ADC-based) temperature calibration for characterization of thermal versus temporal inter-scan variability.

Isotropic Diffusion Kurtosis Imaging (iDKI) Phantoms

Four quantitative iDKI phantom materials were chemically designed based on water solutions of paired long carbon-chain surfactants (cetyltrimethylammonium bromide [CTAB] or behentriammonium chloride [BTAC]) and alcohols (cetearyl [CA] or decyl [DEC]), as well as prolipid 161 [PL161] (see details in (25); online Supplemental Figure 1). These materials formed two uniformly distributed physical compartments with distinct (several orders of magnitude different) proton diffusion rates, resulting in apparent water diffusion (Dapp) and apparent kurtosis (Kapp) at high b-values. Major differences among the tested chemical designs were in the physical origin of restricted diffusion for lamellar structures versus vesicular phase materials (25) (see online Supplemental Figure 1). Three negative control, monoexponential diffusion samples, were included based on polyvinylpirrolidone (PVP) (26) solutions in water at 0%, 20%, and 40%. All seven phantom materials were individually housed in polypropylene vials (V1–V7) of 150 mm in length and 25 mm of diameter, in a circular arrangement, submerged in water bath in a 1L plastic jar. The chemical phantom sample assignments for V1–V7 vials are provided in Table 1. The example axial-plane b = 0 image of the phantom with vial (region of interest [ROI]) labels is shown in Figure 1A. Three identical phantom prototypes were prepared using the same material batch, labeled for consistent scan geometry (see online Supplemental Figure1), and shipped to each of the participating sites. The jars were filled with tap water on-site and scanned at ambient temperature.

Table 1.

Sample-Specific Inter-scan (All-Site) Average Kurtosis Parameters With Test–Retest (Repeatability-Based) 95% Confidence Intervals (95% CI)

Vial# Sample Dapp ± 95% CI Kapp ± 95% CI
V1 DEC-CTAB 0.71 ± 0.014 1.11 ± 0.017
V2 CA-BTAC 1.02 ± 0.022 1.69 ± 0.013
V3 PVP20% 1.27 ± 0.017 0.04 ± 0.013
V4 Water 2.16 ± 0.034 0.06 ± 0.021
V5 PVP40% 0.60 ± 0.012 0.08 ± 0.022
V6 PL161 1.11 ± 0.014 1.29 ± 0.009
V7 CA-CTAB 0.39 ± 0.013 0.84 ± 0.076
Figure 1.

(A) Axial b = 0 image of the central slice of the kurtosis phantom acquired at 1.5T showing sample vial cross section with typical ROI placement. (B) example fit parametric diffusion kurtosis maps for (A) with the common color-bar indicating (×10−3 mm2/s) scale for Dapp and dimensionless for Kapp. (C) and (D) show b-value dependence of ROI-mean log-signal DWI (asterisks) and kurtosis model fit (traces) for kurtosis samples and negative (mono-exponential diffusion) controls, respectively. Sample vial data are color-coded in the legend corresponding to the ROI numbers in (A). Last DWI data point on the solid-fit curves indicates maximum b-value (bmax), allowed by the fit constraints of kurtosis model convergence in (C) and DWI noise floor in (D). Dashed segments for V2, V4, and V7 illustrate (unphysical) model extrapolation, prevented by constrained fit.


Multicenter iDKI Phantom Studies

The prototype quantitative iDKI phantoms were scanned at three Quantitative Imaging Network (27) centers on four MRI scanners (2 at 1.5 T and 3 T each) using shared scan protocol over a period of six months. Consistent with the clinical iDKI scan protocol, the phantom scan instructions prescribed single-shot echo-planar imaging (SS EPI) acquisition of 3 orthogonal axial DWI directions with 11 b-values (b = 0, 50, 100, 200, 500, 800, 1000, 1500, 2000, 2500, 3000 s/mm2), using a 16-channel head-coil. Other nominal acquisition parameters included the following: field of view (FOV) = 220 × 220 mm2, echo time/repetition time = shortest/10 000 ms. (Actual minimum echo time varied from 93 ms to 107 ms across system scans owing to differences in gradient settings). The acquired section of the phantom ranged between 3 and 8 slices (3–5 mm in thickness) for the sites. Minor deviations from nominal scan protocol parameters among the sites were allowed with no effect on repeatability results. Test–retest acquisitions were performed with fixed scan protocol parameters with or without phantom repositioning, anywhere from several minutes to several days apart.

All acquired data were stored and distributed in Digital Image Communication in Medicine (DICOM) format (28), and centralized analysis of multi-b trace DWI DICOM data was performed using quality control routines developed in MATLAB 7 (MathWorks, Natick, MA) (20). Noncompliant scans from two dates that had large deviation in FOV (two scans) or had high EPI susceptibility artifacts (one scan), precluded uniform ROI definition and were excluded from the analysis. The remaining ten sets of test–retest data (three from each of the 3 T and two from each of the 1.5 T scanners) and four (early) single-run acquisitions (from one 3 T scanner) were analyzed. Test–retest studies were used for intra-scan repeatability assessment, while single runs were included for intra-scan reproducibility and sample stability evaluation. Phantom temperatures were not controlled and varied with the scanner room (ambient) environment. Reference scan room temperature was recorded for four (later) study scans. One site (that provided single-run acquisitions) stored the phantom in a scan room over the course of the study, while the other two allowed the phantom to thermally equilibrate in the scan room (for one 3 T and two 1.5 T systems) for <24 hours before each scan.

Parametric Map Generation and Repeatability Analysis

The parametric maps of apparent diffusion, Dapp, and kurtosis, Kapp, (Figure 1B) were calculated using linear least square fit of voxel DWI log-signal to a quadratic function of b-value, according to the iDKI model (11, 12), Log(Sb/S0) = − Dapp · b + Kapp/6 · (Dapp · b)2. Maximum b-value allowed in the fit was constrained by bmax < 3/(Kapp·Dapp) to satisfy iDKI signal model convergence (11) and Sbmax/S0 > 0.01 (to ensure SNRbmax > 2). This yielded bmax = 1500 s/mm2 for CA-BTAC (V2), and bmax = 2000 s/mm2 for water (V4) and PL-161 (V6) vials (Figure 1, C and D). Absolute (residual) kurtosis bias of negative controls (Figure 1, A and D: V3, V4, and V5) was estimated as Kapp fit parameter deviation from zero (29) for monoexponential (zero kurtosis) diffusion materials.

Figure 2.

Left pane shows axial ADC maps (based on mono-exponential fit using bmax = 1000 s/mm2) for phantoms scanned by two participating sites at different (measured) temperatures Tm = 24 and 19.5°C (recorded by sites). The common scale for the ADC maps is indicated by the color bar. Change in water ADC contrast between two maps illustrates sufficient thermal sensitivity for self-calibration of “apparent” phantom temperature, Ta (as described in Methodology). Linear ADC dependence on Ta is observed in the right pane for mean-ROI values of the negative control samples (color-coded in legend) from all analyzed scans (different sites and dates).


Uniform areas of the b = 0 image were used to define ROIs within phantom vials, for example, avoiding susceptibility and parallel imaging artifacts. Seven circular ROIs (12 mm diameter, 155 pixels) were defined on DWI (b = 0) for phantom tubes separately for the test–retest runs, using in-house MATLAB-based tools to generate ROI statistics for repeatability estimates of the Dapp and Kapp parameters. Uniform ROI definition was noted to be challenging for V7 owing to multiple small air bubbles (Figure 1A) apparently formed within the sample volume. These air bubbles were observed to “migrate” between test–retest runs. For all scans, the defined ROI pixel locations were within ±30 mm from the magnet isocenter that minimized potential contribution of gradient system and offset-dependent DWI bias (20, 21).

Sample-specific coefficient of variance (wCV) was calculated from available test–retest studies (18, 19): wCV = 2/Ni= 1N | X1 −X2|/(X1 + X2), where X1 and X2 were mean-ROI test–retest (Dapp or Kapp) parameter values, respectively, for N repeatability studies. The 95% confidence interval (CI) for an average value of measured parameter (X), was estimated as 1.96·wCV·ave(X), where the average was over all available (ten) test–retest DKI acquisitions (including less repeatable outliers) for each phantom vial. Single-acquisition 95% CI was also estimated for individual test–retest studies (N = 1) to assess systematic site and field dependencies. Bland–Altman (BA) repeatability analysis was performed for Dapp and Kapp across all test–retest samples (pool of 70). The overall BA limits of agreement (LOA) were calculated across all sample vials and test–retest scans excluding less repeatable scan “outliers.” These “outliers” were identified on the basis of test–retest value differences >1.5 interquartile ranges above the upper quartile or below the lower quartile of the 70 sample test–retest parameter difference histogram, corresponding to ±2.7 × SD for the normal error distribution (defined according to MATLAB “boxplot” default outliers).

Pearson correlation, R, was evaluated for the derived mean parameter values and their corresponding 95% CI estimates versus scan time (days from phantom manufacturing), apparent (water ADC-based) phantom temperature, and system magnetic field, to characterize the sources of variation in the measured iDKI parameters and identify materials with desired properties. Among covariates, date was not correlated to temperature, allowing independent analysis, while magnetic field had significant negative correlation to temperature (−0.64; pR = .02) as expected from dependence on scanner environment.

Water ADC-Based Apparent Phantom Temperature

Comprehensive characterization of thermal phantom properties was beyond the scope of this study; however, assessment of apparent phantom temperature (Ta) was deemed useful for discrimination between temporal and thermal origin of inter-scan variation in measured kurtosis parameters across multiple sites and dates. To this end, the Ta of each phantom scan was self-calibrated retrospectively using water diffusion coefficient based on Speedy–Angell relation (30): Ta = 215.05 · ([ADC/D0]1/γ+ 1) − 273.15; γ = 2.063, D0 = 0.1635 mm2/; it ranged between 19.5°C and 25.5°C (±1°C) (Figure 2). For ADC-based Ta, water ADC was fit as a slope of log-signal DWI dependence on b-value up to bmax = 1000 s/mm2 (to minimize SNR bias), and mean ADC value was measured from 15 × 15 mm2 ROI defined on the central vial (V4, Figure 1A). ADC map vertical image “gradients” were observed for one system (online Supplemental Figure 2), with values increasing toward the posterior direction, indicative of phantom warming during the scan, possibly owing to contact from support pads or coil-induced heating. For this system, mean ADC values were used from three ROIs across the water-bath volume away from the posterior coil (see online Supplemental Figure 2).

Four independent, direct water temperature (Tm) measurements (with alcohol-based thermometer, CI = ±0.5°C) were recorded by the sites and indicated ∼0.5°C positive bias of “apparent” Ta-values. (The ADC calculation using b-values up to 2000 s/mm2 resulted in +1°C bias for the same independent Tm-measurements.) Notwithstanding the limited accuracy and precision of the utilized ADC-based Ta-calibration procedure (CI = ±1°C, owing to relatively imprecise water ADC values [±0.03 × 10(−3) mm2/s]), the derived apparent temperature, Ta, was sufficient to differentiate thermal from temporal trends in the measured diffusion kurtosis parameters. Adequacy of the water ADC-based Ta-calibration procedure was confirmed by observation of (expected) linear temperature dependence for ADC of the negative control PVP samples (PVP20%: V3 and PVP40%: V5; Figure 2) not used for internal calibration. Minor excursions from linearity in Figure 2 for ADC values of PVP20% (V3) and PVP40% (V5) vials offset from the isocenter compared with the centrally positioned water (V4) (Figure 1), further confirmed the negligible effect of scanner gradient system bias (20, 21) on inter-scan variability for the measured diffusion parameters.


Four different chemical designs tested for iDKI phantom materials in V1, V2, V6, and V7 (Table 1) exhibited restricted diffusion at high b-values (>1000 s/mm2), with DWI signals sustained above 20% of S0 (Figure 1C), and apparent kurtosis coefficient exceeding negative control bias owing to background noise (Figure 1B, Kapp). All materials allowed achievement of physiologically relevant apparent kurtosis parameter values (Kapp ranges, 0.8–1.7; Table 1). Consistent qualitative observations across sites were that phantom samples apparently degassed after 3–4 weeks from preparation. Less viscous materials formed large air bubbles outside the sample volume, while more viscous materials formed small visible bubbles within the sample volume (Figure 1A; V7). The in-volume microbubbles tended to migrate between test–retest runs, potentially contributing fluctuating measurement errors owing to susceptibility artifact.

BA analysis across all test–retest acquisitions and samples summarized in Figure 3 showed generally good agreement for apparent diffusion kurtosis parameters of all phantoms across centers, compared with those of negative controls. Excluding outliers, BA 95% LOAs were ±0.025 (×10−3 mm2/s) for Dapp and ±0.035 for Kapp. Negligible positive bias of 0.005 was observed for Dapp. This bias and lower repeatability for several Dapp (V4) and Kapp (V7) “outliers” (well outside the LOA) was likely because of finite noise floor interference (V4, high water ADC) and “migrating” air bubble artifacts (V7) for the corresponding test–retest scans.

Figure 3.

Bland–Altman (BA) plot for ROI-mean Dapp (A) and Kapp (B) fit parameters of all phantom samples (color-coded in the legend) from ten test–retest study scans. Solid and dashed horizontal lines mark mean bias and 95% LOA, respectively, across all samples (excluding outliers for V4 (A) and V7 (B)). Horizontal data spread for individual vials reflects inter-scan (temporal and thermal) variability of measured parameters.


Finite spread of the mean parameter values of each sample observed along the horizontal axis in Figure 3 reported on cross-system and cross-scan variability, further detailed for individual sample vials in Figure 4A. The scan-to-scan differences in Dapp of negative controls (V3, V4, V5, diamonds) were fully explained by the dependence on scanner ambient temperature (Figure 2; R > 0.97, pR < 1e-5). Absolute bias for Kapp of negative control materials (Figure 2, “x”, right axis) did not exceed 0.1 (without significant temperature dependence). The highest bias, independent of system (magnetic field), was observed for V5 (40%PVP sample) consistent with contrast-to-noise limits for this (low ADC) control. For V4, the bias was inversely dependent on the field strength (higher for 1.5 T Sys2 and Sys3), indicating its SNR origin. All measured Kapp for kurtosis samples (V1, V2, V6, and V7) exceeded negative control (zero kurtosis) bias. The estimated single test–retest 95% CIs (Figure 4B) for iDKI phantom materials ranged between 0.0003 and 0.15 (median 0.015), and (except for V7: Kapp and V4: Dapp outliers) these were not significantly different for Dapp versus Kapp and 1.5 T (Sys2, Sys3) versus 3 T (Sys1, Sys4) systems. CI(Dapp) (Figure 4B, diamonds, left axis) for V1 and V2 has shown minor correlation to measured Dapp values (R = 0.59, 0.57; pR = .07, .09), suggesting negligible contribution of model fit error to test–retest repeatability. For V2 sample, CI(Dapp) was significantly correlated to temperature (R = 0.67, pR = .033), indicating thermal noise sensitivity of this material. No other significant correlations were observed for the material-specific test–retest measurement errors (pR > 0.1).

Figure 4.

Vial-specific mean test–retest values for Dapp (diamonds) and Kapp (“x”, horizontally offset for clarity) in (A) and corresponding (single test–retest) 95% CI in (B) are color-coded for system of origin, as indicated in the legend (Sys1, Sys4 are 3 T, and Sys2, Sys3 are 1.5 T). Left and right vertical axes are for Dapp and Kapp,, respectively. The vertical spread of mean values reflects potential thermal, temporal, and field dependence of measured diffusion kurtosis parameters, while spread of CIs reports on test–retest measurement error.


The mean iDKI parameter values and derived 95% CIs observed across sites and scans are summarized in Table 1 for individual phantom components (including less repeatable “outliers”). Except for the V7 outlier Kapp (95%CI: 0.076), the apparent measurement precision of iDKI phantom parameters (CI[Dapp]: 0.013–0.022 (×10−3 mm2/s) and CI[Kapp]: 0.009–0.017) was as good (or better) than that of the negative controls (0.012–0.034 (×10−3 mm2/s) and 0.013–0.022). The achieved measurement precision was sufficient for analysis of systematic scan-to-scan variability sources for kurtosis phantom parameters (Figure 4A, V1, V2, V6, V7).

Table 2 summarizes correlation between mean parameters and apparent scan room temperature (Ta), day and field variables. The bulk of the significant correlation to magnetic “field” observed for sample V1 (negative for Dapp, and positive for Kapp) apparently originated from the systematic kurtosis parameter differences observed for Sys1 phantom stored in the scanner room versus two other sites using prolonged storage outside of their scanners (Sys2, Sys3, Sys4). Unambiguous interpretation of significant correlation to magnetic field observed for Kapp of V7 sample was not warranted owing to limited precision of the corresponding measurements (Table 1, CI[Kapp] = 0.076).

Table 2.

Dapp and Kapp Percent-Correlation (%R) Summary for Kurtosis Phantom Materials (V1, V2, V6, V7)

Vial\%R (pR) (Dapp, Ta) (Dapp, day) (Dapp, field) (Kapp, Ta) (Kapp, day) (Kapp, field)
V1 54.1(0.046) 64.1(0.013) −76.9(0.0013) −53.8(0.047) −70.7(0.0047) 71.2(0.0043)
V2 86.5(<0.001) −3.9(0.89) −42.9(0.13) −23.4(0.42) −56.2(0.036) 12.8(0.66)
V6 25.1(0.39) −90.6(<0.001) 6.8(0.82) 9.5(0.75) 98.3(3E-10) −30.5(0.29)
V7 13.3(0.65) −84.5(<0.001) 10.7(0.72) 32.8(0.25) −5.1(0.86) -61.8(0.019)

For vials showing significant thermal and temporal correlations in Table 2, the corresponding parameter dependence is plotted in Figure 5. Temperature dependence was a significant contributor to 10%–15% variation in Dapp (Figure 5A) of V2 and both “parallel” trends of V1 phantom materials. The deviations from linear trends were due to finite precision of self-calibrated Ta values and temporal stability. Marginally significant negative thermal correlation for Kapp of V1 was evidently caused by 2 high-Ta > 24°C measurements for Sys2 and Sys3 (Figure 5B), when this viscous material might not have reached thermal equilibrium. Temporal Dapp and Kapp parameter value trends (Figure 5, C and D) for V1, V2, and V7 materials exhibit initial slope (Dapp V1: 9%, V7: −22%; Kapp V1: −18%, V2: 6%) which settled into relatively stable values after a 3- to 4-week stabilization period (coincidental with observed active sample degassing). In contrast, V6 (PL161 lamellar phantom) diffusion kurtosis parameter values continued to drift toward 50%-higher Kapp and 20%-lower Dapp parameter values over the whole study period (without significant Ta-dependence). Interestingly, Dapp of V7 sample was also nominally independent of temperature. The site-dependent ∼0.2 (×10−3 mm2/s) “fork” in Dapp was observed consistently for thermal and temporal dependence of V1, strongly suggesting involvement of phantom storage conditions and/or low thermal conductivity of this viscous material.

Figure 5.

Thermal (A, B) and temporal (C, D) dependence of mean Dapp (A, C, diamonds) and Kapp (B, D, ‘x”) for phantom materials with significant (pR < 0.05, Table 2) correlation to Ta/Time variables. Source vial number is color-coded in the legend (consistent with previous figures). The vertical data spread in each plot is indicative of cross-dependence on alternative variable (Ta in C, D or Time in A, B).



All four of the different chemical designs evaluated for the prototype iDKI phantom (25) provided quantitative diffusion characteristics which could be tuned to a physiologically relevant range of parameters (Kapp > 0.8) observed for in vivo tumor tissue, for example, for head and neck, prostate, and bladder cancers (5, 1315). The study confirmed feasibility of quantitative iDKI phantoms based on vesicular and lamellar phases of liquid crystal materials of different viscosity, and provided guidance toward a phantom product and multisite quality control protocol with improved precision and reproducibility. Included negative control samples allowed independent characterization of kurtosis bias and supplied internal standards for thermal diffusion-based calibration. Independent of chemical design, all kurtosis phantoms allowed sufficient SNR to avoid noise-bias or noise-limited precision in measured parameters. Phantom material-specific confidence intervals, derived from test–retest repeatability measurements, depended on sample preparation and handling more than on scan SNR, indicating possible improvement venue. The achieved model parameter precision (95% CI) of 1%–3.5% was sufficient to study sources of systematic inter-scan variability related to thermal and temporal stability of the prototype phantom materials. These results will be used in future studies to improve development of the next-generation quantitative iDKI phantom for utilization in multicenter clinical trials.

Among studied chemical designs, CA-BTAC (V2) phantom has shown the most promising characteristics and was least sensitive to sample preparation (6% Dapp change during stabilization stage). Owing to thermal sensitivity of Dapp (∼3%/°C), typical of water-based phantoms (30), this iDKI phantom should be best used with temperature control or monitoring. In contrast, moderately viscous CA-CTAB (V7) phantom has shown thermally stable parameters, but large (22%) change in Dapp during initial stabilization period, as well as limited Kapp precision (9%, likely owing to migrating in-volume microbubbles). The observed field dependence of its Kapp might be related to chemical properties of the material; however, this would require further investigation with improved precision. More viscous lamellar DEC-CTAB (V1) material exhibited moderate (9%–18%) kurtosis parameter changes during stabilization and moderate thermal sensitivity (10%), but was sensitive to prolonged storage and thermal equilibrium conditions, likely due to lower thermal conductivity. The stable kurtosis parameter values were not achieved for PL161 (V6) sample and continually changed over the course of the study, reflecting poor temporal stability of this material.

A limitation of this study was that all phantoms shared among sites were prepared from a single batch of (four families of) materials; repeatability of the batch preparation procedure itself was not evaluated. Temperature was not consistently monitored during scanning, which should be implemented for future multicenter studies, for example, by including in situ thermometer. The phantom T1 and T2 relaxation properties were not studied, and likely do not match in vivo tissue characteristics. However, having longer-than-tissue T2 relaxation times could be desirable for intended use of the kurtosis phantoms to increase the range of accessible b-values for DKI protocol optimization. Furthermore, adjustment of relaxation properties for vesicular phase (predominantly water) materials by adding relaxivity agents should be possible without substantial interference with diffusion characteristics.

Overall, observed apparent phantom diffusion sensitivity to temperature (2%–3%/°C) was similar to free water diffusion (30) and markedly higher than that of apparent kurtosis, consistent with the restricted diffusion origin of the latter. All phantom materials were noted to undergo initial parameter stabilization period of 3-4 weeks following preparation, coincidental with evident sample degassing. The parameter values for vesicular phase materials remained relatively stable after stabilization period. The candidate materials based on more viscous multilamellar vesicle phase, exhibited either poor temporal stability (PL161: V6) or notable dependence on site storage and thermal equilibrium conditions (DEC-CTAB: V1), and hence are not recommended for product iDKI phantom manufacturing. The kurtosis parameter values of CA-CTAB (V7) vesicular material had limited precision (9%) likely owing to formation of in-volume gas microbubbles, but warranted further evaluation after improved preparation due to offered thermal stability.

These observations suggested that sample degassing (eg, by centrifuging) during preparation should be attempted to improve precision and shorten stabilization period, preferably down to <1 week. The future studies should also monitor DKI parameter changes for up to a month for several material batches to evaluate reproducibility of phantom preparation and stabilization time. For use of temperature-sensitive phantoms, temperature monitoring (with DKI parameter calibration) is also recommended for multisite reproducibility studies at ambient temperature. Temperature monitoring could be implemented using an in situ thermometer or a calibrated internal standard, and it would be preferred to temperature control (eg, with ice-water bath) to avoid kurtosis phantom material phase transition (to gel) at lower temperatures.


The present multisite repeatability study has identified the liquid crystal materials based on vesicular phase as best candidates for quantitative iDKI phantom production. Independent of chemical design, the preparation procedure for iDKI phantoms could be improved by including degassing step to enhance repeatability and reduce stabilization period of diffusion kurtosis characteristics. The most promising iDKI phantom design recommended for multisite trials is based on CA-BTAC (V2) vesicular suspension that allowed easy preparation, temporal stability, and independence of storage. Before utilization in multisite studies, this phantom would require temperature calibration and monitoring owing to observed thermal sensitivity of diffusion (similar to other water-based phantoms). Another iDKI phantom design (based on CA-CTAB: V7) with desirable thermal stability, needs to be studied after improved preparation to enhance precision and allowed longer thermal equilibration before scanning to ensure reproducibility for adaption in future longitudinal multicenter clinical trials.

Supplemental Materials


[1] Abbreviations:


Diffusion kurtosis imaging


diffusion-weighted imaging


apparent diffusion coefficient


signal-to-noise ratio


cetyltrimethylammonium bromide


behentriammonium chloride


cetearyl alcohol


decyl alcohol


region of interest




limits of agreement


single shot echo planer imaging


field of view


quantitative imaging biomarker


digital image communication in medicine


This research was supported by National Institutes of Health Grants: U01CA166104, U01 CA211205, P01CA085878 and in part through P30 CA008748.

Disclosure: S.D. Swanson, D.I. Malyarenko, and T.L. Chenevert are co-inventors on intellectual property assigned to and managed by the University of Michigan for the technology underlying the manufacturing of the quantitative diffusion kurtosis phantoms utilized in this manuscript.

Conflict of Interest: The authors have no conflict of interest to declare.


    Le Bihan D. Molecular diffusion, tissue microdynamics and microstructure. NMR Biomed. 1995;8:375–386.
    Manenti G, Di Roma M, Mancino S, Bartolucci DA, Palmieri G, Mastrangeli R, Miano R, Squillaci E, Simonetti G. Malignant renal neoplasms: correlation between ADC values and cellularity in diffusion weighted magnetic resonance imaging at 3 T. Radiol Med. 2008;113:199–213.
    Squillaci E, Manenti G, Cova M, Di Roma M, Miano R, Palmieri G, Simonetti G. Correlation of diffusion-weighted MR imaging with cellularity of renal tumours. Anticancer Res. 2004;24:4175–4179.
    Koh DM, Collins DJ. Diffusion-weighted MRI in the body: applications and challenges in oncology. AJR Am J Roentgenol. 2007;188:1622–1635.
    Lawrence EM, Gnanapragasam VJ, Priest AN, Sala E. The emerging role of diffusion-weighted MRI in prostate cancer management. Nat Rev Urol. 2012;9:94–101.
    Levy A, Medjhoul A, Caramella C, Zareski E, Berges O, Chargari C, Boulet B, Bidault F, Dromain C, Balleyguier C. Interest of diffusion-weighted echo-planar MR imaging and apparent diffusion coefficient mapping in gynecological malignancies: a review. J Magn Reson Imaging. 2011;33:1020–1027.
    Foltz WD, Wu A, Chung P, Catton C, Bayley A, Milosevic M, Bristow R, Warde P, Simeonov A, Jaffray DA, Haider MA, Ménard C. Changes in apparent diffusion coefficient and T2 relaxation during radiotherapy for prostate cancer. J Magn Reson Imaging. 2013;37:909–916.
    Jensen LR, Garzon B, Heldahl MG, Bathen TF, Lundgren S, Gribbestad IS. Diffusion-weighted and dynamic contrast-enhanced MRI in evaluation of early treatment effects during neoadjuvant chemotherapy in breast cancer patients. J Magn Reson Imaging. 2011;34:1099–1109.
    Lacognata C, Crimi F, Guolo A, Varin C, De March E, Vio S, Ponzoni A, Barilà G, Lico A, Branca A, De Biasi E, Gherlinzoni F, Scapin V, Bissoli E, Berno T, Zambello R. Diffusion-weighted whole-body MRI for evaluation of early response in multiple myeloma. Clin Radiol. 2017;72:850–857.
    Kallehauge JF, Tanderup K, Haack S, Nielsen T, Muren LP, Fokdal L, Lindegaard JC, Pedersen EM. Apparent Diffusion coefficient (ADC) as a quantitative parameter in diffusion weighted MR imaging in gynecologic cancer: Dependence on b-values used. Acta Oncol. 2010;49:1017–1022.
    Jensen JH, Helpern JA. MRI quantification of non-Gaussian water diffusion by kurtosis analysis. NMR Biomed. 2010;23:698–710.
    Jensen JH, Helpern JA, Ramani A, Lu H, Kaczynski K. Diffusional kurtosis imaging: the quantification of non-gaussian water diffusion by means of magnetic resonance imaging. Magn Reson Med. 2005;53:1432–1440.
    Jansen JF, Stambuk HE, Koutcher JA, Shukla-Dave A. Non-Gaussian analysis of diffusion-weighted MR imaging in head and neck squamous cell carcinoma: a feasibility study. AJNR Am J Neuroradiol. 2010;31:741–748.
    Raab P, Hattingen E, Franz K, Zanella FE, Lanfermann H. Cerebral gliomas: diffusional kurtosis imaging analysis of microstructural differences. Radiology. 2010;254:876–881.
    Rosenkrantz AB, Padhani AR, Chenevert TL, Koh DM, De Keyzer F, Taouli B, Le Bihan D. Body diffusion kurtosis imaging: Basic principles, applications, and considerations for clinical practice. J Magn Reson Imaging. 2015;42:1190–1202.
    Grech-Sollars M, Hales PW, Miyazaki K, Raschke F, Rodriguez D, Wilson M, Gill SK, Banks T, Saunders DE, Clayden JD, Gwilliam MN, Barrick TR, Morgan PS, Davies NP, Rossiter J, Auer DP, Grundy R, Leach MO, Howe FA, Peet AC, Clark CA. Multi-centre reproducibility of diffusion MRI parameters for clinical sequences in the brain. NMR Biomed. 2015;28:468–485.
    Jerome NP, Miyazaki K, Collins DJ, Orton MR, d'Arcy JA, Wallace T, Moreno L, Pearson AD, Marshall LV, Carceller F, Leach MO, Zacharoulis S, Koh DM. Repeatability of derived parameters from histograms following non-Gaussian diffusion modelling of diffusion-weighted imaging in a paediatric oncological cohort. Eur Radiol. 2017;27:345–353.
    Barnhart HX, Barboriak DP. Applications of the repeatability of quantitative imaging biomarkers: a review of statistical analysis of repeat data sets. Trans Onc. 2009;2:231–235.
    Raunig DL, McShane LM, Pennello G, Gatsonis C, Carson PL, Voyvodic JT, Wahl RL, Kurland BF, Schwarz AJ, Gönen M, Zahlmann G, Kondratovich MV, O'Donnell K, Petrick N, Cole PE, Garra B, Sullivan DC; QIBA Technical Performance Working Group. Quantitative imaging biomarkers: a review of statistical methods for technical performance assessment. Stat Methods Med Res. 2015;24:27–67.
    Malyarenko D, Galban CJ, Londy FJ, Meyer CR, Johnson TD, Rehemtulla A, Ross BD, Chenevert TL. Multi-system repeatability and reproducibility of apparent diffusion coefficient measurement using an ice-water phantom. J Magn Reson Imaging. 2013;37:1238–1246.
    Mulkern RV, Ricci K, Vajapeyam S, Chenevert TL, Malyarenko DI, Kocak M, Poussaint TY. Pediatric Brain Tumor Consortium multi-site assessment of apparent diffusion coefficient z-Axis variation assessed with an ice water phantom. Acad Radiol. 2015;22:363–369.
    Fieremans E, Pires A, Jensen JH. A simple isotropic phantom for diffusional kurtosis imaging. Magn Reson Med. 2012;68:537–542.
    Phillips J, Charles-Edwards GD. A simple and robust test object for the assessment of isotropic diffusion kurtosis. Magn Reson Med. 2015;73:1844–1851.
    Portakal ZG, Shermer S, Jenkins C, Spezi E, Perrett T, Tuncel N, Phillips J. Design and characterization of tissue-mimicking gel phantoms for diffusion kurtosis imaging. Med Phys. 2018;45:2476–2485.
    Swanson S, Malyarenko D, Paudyal R, LoCastro E, Jambawalikar S, Schwartz L, et al. Design and Development of a Novel Phantom to Assess Quantitative Diffusion Kurtosis Imaging, a Multi-Site Initiative. Proceedings Quantitative Imaging Networ Annual Face-to-Face meeting; 2018, Bethesda, MD.
    Pierpaoli C, Sarlls J, Nevo U, Basser PJ, Horkay F, editors. Polyvinylpyrrolidone (PVP) water solutions as isotropic phantoms for diffusion MRI studies. Proceedings Intl Soc Mag Reson Med; 2009; Honolulu HI.
    NCI Quantitative Imaging Network (QIN). (last accessed 27 Sept 2018)
    Clunie DA. DICOM structured reporting and cancer clinical trials results. Cancer Inform. 2007;4:33–56.
    Scheel M, Hubert AAB, editors. Diffusion kurtosis imaging and Pseudokurtosis in phantom studies. Eur Soc Radiol 2015.
    Holz M, Heil SR, Sacco A. Temperature-dependent self-diffusion coefficients of water and 6 selected molecular liquids for calibration in accurate H-1 NMR PFG measurements. Phys Chem Chem Phys. 2000;2:4740–4742.

Supplemental Media


Download the article PDF (1.2 MB)

Download the full issue PDF (21.39 MB)

Mobile-ready Flipbook

View the full issue as a flipbook (Desktop and Mobile-ready)