Čičak, Radišić Biljak, and Šimundić: Verification of a 6-part differential haematology analyser Siemens Advia 2120i

Introduction

Haematology analyser (HA) Siemens Advia 2021i (Siemens, Erlangen, Germany) is designed for mid- to high-volume testing in routine work and it measures complete blood count (CBC) with 6-part white blood cell (WBC) differential count (1). As HA becoming more technologically advanced and report an extended number of parameters for CBC, it is important to establish all the advantages and limitations of HA by verification.

There are numerous studies that assessed only the precision and/or accuracy as comparability of Siemens Advia 2120i to another type of HA (2-4). But, estimation of other analytical parameters, such as analytical measuring range (AMI) (linearity), carryover, limit of blank (LoB), limit of detection (LoD) and limit of quantitation (LoQ) in already published articles are fairly scarce. All HA are prone to errors to a more or less extent, and assessment of bias in comparability studies does not reflect the true deviation of measured parameters. As best we know, until now, none of the published studies was verified trueness by reference material (Siemens, Erlangen, Germany) which would enable to estimate the true bias and thus calculate the total error for all the measured parameters. Because of that, we decided for different approach than other studies had for estimation accuracy of our HA.

To the best of our knowledge, none of the studies published until now have performed extended verification of the analytical performance of Advia 2021i prior to implementation in routine work. The aim of this study was to verify the analytical performance of precision, estimate bias as a measure of trueness, AMI (linearity), carryover, LoB, LoD, LoQ and total error (TE) for CBC parameters which measures HA Siemens Advia 2021i.

Materials and methods

Study design

This study was performed from April to July 2018 at the Department of Medical Laboratory Diagnostics of University Hospital “Sveti Duh” (Zagreb, Croatia). Verification was performed according to the internally developed protocol, based on Clinical and Laboratory Standards Institute (CLSI) H26-A2, Validation, Verification, and Quality Assurance of Automated Haematology Analysers, CLSI EP17-A Protocols for Determination of Limits of Detection and Limits of Quantification, and International Council for Standardization in Haematology (ICSH) guidelines for the evaluation of blood cell analysers including those used for differential leukocyte and reticulocyte counting (5-7).

Materials

For the verification study, the K2 ethylenediaminetetraacetic acid (EDTA) (Kima, Piove di Sacco, Italy) patients’ leftover samples were used for. The study had the approval of the hospital Ethics Committee. For estimation of precision and bias, three levels of the commercial ADVIA 3 in 1 TESTpoint Haematology Controls (Siemens, Erlangen, Germany) were used: ABN1 control lot TP81015, NORM control lot TP82015, and ABN2 control lot TP83015. These control samples are haematology reference materials for monitoring the precision and trueness of ADVIA 120/2120/2120i Haematology systems.

Methods

The analyser Advia 2021i is haematology analyser based on the flow cytometry. Analyser Advia 2021i uses 5 channels to analyse blood samples: i) haemoglobin channel, ii) erythrocyte/platelets channel, iii) peroxidase channel (to distinguish peroxidase-positive cells from peroxidase-negative cells), iv) lobularity/nuclear density channel and v) reticulocyte channel (8). Within-run precision was estimated by analysing commercial control samples in a series of 20 replicates and on three patients’ blood samples (10 replicates in a series). Between-run precision was estimated by analysing commercial control samples for consecutive 20 days.

Within-, between-run precision and estimation of bias were determined for leukocytes, erythrocytes, haemoglobin, haematocrit, mean corpuscular volume (MCV), platelets and mean platelet volume (MPV).

Analytical measuring range (linearity) was assessed for leukocytes, erythrocytes, haemoglobin, and platelets of patients’ whole blood samples, with concentrations close to the upper analytical measuring range (linearity) limit. The initial values for leukocytes were 90 x109/L, erythrocytes 7.06 x1012/L, haemoglobin 220 g/L, and for platelets 970 x109/L. Based on CLSI H26-A2 guidelines the concept of linearity can only apply to measuring the concentration of haemoglobin, while the term analytical measuring range was used for the measuring number of cells (WBC, RBC, Plt) (5). The AMI was verified by preparing serial dilutions of a known high values of certain parameter. Serial dilutions (1:0, 1:2, 1:4, 1:8 and 1:16) were prepared by using the original HA diluent (Sheat rinse ADVIA 2120i, Siemens). Carryover was estimated for leukocytes, erythrocytes, haemoglobin, and platelets by using one sample with low (sample L) and one with high analyte concentration (sample H). Sample H was analysed in triplicate (H1, H2 and H3), followed by the sample L in triplicate (L1, L2 and L3).

The estimation of carryover for each analyte was performed three times, using 3 different H and L samples. Samples with high values had leukocytes > 55.00 x109/L, erythrocytes > 6.00 x1012/L, haemoglobin > 170 g/L, and platelets > 720 x109/L. On the other hand, samples with low values had leukocytes < 3.00 x109/L, erythrocytes < 1.10 x1012/L, haemoglobin < 20 g/L, and platelets < 25 x109/L. Limit of blank was estimated for leukocytes, erythrocytes, haemoglobin, and platelets by measuring a blank sample (distilled water) in 20 replicates in a series.

Limit of detection was estimated by measuring leukocytes and platelets in six blood samples with very low concentrations of analytes, 10 times in a series. The values of six blood samples for leukocytes were lower than 0.3 x109/L and platelets < 7 x109/L.

Coefficient of variation (CV) was calculated for each sample and for each parameter. For verification of LoQ, six blood samples were analysed with leukocytes values between 0.10-0.17 x109/L and platelets between 2-10 x109/L.

Statistical analysis

Trueness was estimated by calculating the bias between the mean observed value for every parameter from the between-run precision experiment, and the mean declared value from the manufacturer by using the following equation (Eq.) 1 (9):

bm-32-2-020710-e1.tif

The observed values for verification AMI (linearity) were considered linear if the coefficient of correlation between measured and calculated values was r > 0.99 with P < 0.001. The coefficient of correlation was determined by using MedCalc Statistical Software version 14.8.1 (MedCalc Software bv, Ostend, Belgium).

Carryover was calculated using the following equation (Eq. 2.) (7):

bm-32-2-020710-e2.tif

The results were compared with predefined acceptance criteria (criteria from manufacturer and State-of-the-art criteria (SOTA) (10). Equation 3. was used for calculating LoB (6):

bm-32-2-020710-e3.tif

For calculating LoD, equation 4 was used (6):

bm-32-2-020710-e4.tif

For each sample out of six which was used for verification LoQ, the CV% was determined. The concentration at which CV% was lower than the desired imprecision (15% for leukocytes and 25% for platelets) represented LoQ.

The TE was calculated only for CBC. The TE was calculated according to Eq. 5. (11):

bm-32-2-020710-e5.tif

For statistical analysis of obtained data, the Microsoft Office Excel 2010 (Microsoft, Washington, USA) was used. Acceptance criteria for precision, trueness and total error were defined from SOTA 2016 criteria, European Federation of Clinical Chemistry and Laboratory Medicine (EFLM) 2019 Biological Variation Database, and manufacturer technical specifications (10, 12, 13). Moreover, SOTA performance specifications for haematology parameters was published 2016 by Vis and Huisman (10).

Results

Within-run precision for low concentration of platelets exceeded the SOTA acceptance criterion (4.5%), both in patients’ (7.6%) and control samples (4.8%). The precision of MPV in low concentration control sample was higher that the acceptance criteria both in within-run and between-run precision experiments (4.6 and 4.7% respectively) but was within acceptance criteria in normal and high concentration control samples. Also, within-run precision (1.1%) for low concentrations of Hb (53 g/L) in control samples slightly exceeded from acceptance criteria of the manufacturer and SOTA (0.9%). Other CBC parameters did meet SOTA acceptance criteria, both at normal and high concentration levels, in patients’, as well as in control samples (Table 1).

Table 1

Estimated within- and between-run precision for Siemens Advia 2120i haematology analyser

Parameter Within-run precision – patients’ samples
CV% (concentration)
Within-run precision – control samples
CV% (concentration)
Acceptance criteria for within-run precision
CV%
Between-run precision control samples
CV% (concentration)
Acceptance criteria for between-run precision
CV%
L N H L N H Siemens SOTA L N H SOTA for values
L/N/H
EuBIVAS
MIN
EuBIVAS
DES
WBC, (x109/L) 4.7 (0.53) 2.0
(6.29)
2.4
(30.48)
2.4
(3.52)
1.6
(7.26)
1.8
(16.84)
2.7 2.5 2.3
(3.45)
2.4
(7.13)
2.5
(16.87)
6.0/2.5/1.5* 8.1 5.4
RBC, (x1012/L) 0.8
(2.36)
0.6
(4.15)
0.7
(6.02)
0.7
(2.30)
0.7
(4.32)
0.9
(5.17)
1.2 1.1 0.8
(2.27)
0.8
(4.27)
1.0
(5.15)
1.1 2.0 1.3
Haemoglobin, (g/L) 0.8
(84)
0.6
(124)
0.9
(175)
1.1
(53)
0.7
(112)
0.7
(165)
0.9 0.9 1.7
(54)
1.3
(111)
0.4
(166)
1.0 2.0 1.4
Haematocrit, (L/L) / / / 0.8
(0.17)
0.8
(0.34)
1.0
(0.48)
/ 1.2 1.2
(0.16)
1.3
(0.33)
1.2
(0.48)
1.4 2.1 1.4
MCV, (fL) 0.3
(82)
0.3
(91)
0.3
(102)
0.5
(72)
0.3
(79)
0.3
(94)
0.8 0.6 0.7
(71)
0.8
(78)
0.6
(93)
0.8 0.6 0.4
Platelets, (x109/L) 7.6
(20)
2.5
(199)
2.3
(623)
4.8
(74)
2.4
(214)
1.6
(458)
2.9 4.5 4.4
(76)
2.5
(214)
2.2
(463)
4.5/3.0/5.0* 4.2 2.8
MPV, (fL) / / / 4.6
(7.1)
1.2
(7.2)
1.0
(7.1)
/ 2.5 4.7
(7.0)
1.5
(7.2)
1.2
(7.1)
2.5 1.7 1.1
Lighter gray - meets at least one of the criteria. Darker gray – did not meet any criteria. *The SOTA criteria define limits of acceptable imprecision for three cut-off values for WBC and platelets. Ranges of values WBC based on SOTA are: L: < 1.0 x109/L, N: 1-10 x109/L and H: > 10 x109/L. Ranges of values platelets based on SOTA are: very low: 10-20 x109/L, low: ~ 50 x109/L and normal: > 50 x109/L. L– low values. N – normal values. H – high values. WBC – White Blood Cell count. RBC – Red Blood Cell count. MCV – Mean Corpuscular Volume. MPV – Mean Platelet Volume. SOTA – State-of-the-Art acceptance criteria. EuBIVAS DES – EFLM Biological Variation Database, Desirable specification. EFLM – European Federation of Clinical Chemistry and Laboratory Medicine.

The estimated bias exceeded even the SOTA acceptance criteria (2.0%) only for MCV at high concentration control sample (2.2%) (Table 2). The estimated percentage bias was within the acceptance criteria for all other CBC parameters.

Table 2

Estimated accuracy on control samples for haematology analyser Siemens Advia 2120i

Parameter Bias,%
(declared concentration by manufacturer)
Acceptance criteria,%
L N H SOTA EuBIVAS
MIN
EuBIVAS
DES
WBC, (x109/L) 1.1
(3.41)
1.5
(7.02)
1.4
(16.63)
4.4 7.4 4.9
RBC, (x1012/L) -1.7
(2.31)
0.5
(4.25)
-0.4
(5.17)
3.2 2.6 1.8
Haemoglobin, (g/L) 2.1
(53)
1.0
(110)
1.7
(163)
1.3 2.4 1.6
Haematocrit, (L/L) -0.8
(0.16)
1.8
(0.33)
1.8
(0.47)
1.8 2.3 1.5
MCV, (fL) 0.9
(70)
1.4
(77)
2.2
(91)
2 1.4 0.9
Platelets, (x109/L) -4.9
(80)
-2.7
(220)
-4.5
(485)
6.4 7.6 5.0
MPV, (fL) 0.1
(7.0)
-0.7
(7.2)
-1.6
(7.2)
/ 2.8 1.9
Lighter gray – meets at least one of the criteria. Darker gray – did not meet any criteria. L – low values. N – normal values. H – high values. WBC – White Blood Cell count. RBC – Red Blood Cell count. MCV – Mean Corpuscular Volume. MPV – Mean Platelet Volume. SOTA – State-of-the-Art acceptance criteria. EuBIVAS DES – EFLM Biological Variation Database, Desirable specification. EFLM – European Federation of Clinical Chemistry and Laboratory Medicine.

There was a linear relationship over the defined analytical range for RBC, WBC, Hb and Plt, with no significant constant and proportional difference. All four parameters showed excellent linearity with a coefficient of correlation 1.00 (95%CI 0.99 to 1.00), P < 0.001 (Supplementary Table 1).

No significant carryover effect was observed for RBC, Hb, WBC and Plt. Estimated carryover was within the manufacturer’s criteria, listed in the Supplementary Table 2. Furthermore, the observed results for leukocytes and haemoglobin for carryover were higher than the SOTA criteria.

Manufacturer’s LoB for leukocytes (< 0.1 x109/L) and for platelets (< 5 x109/L) was verified. The manufacturer did not declare acceptance criteria for erythrocytes and haemoglobin. Furthermore, the obtained results for LoB did meet the SOTA criteria for erythrocytes (< 0.01 x1012/L) and haemoglobin (< 0.7 g/L) (data for verification LoB are not shown). LoB Estimated LoD for leukocytes and platelets were 0.05 x109/L and 2 x109/L, respectively. LoQ for leukocytes was estimated at 0.10 x109/L. Estimated LoQ for platelets was 3, even lower than the lower AMI (linearity) limit (Supplementary Table 3.)

The calculated TE for MCV exceeded the acceptance criteria. All other parameters were within the allowable TE (Table 3).

Table 3

Estimated precision, bias and total error for Siemens Advia 2120i haematology analyser

Parameter Between-run precision for control sample N
CV% (mean concentration)
Bias % Total Error Acceptance criteria, %
EuBIVAS
OPT
EuBIVAS
DES
EuBIVAS
MIN
WBC, (x109/L) 2.4 (7.13) 1.5 5.5 6.9 13.8 20.7
RBC, (x1012/L) 0.8 (4.27) 0.5 1.8 1.9 3.9 5.8
Haemoglobin, (g/L) 1.3 (111) 1.0 3.5 1.9 3.8 5.8
Haematocrit, (L/L) 1.3 (0.33) 1.9 3.9 1.9 3.9 5.8
MCV, (fL) 0.8 (78) 1.4 2.7 0.8 1.6 2.4
Platelets, (x109/L) 2.5 (214) -2.7 6.8 4.8 9.7 14.5
MPV, (fL) 1.5 (7.2) -0.7 3.2 1.9 3.8 5.6
Gray – did not meet any criteria. WBC – White Blood Cell count. RBC – Red Blood Cell count. MCV – Mean Corpuscular Volume. MPV – Mean Platelet Volume. SOTA – State-of-the-Art acceptance criteria. EuBIVAS OPT – EFLM Biological Variation Database, Optimal specification. EuBIVAS DES – EFLM Biological Variation Database, Desirable specification. EuBIVAS MIN – EFLM Biological Variation Database, Minimum specification. EFLM – European Federation of Clinical Chemistry and Laboratory Medicine

Discussion

The within- and between-run precision, estimated bias and total error results meet the criteria for all parameters across concentration ranges except for Plt and MCV in low concentrations. The AMI (linearity) was verified, and no significant carryover was observed for RBC, Hb, WBC and Plt.

As previously mentioned, within-run precision for Plt at low concentration did not meet criteria but all laboratory findings with Plt count below 100 x109/L, in our Department are revised microscopically and there is no potential harm for patient due to enlarged within-run CV% for Plt. The SOTA criterion has stricter criteria because carryover of e.g., 2% can have a significant impact on results. The largest obtained carryover in this study was for leukocytes and it was 0.8%. For example, if the samples with a higher leukocyte count of 72 x109/L and with a lower count 3 x109/L would be analysed one after the other, and the carryover was 0.8%, the second sample would have falsely increased result of 4 x109/L, which is not clinically significant.

Moreover, obtained results for TE are within desirable the European Biological Variation Study (EuBIVAS) acceptance criteria for all parameters except MCV. The importance of calculating TE is because it describes the precision and estimated bias of certain parameter measurement that can occur. The measurement for certain parameter which do not meet the criteria should be controlled more often and with more consideration of its performance.

Harris et al. results agree with ours for within-run precision at certain concentrations which are similar to our normal (N) values for control and patients’ samples (Table 1) (1). Also, Harris et al. in the other published article only describes technical aspects of Siemens Advia 2021 and states manufacturer claims for analytical measuring range (linearity) of WBC, RBC, Hb and Plt (8). In our study we verified this manufacturer’s claims for these parameters and estimated the limit of detection and quantitation for WBC and Plt.

All other studies (2-4) performed verification of accuracy as comparison and their results showed that the Siemens Advia 2021/2021i was comparable with all other types of HA. In our study, we performed an estimation of bias with reference material and the obtained results implicate that HA Siemens Advia 2021i showed acceptable analytical performance.

As for the limitations of this study, we did not perform validation of morphology flags and calculation of TE for differential blood count nor compare parameters from leukocyte differential count for Advia 2021i with manual differentiation of leukocytes and estimate the diagnostic accuracy of the Advia 2021i with other types of HA. Also, our study has estimated analytical measuring range (linearity), carryover, LoB, LoD and LoQ only for open tube mode because of the limited volume of the samples. The ICSH guidelines for the evaluation of the blood cell analyser advise to assess those analytical performances for both, open and closed tube mode (7).

In conclusion, to the best of our knowledge, this study was the first that performed additional analytical performances (linearity, carryover, LoB, LoD, and LoQ) except precision and trueness which were already obtained in other published studies. The HA Siemens Advia 2021i showed reliable analytical performance for standard CBC parameters and it is suitable for routine use in a clinical laboratory.

Notes

[1] Conflicts of interest Potential conflict of interest

None declared.

References

1 

Harris N, Jou JM, Devoto G, Lotz J, Pappas J, Wranovics D, et al. Performance evaluation of the Advia 2120 hematology analyzer: an international multicenter clinical trial. Lab Hematol. 2005;11:62–70. https://doi.org/10.1532/LH96.04064

2 

Guerti K, Vertessen F, Daniels L, van der Planken M. Performance evaluation of the PENTRA 60C+ automated hematology analyzer and comparison with the Advia 2120. Int Jnl Lab Hem. 2009;31:132–41. https://doi.org/10.1111/j.1751-553X.2007.01011.x

3 

Kulik K, Kwiecien I, Chelstowska B, Rutkowska E, Rzepecki P. Evaluation and comparison of the new Mindray BC-6200 hematology analyzer with ADVIA 2120i. Int J Lab Hematol. 2021;43:395–402. https://doi.org/10.1111/ijlh.13418

4 

Bruegel M, Nagel D, Funk M, Fuhrmann P, Zander J, Teupser D. Comparison of five automated hematology analyzers in a university hospital setting: Abbott Cell-Dyn Sapphire, Beckman Coulter DxH 800, Siemens Advia 2021i, Sysmex XE-5000, and Sysmex XN-2000. Clin Chem Lab Med. 2015;53:1057–71. https://doi.org/10.1515/cclm-2014-0945

5 

Clinical and Laboratory Standards Institute (CLSI). H26-A2 Validation, Verification and Quality Assurance of Automated Hematology Analyzers – Second Edition. CLSI document; Wayne (PA): 2010.

6 

Clinical and Laboratory Standards Institute (CLSI). EP17-A Protocols for Determination of Limits of Detection and Limits of Quantitation; Approved Guideline. CLSI document; Wayne (PA): 2004.

7 

CBriggsNCulpBDavisGD’onfrioGZiniSJMachinInternational Council for Standardization of Haematology. ICSH guidelines for the evaluation of blood cell analyzers including those used for differential leukocyte and reticulocyte counting. Int J Lab Hematol. 2014;36:613–27. https://doi.org/10.1111/ijlh.12201

8 

Harris N, Kunicka J, Kratz A. The ADVIA 2021 Hematology System: Flow Cytometry-Based Analysis of Blood and Body Fluids in the Routine Hematology Laboratory. Lab Hematol. 2005;11:47–61. https://doi.org/10.1532/LH96.04075

9 

Supak Smolcic V, Bilic-Zulle L, Fisic E. Validation of methods performance for routine biochemistry analytes at Cobas 6000 analyzer series module c501. Biochem Med (Zagreb). 2011;21:182–90. https://doi.org/10.11613/BM.2011.028

10 

Vis JY, Huisman A. Verification and quality control of routine hematology analyzers. Int J Lab Hematol. 2016;38:100–9. https://doi.org/10.1111/ijlh.12503

11 

Rifai N, Horvath AR, Wittwer CT, editors. Tietz Fundamentals of Clinical Chemistry and Molecular Diagnostics. 8th ed. St. Louis: Elsevier Saunders; 2018.

12 

Aaesand AK, Fernandez-Calle P, Webster C, Coskun A, Gonzales-Lao E, Diaz-Garzon J, et al. The EFLM Biological Variation Database. [Cited 2021 April 15]. Available from: https://biologicalvariation.eu/

13 

ADVIA® 2120/2120i Hematology Systems. Operator’s Guide. Rev. 03-2019. Siemens, Erlangen, Germany.