Avaliação do serviço de análises clínicas prestado a uma unidade de emergência
Angela S. Higioka; Jéssica M. Martins; Flavia Martinello
Universidade Federal de Santa Catarina (UFSC), Florianópolis, Santa Catarina, Brazil
Corresponding author
Flavia Martinello
0000-0002-6073-3404
e-mail: flaviamartineno@gmail.com
First Submission on 9/21/2018
Last Submission on 11/7/2018
Accepted for publication on 11/15/2018
Published on 2/20/2019
ABSTRACT
INTRODUCTION: Time for releasing test results and critical value communication by the clinical laboratory are considered important determinants of patients’ length of stay in the Emergency Department (ED). As well as physician satisfaction, they are used as quality indicators of the Clinical Analysis Service (CAS).
OBJECTIVE: The aim of this study was to evaluate the time to return a test result, the communication of critical values and the level of satisfaction of the ED physicians of a university hospital with the CAS.
MATERIAL AND METHODS: A physician satisfaction survey was conducted using a questionnaire. The test turnaround time for emergency requests was analyzed by observation of the pre-analytical phase and monitoring the analytical and post-analytical phases through the laboratory information system. In order to evaluate the communication of critical values by the CAS, a document analysis of the process was performed.
RESULTS: Physicians’ overall satisfaction with the CAS was considered average. Greater satisfaction was observed with reliability of the results and the staff courtesy and lesser with the delivery time of results. The test turnaround time exceeded clinicians’ expectations and the average described in the literature. No experience with critical-value communication was perceived.
CONCLUSION: The results show several opportunities for progress in the relationship between ED and CAS. The improvement of laboratory quality indicators also depends on the involvement of ED physicians and nurses and embraces monitoring, planning, education and investment in system computerization.
Keywords: hospital laboratories; clinical laboratory services; hospital emergency service; laboratory critical values; health care quality indicators; time.
RESUMEN
INTRODUCCIÓN: El tiempo de entrega de pruebas y la comunicación de valores críticos por el laboratorio clínico son considerados factores determinantes del tiempo de permanencia del paciente en la Sección de Urgencias (SU). Por lo tanto, así como la satisfacción de los médicos, estos datos también son utilizados como indicadores de calidad del Servicio de Análisis Clínicos (SAC).
OBJETIVO: Evaluar el tiempo de entrega de pruebas, la comunicación de valores críticos y el grado de satisfacción de los médicos de la SU de un hospital universitario con el SAC.
MATERIAL Y MÉTODO: Se realizó una encuesta de satisfacción de los médicos, utilizando un cuestionario. El tiempo de reporte de resultados en la SU ha sido analizado por medio de observación presencial de la fase preanalítica y monitoreo en el sistema computarizado de las fases analítica y postanalítica del laboratorio. Para evaluar la comunicación de valores críticos por el SAC, un análisis documental del proceso ha sido realizado.
RESULTADOS: La satisfacción general con el SAC fue considerada regular por los médicos participantes; hubo mayor satisfacción con la confianza en los resultados y con la atención del personal, y menor con el tiempo de entrega de resultados. Los tiempos de reporte han sido más largos que las expectativas de los médicos y la media descripta en la literatura. No se ha observado una cultura de comunicación de valores críticos.
CONCLUSIÓN: Los resultados han enseñado varias oportunidades de progreso en la relación entre SU y SAC. La mejoría de los indicadores de calidad de laboratorio evaluados depende también del envolvimiento de los médicos y enfermeros del SU e incluye monitoreo, planeamiento, educación e investimento en informatización del sistema.
Palabras-clave: laboratorios clínicos hospitalarios; servicios de laboratorio clínico; servicio de urgencias hospitalario; valores críticos de laboratorio; indicadores de calidad en asistencia sanitaria; tiempo.
RESUMO
INTRODUÇÃO: O tempo de liberação de exames e a comunicação de valores críticos pelo laboratório clínico são considerados importantes determinantes do tempo de permanência do paciente no Serviço de Emergência (SE). Portanto, assim como a satisfação dos médicos, esses dados também são utilizados como indicadores de qualidade do Serviço de Análises Clínicas (SACL).
OBJETIVO: Avaliar o tempo de liberação de exames, a comunicação de valores críticos e o nível de satisfação dos médicos do SE de um hospital universitário em relação ao SACL.
MATERIAL E MÉTODOS: Foi realizada uma pesquisa de satisfação dos médicos, utilizando um questionário. O tempo de liberação dos resultados de exames de emergência foi analisado por meio de observação presencial da fase pré-analítica e monitoramento no sistema informatizado das fases analítica e pós-analítica do laboratório. Para avaliar a comunicação de valores críticos pelo SACL, foi realizada análise documental do processo.
RESULTADOS: A satisfação geral com o SACL foi considerada regular pelos médicos participantes, com maior satisfação quanto à confiança nos resultados e à cortesia dos servidores e menor quanto ao tempo de entrega de resultados. Os tempos de liberação de resultados dos exames ultrapassaram as expectativas dos médicos e a média descrita na literatura. Não foi observada cultura de comunicação de valores críticos.
CONCLUSÃO: Os resultados demonstraram várias oportunidades de progresso na relação entre o SE e o SACL. A melhoria dos indicadores da qualidade laboratorial avaliados depende também do envolvimento dos médicos e dos enfermeiros do SE e inclui monitoramento, planejamento, educação e investimento em informatização do sistema.
Palavras-chave: laboratórios hospitalares; serviços de laboratório clínico; serviço hospitalar de emergência; valores críticos laboratoriais; indicadores de qualidade em assistência à saúde; tempo.
INTRODUCTION
The Adult Emergency Department (AED) of the University Hospital (UH) has a staff of 76 nursing professionals, 35 permanent physicians (22 duty doctors and 13 of the day shift) and nine residents of general medicine and surgery, a psychologist, a social worker, a dietitian, a pharmacist, administrative and pharmaceutical agents, security guards, kitchen assistants, and cleaning auxiliaries. According to data from the UH direction, in the year of 2017, 71,048 emergency room visits occurred in the AED. In that same period, the Clinical Analysis Service (CAS) of the institution performed approximately 93,727 tests for that department.
Emergency departments (EDs) operate 24 h a day and work as entry points to the health system, receiving patients from urgency itself, patients with conditions perceived as urgency, those lost for primary and specialized attention, besides social urgencies. Such demands mix in EDs, overloading them, what compromises quality of assistance delivery(1). In this context, successful interaction with other areas of the health system is necessary so as to optimize service rendering(2). This optimization is important when one considers the short time for decision making, typical of an ED, what does not allow the existence of doubts and requires maximum reliability on laboratory results(3, 4). These play a key role in the clinical decision-making process, and can influence up to 70% of diagnoses and medical treatments(5).
Follow-up and the opportunity to be in tune with users’ satisfaction, turnaround time (TAT) of laboratory results, and communication of critical values are crucial to improve quality in the relationship between clinical laboratory-emergency service-patient care.
The quality of a service, defined as its conformity to users’ need, can be assessed by users’ satisfaction questionnaires as tools(6). However, as they must not be considered a single quality assessment criterion(7), just one-fourth of the laboratories conduct client satisfaction surveys(6). Moreover, lower satisfaction indices are related to poor communication between the involved parts(8).
Test releasing time by the clinical laboratory is considered one of the major determinants of a patient’s time of permanence in the ED, although the length of stay is influenced by several factors. In order to achieve the goals of ideal test releasing time, all aspects of the process must be considered, namely, from test order to result release in the system or its direct communication to the ordering physician – the TAT(9).
The current concern of health institutions to enhance patient security has renewed interest in the establishment and communication of critical laboratory values(10). This communication can be reflected in both logistic efficiency of the laboratory and clinical efficacy(11). Therefore, to ensure adequate medical care, as well as to avoid damage caused by treatment delays, opportune, precise, complete and unequivocal communication of those critical values is essential.
Due to scarcity of evidence, the objective of this study is to evaluate some aspects of the relationship between the AED and the CAS of a UH as regards physicians’ level of satisfaction with result releasing time and communication of critical values by the laboratory.
MATERIAL AND METHODS
This study was approved by the Ethics Research Committee of the institution (CAAE 01423412.4.0000.0121), followed the recommendations of Resolution no. 466/2012 of the National Council of Health and was conducted from August to October, 2017, at the EAS and CAS of the UH.
The survey was carried out in four steps. The first one measured physicians’ satisfaction with the day shift at the EAD in relation to the service rendered by the CAS of the UH, using a questionnaire (Table 1).
The next step was data acquisition of the average time consumed between laboratory test orders for EAD patients, specimen collection by the laboratory personnel, and specimen registry in the laboratory information system (LIS) of CAS/ UH. The moment of test order was considered that in which the physician puts test request on the specific place for requests on the assistance counter of EAD. Eighty orders were monitored for varied tests along three months, in alternate days from Monday to Friday, from 8 a.m. to 6 p.m. Time was monitored by just one investigator, using a chronometer, without other involved professionals knowing about the evaluation, and without intervention by the observer in the procedures. The tests monitored in the investigation were: blood count, coagulation tests (prothrombin time, and partially activated thromboplastin), troponin and biochemical tests [sodium, potassium, calcium, urea, creatinine, magnesium, creatine kinase (CK), CK fraction MB (CK-MB), transaminases, gamma glutamyl transferase, lactic dehydrogenase, amylase, and lipase].
In the third step, monitoring was carried out, by the LIS, of the average elapsed time between registry of the specimen come from EAD and result release, which corresponds to the computerized phase of the process. In this phase, it was possible to monitor the average time of the analytical phase of a larger number of tests ordered in the same period of the second phase, including urinalysis. Releasing times of 311 blood counts, 113 coagulation, 325 biochemical, 54 troponin and 215 urine tests were analyzed.
Data were tabulated in Excel spreadsheets and analyzed at GraphPadPrism 5.0.
In the last step, the laboratory verified registries of critical value communications to EAD. This process of communication was evaluated in the departments of biochemistry, hematology, urinalysis, and microbiology. Besides that, based on documental analysis, we examined: a) which are the values considered critical; b) how they were defined; c) if there was consensus within the medical team; and d) how communication is recorded in the laboratory.
RESULTS
First step – EAD physicians’ satisfaction with the CAS
Among 13 doctors of the effective board of EAD and nine resident doctors for which the questionnaires were sent, 10 (45%) answered it, being five permanent doctors and five residents. Doctor satisfaction with CAS is described in Table 2.
For 30% (three) of the doctors, the acceptable deadline for urinalysis release (from collection) in case of emergency patients is 45 minutes; 40% (four) consider it 60 minutes, and 30% (three), 90 minutes (Table 3). Regarding blood count, biochemical analysis and coagulation tests, the acceptable deadline for result release from collection is 45 minutes for 60% (six) of the doctors (Table 3).
All the physicians (10) answered that they trust the results released by the CAS and would adopt an electronic test order, in case it could expedite result reporting.
Most (90% – nine) doctors answered that “most times”, the delay in test release has slowed down patients’ treatment or discharge, and that the early notification of critical values to the EAD is “very important”.
As to the frequency with which doctors have received notification of some critical values by the laboratory, 10% (one) answered “most of times”; 20% (two), “sometimes”; 50% (five) “few times”; and 20% (two), “never” were notified.
In general, these were cited as the major CAS problems: 1. collections ordered urgently many times are not conducted with due urgency; 2. result release time; 3. delay in collection and conduction of tests; 4. prolonged time between test request and result reporting; 5. delay to collect, especially on duty hours.
As suggestions for CAS improvement, the following measures were proposed: 1. keep a professional just for urgency tests, besides the routine technicians; 2. streamline all procedures; 3. hire a larger number of workers, or optimize the time of those who already work in the institution to expedite the work flow; and 4. set up a collection center with staff members in the ED.
Second step – analysis of time spent in the pre-analytical phase
Figure 1A presents time spent in each step of the pre-analytical phase of laboratory tests requested at EAD, in other words, time between test order and specimen collection and between specimen collection and its registry at LIS.
Figure 1. Time involved in the different steps of laboratory process
A) time of steps in the pre-analytical phase; B) time between specimen collection and result release. The blue continuous and dotted lines represent mean and standard deviation, respectively; the black lines, median; the error bars, minimum and maximum quartiles.
Third step – analysis of time spent in the analytical and post-analytical phases
Average time of analytical phase, that is, time between sample receipt/registry and result release of each studied test is represented in Table 3. The average time between specimen collection and result release, and between test order and result release are represented in Figure 1B and Table 3, respectively.
Fourth step – analysis of critical value communication
Just the hematology department has a list of critical values, which were obtained from the literature. The biochemistry department also has a list obtained from the literature, containing parameters of several areas, but with no routine use. The department of urinalysis does not have a list of critical values. Although the microbiology department does not have a standard operational procedure, the communication of critical values is done whenever positive blood culture occurs in any unit of the hospital. The communication of some critical values is also done as a non-systematized form by the hematology department. The biochemistry and urinalysis departments, in their turn, do not perform the communication of critical values.
Communication is made by telephone in the sectors of hematology and microbiology, although in this one both communication and preliminary result release are done in the computerized system. For both sectors, critical values are reported to each individual that answers the phone, with no obligation of registry in the hospital records. The recorded communication of critical value in the sector of microbiology is carried out in the work map of each test, where the critical value, the name and the function of who received the information are recorded, as well as the date, time, and the name of who reported the result. This map is discarded after a year. The communication registry is not entered by the hematology sector.
DISCUSSION
Aiming to improve the health system, users’ satisfaction is considered a goal to be achieved(7, 18, 19). The use of a satisfaction questionnaire as a tool is just a form to receive a feedback from professionals who use the service(18, 19); in the case of this work, the CAS/UH, it cannot be considered the only criterion for evaluation of service quality.
In our study, although the number of participants in the satisfaction survey seems small – 45% of those in a position to answer –, in similar researches, the mean rate of responding doctors was 40.8% and 57.3%(20, 21).
Courtesy is important for a good relationship among team professionals. In this context, laboratory personnel courtesy was considered good by approximately 75% of the doctors. A similar result was observed in studies conducted in hospitals of Ethiopia, where, on average 76% doctor satisfaction was observed in the area of laboratory personnel courtesy(22, 23). However, this range is below average satisfaction (96%) reported in a study conducted by the College of American Pathologists (CAP) with 81 laboratories(24).
The high percentage of doctors who consider that many times delayed TAT has slowed down patients’ treatment or discharge is worrying, because in general delays in diagnosis and/or treatment extends permanence of patients at EAD, contributing to its overcrowding and increasing hospital costs.
All the satisfaction survey participants answered they trust the tests results released by CAS/UH. In other studies, the reliability rate was 80%-98%(22, 24). Trust in results is important to expedite patient care and avoid costs of test repetition. Besides, all participating doctors answered that they would make an electronic test order, if that could streamline result release, what demonstrates an opportunity for process improvement.
While general satisfaction with CAS was considered fair for 60% of doctors, in other studies the rate ranged from 51% to 84%(7, 22-24). However, differently from what was exposed in our survey, another study reported 86% satisfaction with getting urgent results on time(22).
The complaints and suggestions to CAS described by participants were very different from those cited in the study by Mengesha(23), what demonstrates diverse organizational realities of laboratories and hospitals.
The use of open-ended questions at a customer satisfaction questionnaire can be very useful, as answers can indicate problems unknown to the laboratory(18). Monitoring customer satisfaction is invaluable for a program to improve laboratory quality, because it allows a feedback about quality of the offered service(25). However, monitoring itself does not increase quality when corrective actions are not adopted(18).
The CAP requires laboratories to measure users’ satisfaction (doctors, clients and patients) at least once every two years, as a vital component for evaluation of the laboratory performance(24).
Among doctors who answered the satisfaction questionnaire, most (80%) considered time between order and specimen collection fair at EAD. Average time between order and specimen collection was verified to be 50 minutes, what can in fact be excessive when it comes to patients in critical state. This excessive time of the pre-analytical phase at CAS can be due to several factors, including failure in making the test request to CAS, no exclusivity of laboratory technicians for EAD, great number of collection requests, time it takes laboratory technicians to go from CAS to EAD and time for order registry, besides eventual variables.
For 70% of the participants of the satisfaction survey, the total time between test order and result release in the system was considered fair. In other studies, similar satisfaction was observed (61%-80%)(7, 22). In general, the CAP states that TAT is an area of dissatisfaction, with no significant association with general satisfaction regarding laboratory service. This paradigm highlights the need laboratories have to remain watchful about TAT(24).
Although the measure of time for result release is a comon method in clinical analyses, comparing studies is complex, because there are different definitions of TAT being used. Some authors consider that TAT begins with test order; others, with sample collection; others, still, with specimen entry in the analysis sector(26). Considering TAT the time between test order and result release, we observe that the time desired by most doctors participating in the study is in agreement with that described in the literature(2, 12-14, 16, 17). However, time of result release at CAS was aproximately three times that desired by doctors at EAD.
Likewise, considering TAT as time between specimen registry/receipt and result release, also called laboratory TAT, CAS demonstrated performance below that described in the literature(2, 13, 15). We can notice that laboratory TAT (time of analytical and post-analytical phases) of CAS/UH (for the investigated tests) is close to that found in other institutions as total TAT (time between order and result release). We can also note that laboratory TAT was approximately 50% of total TAT. This percentage was also observed by Goswami et al. (2010)(27), although they have found a total TAT for all emergency tests much lower (60-90 minutes) than that found in our study. In our case, data sugest that the pre-analytical phase must be the main target for improvement.
Guidelines recommend that time for troponin result release, from sample collection, is 30 minutes(15), what is four times shorter than the observed in our study; when it is longer than 1 hour, a remote laboratory test must be implemented in the place(15).
In this survey, lack of process computerization made collection of test releasing times difficult. This fact was the reason for the reduced number of monitored orders, which cannot represent CAS as a rule. Difficulty to obtain data reinforces even more the need to computerize all the process steps, from electronic test order and automatic receipt of collection order, registry, label print, and identification of specimens at collection up to registry (bar code reading) at the moment of specimen entry in the analysis sector, so as to have control over each of the steps.
Early notification of critical values for EAD was considered important by all doctors participating in the investigation and very important by 90% of them. This result confirms the opinion described in the literature(28) and probably demonstrates the possibility of immediate action in the presence of a risky situation for the patient. Even so, half of the participants refer that few times they received notifications of critical values by the laboratory, a result similar to other studies, which reported doctors’ dissatisfaction of about 39%-56% because of lack of communication of critical values(7, 22). On the other hand, the study conducted by the CAP presented a rate of 95% satisfaction with the performed notifications, demonstrating this culture in the relationship of laboratories and doctors(24). It also stated that critical value notification is an area of dissatisfaction with no association with general satisfaction regarding laboratory service(24).
When there is real-time monitoring of critical results, by a computerized alert system and/or professionals are motivated to perform effective notification, communication of critical values provides information that can accelerate therapeutical decisions and, potentially, improve patient care. Yet, it was verified that there is no culture of critical value notification at CAS in the analyzed sectors. We did not observed standardization in the way to establish a list of results considered critical, the communication procedures, and collaborators (both from the laboratory and from EAD) training, as recommended in the literature(28).
So that active communication of critical values can occur, systematization of the process is necessary. The ideal is that critical values be established according to the disease or medical specialty, and there is a consensus among medical staff, laboratory and bibliographies about these values and the best form to report them(28-30). Technology must be an ally, so that the information system itself, fed with the values considered critical, emits an alert when it detects a relevant value during result interfacing(28, 31).
Just like Laboratories must be organized to communicate criticai values efficiently, EDs must be prepared to receive and record information. Some criteria must be set – such as who is apt to receive the critical value and where to record it – and are fundamental for the success of the system(28).
CONCLUSION
The degree of doctor satisfaction with the laboratory service was acceptable, but several opportunities for improvement were observed, especially regarding time to release test results and communication of critical values. Our survey reveals that to enhance the process of prompt acquisition of a laboratory test result, from request to critical value reporting, participation of doctors and nurses is necessary to provide quality services. With this in mind, reducing time for test release is a complex task that involves monitoring, planning, education, and investment in system computerization. Further studies are recommended, with larger sample sizes, use of other quality indicators, and comparison of the relationship between EAD and CAS during the day shift with the relationship during night shifts and weekends.
REFERENCES
1. Higginson I. Emergency department crowding. Emerg Med J. 2012; 29(6): 437-43. PubMed PMID: 22223713. PMID: 22223713
2. Steindel SJ, Howanitz PJ. Physician satisfaction and emergency department laboratory test turnaround time. Arch Pathol Lab Med. 2001; 125(7): 863-71. PubMed PMID: 11419969. PMID: 11419969
3. Chien T, Lu JY, Kao JT, Cheng YC, Lee YF. Evaluation and improvement strategy of analytical turnaround time in the stat laboratory. J Formos Med Assoc. 2007; 106(7): 558-64. PubMed PMID: 17660145. PMID: 17660145
4. Casagranda I. Point-of-care testing in critical care: the clinician’s point of view. Clin Chem Lab Med. 2010; 48(7): 913-34. PubMed PMID: 20441464. PMID: 20441464
5. Guidi GC, Lippi G. Laboratory medicine in the 2000s: programmed death or rebirth? Clin Chem Lab Med. 2006; 44(8): 913-7. PubMed PMID: 16879053. PMID: 16879053
6. Barth JH. Clinical quality indicators in laboratory medicine: a survey of current practice in the UK. Ann Clin Biochem. 2011; 48: 238-40. PubMed PMID: 21367882. PMID: 21367882
7. Addis Z, Birhan W, Derseh D, Sahle B, Gizaw N. Physicians’ and nurses’ satisfaction with the clinical laboratory service of Gondar University Hospital, northwest Ethiopia. Am J Clin Pathol. 2013; 140(3): 324-8. PubMed PMID: 23955450. PMID: 23955450
8. Shahangian S, Snyder SR. Laboratory medicine quality indicators: a review of the literature. Am J Clin Pathol. 2009; 131: 418-31. PubMed PMID: 19228647. PMID: 19228647
9. Li L, Georgiou A, Vecellio E, et al. The effect of laboratory testing on emergency department length of stay: a multihospital longitudinal study applying a cross-classified random-effect modeling approach. Acad Emerg Med. 2015; 22(1): 38-46. PubMed PMID: 25565488. PMID: 25565488
10. Piva E, Plebani M. Interpretative reports and critical values. Clin Chim Acta. 2009; 404(1): 52-8. PubMed PMID: 19306860. PMID: 19306860
11. Diaz MAL, Rioja RG, Funes VA, et al. Comunicación de valores críticos: resultados de una encuesta realizada por la comisión de la calidad extraanalítica de la SEQC. Critical values reporting: Results of a Spanish laboratories survey. Rev Lab Clin [Internet]. 2010; 3(4): 177-82. Available at: http://www.elsevier.es/es-revista-revista-del-laboratorio-clinico-282-sumario-vol-3-num-4-S1888400810X00046.
12. Salinas M, López-Garrigós M, Gutiérrez M, Lugo J, Llorca F, Uris J. Stat laboratory timeliness management according to clinician needs. Clin Chem Lab Med. 2011; 49(2): 331-3. PubMed PMID: 21105838. PMID: 21105838
13. Holland LL, Smith LL, Blick KE. Reducing laboratory turnaround time outliers can reduce emergency department patient length of stay: an 11-hospital study. Am J Clin Pathol. 2005; 124(5): 672-4. PubMed PMID: 16203280. PMID: 16203280
14. Novis DA, Jones BA, Dale JC, Walsh MK. Biochemical markers of myocardial injury test turnaround time: a College of American Pathologists Q-Probes study of 7020 troponin and 4368 creatine kinase-MB determinations in 159 institutions. Arch Pathol Lab Med. 2004; 128(2): 158-64. PubMed PMID: 14736289. PMID: 14736289
15. Storrow AB, Apple FS, Wu AHB, et al. National Academy of Clinical Biochemistry Laboratory Medicine Practice Guidelines: point of care testing, oversight and administration of cardiac biomarkers for acute coronary syndromes. Point Care [Internet]. 2007; 6(4): 215-22. Available at: https://journals.lww.com/poctjournal/toc/2007/12000.
16. Fitch JCK, Mirto GP, Geary KLB, Byrne DW, Hines RL. Point-of-care and standard laboratory coagulation testing during cardiovascular surgery: balancing reliability and timeliness. J Clin Monit Comput. 1999; 15(3-4): 197-204. PubMed PMID: 12568171. PMID: 12568171
17. Fernández-Grande E, Valera-Rodriguez C, Sáenz-Mateos L, Sastre-Gómez A, García-Chico P, Palomino-Munoz TJ. Impact of reference change value (RCV) based autoverification on turnaround time and physician satisfaction. Biochem Med. 2017; 27(2): 342-9. PubMed PMID: 28694725. PMID: 28694725
18. Oja P, Kouri T, Pakarinen A. Health centres’ view of the services provided by a university hospital laboratory: use of satisfaction surveys. Scand J Prim Health Care. 2010; 28(1): 24-8. PubMed PMID: 20205616. PMID: 20205616
19. Martins JM, Rateke ECM, Martinello F. Assessment of the pre-analytical phase of a clinical analyses laboratory. J Bras Patol Med Lab [Internet]. 2018; 54(4): 232-40. Available at: file:///C:/Users/lab00/Downloads/ v54n4a06%20(2).pdf.
20. Koh YR, Kim SY, Kim IS, et al. Customer satisfaction survey with clinical laboratory and phlebotomy services at a tertiary care unit level. Ann Lab Med. 2014; 34(5): 380-5. PubMed PMID: 25187892. PMID: 25187892
21. Oja PI, Kouri TT, Pakarinen AJ. From customer satisfaction survey to corrective actions in laboratory services in a university hospital. Int J Qual Health Care. 2006; 18(6): 422-8. PubMed PMID: 17003077. PMID: 17003077
22. Teklemariam Z, Mekonnen A, Kedir H, Kabew G. Clients and clinician satisfaction with laboratory services at selected government hospitals in eastern Ethiopia. BMC Res Notes. 2013; 6: 15. PubMed PMID: 23324260. PMID: 23324260
23. Mengesha MB. The clinical laboratory service medical practitioners’ satisfaction in southern Ethiopia. Am J Clin Pathol. 2015; 144(6): 895901. PubMed PMID: 26572996. PMID: 26572996
24. McCall SJ, Souers RJ, Blond B, Massie L. Physician satisfaction with clinical laboratory services. A College of American Pathologists Q-Probes study of 81 institutions. Arch Pathol Lab Med. 2016; 140(10): 1098-103. PubMed PMID: 27684982. PMID: 27684982
25. Jones BA, Bekeris LG, Nakhleh RE, Walsh MK, Valenstein PN. Physician satisfaction with clinical laboratory services: a College of American Pathologists Q-probes study of 138 institutions. Arch Pathol Lab Med. 2009; 133(1): 38-43. PubMed PMID: 19123734. PMID: 19123734
26. Breil B, Fritz F, Thiemann V, Dugas M. Mapping turnaround times (TAT) to a generic timeline: a systematic review of TAT definitions in clinical domains. BMC Med Inform Decis Mak. 2011; 11: 34. PubMed PMID: 21609424. PMID: 21609424
27. Goswami B, Singh B, Chawla R, Gupta V K, Mallika V. Turn around time (TAT) as a benchmark of laboratory performance. Ind J Clin Biochem. 2010; 25(4): 376-9. PubMed PMID: 21966108. PMID: 21966108
28. Rocha BCB, Alves JAR, Pinto FPD, Mendes ME, Sumita NM. The critical value concept in clinical laboratory. J Bras Patol Med Lab [Internet] . 2016; 52(1): 17-20. Available at: file:///C://Users//lab00//Downloads/ v52n1a04%20(1).pdf.
29. Hanna D, Griswold P, Leape LL, Bates DW. Communicating critical test results: safe practice recommendations. Jt Comm J Qual Patient Saf. 2005; 31(2): 68-80. PubMed PMID: 15791766. PMID: 15791766
30. Woods DM, Holl JL, Angst DB, et al. Gaps in pediatric clinician communication and opportunities for improvement. J Healthc Qual. 2008; 30(5): 43-54. PubMed PMID: 18831476. PMID: 18831476
31. Singh H, Wilson L, Reis B, Sawhney MK, Espadas D, Sittig DF. Ten strategies to improve management of abnormal test result alerts in the electronic health record. J Patient Saf. 2010; 6(2): 121-3. PubMed PMID: 20563228. PMID: 20563228