Table 4 Summary of mixed methods appraisal tool (MMAT) evaluation criteria [24]

MMAT Screening Questions

S1 = Are there clear research questions?

S2 = Do the collected data address the research questions?

MMAT Criteria for Qualitative Studies

1.1 = Is the qualitative approach appropriate to answer the research question?

1.2 = Are the qualitative data collection methods adequate to address the research question?

1.3 = Are the findings adequately derived from the data?

1.4 = Is the interpretation of results sufficiently substantiated by data?

1.5 = Is there coherence between qualitative data sources, collection, analysis and interpretation?

MMAT Criteria for Non-Randomised Studies

3.1 = Are the participants representative of the target population?

3.2 = Are measurements appropriate regarding both the outcome and intervention (or exposure)?

3.3 = Are there complete outcome data?

3.4 = Are the cofounders accounted for in the design and analysis?

3.5 = During the study period, is the intervention administered (or exposure occurred) as intended?

MMAT Criteria for Quantitative Descriptive Studies

4.1 = Is the sampling strategy relevant to address the research question?

4.2 = Is the sample representative of the target population?

4.3 = Are the measurements appropriate?

4.4 = Is the risk of nonresponse bias low?

4.5 = Is the statistical analysis appropriate to answer the research question?

MMAT Criteria for Mixed Methods Studies

5.1 = Is there an adequate rationale for using a mixed methods design to address the research question?

5.2 = Are the different components of the study effectively integrated to answer the research question?

5.3 = Are the outputs of the integration of qualitative and quantitative components adequately interpreted?

5.4 = Are divergences and inconsistences between quantitative and qualitative results adequately addressed?

5.5 = Do the different components of the study adhere to the quality criteria of each tradition of the methods involved?