Monitoring compliance with high-level commitments in health: the case of the CARICOM Summit on Chronic Non-Communicable Diseases
T Alafia Samuels a, John Kirton b & Jenilee Guebert b
a. University of the West Indies, Cave Hill Campus, PO Box 64, Bridgetown, Barbados BB11000.
b. University of Toronto, Toronto, Canada.
Correspondence to T Alafia Samuels (e-mail: email@example.com).
(Submitted: 17 June 2013 – Revised version received: 15 November 2013 – Accepted: 21 November 2013 – Published online: 19 February 2014.)
Bulletin of the World Health Organization 2014;92:270-276B. doi: http://dx.doi.org/10.2471/BLT.13.126128
The Caribbean Community (CARICOM) is composed of 15 member states and five associate members. Most of these are Caribbean islands; three are countries on the mainland of Central and South America.1 CARICOM members have a combined population of 17 million and an average life expectancy ranging from 70 to 80 years except in Haiti, where it is 62 years.2
The Caribbean region has the highest burden of noncommunicable diseases (NCDs) in the Americas.2 In light of this, the Caribbean Cooperation in Health Initiative, approved by health ministers in 1986, made NCDs a priority concern.3 In their 2001 Nassau Declaration, the CARICOM heads of government identified human immunodeficiency virus (HIV) infection, NCDs and mental health problems as regional priorities, called for strategies for the prevention and treatment of NCDs and articulated principles and processes to preserve and enhance “the health of the Region which is the wealth of the Region”.4 In 2005, the Caribbean Commission on Health and Development reported that the number of deaths from diabetes, hypertension and heart disease combined was 10 times higher than the number of deaths from acquired immunodeficiency syndrome (AIDS) and declared NCDs a “super priority”.5
At the CARICOM Summit in July 2006, leaders received a report on “the macro-economic implications of non-communicable diseases”.6 Trinidad and Tobago agreed to host a special regional consultation on compliance with specific recommendations pertaining to tobacco, diet and physical activity.7 In October of the same year, Sir George Alleyne, director emeritus of the Pan American Health Organization (PAHO) – regional office for the Americas of the World Health Organization (WHO) – called for more attention to NCDs. He argued that although “impressive gains” had been made in stemming malnutrition and infant mortality, “obesity was of growing concern, even among children” and diabetes was the “steady cause of death” among many in the Caribbean.7 Sir George’s presentation spurred the decision to hold a summit devoted to NCDs. In February 2007, Prime Minister Denzil Douglas of Saint Kitts and Nevis, in his capacity as CARICOM Minister of Health in the quasi-cabinet of the 18th Inter-sessional CARICOM Heads of Government Summit, urged CARICOM members to develop a “comprehensive regional strategic plan to respond to the chronic non-communicable diseases and the havoc they are wreaking on our Caribbean people”.8Five months later, leaders agreed to participate fully in the CARICOM Summit on Chronic Non-Communicable Diseases, to be held later in the year. Thus, the world’s first summit of heads of government devoted specifically to NCDs was the product of over a decade of regional discussions.
The CARICOM Summit was held in Port of Spain, Trinidad and Tobago, on 15 September 2007. The 11 heads of government and five ministers present agreed that “immediate collective actions were necessary to manage and control NCDs” and issued a 15-point summit declaration titled Uniting to stop the epidemic of chronic NCDs (also known as the declaration of Port of Spain),9 calling for policies and actions for the prevention and control of the four major NCDs and their common risk factors. Regional and multilateral organizations and the independent, authoritative scientific and academic community were represented at the CARICOM Summit, but there was inadequate representation of nongovernmental organizations. The financial resources to support the Summit were contributed by external actors, including Canada, yet funding for follow-up actions was meagre – less than 2% of the external funding for HIV infection and AIDS.
CARICOM Summit follow-up
Commitments are discrete, specific, publicly expressed and collectively agreed to statements of intent. They are understood to be a “promise” by summit members that they will undertake future action to move towards, meet or adjust to an identified target.10 Whether summits succeed and their commitments are complied with depends largely on how quickly and often follow-up occurs. In this case, follow-up took place within a month of the Summit and repeatedly afterwards. In October 2007, CARICOM agriculture ministers discussed the impact of food and agricultural policies on NCDs and made 13 commitments to combat these diseases.11 At its November 2008 meeting, CARICOM’s Council for Human and Social Development (COHSOD) focused on the connection between health and education and noted the importance of physical activity and healthy school meals.12
As mandated in the declaration of Port of Spain, the first Caribbean Wellness Day was celebrated on 13 September 2008 to commemorate the anniversary of the CARICOM Summit, with support from PAHO.13 In July 2009, CARICOM heads of government endorsed the Caribbean Wellness Day slogan of “Love That Body”.13,14 and, during the six years since the CARICOM Summit, the majority of countries have celebrated Caribbean Wellness Day every year.
At the June 2009 meeting of the COHSOD, the chair pointed out that achieving the United Nations Millennium Development Goals (MDGs) by their 2015 deadline would result in reduced rates of NCDs. “The Strategic Plan of Action for the Prevention and Control of NCDs in Countries of the Caribbean Community” was reviewed in November 2009, in a workshop attended by representatives of ministries of health from 10 CARICOM countries, the CARICOM Secretariat’s Health Desk and experts from PAHO and the University of the West Indies. The completed plan was tabled and endorsed at the 2010 COHSOD.5
In September 2010 and December 2011, regional NCD meetings were held in Trinidad and Tobago with funding from PAHO and the Inter-American Development Bank. At these meetings, NCD focal points within the health ministries and chief medical officers reviewed and evaluated compliance with the commitments acquired under the declaration of Port of Spain and shared plans to advance the NCD agenda nationally and regionally.
From the Caribbean to the United Nations
Following the 2007 CARICOM summit, CARICOM leaders, actively encouraged a broader range of countries and organizations to take action towards the control of NCDs. In 2008, Guyanese health minister and World Health Assembly president Leslie Ramsammy advocated for NCDs to be given a more prominent place on the global public health agenda and made the subject of an additional MDG.15
NCDs were on the agenda of the Fifth Summit of the Americas in Trinidad and Tobago in April 2009. Their leaders declared that they could “reduce the burden of non-communicable diseases (NCDs) through the promotion of comprehensive and integrated preventive and control strategies at the individual, family, community, national and regional levels and through collaborative programmes, partnerships and policies supported by governments, the private sector, the media, civil society organisations, communities and relevant regional and international partners”.16 They supported holding a United Nations (UN) high-level meeting on NCDs.
NCDs were highlighted at the November 2009 Commonwealth Heads of Government Meeting, also held in Trinidad and Tobago. Participants specifically called for “the consideration of a Summit on NCDs to be held in September 2011, under the auspices of the United Nations General Assembly (UNGA), in order to develop strategic responses to these diseases and their repercussions”.17 They also supported initiatives to promote accountability, specifically “the monitoring of NCDs in existing national health information systems” and the inclusion of NCD indicators as part of the monitoring of the MDGs.
In February 2010, CARICOM, Brazil and WHO jointly advocated for a UN high-level meeting on NCDs before UN permanent representatives in New York. In May 2010, UNGA approved a resolution, presented on behalf of CARICOM member states, to hold such a meeting.18,19
At the Second CARICOM-Japan Ministerial Conference, held in September 2010, participants called for widespread support for the high-level meeting on NCDs.20 Participants at the UN Summit on the Millennium Development Goals, also held in September 2010, committed themselves to taking action at the national, regional and global levels to control NCDs and to ensuring the success of the UN high-level meeting.19
In July 2010, at the Thirty-first Regular Meeting of the Conference of Heads of Government of the Caribbean Community, UN Secretary General Ban Ki-moon pledged his full support for the high-level meeting and commended CARICOM for raising the critical issue of NCDs.19,21 The problems posed by NCDs were brought up at the Seoul Summit of the Group of Twenty (G20) in November 201022 and dealt with during the Asia Pacific Economic Cooperation summit, which was held the same month in Yokohama, Japan. At this summit, leaders agreed on the necessity to “enhance” NCD control.23
The United Nations high-level meeting
On 19–20 September 2011, 113 member states, including 35 heads of state and government, attended the UN High-level Meeting on Non-communicable Disease Prevention and Control in New York City.24 Participants discussed how to better address the burden of NCDs, which annually kill 9 million people under the age of 60 years. Following the meeting, WHO adopted the target of reducing premature mortality from NCDs by 25% between 2012 and 2025, and in May 2013, UN member states adopted an additional nine targets and 25 indicators during the 2013 World Health Assembly.25 Documenting progress on these indicators in an easy-to-read document, similar to the one used to monitor compliance with CARICOM’s commitments in relation to NCDs, can help to achieve the established targets. The accountability mechanisms developed for the CARICOM Summit show how and why this is so and suggest how compliance can be enhanced for this and other summits on NCDs and other health concerns.
CARICOM and PAHO, as the joint secretariat for the Caribbean Cooperation in Health Initiative, were responsible for monitoring and evaluating compliance with the commitments acquired under the declaration of Port of Spain.9 These activities were central to advancing the NCD agenda. Before they could recommend a global summit on NCDs, CARICOM leaders needed to demonstrate that their regional summit had made a difference in their countries.
In 2008, one of the authors of this paper (TAS) designed and implemented a one-page reporting grid that was endorsed by the CARICOM heads of government and ministers of health (Table 1). The grid, intended as a tool for monitoring CARICOM members’ compliance with the commitments acquired under the declaration of Port of Spain, presented succinct information to show where countries stood in terms of NCD-related plans and budgets and of activities and policies surrounding smoking, nutrition, physical activity, health promotion, NCD surveillance and the treatment of NCDs. The grid was revised in 2010; the original 21 indicators were expanded to 26 and colour coding was added (Table 2, available at: http://www.who.int/bulletin/volumes/92/4/13-126128). This was done in collaboration with Fitzroy Henry, director of the former Caribbean Food and Nutrition Institute, now part of the Caribbean Public Health Agency. Countries update the grid annually.4 This task is usually performed by NCD focal points and validated by the chief medical officers in the ministries of health of CARICOM countries. Through this self-reporting, governments note the progress made by their ministries and societies in complying with the Declaration’s 15 items, which translate into 27 commitments acquired under the CARICOM Summit. The updated grid is presented to CARICOM ministers of health every September and to the heads of CARICOM governments annually.
Table 1. Original grid for the reporting of countries’ compliance with the mandates of the declaration of Port of Spain, 2008
Table 2. Revised grid for the reporting of countries’ compliance with the 15 mandates of the declaration of Port of Spain, 2010
The ministers of health are given a detailed presentation on the status of compliance in their respective countries. In subsequent discussions, the ministers of the countries with the poorest performance are encouraged to improve and are offered assistance by other countries and agencies. Competition among countries over grid status is notable and leads to efforts to improve. For example, at the 2010 Caucus of Caribbean Community Ministers of Health, the health minister of Trinidad and Tobago reviewed the grid. When she noticed that her country had not conducted a STEPwise approach to surveillance (STEPS) NCD risk factor survey, she prioritized completion of this survey, which was published in 2012.
The grid has been used at regional NCD meetings in September 2010 and December 2011 to compare the progress made by countries, set priorities, and identify areas of poor performance. It has spurred a focus on areas of lower performance and has generated an awareness of the need for regional initiatives.
Some of the data from the grid are publicly available. The grid itself was published in a newspaper supplement on 25 September 2011, soon after the UN high-level meeting.26 Surveillance reports and legislation, such as the STEPS reports on NCDs, are made public. Caribbean Wellness Day celebrations are covered widely in the regional media. Data on tobacco control are publicly available through the Framework Convention on Tobacco Control (FCTC) website. Information on other NCD-related commitments is covered in internal health ministry documents and is not publicly available.
The grid has limitations. It is not used to monitor regional actions, as required under the declaration of Port of Spain, partly because it is not suitable for monitoring the unique inputs from each of the regional entities. In addition, the data are self-reported by the people responsible for the NCD programme area, so respondent bias cannot be ruled out. Some indicators are not precisely defined and are open to interpretation. For example, in the health promotion indicator “…≥ 50% of public and private institutions with physical activity and healthy eating programmes”, “physical activity programme” is not defined and each country can choose its own definition.
The grid illustrates the importance of holding leaders accountable for acting on their commitments and of conducting independent expert assessments. Summits generate declarations that politically bind national leaders to commitments they make personally, publicly and collectively. Independent analysis of compliance with these commitments reveals how well and under what conditions countries comply with them. It also makes it possible to see how compliance by CARICOM member countries has varied over time in different areas and what factors are associated with high and low compliance.4,27
Compliance assessment results
The Healthy Caribbean Coalition’s assessment
In March 2010, Trevor Hassell, chair of the Healthy Caribbean Coalition, summarized the contents of the grid to assess compliance with the commitments acquired during the CARICOM Summit (Table 2).28 He concluded that, almost three years after the Summit, compliance was modest and mixed. Barbados, Guyana, Jamaica and Trinidad and Tobago showed the highest compliance; Haiti, Montserrat and Turks and Caicos showed the lowest.
The G8 Research Group’s assessment
In 2011, two of the authors (JK, JG) assessed compliance with CARICOM Summit commitments using a standard method developed by the G8 Research Group,27 which is the world’s leading independent source of information, analysis and research on Group of Eight institutions, activities and members. The method built on the compliance methods first developed by Von Furstenberg & Daniels in 199229 and expanded on those developed by Kokotsis in 1999.10 Full compliance with a commitment is assigned a score of +1; a score of −1 indicates a failure to comply with a commitment or that a country did the opposite of what was promised; an “inability to commit” or a “work in progress” is scored at 0.
The assessment revealed 27 concrete, discrete commitments emanating from the 15-point declaration of Port of Spain. Application to the 2009 reporting grid showed an overall average compliance score of merely +0.23, equivalent to 61.5%. The average score for the 15 full members of CARICOM was slightly higher, at +0.27 (63.5%). The average score for the five associate members of CARICOM was +0.08 (54%). When applied to the more up-to-date grid results generated for 2011 at the University of the West Indies, which included additional indicators, compliance remained mixed and the average score was +0.06 (53%). The countries with the highest implementation scores were, in order, Barbados (+0.64 or 82%), Trinidad and Tobago (+0.44 or 72%), Bermuda (+0.43 or 71.5%) and Dominica (+0.38 or 69%). The countries with scores below average were Saint Vincent and the Grenadines (−0.45 or 27.5%), Anguilla (−0.61 or 19.5%) and Haiti (−0.83 or 8.5%).
The low average score observed was largely due to the inclusion of indicators for compliance with commitments relating to food and nutrition policy. “Upstream” actions that create healthy food environments are likely to have greater impact than promoting behaviour change around diet and physical activity. Such actions are addressed by items 7, 8 and 9 of the declaration of Port of Spain and include a food supply free of trans-fats, trade agreements conducive to meeting national health goals, and mandatory labelling of packaged foods for nutrition content.9 These public and private sector policies and actions were monitored on the grid and received the worst compliance scores across all countries.27
Factors influencing compliance
Assessing the factors that influence compliance, the ways in which governments comply with their summit commitments and the effects of accountability assessment is a complex and challenging task. Many factors – some well beyond the control of governments or their leaders – can undermine compliance.30 Sudden events unrelated to NCDs can distract a country. For example, the 2010 earthquake in Haiti diverted the country’s attention towards the immediate crisis. This weakened governance in the country and pushed NCDs down on the list of priorities. Even without the earthquake, however, compliance with Summit commitments would probably have been minimal. The global economic crisis that started in 2008 has aggravated matters. At the regional level, the recent creation of the Caribbean Public Health Agency as an international institution may have drawn potential financial support away from NCDs.
However, in the case of the CARICOM Summit, some key factors stand out. Countries with a higher gross national income (GNI), a higher gross domestic product (GDP) and a larger population – these are the standard measures of overall national capability – are more likely to follow through on their commitments than those with lower GNIs and GDPs or smaller populations. Commitments supported regionally, such as Caribbean Wellness Day, or internationally, such as commitments related to the FCTC, are also more likely to be fulfilled.4
More generally, there is mounting evidence, especially from G8 summits, that leaders in attendance can use the power of the chair to craft their commitments in ways that improve compliance. They can, for example, add accountability mechanisms.30–32 Independent assessments conducted by experts for G8 and G20 summits have been reported by the media, discussed by leaders’ representatives at preparatory meetings, and publicly referred to and discussed by leaders at the summits.
In summary, the CARICOM Summit was successful in several ways. It was the first summit of heads of government to focus on the problem of NCDs and it resulted in multiple collective, multilateral commitments for implementation of policies and actions pertaining to NCD control. Although there is room for improvement, countries fulfilled some important commitments acquired at the Summit. The CARICOM Summit sparked interest in a global summit on NCDs and resulted in the UN high-level meeting on NCDs. An accountability mechanism based on annual reporting is critical for monitoring progress and highlighting areas in need of correction.
- Caribbean Community Secretariat [Internet]. Caribbean Community Secretariat: members and associate members. Georgetown: Caribbean Community; 2013. Available from: http://www.caricom.org/jsp/community/member_states.jsp?menu=community [accessed 26 November 2013].
- Health situation in the Americas: basic indicators 2012. Washington (DC): Pan American Health Organization; 2012. Available from: http://www.paho.org/hq/index.php?option=com_content&view=article&id=7170&Itemid=2395 [accessed 23 January 2014].
- Caribbean Community Secretariat [Internet]. Caribbean Cooperation in Health Phase III (CCH III): regional health framework 2010-2015. Georgetown: Caribbean Community; 2013. Available from: http://www.caricom.org/jsp/community_organs/health/health_main_page.jsp [accessed 22 January 2013].
- Hospedales CJ, Samuels TA, Cummings R, Gollop G, Greene E. Raising the priority of chronic noncommunicable diseases in the Caribbean. Rev Panam Salud Publica 2011; 30: 393-400 pmid: 22124699.
- Caribbean Community Secretariat [Internet]. Strategic Plan of Action for the Prevention and Conrol [sic.] of Non-communicable diseases for countries of the Caribbean Community 2011-2015. Washington & Georgetown: Pan American Health Organization & CARICOM Secretariat; 2011. Available from: http://www.healthycaribbean.org/publications/strategic-plan-of-action.html [accessed 24 January 2014].
- Caribbean Community Secretariat [Internet]. Communiqué issued at the conclusion of the twenty-seventh meeting of the conference of heads of government of the Caribbean Community (CARICOM). Georgetown: Caribbean Community; 2006.
- Caribbean Community Secretariat [Internet]. CARICOM priority necessary to lowering non-communicable diseases. Georgetown: Caribbean Community; 2006.
- Caribbean Community Secretariat [Internet]. Communiqué issued at the conclusion of the eighteenth intercessional meeting of the Conference of Heads of Government of the Caribbean Community (CARICOM) 12-14 February 2007, Kingstown, St. Vincent and the Grenadines. Georgetown: Caribbean Community; 2007.
- Caribbean Community Secretariat [Internet]. Communiqué issued at the conclusion of the Regional Summit of Heads of Government of the Caribbean Community on chronic non-communicable diseases (NCDs), 15 September 2007, Port-of-Spain, Trinidad and Tobago. Georgetown: Caribbean Community; 2007.
- Kokotsis E. Keeping international commitments: compliance, credibility and the G7, 1988–1995. New York: Garland Publishing; 1999.
- Caribbean Community Secretariat [Internet]. Declaration of St. Ann: implementing agriculture and food policies to prevent obesity and non-communicable diseases (NCDs) in the Caribbean Community. Georgetown: Caribbean Community; 2007.
- Caribbean Community Secretariat [Internet]. Communiqué issued at the conclusion of the seventeenth special meeting of the Council for Human and Social Development (COHSOD) – SPORT. Georgetown: Caribbean Community; 2008.
- Samuels TA, Fraser H. Caribbean Wellness Day: mobilizing a region for chronic noncommunicable disease prevention and control. Rev Panam Salud Publica 2010; 28: 472-9 http://dx.doi.org/10.1590/S1020-49892010001200009 pmid: 21308174.
- Caribbean Community Secretariat [Internet]. Communiqué issued at the conclusion of the thirtieth regular meeting of the conference of heads of government of the Caribbean Community, 2-5 July 2009, Georgetown, Guyana. Georgetown: Caribbean Community; 2009.
- Ramsammy L. Address to the Sixty-First World Health Assembly, 19 May 2008. Geneva: World Health Organization; 2008.
- Declaration of commitment of Port of Spain: securing our citizens’ future by promoting human prosperity, energy security and environmental sustainability. Port of Spain: Summit of the Americas; 2009. Available from: http://www.oas.org/psf/docs/Declaration_VSummit.htm [accessed 24 January 2014].
- The Commonwealth [Internet]. Commonwealth Heads of Government Meeting Secretariat (CHOGM) communiqué. Port of Spain: Commonwealth Heads of Government; 2009.
- The NCD Alliance [Internet]. UN votes yes for NCD Summit. 2010. Available from: http://www.ncdalliance.org/node/80 [accessed 26 November 2013].
- Keeping the promise: united to achieve the Millennium Development Goals. New York: United Nations General Assembly; 2010. Available from: http://www.mofa.go.jp/region/latin/caricom/mc_1009/ps.html [accessed 24 January 2014].
- Ministry of Foreign Affairs of Japan [Internet]. Partnership for Peace, Development and Prosperity between Japan and the Member States of the Caribbean Community (CARICOM). Tokyo: MFA; 2010. Available from: http://www.mofa.go.jp/region/latin/caricom/mc_1009/ps.html [accessed 24 January 2014].
- Caribbean Community Secretariat [Internet]. Communiqué issued at the conclusion of the thirty-first regular meeting of the conference of heads of government of the Caribbean Community (CARICOM). Georgetown: Caribbean Community; 2010.
- Guebert J, Lennox R. Health at the G20: a small but significant step in Seoul. Health Diplomacy Monit 2011; 1: 9-10.
- Asia-Pacific Economic Cooperation [Internet]. 2010 leaders’ declaration: Yokohama declaration – The Yokohama vision – Bogor and beyond. Yokohama: APEC; 2010.
- World Health Organization [Internet]. United Nations high-level meeting on noncommunicable disease prevention and control. Geneva: WHO; 2013. Available from: http://www.who.int/nmh/events/un_ncd_summit2011/en/ [accessed 24 January 2014].
- World Health Organization [Internet]. Sixty-sixth World Health Assembly. Geneva: WHO; 2013.
- Caribbean Community Secretariat [Internet]. Declaration of Port of Spain: uniting to stop the epidemic of chronic NCDs. Georgetown: Caribbean Community; 2011.
- Kirton J, Guebert J, Samuels TA. Controlling NCDs through summitry: the CARICOM case. Toronto: University of Toronto; 2011.
- Hassell T. Caribbean chronic disease initiatives post summit of Port of Spain. In: 16th Annual International Diabetes Conference, University Diabetes Outreach programme, Ocho Rios, Jamaica, March 25-28, 2010. St Michael: Healthy Caribbean Coalition; 2010. Available from: http://www.healthycaribbean.org/presentations/deadly-duo/Caribbean-Chronic-Disease-initiatives-post-Summit-of-7-march27-2010.pdf [accessed 24 January 2014].
- von Furstenberg GM, Daniels JP. Economic summit declarations, 1975-1989: examining the written record of international cooperation [Princeton Studies in International Finance No. 72]. Princeton: Princeton University Press; 1992.
- Kirton JJ, Guebert J. North American health governance: shocks, summitry, and societal support. Rev Norteamericana 2010; 5: 221-44.
- Kirton JJ, Roudev N, Sunderland L. Making G8 leaders deliver: an analysis of compliance and health commitments, 1996–2006. Bull World Health Organ 2007; 85: 192-9 http://dx.doi.org/10.2471/BLT.06.039917 pmid: 17486210.
- Kirton JJ. Explaining compliance with G8 finance commitments: agency, institutionalization and structure. Open Econ Rev 2006; 17: 459-75 http://dx.doi.org/10.1007/s11079-006-0359-5.