Chapter 8 Publication/presentation requirement
Regulation 4.10
Candidates must complete the publication/presentation component of advanced training to be eligible to sit the fellowship examination. Although a minority of trainees ruled eligible to sit the fellowship examination prior to 2004 may complete this component after sitting the fellowship examination, the component must be satisfied within three years of passing the exam or the pass will become null and void and a resit will be required. For this reason, it is preferable to finalise this component of your training prior to embarking on your study program for the fellowship exam. Otherwise, it can distract from your study progress.
Research presented for this component must be relevant to emergency medicine. As such, trainees who have completed projects prior to entering the training program may be granted an exemption if their previous work meets the requirements of the College. However, this is uncommon.
It is of utmost importance that you carefully study the requirements of regulation 4.10 regarding authorship, content and procedural matters as set out in the College website.
Regulation 4.10 serves a number of purposes. Most FACEMs are involved in research during their careers, whether as investigators or recruiting patients for studies being run by others. This component is designed to give trainees insight into or ‘a taste of’ how research works. Even for those who are not involved in research later in their careers, it is imperative to be aware of study design and the concepts of evidencebased medicine in order to critically appraise the research of others. Being directly involved in a research project provides valuable insight into the particular challenges of conducting quality research. This is a two-way process, making you more sensitive to the importance of ensuring good study design and also more astute in detecting methodological flaws. Finally, of course, the research thus performed aims to boost the collective knowledge of issues related to emergency medicine and ultimately to improve patient care.
Research undertaken for the 4.10 may be presented in a number of ways:
Regardless of the mode in which the 4.10 is completed, the path is the same. Therefore, this is not an essential decision in the initial stages. It is more fruitful to concentrate first on what you will do and how you will achieve this than whether you will be submitting for publication or applying for an oral or poster presentation. However, eventually you will need to choose which format best suits the topic and your personal preferences.
Publication in a refereed journal carries with it the challenges of going through the manuscript acceptance process. Your article will undergo peer review by a number of persons specifically selected for that purpose (usually experts in that particular field). This level of scrutiny can be disheartening depending on how well you handle critique (rarely is a submission accepted without revision), but it is also highly productive as you receive expert sug gestions on improving your article. The process can take a considerable period of time depending on the publisher selected, although most have developed rapid turnaround systems.
Your article does not actually have to be published for your 4.10 to be considered satisfied for the purpose of being eligible to sit the fellowship exam. Evidence of acceptance for publication is sufficient, leaving you free to concentrate on preparing for the exam itself while you wait to see your name immortalised in print.
The strength of choosing publication is that you will have this forever on your CV. Should you choose to continue to publish, the lessons you learn from this experience will be invaluable. Subsequent projects will become progressively easier.
The most popular form chosen is for oral presentation at a recognised meeting — usually a national, state or regional emergency medicine meeting. This popularity probably arises from familiarity, as this is the most common form of presentation at meetings in general and is similar to the way the majority of teaching sessions are run.
However, even though an oral presentation does not require submission to a publisher, you do need to submit your project details to the College for consideration. When assessing your project, the College follows the same basic procedure as the publishing review process.
The oral presentation tests your capacity to speak in a public forum, keep to time and handle questions asked by FACEM adjudicators. Many of these questions will be the same as those posed by the publishing review process, but time constraints will mean the depth of questioning and time for your response will be much less than via the publishing process.
If you are comfortable with public speaking and have prepared and know your project well, you will find an oral presentation far less stressful. The particular advantage is that the decision to accept/reject your proposal will be made in a known time frame without the uncertainty associated with publication time lines.
Poster presentations are often overlooked as a format, although they have become increasingly popular in recent years and we encourage you to consider this option. Preparation is essentially identical to that for an oral presentation, including material that must be submitted to the College. However, there is a greater capacity to accommodate poster presentations than oral presentations from the point of view of meeting organisers and so a submission to present a poster (or tick the box that says ‘either’) is more likely to be accepted than a request only to present orally.
Posters do not have to be large, glossy and expensive. Although most posters are professionally printed, it is perfectly acceptable to print out A4 or A3 sheets of paper and arrange them on the posterboard using the standard headings. If you do elect to have your poster printed professionally, allow sufficient time so that proofs can be read and corrected if necessary.
The poster itself will do some of the ‘talking’ for you, becoming a focal point of discussion. Posters are generally put on display for a period of time prior to the presentation session, providing you with the opportunity to get feedback from those browsing by. Explaining your project and discussing issues with strangers in an informal manner is a reasonably low-stress way of finetuning your presentation prior to the session with the adjudicators. Your time with the adjudicators will be split between you explaining your project and them questioning you on details about it. More information can be found on the College website.
A poster also gives you something to take away once you have been successful. The poster can adorn your office or take pride of place in the department for many years to come.
If the research bug is part of your make-up, you may wish to commence more formal study from the outset and have the 4.10 project become part of a wider research endeavour. This will require a nominated supervisor and considerable time in planning the way forward. If this is for you, you are strongly encouraged to meet your local or regional research group, who will be invaluable in assisting you with the 4.10 project and your wider research endeavours.
There is no ideal time to do the project; it depends on your professional and personal commitments. We recommend embarking on the 4.10 after being energised from your success at the primary examination and getting what most trainees perceive as an obstacle out of the way after a suitable period of rest and relaxation.
Whether you elect for publication or presentation, the whole project needs to be planned well ahead of time. The College has nominated 4.10 mentors in every region whose names are readily available. These people all have significant experience in research and have supervised many 4.10 projects. Make contact with these individuals as early as possible. They will be invaluable in all aspects of planning and conducting your study.
In addition, time spent carefully considering all of the following before you begin is essential.
Decide from the outset whether you work better by yourself or with one or more colleagues. If there are a number of you at the same stage of training, you may wish to work collaboratively on several projects, with one of you acting as lead investigator (and author) for each project. Sharing the workload and addressing the issues that arise as a group can be helpful. If you do work with others, however, choose very carefully: you want to work with people who are experienced and compatible and who will pull their weight.
Probably the hardest decision you will have to make is what your research topic will be. Sometimes a rush of enthusiasm based on the fortuitous discovery of an interesting research question or dilemma triggers your thinking. However, most trainees need time to select their topic.
Coming up with a great idea will be less of a stumbling block if you have an enquiring bent towards clinical medicine. Why do we choose a particular investigation or way of managing a patient? Is there a better way of doing a procedure? Can we better predict which patients will present or benefit most? These are questions that need to be posed frequently for you to become a more informed evidence-based clinician. Constant enquiry helps in ‘currency’ of knowledge and, in this instance, allows you to formulate worthwhile research questions of clinical relevance and importance to emergency medicine practice.
A research question that captures and maintains your enthusiasm and interest is the start to the 4.10 ‘journey’. This may occur from acute personal observation in your clinical life, attendance at critical appraisal forums, reading the medical literature widely or talking to your peers or consultants about their research interests.
Being forced to think up a project as a deadline looms may be counterproductive if you have not been involved in research previously. This strategic phase of looking out for, formulating and then designing a feasible and useful study may take some time. A ‘shopping’ type approach in looking around to buy the most attractive product is recommended, rather than thoughtlessly committing to the first project offered to you for which you do not feel a deep attachment.
When deciding on a topic, there are three things to bear in mind:
Once you have selected a topic, conduct a literature review to ensure that the answer to your question is not already available. A well-conducted literature review (see Chapter 9) may also provide other research ideas, suggest ways of streamlining your project and give valuable insight into the particular design that will best suit the topic. Because of the time frame involved from start to finish, you should repeat the literature review prior to final presentation, in order to ensure that other relevant information has not come to light during this interval.
Chapter 9 will provide useful suggestions on different types of study designs. It is unlikely that your first research project will be a multi-centre, randomised controlled trial assessing a major health issue. You will need to develop a balance between higher levels of evidence, which require higher levels of expertise and time, and lower levels of evidence where simpler designs are appropriate.
As a general guide, studies that enrol patients for intervention or observation prospectively are viewed more favourably. However, they can be the most difficult to implement successfully, as proposals must be approved first by ethics committees, medications or interventions may need to be specially prepared in order to ensure adequate blinding and projects that involve follow-up will always involve a percentage of subjects that will be ‘lost’.
Non-randomised studies are definitely inferior for assessing the effect of a medical intervention. Prospective observational studies are useful to detect adverse effects of treatment or to follow the natural history of a disease. On the good news side, nonintervention and non-prospective studies are an appropriate and valid trial design for most other purposes. Although such designs are often mistakenly adjudged to be inferior to the randomised controlled trial, non-randomised designs using easily collected or existing data such as that from cross-sectional surveys, clinical notes, ED patient clinical databases (EDIS, for example), registry information (major trauma registries), mission reports (aero medical service providers) and procedural databases are a valid, and often the only, way to answer non-intervention questions.
For instance, trauma epidemiology is best examined using trauma registries. Casecontrol studies are used to determine the role of detrimental lifestyle factors such as smoking in disease causation. Case series may offer speculative evidence of new side effects of a treatment. Observational series can assess the effects of interventions that it would be unethical to deny to a treatment arm in a randomised trial (e.g. evacuation of an EDH). The critical element in study design is that the study type chosen is valid for, and best suited to, the research question.
The design and conduct of a study is similar to critically appraising a research paper, but done in reverse (for more detail, see Chapter 9). A study needs to be methodologically internally valid before even considering its generalisabilty or applicability. Time taken in meticulous study design is well worth it, as mistakes in design are not easily rectified during the study and may invalidate the study results.
Write your study hypothesis and methods before you commence the study. Ensure that the aim of the study is clear and will be addressed by the methods chosen. The typical headings to consider when writing the protocol for your randomised interventional study are provided in Table 8.1. These can also be applied to other study types, although some sections (e.g. interventions) may not be required or be appropriate. These items also form the basis of submissions to ethics and regulatory bodies. Time spent considering each of these items and how they apply to your project will make such submissions and your subsequent project write-up much easier.
TABLE 8.1 A template for a randomised controlled trial protocol
Source: adapted from www.practihc.org/toolindex.htm.
A well-constructed project is virtually ‘written’ before the data are collected. Only the discussion then needs to be written once the results are collated.
Issues regarding sample size, comparison between groups and specific method(s) to analyse difference will vary depending on the topic chosen and study methodology. Some of these issues are addressed in more detail in Chapter 9. Expert statistical advice is required early in your project to ensure that each method chosen is appropriate and your project is achievable.
When you have found a research question that is appealing, you need to determine whether it can be answered within your time, resource and expertise limitations.
The first step is to determine the true incidence of the condition or study group you have chosen. Although one or two examples of a particular condition may have prompted your interest in a topic, the true incidence may be substantially lower in everyday practice. You are strongly encouraged to use available databases (such as EDIS or registry data) to further determine the frequency of presentations. This result can then be matched to the power calculations the statistician has helped you determine and a likely time frame for data collection can be estimated.
Be aware that estimates of likely subject numbers are generally well in excess of actual suitable subjects. As a rough guide, we suggest you assume that no more than one in four eligible ‘patients’ or subjects will actually be recruited successfully. For most studies, including those where data are collected from medical records, we suggest you undertake a ‘pilot’ study before commencing the main study. This will help clarify whether your assumptions have been correct regarding numbers, as well as provide insight as to the feasibility of collecting the data you require. A well-conducted pilot study may enable you to make small changes that will greatly improve the efficiency of your overall project.
Studies involving patients require approval or waiver from the local ethics committee. Projects that do not involve changes to patient care (such as analysing the outcomes from a newly introduced medication) will probably be waived by the ethics committee if conducted as a quality assurance project. However, the same standards of data integrity and confidentiality will still apply.
Where patient treatment changes are involved, patient consent will almost certainly be required. Having a project that is intended to improve the outcome for all patients will prove more successful for gaining ethics committee approval and patient recruitment.
Undertaking a pilot study is also an excellent way to iron out any ‘bugs’ in your data collection form or methodology, and we strongly recommend that you carry out such a study before continuing with the main body of your project.
Data can be collected by you (and your colleagues, if working as a group) or by others. If the study is designed to be blinded and an observer is required, you may have to enlist assistance to prevent invalidating data collection. If data collection involves colleagues recruiting subjects and/or completing forms, your persuasive powers will be put to the test. Keeping them ‘sweet’ by providing constant positive feedback is essential to maintaining enthusiasm and ensuring that your project does not flag. We have also found that chocolate is an excellent currency! Detailed education sessions with each new resident rotation, visits to the recruiting sites, reward systems for good patient recruitment and other measures to keep recruiting staff enthusiastic are crucial for the study to meet its due schedule. The data acquisition period in a prospective or intervention study often takes a relatively long time, so it is important to think about strictures or hindrances to participant recruitment. Be inventive to keep recruitment going.
It is also important to enter the data collected as they become available in a wellorganised and secure de-identified database. The construction of dummy tables to trial data entry and pre-study consultation with a clinical trials methodologist or statistician are crucial to ensuring that only data relevant to the study objectives are collected. Study analysis plans should be carefully formulated in conjunction with a statistician and pre-specified in detail during the write-up of the study protocol. This ensures that appropriate outcome data are obtained and then analysed reliably. When the study is closed, with no further data entry permitted, it is crucial that you consult with a statistician to make the correct unadjusted and adjusted interpretations of the data.
The writing-up phase for submission to a journal or presentation at a conference is often the most enjoyable phase, as you are in sole control and are not dependent on the enthusiasm and generosity of others.
The write-up is based on a generic IMRaD formula:
The introduction and methods sections are substantially based on the same sections in the study protocol, with the results and discussion sections requiring substantial new work. The discussion section needs to be written in the context of the study findings. This will require a balanced approach and involves presenting literature both supporting and refuting your study findings. As mentioned earlier, we recommend that you repeat your original literature search at the conclusion of your study to ensure that you are aware of any recent publications of relevance. Clinical relevance and generalisabilty also need to be covered in the discussion section, and in addition, we recommend that you include a section acknowledging limitations and further research prior to your structured conclusion/summary. If you have received significant assistance from others, they should also be acknowledged.
A feature of the publication pathway is that you do not have to present in person ‘on the day’. However, before submitting your paper, you should show it to colleagues with research experience to ensure that your presentation is the best it can be on its first submission.
Do not expect your paper to be approved on first submission: most papers require some revision after the peer-review process. The reviewers will provide con structive critique that will help improve your paper. Do not take these comments personally. Consider each point in turn and ensure that all are adequately addressed before resubmitting the paper. If all issues are dealt with appropriately, it is highly likely you will succeed.
The marking scheme for published papers is detailed on the College website.
Conferences must be approved in advance by ACEM and adjudication is provided by FACEMs approved by the College. The same principles of preparation apply as for the clinical components of the examination. Your oral presentation or poster session should be well rehearsed in front of peers. These practice presentations are a good opportunity to find out which questions are ‘naturally’ generated by your project. It may not be necessary to change your presentation to include an answer to a question if the point is not crucial. In fact, having been asked a question beforehand about a particular issue or detail and having had time to consider your response may be to your advantage on the day!
Ensure that you arrive well ahead of time, including travel considerations if required, and are familiar with the venue and audiovisual arrangements. Your electronic presentation or poster will be required by the conference management ahead of time. Check carefully that everything ‘works’.
The timing for your presentation will be strictly regulated. You should be well practised to finish with time for questions afterwards. If you run overtime, you will be stopped. Questions may come from the audience in general or, more likely, be dominated by those from the adjudicators. The adjudicators will be particularly interested in your study design, statistical methods, confounders and so on, as their focus is on the process of the project more than simply the results, whereas the general audience is often focused only on the clinical implications. Remember, it is the adjudicators, not general audience, who mark you, so keep this in mind when briefing/choosing your ‘test’ audiences.
Regardless of your mode of delivery, three adjudicators will mark you. Adjudicators are preselected to ensure that they do not have a conflict of interest with your project. One acts as the designated lead adjudicator, and each marks you independently against specified criteria detailed on the College website. At the end of the session, they meet. If all three mark you as a pass, or if two (including the lead) mark you as a pass, you will be notified on the day that you are successful. However, you may still pass if you do not fulfil these requirements, as all papers are referred to the Board of Censors for a final decision.
Once you have completed regulation 4.10, your future publishing and presenting activities will become exponentially easier.