Original Article | Volume 8 - Issue 1 | Article DOI :
Download PDF
Amie M Cox¹*, Rachel Scrivin¹, Fiona Pelly¹, Carl Langan-Evans², David Jenkins¹,⁴, Reid J Reale³, and Gary J Slater¹
¹School of Health and Sports Sciences, University of the Sunshine Coast, Australia
²School of Sport and Exercise Sciences, Liverpool John Moores University, United Kingdom
³UFC Performance Institute, Shanghai, China
?Applied Sports Science Technology and Medicine Research Centre, Swansea University, Australia
Corresponding Author:
Amie M Cox, School of Health and Sports Sciences, University of the Sunshine Coast, Sunshine Coast, Queensland, Australia
Keywords
Body Mass Management; Olympic Weightlifters; Athletes
Abstract
This study aimed to adapt and validate a pre-existing weight loss questionnaire specific for Olympic weightlifting (OWL) athletes, given their pre-competition body mass (BM) management practices are unknown. A structured four-phase validity process was employed, focusing on content, face validity, and internal reliability. The Delphi technique was applied utilising experts (n = 7) over three anonymous rounds to achieve consensus. Questions were reviewed to determine whether to keep, modify, or delete, then rate the relevance of each (content validity index (CVI)). Online interviews were conducted with a pilot group of OWL athletes (n = 6) to assess readability and item difficulty. A test-retest process was undertaken with a second pilot group (n = 9) to verify questionnaire reliability using Pearson’s correlation. All items in the first round achieved consensus with an item-CVI of 0.93, scale-CVI average of 0.98, and no items were recommended for deletion. The average difficulty rating was 4.8/5. Internal reliability was high for weight history (r = 0.93) and weight loss methods (r = 0.83), and moderate for influences (r = 0.65). The adapted questionnaire was shown to be a valid tool for content and face validity to assess the BM management practices of OWL athletes..
Citation
Cox AM, Scrivin R, Pelly F, Langan-Evans C, Jenkins D, et.al., (2023) Dietary, Lifestyle, and Medicinal Factors that Influence Nitric Oxide Production-A Review. SM J Nutr Metab 8: 7.
Introduction
Weight categories have been established in a number of sports to facilitate fairness and equity by limiting size and strength disparity between competitors [1-3]. Athletes in weight-category sports use both chronic and acute body mass (BM) management practices to compete in categories below their day-to-day training BM (i.e., making weight) [4 10]. This is to achieve a potential size or strength advantage over their opponents [11-14]. Due to increased participation rates in combat sports, there has been growing concern about the health and/or performance implications of these BM management practices [4-10,15]. However, little is known about the BM management practices of Olympic weightlifting (OWL) athletes, a sport included in the summer Olympic Games for the past 100 years.
Anonymous questionnaires have served as a primary research instrument in identifying the BM management practices of athletes in weight-category sports. A rapid weight loss questionnaire (RWLQ) designed and validated by Artioli et al., [4], for judo athletes, has subsequently been used to assess the BM management practices of athletes in other weight category sports [Table 1].
Table 1: Questionnaires identifying the body mass management practices used by weight-category athletes
|
Sport
|
Questionnaire was derived from
|
Calibre of athletea
|
Form of validation
|
Methods used at a specific
competition or in general practice
|
|
Wrestling(41)
|
IS
|
Tier 2
|
Test-retest reliability
|
General Practices
|
|
Wrestling (51) IS
|
Tier 2
|
Nil
|
General Practices
|
|
Jockey (17)
|
IS
|
Tier 2, 3, 4
|
Nil
|
General Practices
|
|
Rowing (48)
|
IS
|
Tier 2, 3
|
Informal readability – a pilot
study
|
Specific Competition
|
|
Judo (4)
|
Artiolib
|
Tier 1, 2, 3, 4
|
Content, discriminant test-retest
reliability
|
Specific Competition
|
|
Judo(43)
|
Artioli
|
Tier 2,3,4
|
Content, discriminant, test-
retest reliability
|
General Practices
|
|
Judo (13)
|
IS
|
Tier 4, 5
|
Nil
|
General Practices
|
|
MMA (1)
|
IS
|
Unsure
|
Nil
|
General Practices
|
|
Taekwondo (8) Artioli
|
Tier 3
|
Nil
|
General Practices
|
|
MMA (19)
|
Artioli
|
Tier 3
|
Nil
|
Specified competition
|
|
MMA (42)
|
Artioli
|
Tier 3,4,5
|
Content; test-retest reliability
|
General Practices
|
|
MMA (5)
|
IS
|
Tier 3
|
Nil
|
General Practices
|
|
Judo (6)
|
Artioli
|
Tier 2
|
Nil
|
General Practices
|
|
MMA (44)
|
Artioli
|
Tier 3, 4
|
Informal readability – pilot
study
|
General Practices
|
|
MMA (7)
|
Artioli
|
Tier 4:
|
Nil
|
General Practices
|
|
MMA (10)
|
IS
|
Tier 2, 3, 4
|
Informal readability – pilot
study
|
General Practices
|
|
Powerlifting (20)
|
Artioli
|
Tier 2,3,4
|
Nil
|
General Practices
|
However, many have failed to validate the instrument for their population [1,5-8,16-20]. Failing to validate a questionnaire prior to administration, draws into question the sensitivity and reliability of the data captured [21,22]. Even minor alterations to a questionnaire can influence user response, confirming validation should be undertaken, even with the slightest of adjustments [23].
A valid questionnaire should possess attributes of clarity, relevance, reliability, and the ability to precisely capture the intended construct [21,23,24]. A critically appraised content validation ensures that each item (question) is not only easily understood, but also holds relevance to the subject in focus [21,24]. The Delphi technique has been particularly encouraged in healthcare settings as an important means of facilitating content validity [25]. This technique plays a significant role in determining the relevance of the items, guiding decisions on their inclusion or exclusion, and ensuring the clarity of each item [25]. Despite its clear application, the Delphi technique remains underutilised in the validation of BM management questionnaires.
The aim of this study was to adapt a previously validated BM management questionnaire [26], and undertake content and face validity of the modified tool by following recommended methodologies [21,22,27], for an OWL population. It was hypothesised the questionnaire could achieve adequate content and face validity and reliability testing to enable the delivery of a tool for future research, addressing the BM management practices of OWL athletes prior to competition.
Methods
To adapt and validate the RWLQ, a mixed methods approach was undertaken over four phases. Participants in phases 2, 3 and 4 were provided with specific research participation information sheets and signed an online written consent form.
The four phases involved [Figure 1]

Figure 1: Methodological framework outlining the development and validation process of adapting and validating a rapid weight loss questionnaire (RWLQ). aReview of previous athlete questionnaires (Table 1). bArtioli et al(4) RWLQ.
cResearch team: Amie Cox, Gary Slater, Rachel Scrivin, Fiona Pelly, David Jenkins, Reid Reale, Carl Langan-Evans. dAccredited, Advanced Sports Dietitians and Fellow with Sports Dietitians Australia. ePilot group 1, Olympic weightlifting (OWL) athletes from Cougars Weightlifting Club (Brisbane Australia). fPilot group 2, OWL athletes from the researchers known contacts.
Phase 1: Initial item (question) adaption from a previously validated questionnaire
Phase 2: Content validity (subject matter experts (SMEs), including the Delphi technique)
Phase 3: Face validity (OWL athletes)
Phase 4: Reliability processes (OWL athletes, test-retest)
Phase 1
Phase 1 of the study was to adapt a previously validated RWLQ, initially designed for judo athletes [26], for an OWL population. The questionnaire was adapted by the primary researcher and formally reviewed twice by the research team, which consisted of four experienced sports dietitians and two experienced sports scientists.
The majority of items were kept, answers were adapted for a more appropriate online presence and the item language was modified for an OWL population. Time frames increased from one year to two years due to COVID-19 and the lack of competitions athletes were able to compete in. Two questions were removed including, ‘at what age did you begin to cut weight for competitions’ and ‘how much did you weigh in the last off season?’ Athlete calibre was changed to identify the highest total the OWL athlete had ever lifted within their normal body weight category rather than by identifying their medal tally from competitions.
A question was added, asking athletes to identify the reasons behind why they competed in a different weight category. Additional options were included for sources/people of influence which included journal articles, social media, and the internet. Water loading, hot baths, low carbohydrate diet, low fibre diet, low weight high calorie food options, low salt were all added to the weight loss methods section and the ‘how often’ scale was changed to time domains (e.g., <24 hours, last week, last 4 weeks etc).
Phase 2
Phase 2 of the questionnaire development included an expert content review using the Delphi technique. The Delphi technique is a process where items are reviewed anonymously in a series of rounds by SMEs until consensus is obtained, or until the items for review decrease [25]. An electronic questionnaire review template was created with Qualtrics Core XM survey software and this platform was used this throughout all validation phases (Qualtrics LLC, Provo, Utah).
Researchers determined that SMEs were Sports Dietitians with greater than five years of experience in supporting athletes competing in weight-category sports [25]. SMEs (n = 7) were contacted individually via email through the research teams sports dietitians’ contacts. Seven SMEs (Fellow, Accredited Sports Dietitians, and Advanced Accredited Sports Dietitians) volunteered to participate in the review process.
During the first review round, 17 content-related items (excluding yes, no, or skip logic questions) were presented. The SMEs (n = 7) were then tasked with rating each item’s relevance on a Likert scale from 1 to 4 (1 = Not relevant, 2 =Somewhat relevant, 3 = Quite relevant, 4 = Highly relevant). The content validity index (CVI) was calculated for each item to gauge item consensus, as well as the scale-CVI average (S-CVI/Ave). An individual item was deemed to have achieved unanimous agreement if its item-CVI (I-CVI) was greater than 0.78. For the overall content to be considered valid, the S-CVI/Ave needed to exceed 0.80 [21,28].
In addition to the rating, SMEs were also asked to determine whether each item should be kept, modified, or deleted, and to provide any additional comments, as advocated in previous questionnaire validation processes [29]. Agreement scores for keep, modify, or delete responses were calculated, and items that scored ≥70% to keep were reviewed in subsequent rounds.
After each Delphi round, a content review was conducted categorising feedback based on item content specifics, presentation style and language changes [25]. General feedback that did not result in changes was also documented. A member of the research team cross-verified these categories to ensure accuracy. After each round, an anonymous report was compiled for the SMEs to review, detailing group outcomes with corresponding researchers’ feedback.
Phase 3
Phase 3 included a face validity process undertaken with a pilot group of OWL athletes (Pilot group 1, PG1) (n = 6, four males and two females, mean age 29 ± 5.8 years) who were recruited through Cougars Weightlifting Club in Brisbane, Australia. Individual athletes and the main researcher conducted online interviews via Zoom (Zoom Video Communications Inc., San Jose, California) over a three day period to review the questionnaire for readability [30, 31]. Athletes reviewed each item on a 5-point Likert scale rating the item difficulty from 1 (very difficult to understand) to 5 (very easy to understand) and provided any comments on each question. At the completion of the questionnaire, athletes were required to respond to the questionnaire’s overall ease of use (feasibility). A content review was conducted on all comments to determine categories (content, language, general - clarification, other). Based on athlete feedback, the questionnaire was modified and confirmed by the research team for the final phase (Supplementary File 1: Body mass management questionnaire).
Phase 4
In phase 4, reliability testing was conducted using a test-retest procedure on a cohort of independent OWL athletes. The second pilot group (PG2), consisting of 9 participants (4 males and 5 females, with a mean age of 31 ± 8.5 years), was instructed to complete the questionnaire. Fourteen days later, the same group was asked to complete the questionnaire once more. The selected time frame was intentionally set to avoid any competitions, ensuring the standardisation of results.
Statistical Analysis
This research project was approved by the Human Research Ethics Committee (University of the Sunshine Coast, Australia); ethics approval number S221696. All data was analysed with IBM SPSS Statistics 26.0 (IBM Corporation, Armonk, New York). I-CVI scores were calculated by the total item score divided by the number of experts answering that item. S-CVI is the average of each items I-CVI score. Frequency statistics were used to describe categorical variables, and descriptive statistics were used to describe continuous variables. To determine internal consistency between test-retest scores, Cronbach alpha was measured (α >0.90 is considered excellent reliability; α = 0.80-0.89 is good reliability; α = 0.70-0.79 is acceptable). For internal reliability, Pearson’s correlation was measured (r >0.90 is a considered very high correlation; r = 0.70-0.90 is a high correlation r = 0.50-0.70 is a moderate correlation) [32], and P-values <0.05 were considered statistically significant.
Results
Phase 1
The questionnaire adapted by the primary researcher and research team consisted of 17 items with five areas of investigation. These include demographics, training and competition, weight history, source of influence, and weight loss methods.
Phase 2
From the initial email invitation to seven SMEs, all experts agreed to volunteer to participate in the content review process. In the first review round a 100% (n = 7) response rate was achieved, while in rounds two and three, responses were received from three SMEs. The first-round expert group (n = 7) had 18.6 ± 12.0 years of sports nutrition experience. All items in the first round obtained consensus with an I-CVI of 0.93 and a S-CVI average of 0.98 [Table 2].
Table 2: Item relevance (I-CVI) and keep, modify, or delete responses from subject matter experts (Delphi round 1) (n = 7)
|
Item
|
Item Type
|
1ᵃ
|
2ᵇ
|
3ᶜ
|
4ᵈ
|
Total = 3 + 4
|
I-CVIᵉ
|
Delete %
|
Modify %
|
Keep%
|
|
Item 1
|
Demographics
|
|
|
2
|
3
|
5
|
1
|
0
|
|
100.0%
|
|
Item 2ᶠ
|
Demographics
|
|
|
1
|
4
|
5
|
1
|
0
|
16.7%
|
83.3%
|
|
Item 3
|
Demographics
|
1
|
2
|
2
|
|
4
|
0.8
|
0
|
|
100
|
|
Item 4
|
Demographics
|
|
|
2
|
3
|
5
|
1
|
0
|
|
100
|
|
Item 5ᶠ
|
Training + Competition
|
|
|
3
|
2
|
5
|
1
|
0
|
16.7
|
83.3
|
|
Item 6
|
Training + Competition
|
|
|
3
|
2
|
5
|
1
|
0
|
|
100
|
|
Item 7
|
Training + Competition
|
|
|
2
|
2
|
4
|
1
|
0
|
|
100
|
|
Item 8ᶠ
|
Training + Competition
|
|
|
1
|
3
|
4
|
1
|
0
|
16.7
|
83.3
|
|
Item 9ᶠ
|
Weight History
|
1
|
3
|
1
|
|
4
|
0.8
|
0
|
16.7
|
83.3
|
|
Item 10
|
Weight History
|
|
|
1
|
2
|
3
|
1
|
0
|
|
100
|
|
Item 11ᶠ
|
Weight History
|
|
|
1
|
4
|
5
|
1
|
0
|
16.7
|
83.3
|
|
Item 12ᶠ
|
Weight History
|
|
|
|
|
|
|
|
|
|
|
Item 13
|
Weight History
|
|
|
|
4
|
4
|
1
|
0
|
|
100
|
|
Item 14
|
Weight History
|
|
|
1
|
4
|
5
|
1
|
0
|
|
100
|
|
Item 15
|
Weight History
|
|
|
|
5
|
5
|
1
|
0
|
|
100
|
|
Item 16
|
Influence
|
|
|
2
|
2
|
4
|
1
|
0
|
20
|
80
|
|
Item 17ᶠ
|
Weight loss Methods
|
|
|
1
|
4
|
5
|
1
|
0
|
16.7
|
83.3
|
|
Mean
|
|
1
|
1.8
|
2.9
|
4.5
|
|
0.98
|
0
|
17.2
|
92.5
|
|
SDᵇ
|
|
0
|
0.8
|
1.1
|
0.6
|
|
0.07
|
0
|
1.4
|
8.8
|
|
SEᶦ
|
|
0
|
0.2
|
0.3
|
0.2
|
|
0.02
|
0
|
0.6
|
2.2
|
|
Lower (95% CI)ʲ
|
|
1
|
1.3
|
2.3
|
4.2
|
|
0.9
|
0
|
15.8
|
87.8
|
|
Upper (95% CI)
|
|
1
|
2.2
|
3.5
|
4.6
|
|
1
|
0
|
18.7
|
97.2
|
The item agreement rating from the SMEs indicated that nine items were to be kept, seven items were suggested to be modified, there were no recommendations to delete any items, and one item was suggested to be added (i.e., Have you ever missed competing in an Olympic weightlifting competition as a result of not making weight?) [Table 3]. One question was missed due to an input error with Qualtrics. As a result, the item was removed from the round one review process and was sent to the SMEs in the second round to review.
Table 3: Content validity subject matter expert’s results generated over three rounds.
|
Item
|
Experts
|
Total Items Reviewed
|
Delete
|
Modify
|
Keep
|
Added
|
T o t a l comment
|
Content
|
Format
|
Language
|
Comments not requiring a
change
|
|
Round 1 (totals)
|
7
|
17
|
0
|
7
|
10
|
1
|
17
|
6
|
0
|
6
|
5
|
|
Returned i t e m s (n=8)
|
|
|
|
|
|
|
13
|
6
|
0
|
5
|
2
|
|
Round 2 (totals)
|
3
|
8
|
0
|
3
|
5
|
0
|
6
|
1
|
0
|
2
|
3
|
|
Returned i t e m s (n=3)
|
|
|
|
|
|
|
3
|
1
|
0
|
2
|
0
|
|
Round 3 (total)
|
3
|
3
|
0
|
0
|
3
|
0
|
0
|
0
|
0
|
0
|
0
|
In round one, the most frequent comments were related to content (n = 6, 35%) and language changes (n = 6, 35%). Eight items were returned to SMEs for review (seven original items and one additional item) and during round two, recommendations for a language change (n = 1, 33%) and comments surrounding item clarification (n = 2, 50%) were provided. Only three items were returned for a third and final round as they scored less than 70% in the second round. The most frequent comments provided by the experts were to “modify the item” (n = 6, 35%) or to “change the question/answer wording” (n = 6, 35%), which has been summarised in Table 4. All returned items had a total of 15 comments (average = 2.1comments per returned item). The adapted questionnaire contained five sections which included 18 questions prior to being subjected to face validity.
Table 4: Examples of summarised subject matter expert’s comments with identifying categories from round one, two and three
|
Item
|
Comment
|
Category
|
|
2
|
What (weight) range do you normally sit in / how much above your weight class do you tend to train at (either by percentage or kg)?
|
Language
|
|
2
|
What is your most recent weight? (If they don't regularly weigh themselves)
|
Language
|
|
5
|
Is this referring to when they became a professional weightlifter with the Olympics in sight?
|
General – Clarification
|
|
7
|
Follow on with a question identifying whether any competitions were missed due to making weight reasons.
|
Content
|
|
8
|
Which weight class have you competed in most in the past two years?
|
Language
|
|
9
|
Total what? Do you mean what is the heaviest you have been or what is the most weight you have lost?
|
Language
|
|
9
|
Do you mean the highest total weight lifted? The question could be clearer.
|
Language
|
|
11
|
Coming off injury could be a useful sub-category here.
|
Content
|
|
11
|
Lack of understanding of how to make a lighter-weight class.
|
Content
|
|
11
|
You have only included an option that suggests an increase in lean mass was the only reason to change the weight category. What about a decrease in body fat/lean mass?
|
Content
|
|
17
|
Would intermittent fasting be worth including also (in isolation or with the 'fasting' question)?
|
Content
|
|
17
|
Perhaps add an extra row for 'other' and allow space for comments.
|
Content
|
Phase 3
Six OWL athletes (PG1) were recruited for the face validity process. The average difficulty rating was 4.8 ± 0.2 out of 5 on the Likert scale (1 = Extremely difficult to answer to 5 = Extremely easy to answer), with an overall questionnaire difficulty rating of 4.8 ± 0.4 out of 5. The OWL athletes comments consisted of format changes (n = 9, 75%) and general comments not requiring change (n = 3, 25%) as identified in Table 5.Revisions to the layout were made by the research team for items 14 and 15. Item 14 was segregated into three items, asking the same question but more directly. To assist with interpretation, an example of how to answer item 15 was provided.
Table 5: Face validity: examples of the Olympic weightlifting athlete comments summarised into identifying category
|
Category
|
n
|
Comments from Athletes
|
|
Content Change
|
2
|
Add in increased cardio with increased exercise. Tracking calories.
|
|
Format Change
|
5
|
Move water loading to the top around the restriction of fluid.
Do I answer ‘other’?
How it reads, I didn’t realise I had to select each row.
|
|
Language Change
|
3
|
Is that in the last year or the last 12 months?
Specifically, is that apart from doing resistance training in other sports?
|
|
Comments not requiring a change
|
2
|
CrossFit training versus Olympic lifting? It’s a long question.
|
Phase 4
The average time between the test-retest rounds for PG2 was 14.1 ± 0.3 days. For the first test, athletes took an average 8.6 ± 3.2 minutes and the second was 6.2 ± 2 minutes. Internal consistency was identified as excellent using Cronbach’s alpha for demographics (α = 0.99), training and competition (α = 0.96), weight history (α = 0.97), and weight loss methods (α = 0.94). The internal consistency of the influences section was determined to be acceptable (α = 0.75). An intraclass correlation applied between test-retest rounds using Pearson’s correlation identified excellent agreement for demographics (r = 0.99, p = 0.01), training and competition (r = 0.96, p = 0.02) and weight history (r = 0.93, p = 0.02). There was good agreement for weight loss methods (r = 0.83, p = 0.10) and a moderate agreement for influences (r = 0.65, p = 0.20).
Discussion
The aim of this study was to adapt a previously validated BM management questionnaire and establish content and face validity, and reliability for use in an OWL population. Utilising current best practice guidance for content and face validity of a questionnaire [22], the results show the BM management questionnaire developed for an OWL population is valid. The final questionnaire was comprised of 20 items, (depending upon skip logic responses) presented over five sections including, demographics, training and competition, weight history, influences, and weight loss methods.
In the realm of sport-specific research, the necessity to adapt scales to accommodate the nuances of specific athletic populations is recognised. For an OWL demographic, utilising an adapted scale rather than Artioli’s et al. [4], questionnaire validated amongst judo athletes offer distinct advantages. OWL and judo have different competition regulations, including differences in weight categories, timeframe between weigh-in and competition, plus limits on weight restoration following weigh-in [33], training paradigms, and physiological demands [34]. Furthermore,the bespoke nature of the adapted scale enables the implementation of familiar sport specific terminology, likely making it more comprehensible for OWL athletes. This tailored approach also better discerns the distinct cultural and social influences within OWL, thereby enhancing the scale’s construct validity and reliability. Ultimately, an OWL-adapted questionnaire not only provides a more accurate representation of current weight management practices within the sport but also allows for a more coherent comparison with other weightlifting-centric studies [20,35-37].
Historically, the Delphi technique has been used in health survey validation studies [29], and more recently in sports nutrition questionnaire design [27,38,39]. Recent studies have used the Delphi technique in the development of a questionnaire to align the tool with the target population [27,38,39]. The CVI rating method and agreement rating were used to determine the item relevance and seek agreement. This methodology was adapted from Scrivin et al. [40], and Tam et al. [27], which included not only the CVI rating method but also an additional agreement rating, asking SMEs whether each item should be kept, modified, or deleted. The experts’ additional comments required a content review of each category. As there is no general agreed cut-off, researchers determined a <70% agreement to return items for further review [40]. The items that required modifications had the greatest amount of feedback or comments. Although the I-CVI was appropriate for all items, the additional agreement method allowed for additional content and language changes that would not have occurred otherwise. This agreement method also provided the possibility for additional items to be included to ensure the questionnaire asks what it is intended to do. As a result, the second agreement rating has been deemed an integral part of the content validation process, and the researchers would recommend utilising both agreement methods in the development of future sports nutrition questionnaires.
A small proportion of studies that used the original questionnaire undertook an additional validation process prior to administration using either formal or informal methods of validation for their population [4,17,41-44]. However, many researchers modified the Artioli et al. [4], questionnaire with minor adjustments without any further validation [Table 1] [6-9,19,23]. Consequently, given differences in target populations between investigations, it is unclear if the outcomes of these investigations are reliable.
Face validity identified problems with the presentation of two questions (items 14 and 15). For item 15, an example was provided to show how to answer the question appropriately, however, for item 14 (“What is the maximum amount of weight loss you have lost for an OWL competition and in what time frame? Please answer each row.”) was modified into three questions. The aim was to understand the maximum amount of weight an athlete lost in the week before an OWL competition and the maximum weight loss achieved in an athlete’s competition career. Due to the online format of the questionnaire, it was identified that athletes struggled to answer the question in full detail. As a result, three specific questions were asked instead, “What was the maximum amount of weight you have had to lose for an Olympic weightlifting competition?’’, “In what time frame was this achieved?”, and “What is the maximum amount of weight you have had to lose in the last week?”. It is recognised that the current questionnaire scored a moderate association for internal reliability in the ‘influences’ section, however as the SMEs rated this question highly relevant and did not require any modifications, the item was kept. History effects (internal validity) refer to events that can happen in the environment that may change the conditions of the study [45]. The level of influence a person/source may have over an athlete can change as they may have had an unpleasant experience with a doctor, teammate, social media, or a dietitian in that time frame. This may adjust the level of influence that the athlete may perceive the person/option to have [45]. Items which discuss personal beliefs can be prone to bias, as there are no acceptable measures for these type of constructs [46]. The suggested interval between test-retest processes is between two to six weeks [24,46,47].
Establishing construct validity is necessary for a questionnaire to be deemed valid. The restraint scale was used to determine construct validity in the original RWL questionnaire [26]. However, its emphasis on chronic dieting renders it less suitable here, failing to address acute dietary and training adjustments associated with sport specific populations. An alternative approach could be facilitated via concomitant administration of the newly validated questionnaire with relevant biochemical indices (assessing hydration and energy status), as has been undertaken previously [48]. The Delphi method, while intricate and often lengthy, may lead to a significant drop-out rate due to its requirement for participants to engage in multiple rounds [49]. It is also recognised that a small population of athletes was used to identify the internal reliability and consistency of the questionnaire [50].
In summary, the adapted BM management questionnaire has been validated in accordance with current guidance for content validity, face validity, and test-retest reliability. These validation measures have been an integral part of the questionnaire’s modification for OWL athletes. This adaption enables an opportunity for future research to identify the BM management practices OWL athletes use prior to competition.
Authorship
The authors’ responsibilities were as follows; AC, GS, RS, FP, DJ, RR, and CLE helped in the study concept and design; AC and GS in the acquisition of data; AC, GS and RS assisted in analysis and interpretation of data; GS helped in drafting the manuscript; AC, GS, RS, FP, DJ, RR, and CLE assisted in the critical revision of the manuscript for important intellectual content; RS helped in statistical analysis; and GS in study supervision. AC had full access to all the data in the investigation and takes responsibility for the integrity and the accuracy of the data analysis.
References
1. Crighton B, Close GL, Morton JP. Alarming weight cutting behaviours in mixed martial arts: a cause for concern and a call for action. Br J Sports Med. 2016; 50: 446-447.
2. Jetton AM, Lawrence MM, Meucci M, Haines TL, Collier SR, Morris DM, et al. Dehydration and acute weight gain in mixed martial arts fighters before competition. J Strength Cond Res. 2013; 27: 1322-1326.
3. Alderman B, Landers DM, Carlson J, Scott JR. Factors related to rapid weight loss practices among international-style wrestlers. Med Sci Sports Exerc. 2004; 36: 249-252.
4. Artioli GG, Gualano B, Franchini E, Scagliusi FB, Takesian M, Fuchs M, et al. Prevalence, magnitude, and methods of rapid weight loss among judo competitors. Med Sci Sports Exerc. 2010; 42: 436-442.
5. Anyzewska A, Dzierzanowski I, Wozniak A, Leonkiewicz M, Wawrzyniak A. Rapid Weight Loss and Dietary Inadequacies among Martial Arts Practitioners from Poland. Int J Environ Res Public Health. 2018; 15.
6. Berkovich BE, Stark AH, Eliakim A, Nemet D, Sinai T. Rapid Weight Loss in Competitive Judo and Taekwondo Athletes: Attitudes and Practices of Coaches and Trainers. Int J Sport Nutr Exerc Metab. 2019; 29: 532-538.
7. Connor J, Egan B. Prevalence, Magnitude and Methods of Rapid Weight Loss Reported by Male Mixed Martial Arts Athletes in Ireland. Sports (Basel). 2019; 7.
8. da Silva Santos JF, Takito MY, Artioli GG, Franchini E. Weight loss practices in Taekwondo athletes of different competitive levels. J Exerc Rehabil. 2016; 12: 202-208.
9. Nolan D, Lynch AE, Egan B. Self-Reported Prevalence, Magnitude, and Methods of Rapid Weight Loss in Male and Female Competitive Powerlifters. J Strength Cond Res. 2022.
10. Park S, Alencar M, Sassone J, Madrigal L, Ede A. Self-reported methods of weight cutting in professional mixed-martial artists: how much are they losing and who is advising them? J Int Soc Sports Nutr. 2019; 16: 52.
11. Kirk C, Langan-Evans C, Morton JP. Worth the Weight? Post Weigh-In Rapid Weight Gain is Not Related to Winning or Losing in Professional Mixed Martial Arts. Int J Sport Nutr Exerc Metab. 2020; 30: 357-361.
12. Murugappan KR, Mueller A, Walsh DP, Shaefi S, Leibowitz A, Sarge T. Rapid Weight Gain Following Weight Cutting in Male and Female Professional Mixed Martial Artists. Int J Sport Nutr Exerc Metab. 2021; 31: 259-267.
13. Pettersson S, Ekstrom MP, Berg CM. Practices of weight regulation among elite athletes in combat sports: a matter of mental advantage? J Athl Train. 2013; 48: 99-108.
14. Pettersson S, Pipping Ekstrom M, Berg CM. The food and weight combat. A problematic fight for the elite combat sports athlete. Appetite. 2012; 59: 234-242.
15. Centers for Disease C, Prevention. Hyperthermia and dehydration-related deaths associated with intentional rapid weight loss in three collegiate wrestlers--North Carolina, Wisconsin, and Michigan, November-December 1997. MMWR Morb Mortal Wkly Rep. 1998; 47: 105-108.
16. Kist C, Gier A, Tucker J, Barbieri TF, Johnson-Branch S, Moore L, et al. Physical Activity in Clinical Pediatric Weight Management Programs: Current Practices and Recommendations. Clin Pediatr (Phila). 2016; 55: 1219-1229.
17. Moore JM, Timperio AF, Crawford DA, Burns CM, Cameron-Smith D. Weight management and weight loss strategies of professional jockeys. Int J Sport Nutr Exerc Metab. 2002; 12: 1-13.
18. Pettersson S, Berg CM. Hydration status in elite wrestlers, judokas, boxers, and taekwondo athletes on competition day. Int J Sport Nutr Exerc Metab. 2014; 24: 267-275.
19. Matthews JJ, Stanhope EN, Godwin MS, Holmes MEJ, Artioli GG. The Magnitude of Rapid Weight Loss and Rapid Weight Gain in Combat Sport Athletes Preparing for Competition: A Systematic Review. Int J Sport Nutr Exerc Metab. 2019; 29: 441-452.
20. Nolan D, Lynch AE, Egan B. Self-Reported Prevalence, Magnitude, and Methods of Rapid Weight Loss in Male and Female Competitive Powerlifters. J Strength Cond Res. 2022; 36: 405-410.
21. Bolarinwa OA. Principles and methods of validity and reliability testing of questionnaires used in social and health science researches. Niger Postgrad Med J. 2015; 22: 195-201.
22. Trakman GL, Forsyth A, Hoye R, Belski R. Developing and validating a nutrition knowledge questionnaire: key methods and considerations. Public Health Nutr. 2017; 20: 2670-2679.
23. Juniper EF. Validated questionnaires should not be modified. Eur Respir J. 2009; 34: 1015-1017.
24. Boateng GO, Neilands TB, Frongillo EA, Melgar-Quinonez HR, Young SL. Best Practices for Developing and Validating Scales for Health, Social, and Behavioral Research: A Primer. Front Public Health. 2018; 6: 149.
25. Hasson F, Keeney S, McKenna H. Research guidelines for the Delphi survey technique. J Adv Nurs. 2000; 32: 1008-1015.
26. Artioli GG, Scagliusi F, Kashiwagura D, Franchini E, Gualano B, Junior AL. Development, validity and reliability of a questionnaire designed to evaluate rapid weight loss patterns in judo players. Scand J Med Sci Sports. 2010; 20: e177-187.
27. Tam R, Costa RJ, Pelly F, Lis D, Slater G. Development and validation of a questionnaire investigating endurance athletes practices to manage gastrointestinal symptoms around exercise. Nutr Diet. 2021; 78: 286-295.
28. Polit DF, Beck CT, Owen SV. Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Res Nurs Health. 2007; 30: 459-467.
29. Niederberger M, Spranger J. Delphi Technique in Health Sciences: A Map. Front Public Health. 2020; 8: 457.
30. Al-Madaney MM, Fassler M. Development and validation of a tool to assess researchers’ knowledge of human subjects’ rights and their attitudes toward research ethics education in Saudi Arabia. BMC Med Ethics. 2023; 24: 94.
31. Belogianni K, Seed PT, Lomer MCE. Development and validation of a knowledge, attitudes and practices questionnaire in the dietary management of irritable bowel syndrome. Eur J Clin Nutr. 2023; 77: 911-918.
32. Mukaka MM. Statistics corner: A guide to appropriate use of correlation coefficient in medical research. Malawi Med J. 2012; 24: 69-71.
33. Burke LM, Slater GJ, Matthews JJ, Langan-Evans C, Horswill CA. ACSM Expert Consensus Statement on Weight Loss in Weight-Category Sports. Curr Sports Med Rep. 2021; 20: 199-217.
34. Coyne JOC, Newton RU, Haff GG. Relationships Between Internal Training Load in a Taper With Elite Weightlifting Performance Calculated Using Different Moving Average Methods. Int J Sports Physiol Perform. 2020; 16: 342-352.
35. Gee TI, Campbell P, Bargh MJ, Martin D. Rapid Weight Loss Practices Within Olympic Weightlifters. J Strength Cond Res. 2023; 37: 2046-2051.
36. Durguerian A, Bougard C, Drogou C, Sauvet F, Chennaoui M, Filaire E. Weight Loss, Performance and Psychological Related States in High-level Weightlifters. Int J Sports Med. 2016; 37: 230-238.
37. Kwan K, Helms E. Prevalence, Magnitude, and Methods of Weight Cutting Used by World Class Powerlifters. J Strength Cond Res. 2022; 36: 998-1002.
38. Capling L, Gifford JA, Beck KL, Flood VM, Slater GJ, Denyer GS, et al. Development of an Athlete Diet Index for Rapid Dietary Assessment of Athletes. Int J Sport Nutr Exerc Metab. 2019; 29: 643-650.
39. Thurecht RL, Pelly FE. The Athlete Food Choice Questionnaire (AFCQ): Validity and Reliability in a Sample of International High-Performance Athletes. Med Sci Sports Exerc. 2021; 53: 1537-1543.
40. Scrivin R, Beck KL, Gifford JA, Flood VM, O’Connor HT. Development of an Electronic Questionnaire to Assess Sports Nutrition Knowledge in Athletes. J Am Coll Nutr. 2020; 39: 636-644.
41. Lakin JA, Steen SN, Oppliger RA. Eating behaviors, weight loss methods, and nutrition practices among high school wrestlers. J Community Health Nurs. 1990; 7: 223-234.
42. Reale R, Slater G, Burke LM. Weight Management Practices of Australian Olympic Combat Sport Athletes. Int J Sports Physiol Perform. 2018; 13: 459-466.
43. Brito CJ, Roas AF, Brito IS, Marins JC, Cordova C, Franchini E. Methods of body mass reduction by combat sport athletes. Int J Sport Nutr Exerc Metab. 2012; 22: 89-97.
44. Hillier M, Sutton L, James L, Mojtahedi D, Keay N, Hind K. High Prevalence and Magnitude of Rapid Weight Loss in Mixed Martial Arts Athletes. Int J Sport Nutr Exerc Metab. 2019; 29: 512-517.
45. Andrade C. Internal, External, and Ecological Validity in Research Design, Conduct, and Evaluation. Indian J Psychol Med. 2018; 40: 498-499.
46. Kimberlin CL, Winterstein AG. Validity and reliability of measurement instruments used in research. Am J Health Syst Pharm. 2008; 65: 2276-2784.
47. Lai P. Validating instruments of measure: Is it really necessary? Malays Fam Physician. 2013; 8: 2-4.
48. Slater GJ, Rice AJ, Sharpe K, Mujika I, Jenkins D, Hahn AG. Body-mass management of Australian lightweight rowers prior to and during competition. Med Sci Sports Exerc. 2005; 37: 860-866.
49. Barrett D, Heale R. What are Delphi studies? Evidence Based Nursing. 2020; 23: 68-69.
50. Perneger TV, Courvoisier DS, Hudelson PM, Gayet-Ageron A. Sample size for pre-tests of questionnaires. Qual Life Res. 2015; 24: 147-151.
51. Kiningham RB, Gorenflo DW. Weight loss methods of high school wrestlers. Med Sci Sports Exerc. 2001; 33: 810-813.
52. McKay AKA, Stellingwerff T, Smith ES, Martin DT, Mujika I, Goosey-Tolfrey VL, et al. Defining Training and Performance Caliber: A Participant Classification Framework. Int J Sports Physiol Perform. 2022; 17: 317-331.