First International Youth Coach Course in Bali: 94% Satisfaction and the Missing Metric

The final practical session in the open water of Bali wrapped up at dusk on August 10. On the beach, 18 coaches from 12 countries rolled up their buoys, put away their stopwatches, and lined up for a group photo. Three days later, the survey summary was released: 94% of participants rated the program as exceeding their expectations, with satisfaction for the lecturer and the classroom sessions equal.

That is the entire quantitative portion the program offered. One percentage, one sample size, one single run. The rest is descriptive text.

In 21 years of watching the aquatics industry, I have read hundreds of releases like this. They usually open with a record, a medal, or a promise about the future. This one had only a single survey figure. Precisely because it had only one figure, it deserves more scrutiny than any performance report.

Context: a certification program, not a race

The course was titled the International Youth Coach Course, a combined pool swimming and open water swimming edition, organized by World Aquatics in Bali from August 3 to August 10. It was the first time pool and open water content were merged into a single certification program at the youth coach level.

The course was led by Mel Tantrum, head coach of the Australian Paralympic swimming team and lead developer of World Aquatics' open water swimming coach certification courses. A national-team figure stepping in to deliver grassroots training is not a small detail. It shows knowledge flowing from the elite level down to the foundation, and it also shows Australia acting as the de facto technical authority for open water swimming globally.

On the certification structure, World Aquatics runs a three-tier system: Age Group Coach, Youth Coach, and Performance Coach. The learning model blends online and in-person delivery, with the CORAL e-learning platform as the backbone for the theory component. Seventeen of the 18 participants received full scholarships.

The program ran eight days, with classroom sessions on athlete-centred coaching, long-term athlete development, season planning, session design, communication, and building positive learning environments. The practical component took place directly in the ocean, focused on four open-water-specific skills: pack swimming, drafting, feeding, and starts.

Core analysis: four layers of data

I separated this program into four layers to examine each on its own, because mixing them together produces a pretty but blurry picture.

The first layer, the certification structure. World Aquatics choosing the Youth Coach level, rather than Performance, to pilot the combined format is a strategic signal. The youth level sits at the base of the talent pipeline. Investment there does not produce medals in one or two seasons; it produces the coaching foundation for an entire generation of athletes behind it. The timeframe for this effect is two to eight years, far longer than any competitive cycle, and that is why it rarely appears on the front page of any sports newspaper.

The second layer, the scholarship mechanism. Seventeen scholarships out of 18 participants is a number that says a lot. It goes beyond the scope of a cost-support policy. It is a tool for widening the geographic base of adequately qualified coaches, shifting human resources from wealthy federations toward emerging ones. The cohort came from 12 different countries, a structure that was curated rather than random.

But here the first methodological warning appears. A cohort of fully funded participants tends to rate more positively than a self-funded cohort, simply because the cost barrier has been removed from the psychological equation. When I was doing data analysis at a sports news outlet in Hai Phong, I witnessed internal surveys with sky-high satisfaction rates, and then three months later, with the same group of people, the return-use rate was only half. A small sample plus a sense of gratitude creates a bias that no statistical tool can strip out if you only read the final number.

The third layer, the open water technical content. This is the part with genuine transferable value. The four skills taught differ entirely from pool technique. Pack swimming is a problem of collision and spatial positioning. Drafting is an energy-saving problem, where water resistance is harnessed rather than fought. Feeding is an operational problem, requiring coordination between the athlete and the support crew on the boat. An ocean start is a safety problem, where a wrong dive can push an athlete into a reverse current or into the crowd ahead.

I once used the PPDA metric to prove Russia defended proactively at the 2026 World Cup, while the media called it luck. The principle here is similar. Open water swimming has no lanes, no pool wall, no turn points. It has currents, waves, water temperature, and a group of people swimming beside you toward the same goal. Pool technique can be measured by stroke count per length. Open water technique must be measured by decision-making ability under conditions you cannot control.

The fourth layer, the distribution model. Blended online and in-person learning, with the CORAL platform carrying the theory, is a cost lever. The marginal cost of training one more coach in an emerging federation drops sharply when the theory is moved online. When the goal is scaling a certification program globally on a finite budget, the lever lies in reducing the portion that must be delivered in person, not in adding more in-person classes. That is why the statement that "no single country or system has all the answers" is more descriptive than diplomatic. It is the statement of a strategy of decentralizing expertise.

Comparison with the certification model in China

I had the chance to observe the swimming coach certification system in China during the period when the country was rapidly expanding grassroots swimming centres. The lesson lies in speed and in the price of speed. When a certification system expands faster than its capacity to control quality, the certificate becomes an administrative piece of paper, and coach quality stratifies sharply across centres. A blended model with an online platform solves the quantity problem, but it does not automatically solve the practical-quality problem. Open water practice requires a real ocean environment and genuinely experienced instructors, things that cannot be moved online. This is the point the Bali program, with eight days and a small cohort, is trying to handle, and also the point any scaling effort will have to confront first.

The contrarian angle: the metric is measuring the wrong thing

Now to the part the organizers probably did not want me to write.

The 94% figure is presented as evidence that coaching quality has been raised. It is only evidence that 18 people who just completed a fully funded course felt satisfied at the moment they were asked. These two propositions are different in nature.

Data does not lie, but people who read data do. A satisfaction rate does not measure capability. It measures perceived experience. And perceived experience is shaped by at least three variables outside the program: the cost paid, pre-course expectations, and the atmosphere of a small, like-minded group.

More notable is the improvement feedback. Participants requested more open water practical time, added race simulations, and more real-life coaching scenarios. When a group of participants spends more classroom time than expected yet still rates the program as exceeding expectations, one of two things is happening: their initial expectations were very low, or the metric is measuring the wrong thing. A miracle is just a data point that has not been regressed. A single course, a small sample, a funded cohort, is not enough to conclude anything about the quality of an entire global certification system.

And here is the biggest gap. The program's own text admits that the ultimate measure is what coaches take back to their athletes and programs. But there is no data whatsoever on that "take back" part. No six-month follow-up, no athlete survey, no comparison between a trained group and an untrained group. The program measures the input, publishes the input result, then infers the output effect.

I do not believe in luck; I believe in the margin of error. Here, the margin of error is too wide for the 94% figure to carry the meaning it is presented with.

Risk and downstream ripple

On risk, this program has no competitive element, no doping element, no competition-rules element. All the risk sits at the development layer: the durability of a first-edition pilot format, the ability to measure downstream impact, and the portability of the certification across national federations. The text does not address whether a certificate issued by World Aquatics is automatically recognized by national federations. This is an unresolved governance detail, and it will become important if the program is scaled.

On the downstream ripple, the main point of impact is upstream: the quantity and quality of certified open water coaches. As the coaching tier thickens, the input quality for athlete development rises accordingly, with a two-to-eight-year lag. The safety and risk-management content in open water also creates an indirect dividend: mass-participation and age-group open water events run more safely, a precondition for the open water event market to grow. Nothing in the source relates to equipment, sponsorship, broadcast rights, or betting markets, so those ripple branches cannot be assessed.

What it means for Vietnamese swimming

For the Vietnamese swimming market, the real signal is not the 94% figure. It lies in the fact that a global certification program is formalizing open water coaching skills, and distributing those skills through a scalable model with declining marginal cost.

Vietnam has the advantage of a long coastline and a growing base of pool swimmers. The gap lies in the organizational and safety skills for open water, exactly the part the Bali course focuses on. If the national federation can get its coaches into World Aquatics' scholarship pipeline and online platform, we have a chance to shorten years of trial and error. But that chance only materializes if we build our own metric for output, rather than relying on the organizers' satisfaction surveys.

Data only dies when we stop asking questions. The Bali course has opened a question, not delivered an answer. That question is: after the coaches return, what actually changes on the lanes of the young athletes, and how do we measure it before the next course wraps up.