Innovative Scoring Method for Simulated Flight Competitions Using Normalization Techniques

Simulated flight competitions offer aviation students an excellent opportunity to practice cross-country flying skills in a controlled environment. However, scoring these competitions fairly and accurately can be challenging. Traditional methods typically focus on raw metrics, such as time en route or fuel consumption, but these metrics alone do not provide a balanced assessment of pilot performance.

This post outlines a scoring method that uses normalization to combine key performance factors into an average score, resulting in a fairer, more comprehensive evaluation. Additionally, this approach can be expanded to include other elements of visual flight rules (VFR), making it a flexible tool for aviation educators.

Understanding the Challenges in Scoring Simulated Flight Competitions

In simulated flight competitions, students demonstrate their ability to plan and execute cross-country flights. The main performance indicators usually include:

• Time enroute: How quickly the student completes the planned route.

• Fuel burned: How efficiently the student manages fuel consumption.

  
  

While these metrics are important, they can sometimes conflict. For example, a pilot who flies faster may burn more fuel, while a pilot who conserves fuel may take longer. Simply ranking students by one metric can unfairly favor one style over another.

Additionally, environmental factors like wind or simulator settings can affect these numbers, making direct comparisons difficult. This is where normalization comes in.

How Normalization Improves Scoring

Normalization is a mathematical technique that adjusts values measured on different scales to a common scale. In the context of simulated flight competitions, normalization allows time enroute and fuel burned to be converted into comparable scores.

Here’s how the method works:

1. Collect raw data: Record the time enroute and fuel burned for each student.

2. Find the minimums: Determine the minimum for each metric across all participants.

3. Normalize each metric: Convert each team's raw score into a normalized score between 0 and 100 using the formula:

   
   

``` normalized score = 100/(value - min)```

1. Combine normalized scores: Calculate an average of the normalized time and fuel scores to get a single composite score.

2. Rank students: Use the composite score to rank participants fairly.

   
   

This method balances speed and efficiency, rewarding pilots who perform well in both areas.

Applying the Method in Practice

To implement this scoring method in your simulated flight competitions, follow these steps:

• Step 1: Define the metrics clearly

Ensure all participants understand that both time and fuel efficiency matter. This encourages balanced flying strategies.

• Step 2: Collect accurate data

Use simulator logs or software to record precise time enroute and fuel consumption.

• Step 3: Normalize scores after the competition

After all flights are complete, calculate the normalized scores using the formula above.

• Step 4: Share results with participants

Provide feedback showing how each pilot performed on time, fuel, and the combined score. This transparency helps students learn and improve.

Benefits for Aviation Educators

This scoring method offers several advantages for educators running simulated flight competitions:

• Fairness

Normalization accounts for differences in flying style and environmental factors, making comparisons more equitable.

• Flexibility

You can add new metrics as needed and adjust the scoring to different training goals.

• Clear feedback

Students receive detailed insights into their strengths and areas for improvement.

• Encourages balanced skills

Pilots learn to manage both speed and fuel efficiency, reflecting real-world flying demands.

Example Spreadsheet

Scenario: Three teams using the X-Plane flight simulator piloted the ALIA electric eVTOL aircraft from KSMS to KCUB. The airspace between these two airports is complex, so each team selected a different route to navigate around commercial and military airspace. After the flights, the time and fuel data were recorded in columns B and C.

Note: The data was collected by reviewing a replay of each flight. The referee responsible for judging the competition must save each completed flight as a replay to enable the review process. The referee will note the time of day and fuel levels at takeoff, then subtract the time and fuel used after landing.

• Here is the hidden formula in cell B5 for calculating the minimum time enroute

=MIN(B2:B4)

• Here is the hidden formula in cell C5 for calculating the minimum fuel used

=MIN(C2:C4)

• Here is the hidden formula in cell D2 for calculating time points

=100/(B2/$B$5)

This formula is copied down in rows 3 and 4.

• Here is the hidden formula in cell E2 for calculating time points

=100/(C2/$C$5)

This formula is copied down in rows 3 and 4.

• Here is the hidden formula in cell F2 for finding the average (or composite) score

=AVERAGE(D2,E2)

This formula is copied down in rows 3 and 4.

• Here is the hidden formula in cell G2 for calculating rank

=RANK(F2,$F$2:$F$4)

This formula is copied down in rows 3 and 4.

Please note that the formulas provided are specific to Google Sheets. If you are using another program, like Excel, the formulas may differ. Additionally, the use of the "$" symbol locks the reference to a specific cell, making it an absolute reference. Without the dollar signs, the reference will be relative, which may cause errors when you copy the formula to another cell. It is also important for the reader to have some prior experience with using formulas in spreadsheet calculations. I recommend recreating this example to ensure a clear understanding of how the spreadsheet functions.

Expanding the Method for Broader Use

Beyond time and fuel, you can include other VFR elements such as:

• Airspace violations: Too low, too high, restricted, etc.

• Operating limitations: stall speed, +/- 60 degree bank, +/- 30 degree pitch, etc

• Hard landing: gear force, prop strike, leaving pavement, etc.

  
  

Each new metric can be normalized and added to the composite score, creating a comprehensive evaluation of pilot skills.