Metric final results

As mentioned in the previous post, a metric for comparison of the validity was applied to the Segmentation Algorithms implemented in order to find out which method was the best.

This time i divided the car's course in 3 parts:

1. Straight line route
2. Roundabout approach
3. Roundabout

Just to give you an idea how this pathways look like I've taken some pictures from the Google Maps Street View.

Here is the straight road:

The roundabout approach:

The roundabout

Now you have an idea how the tested scenarios look like.

This time, there were made 21 essays between the values i thought that held physical meaning and that i    considered that were acceptable. Keepin mind that the lower the energy, the better the closest the results to the ground truth.

Here is the results:

Complete route:

Minimum energy value: 143.2369

Minimum energy threshold value: 1.3750 m

Minimum energy value: 78.4062

Minimum energy C0 value: 1.3750 m

Minimum energy value: 160.7339

Minimum energy lamda value: 6.5 degrees

Minimum energy value: 143.9026

Minimum energy threshold value: 2.750  m

Minimum energy value: 136.6162

Minimum energy cosine distance value: 0.475  

Comments:

• The simple segmentation, the Dietmayer and the Spacial Nearest Neighbor presented a similar type of curve.
• The ABD present a very irregular curve.
• The best result was achieved by the Dietmayer Segmentation. 

 Straight Road:

Minimum energy value: 155.0718

Minimum energy threshold value: 1.3750 m

Minimum energy value: 154.7607

Minimum energy C0 value: 1.3750 m

Minimum energy value: 211.7002

Minimum energy lamda value: 6.5 degrees

Minimum energy value: 247.6670

Minimum energy threshold value: 1.250  m

Minimum energy value: 206.2954

Minimum energy cosine distance value: 0.725  

Comments:

• The simple segmentation, the Dietmayer and the Spacial Nearest Neighbor presented a similar type of curve.
• The ABD present a very irregular curve.
• The best result was achieved by the Multivariable Segmentation. 

Roundabout approach:

Minimum energy value: 129.9531

Minimum energy threshold value: 1.750 m

Minimum energy value: 31.8815

Minimum energy C0 value: 3 m

Minimum energy value: 88.8079

Minimum energy lamda value: 15.5 degrees

Minimum energy value: 140.9477

Minimum energy threshold value: 1.00  m

Minimum energy value: 69.9323

Minimum energy cosine distance value: 0.475 

Comments:

• The simple segmentation, the Dietmayer and the Spacial Nearest Neighbor presented a similar type of curve.
• The ABD present a very irregular curve.
• The best result was achieved by the Dietmayer Segmentation. 

Roundabout:

Minimum energy value: 134.9820

Minimum energy threshold value: 0.500  m

Minimum energy value: 18.5544

Minimum energy C0 value: 1.50 m

Minimum energy value: 134.5345

Minimum energy lamda value: 4.7 degrees

Minimum energy value: 111.3381

Minimum energy threshold value: 3  m

Minimum energy value: 52.4475

Minimum energy cosine distance value: 0.475 

Comments:

• The simple segmentation, and the Dietmayer presented a similar type of curve.
• The ABD present a very irregular curve.
• the Spacial Nearest Neighbor has a kinda strange curve as well.
• The best result was achieved by the Dietmayer Segmentation. 

Main conclusion:

1. In general the Dietmayer Segmentation and the Multivarible Segmentation present the best results based only on the energy values.
2. The metric is not fully perfected -   Some of the minimum values occur for the extreme values and theoretically the Spacial Nearest Neighbor Algorithm should be one of the more viable algorithms

Final Note:

The results for the Santos approach will be presented in the next post (it is the only method with 2 variables)