Experiments

In this section, many synthesized images that were used or similar to those used in previous studies were used to evaluate the proposed interpolation method. In the most following illustrations, the left side of figures shows the original two input contour objects and specified feature lines. The right side of figures shows a sequence of interpolation using the proposed method.

Interpolation using a pair of synthetic contours is illustrated in Figure 8 (left). Lee et al. [12] showed that if there is no prior alignment between these two input images, shape-based interpolation couldn’t perform well. The shape-based method creates a bad interpolation, where there is no contour in the interpolated image. In contrast, the proposed method yields better interpolation as shown in Figure 8 (right). In fact, the proposed method employs features to automatically achieving the task of object centralization used in [12]. Additionally, in Figure 4 shown in previous section, the source image contains a small ring, while target image contains a large one with a large offset. This case was not handled well by morphology-based scheme [10]. In contrast, the proposed method performs very well.

                   (left)                                                        (right)
Figure 8. Interpolation between two synthetic contours with a large offset. On the left side, two feature lines are marked on each slice.

 

Both Figures 9 and 10 were tested in [6]. Lin et al. [6] termed Figure 9 a “moderate” concave case and Figure 10 an “extreme” concave case. Their approach employed a very computationally intensive method to distort one contour to like another one. This approach can yield satisfactory results for the moderate concave case, but not for the extreme concave case. Using the simpler proposed scheme, the shapes of intermediate contour change smoothly between two different shape contours for both “moderate” and “extreme” concave cases. In these two examples, the shapes pf two given contours do not change globally. The left portion of figures is either shrinking or enlarging. Therefore, we cannot simply place two cross lines like Figure 8 on these two examples. Alternatively, we place corresponding feature lines along the boundaries of two given contours. In this manner, these features can effectively control the change of shapes. 

(left) (right)
Figure 9. A “moderate” concave case [6].

 

 

 

   

                                   

     (left)    (right)

Figure 10. An “extreme” concave case [6].

 

 

 

 

 

Many previous studies suggested to apply object centralization to have one object enclosed by another one before interpolation [16,17,18]. Sun et al. pointed out that this conventional centralization (i.e., aligning the centroids of the two objects) sometimes fail when the objects are concave like Figure 11 (left) and 12. To solve this issue, Sun et al. [11] iteratively employed object centralization and object enlargement to ensure that object enclosure can occur. After interpolation, this approach requires contour shrinking by means of erosion to compensate the effect of object enlargement. Furthermore, this process cannot always guarantee object enclosure even when the enlarging factor becomes extremely large [11]. The whole process seems not very efficient with respect to computational complexity. In this respect, our proposed scheme seems more practical than this approach. Figure 11 (right) shows a sequence of interpolated results using the proposed scheme.

(left) (right)
Figure 11. Object enclosure does not occur after applying conventional centralization on two concave objects [11].

 

 

 

 

 

 

Figure 12. Overlapping of concave objects after centroid alignment cannot guarantee to achieve object enclosure [11].

The next two examples were evaluated in [10]. Figure 13 is a set of ring-like objects with no overlapping area and Figure 14 illustrates the interpolation between a hollow object and a solid object. In both cases, we need to generate negative objects due to holes. Figure 14 needs to generate a pseudo negative hole. Then, we separately interpolated positive and negative object pairs and then blended them like our previous work [12]. Guo et al. [10] reported that both cases are not handled well by the original shape-based method. Shape-based method simply interpolates distance code for the whole image. Guo et al. [10] also pointed out that [6] fails to deal with Figure 14, but this dynamic elastic method is very computationally intensive. However, our results show the proposed scheme yields very satisfactory results in both examples.  

         (a) positive object pair               (b) negative object pair

(c) Interpolation

Figure 13. Interpolation for a set of ring-like objects [12]

 

 

 

 


           (a) positive object pair        (b) negative object pair

(c) Interpolation

Figure 14. Interpolation between a hollow object and a solid object [12].

 

 

 

 

 

 


Branching examples like Figure 15 have been widely evaluated [6,7,10,11, 12]. The proposed scheme can successfully deal with Figure 15. Like [12], we first independently interpolate three positive object pairs and then unite these three interpolated results together to accomplish interpolation. Multiple objects may exist on two input slices. In this situation, we will also employ our previous method [12] to solve matching problem first and then use similar procedures to perform interpolation. In this experiment, each positive object pair has two different pairs of feature lines. These features effectively control where two positive objects are merged. In other words, the user can fully control interpolation with features.

 (left)

(right)

Figure 15. Branching case [6,7,10,11,12].

 

 

 

 

 

Figure 16 is called heavy invagination case (i.e., abrupt change in shape) in [11]. This case was not handled well by a morphology-based scheme [11,10]. From our results, it is clear that the proposed scheme can handle invagination case well, too. Lee et al. [12] cannot solve a narrow concavity problem like Figure 17. In this example, there are two objects X0 and Xn+1 and the region  is equal to X0. There is a very narrow concavity (i.e., marked by A) in the object X0. In this situation, using method presented in Lee et al. [12], the distance codes of region near B is greater than those of region near to A. Therefore, unfortunately, this method can not ensure Xn+1 to contract into the region near B in the course of interpolation. In contrast, the proposed method also easily solve this problem by placing several corresponding feature lines along the boundaries of both objects as illustrated in Figure 17.

 (left) (right)

Figure 16. The invagination case (abrupt change in shape) [11].

 

 

 

 

 

(left)  (right)

Figure 17. The narrow concavity case [12].

 

 

 

 

 

We have evaluated the proposed scheme using a variety of examples that used in the previous work. Since our method employs feature control to help shape-based interpolation, the results such as Figure 4, 6, 8, 13, 14 and 15 are reasonable and continuous and smoother than are obtained by the original shape-based method. Additionally, with feature control, our method considers the global and local change of shapes in two given objects, so the proposed method can handle cases with complicated structure such as Figure 10, 11, 16 and 17, that cannot be handled well by the other methods. With the concept of positive and negative objects [12], our method can simply handle the hollow and branching cases by the same procedures, so that the results can be obtained easily just merging all intermediate objects using a blending order presented in our previous work [12]. In summary, from above examples with synthesized objects, the proposed method handles different situations effectively.

With respect to computational complexity, the proposed algorithm is in proportion to the number of object pairs. For each object pair, we need to perform the same procedure for the whole image. Therefore, the computational complexity is higher than the shape-based method. However, the proposed method can handle more general cases than the shape-based method and even more than other previous work. Table 1 shows execution timing and the number of features used for each experiment with 256x256 image resolution. This timing is averaged from interpolating 200 slices in each experiment. In this table, we show the execution timing (second) both non-optimized and optimized versions of the proposed method. The optimized version implemented method presented in Section 2.2. The optimized version consistently

performs faster than non-optimized for all experiments. If multiple object pairs are interpolated, we also list the number of features for each pair in this table such as Figure 13 and 15. Our experiments were performed on the Intel Pentium II, 233MHZ personal computer with 256 MB main memory. This table indicates that the execution time is in proportion to the number of object pairs and feature lines. Since we perform interpolation on the whole image, the execution cost is in proportion to the image resolution, too. Observing all experiments, we can know it is not necessary to perform interpolation in this manner. We can save more computation cost as follows. For each object pair, we find the union of their bounding boxes and we just need to perform the same interpolation procedure to this union area like Figure 18. Additionally, we will only perform distance transform on this area, too. In this manner, we can achieve identical results but with lower computation cost as shown in Table 1, too. With this minor change in our implementation, the executing performance is much improved. Like Figure 3, the performance is even faster by about 4.8 times. The main reason is that the union area of two bounding boxes is still not significant (i.e., about 20%) in contrast to the whole image. In this situation, we can save time for both distance transform and interpolation.

Figure 18. B1 and B2 are bounding boxes for two given objects and both distance transform and interpolation is performed only on the union area instead of the whole image to save computation cost.

 

 

Non-optimized

Optimized

Optimized & Bounding Box

No. features

Fig 3

1.86

1.32

0.39

2

Fig 4

2.14

1.59

1.10

2

Fig 6

2.20

1.64

0.37

2

Fig 7

3.62

2.74

1.16

4

Fig 8

2.02

1.60

0.77

2

Fig 9

8.72

6.90

4.15

11

Fig 10

10.22

7.97

5.52

13

Fig 11

2.21

1.60

1.33

2

Fig 13

17.19

13.25

10.10

11 – 13

Fig 14

3.97

2.97

1.88

2 – 2

Fig 15

5.89

4.24

3.99

2 – 2 – 2

Fig 16

2.02

1.59

1.42

2

Fig 17

18.89

14.71

11.02

24

 

 

 

 

 

 

 

 

Table 1. Execution timing (in second) and the number of features for all experiments.