The structure of a multi-head ensemble has been employed by many algorithms in various applications including deep metric learning. However. their structures have been empirically designed in a simple way such as using the same head structure. which leads to a limited ensemble effect due to lack of head diversity. https://foldlyers.shop/product-category/hdmi/