How do ViT backbones work with PatchCore?

[philippr99]

Hello, can someone please explain how PatchCore handles the ViT, for ResNet it takes out certain layers and feeds it into PatchCore as it seems.

Does it use for ViT the class token?

And does the anomaly segmentation (highlighting) work for models with ViT backbone?

Best,
Philipp