I think they are both sized correctly but the upper back of the cafe racer is not pretty. I don’t think you need to size down as other have noted the neck hole is pretty spot on already, it’s just the Aero pattern for this style. The stiff nee CXL isn’t helping either but the extra material is there.
The half belt looks pretty good to me fit wise.
This is my view as well. I probably could have just quoted this instead of writing a book.