ci: do not attempt to compile NumPy in CI for Windows ARM64 #1769

Job	Run time
Build wheels on Linux (x86_64)	21m 50s
Build wheels on Linux (i686)	20m 12s
Build wheels on Linux (aarch64/manylinux)	15m 46s
Build wheels on Linux (aarch64/musllinux)	6m 11s
Build wheels for WebAssembly	6m 39s
Build wheels on macOS (arm64)	7m 32s
Build wheels on macOS (x86_64)	15m 44s
Build wheels on Windows (x64)	17m 56s
Build wheels on Windows (ARM64)	17m 50s
Build sdist and test extra dependencies	2m 6s
Build with sanitizers for debugging purposes	2m 6s
Build wheels on Windows (Win32)	9m 40s
	2h 23m 32s

Provide feedback