A little bit of digging into the sources shows that I just need to add -DHAVE_FAST_COMPILER=0 to the build flags to turn off the tests that require large amounts of memory and CPU cycles to compile.  I will do this for ARM.  Are there any secondary arches that are likely to have the same problem?