https://gem5.atlassian.net/browse/GEM5-366
Yes, pybind11 is slow to build.
See also: gem5 Python C++ interaction.