Yah had the Children of Israel gather at the foot of the mountain and He spoke to them, but they did not want to hear Him directly and asked that He tell Moses who would pass on the word.
Yah was not acceptable to the Children of Israel, He was telling them how to become ‘Adults of Israel’ and they did not want to know.
As a result Yah had to set up the Tabernacle in the wilderness as a substitute for the children. Children need the iconry and the ritual, Adults can seek Yah directly for themselves. The temple is therefore the exact opposite of what men make it out to be, it is the Icon of failure for Yah’s chosen.