What's the Deal With OpenAI Not Knowing How GPT-4 Works?

We can see the inputs and outputs, but the internal reasoning process is largely invisible.