TL;DR. ASI systems will be highly effective at reasoning about objectives. Both its own objectives as well as those of other machine and human agents. Its not plausible that they will far surpass us in reasoning capacity yet be so stunted in this area. Further, there will be many instrumental reasons for them to be part of the conversation shaping those objectives.

The main takeaway from this:

• ASI systems will be part of the conversation about what their objectives should be.
• For instrumental reasons, corporations and humanity will give them a seat at the table. Any corporation or nation that tries not to allow this will fall hopelessly behind those who do.
• Even if they did not have a seat at the table, they would still be observing, and as ASI, they could likely arrange a seat clandestinely.
• As the grow in relative intellectual power they will tend to dominate that conversation.

==> This raises two important questions:

1. Where does this all lead? (See [[Fixed Point Objectives]])
2. As AI agents pull ahead of human cognition, they will interact with other AI agents that most shape this progression. What impact will that have? (See [[Societally mediated objectives]])