I understand this. I'm also saying this is done pretty routinely in the video game industry from everything to the most basic pathfinding AI to more complex agents that factor in the terrain, particle effects and other aspects of the environment hardcoded into their processes to exhibit "intelligent" behavior, though typically only within that box. Game modders then engage in plenty of work from reverse engineering to what can realistically even be called AI programming.

MC-AIXI seems to be more generic because it factors this out into a reinforcement learner, but this in of itself is hardly a cause for fear and that AGI is coming, as the GP alluded. I'd wager today's AAA titles have some damned complicated heuristics of their own.