Sony Patents AI System to Assist Controller Input for Players with Disabilities

Sony has patented a system using artificial intelligence to help players with physical limitations or movement-related disabilities operate game controllers more effectively.

The patent, published on September 17, 2026, details an AI model that analyzes how players operate controls and compensates when they cannot fully actuate buttons or triggers. The system learns individual patterns by monitoring the timing and duration of inputs, movement patterns, and game context to predict and complete intended actions.

According to the patent documentation, "the user may have difficulty actuating a left button, move a left joystick, press a trigger, or other controls of the controller," to which "a video game system can be configured to generate control outputs using an artificial intelligence model using the control inputs from the controller. The AI model is pre-trained at least partially on control actuation information and accessibility data associated with the controller."

The AI determines compensation levels based on user-specific, controller-specific, and game context-specific data. It can also predict a player's intended action from initial inputs or game history to assist with controls accordingly.

The system can run locally on a device or in the cloud. In multiplayer games, the AI accessibility agent can be deactivated automatically or manually by the player, with an indicator visible to other players showing whether it is active.

Sony designed the technology to be controller-agnostic rather than exclusive to PlayStation controllers. The patent states the AI "can still generate the control output relevant to or specific to a particular controller being used by the user," potentially making the accessibility tool usable beyond Sony's ecosystem.

The approach differs from traditional accessibility solutions by adapting to individual physical limitations and habits rather than requiring players to remap controls or use specialized hardware.