We proposed the design and development of a multimedia communication system that utilizes multi-agent computing technology, called Flexible Video Conference System (FVCS). As a part of FVCS, the user interface (UI) presented to the system's users also requires its flexibility. In this paper we propose the adaptive display management function that is used to improve the flexibility of UI in FVCS. Using this function, the user's preference and taste about UI could be obtained easily, and meanwhile the windows of applications in FVCS could be configured properly and automatically in response to the user's preference and the status of operating environment. The design of adaptive display management function based on multi-agents is then introduced in this paper. The structure of the agent organization, the functionality of each agent, as well as the manner of organizing and collaborating of the agents are presented in detail. Also, an implementation of the proposed design is introduced.