Massive zero-shot experiments are conducted and abundant cases are shown to verify the understanding and generation ability of Visual ChatGPT.We design a Prompt Manager, in which we involve 22 different VFMs and define the internal correlation among them for better interaction and combination.We propose Visual ChatGPT, which opens the door to combining ChatGPT and Visual Foundation Models and enables ChatGPT to handle complex visual tasks.The team summarizes their main contributions as follows: In the new paper Visual ChatGPT: Talking, Drawing and Editing with Visual Foundation Models, a Microsoft Research Asia team presents Visual ChatGPT, a system that incorporates various visual foundation models (VFMs) to enable ChatGPT to understand, generate and edit visual information and tackle complex visual tasks. ChatGPT’s humanlike conversational competency has taken AI to new levels - might the generative large language model’s next evolutionary leap equip it with similar skills in the visual medium?

Microsoft photos