language grounding

Beyond ChatGPT: Embodied language understanding

An illustration of a scenario depicting many tasks of interest to researchers in Embodied AI. Here, we have multiple robots operating in a kitchen environment, with a human asking one of the robots if there is any cereal left, while the other one cleans the dishes. The robots must use their navigation, manipulation, and reasoning skills to answer and achieve tasks in the environment. Illustration courtesy of Winson Han.