research
∙
07/17/2023
Multimodal Diffusion Segmentation Model for Object Segmentation from Manipulation Instructions
In this study, we aim to develop a model that comprehends a natural lang...
share
research
∙
07/14/2023
Switching Head-Tail Funnel UNITER for Dual Referring Expression Comprehension with Fetch-and-Carry Tasks
This paper describes a domestic service robot (DSR) that fetches everyda...
research
∙
07/12/2023
Prototypical Contrastive Transfer Learning for Multimodal Language Understanding
Although domestic service robots are expected to assist individuals who ...
research
∙
06/24/2023
Action Q-Transformer: Visual Explanation in Deep Reinforcement Learning with Encoder-Decoder Model using Action Query
The excellent performance of Transformer in supervised learning has led ...
research
∙
08/18/2022
Visual Explanation of Deep Q-Network for Robot Navigation by Fine-tuning Attention Branch
Robot navigation with deep reinforcement learning (RL) achieves higher p...
research
∙
07/19/2022
Relational Future Captioning Model for Explaining Likely Collisions in Daily Tasks
Domestic service robots that support daily tasks are a promising solutio...
research
∙
04/02/2022
Moment-based Adversarial Training for Embodied Language Comprehension
In this paper, we focus on a vision-and-language task in which a robot i...
research
∙
12/28/2021
LatteGAN: Visually Guided Language Attention for Multi-Turn Text-Conditioned Image Manipulation
Text-guided image manipulation tasks have recently gained attention in t...
research
∙
07/02/2021
Target-dependent UNITER: A Transformer-Based Multimodal Language Comprehension Model for Domestic Service Robots
Currently, domestic service robots have an insufficient ability to inter...
research
∙
07/02/2021
Case Relation Transformer: A Crossmodal Language Generation Model for Fetching Instructions
There have been many studies in robotics to improve the communication sk...
research
∙
06/29/2021
Unified Questioner Transformer for Descriptive Question Generation in Goal-Oriented Visual Dialogue
Building an interactive artificial intelligence that can ask questions a...
research
∙
03/06/2021
Visual Explanation using Attention Mechanism in Actor-Critic-based Deep Reinforcement Learning
Deep reinforcement learning (DRL) has great potential for acquiring the ...
research
∙
03/01/2021
CrossMap Transformer: A Crossmodal Masked Path Transformer Using Double Back-Translation for Vision-and-Language Navigation
Navigation guided by natural language instructions is particularly suita...
research
∙
02/12/2021
Predicting and Attending to Damaging Collisions for Placing Everyday Objects in Photo-Realistic Simulations
Placing objects is a fundamental task for domestic service robots (DSRs)...
research
∙
07/09/2020
Alleviating the Burden of Labeling: Sentence Generation by Attention Branch Encoder-Decoder Network
Domestic service robots (DSRs) are a promising solution to the shortage ...
research
∙
12/23/2019
A Multimodal Target-Source Classifier with Attention Branches to Understand Ambiguous Instructions for Fetching Daily Objects
In this study, we focus on multimodal language understanding for fetchin...
research
∙
09/10/2019
Multimodal Attention Branch Network for Perspective-Free Sentence Generation
In this paper, we address the automatic sentence generation of fetching ...
research
∙
06/17/2019
Understanding Natural Language Instructions for Fetching Daily Objects Using GAN-Based Multimodal Target-Source Classification
In this paper, we address multimodal language understanding for unconstr...
research
∙
06/11/2018
A Multimodal Classifier Generative Adversarial Network for Carry and Place Tasks from Ambiguous Language Instructions
This paper focuses on a multimodal language understanding method for car...
research
∙
06/04/2018
SuMo-SS: Submodular Optimization Sensor Scattering for Deploying Sensor Networks by Drones
To meet the immediate needs of environmental monitoring or hazardous eve...
research
∙
01/16/2018