Welcoming Visitors and Semantic Mapping

Preparing Scratchy for its next run..
Preparing Scratchy for its next run...

It works well over here in Lisbon. Yesterday, we focused on the “Welcoming Visitors” and “Getting to know my Home” tasks — today it’s time for “Catering for Granny Annie’s Comfort” and “Visit my home”. Scratchy is doing well so far.

The current scores of TBM1 - Getting to know my home and TBM2 - Welcoming Visitors
The current scores of TBM1 - Getting to know my home and TBM2 - Welcoming Visitors.

TBM1 is about autonomously learning where the things in the apartment are located — Scratchy does this by creating a semantic map. But because of facing some issues with the trained object recognition model, TBM1 didn’t earn that much scoring yet. Also in TBM2 we encountered a few initial mistakes but than there was steady progress. For each benchmark task, it is allowed to do seven runs and the final scoring is the median of the three best ones — so there’s still room for improvement today.

Scratchy is able to grip objects - at least occasionally
Scratchy is able to grip objects - at least occasionally.
And here he hands over a parcel during the Welcoming Visitors task
And here he hands over a parcel during the Welcoming Visitors task.
Our friends from SocRob are also doing a great job with their mBot
Our friends from SocRob are also doing a great job with their mBot.

For more cool pictures, follow us on instagram!