Hi! It's me, Joris.

It looks like I've linked you here myself. Linking people to a blogpost I wrote is often a bit akward, especially at work.

I likely shared this blog in an attempt to further a conversation. Usually the post does a better job at succinctly sharing information than I could by talking.

In any case, I hope me sharing this post doesn't come across as humblebragging, that's really the opposite of what I'm trying to achieve.

Thanks for reading!

Dreaming of the Ultimate Smarthome
20min read

Part 1: Intro & Smart Housekeeping

This is the first post in a multi-part series:
I want a Rosey in my life. Source: [The Jetsons Fandom](https://thejetsons.fandom.com/wiki/Rosey)
Enlarge

I want a Rosey in my life. Source: The Jetsons Fandom

Home Automation has come a long way in the past few years. Yet despite my fairly elaborate setup, I still find that my daydreams about a Jetsons future in which the robots do all the work is pretty far out.

What are the problems to solve? What already exists? What is missing? Some thoughts.

Automating all the things 🤖

Current appliances are already amazing

Historically, household chores took a huge amount of time. Source: [The World in our Data](https://ourworldindata.org/grapher/hours-per-week-spent-in-market-and-non-market-work-by-sex-united-states?country=Food+Preparation+and+Indoor+Household+Chores+(Men)~Food+Preparation+and+Indoor+Household+Chores+(Total)~Food+Preparation+and+Indoor+Household+Chores+(Women))
Enlarge

Historically, household chores took a huge amount of time. Source: The World in our Data

Before we start looking forward, let’s acknowledge how fantastic the - mostly dumb - robots are that we all already use on a daily basis. Washing machines, dryers, kitchen appliances, vacuums and all their companions: these devices and appliances are already quite amazing.

We often forget that in the past, people (mostly housewives) spend almost all day doing laundry, cooking and keeping the house tidy (and childcare of course). While this can still be a hugely laborious job, there really is no comparison when it comes to total-time-spent and quality-of-work of modern house hold appliances vs. manual labor.

But we need more robots

Sign, Me, Up!

Despite this, we all still spend hours per day doing repetitive household work. Why can’t robots and smart appliances do that for us?

Without trivializing the complexity of the tasks, it seems like a lot of these household tasks are (close to) automatable today - it’s clear the next decade will bring huge amount of innovation in this area.

Before diving into the specifics, let’s address a few things up front:

  • Chores can be enjoyable: Chores like cooking or gardening can be enjoyable or even hobbies, but in my ideal world, doing those is a deliberate choice, not something we have to do.
  • One-off solutions: Someone building a one-off in their garage, or spending a small fortune for a bespoke solution only has limited usefulness. Even if you enjoy building things (I do!), we just cannot build everything ourselves. What we’re looking for is off-the-shelf innovative products that are mass manufactured.
  • Outsourcing chores: i.e. hiring a housecleaner, ordering food, etc. This is definitely a solution, but it mostly just shifts the job to lower-income workers, which isn’t exactly ideal. For those of us who can afford it: fantastic. For those that can’t: not exactly utopia.

With that out of the way, let’s start dreaming about the smart home of the future. Starting with… Smart Housekeeping!

Smart Housekeeping 🧹

General tidying

Tidying can be tedious. Especially if you have young children, when it’s pretty much a continuous task. For years, we’ve been told this is being worked on - I’ve lost count of the number of demo, videos I’ve seen, of robots tidying up - yet it seems like no real world solution is coming anytime soon.

Understandably this is a complex problem, given the number of different items that need to be recognized and handled, let alone putting them in the right spot, in vastly different home layouts. Regardless, it would be cool and useful to see relaxed versions of this problem solved in real-world settings. For example, collecting kids/pet toys and sorting them in different piles.

While this is a high-level recruiting video, Dyson might be one of the few companies that can actually bring a tidying robot to the market over the next decade.

Robot Vacuums and Mops

*Confession*: we don’t personally own a robot vacuum or mop (we use a housecleaner). The internet tells me the Roborock S series (S8 Pro depicted) are among the best.
Enlarge

Confession: we don’t personally own a robot vacuum or mop (we use a housecleaner). The internet tells me the Roborock S series (S8 Pro depicted) are among the best.

Vacuuming and mopping seem like problems that are largely solved but need more fine-tuning. With the increased competition (the Roomba Reign days are long gone) and incremental improvements, I’m willing to bet that these robots will be close to flawless in a decade from now. Weird personal indulgence: Robot Vacuum reviews on the Vacuum Wars Youtube channel.

Cleaning: all the rest

Schematic mock-up of a robot cleaning station
Enlarge

Schematic mock-up of a robot cleaning station

But of course, tidying up and cleaning the floor is only a part of house cleaning, perhaps less than 50% of it. You still have to do general dusting and clean the toilet, windows, kitchen counter, fridge, shower, sinks, etc.

While some products exists such as Window Cleaning Robots and Toilet Cleaning Robots (another and another), most of them are still not great: making the work a little easier at best and being expensive gimmicks at worst.

Assuming those get better, robot vacuum towers might evolve in more generic cleaning stations that house additional robots and tools, charging and cleaning them:

  • A window cleaner robot
  • Tiny table/countertop robot vacuum and mop to clean the dinner table and kitchen counter
  • Ultrasonic cleaning unit: for cleaning and sterilizing small items (medical items, baby bottles, jewelry, etc)

An alternative approach is the further development of self-cleaning appliances and furniture. While some of those exists, like self-cleaning ovens, toilets, blenders with cleaning programs, or self-cleaning windows, my personal experience with these is a bit hit-and-miss. Despite this, self-cleaning is definitely trend in the right direction.

By combining smart cleaning robots with self cleaning devices, hopefully we can already cut down on cleaning tasks in the next decade or so. Any hour saved on a weekly basis is a big win in my book.

Laundry folding and storage 🧺

Beyond washing and drying

While washing machines and dryers do the bulk of the work; ironing, laundry folding and neatly putting everything back in the closet is still a manual job that takes hours per week in our family.

The Laundry Jet, this can’t be a good idea. Laundry getting stuck, loud vacuum noises, and who’s got the space and money to install something like this?

Attempts to automate more of this work (like Foldimate, now bankrupt) haven’t succeeded yet.

Perhaps washing machines should get additional drying, sorting and folding features. While the consensus on current washer-dryer combos seems to be that they’re worse than having separate machines (less capacity, worse cleaning/drying, energy inefficient, no parallel activity), this might be an acceptable trade-off if the entire process becomes set-and-forget.

A next-gen version might do sorting using AI and/or smart labels combined with a vaccuum system to place clothes in different bins.

Smart wardrobes 👕

A different angle to this problem is to have a smart wardrobes dewrinkle, (clean) and sort your clothes. Some of this already exists like the Samsung Airdresser or LG Styler, but those are expensive products with limited functionality.

A next-gen smart version of this could be much larger and deal with clothes sorting: dispensing 2 identical socks or some underwear after you’ve dumped a load of clean clothes in the smartrobe. Dewrinkling could happen slowly in a climate controlled chamber or at dispense time (1 min steaming cycle) - skipping pre-sorting and folding entirely for many clothing items.

Similarly, for dirty laundry it could pre-sort clothes by color and fabric. This would easily shave off an hour a week of laundry work! Sign me up :)

Schematic mock-up of a smart wardrobe that could sort and dispense clothes. Obviously this isn’t perfect (for one, it takes up a lot of space), but I’d be excited to see something like this be developed.
Enlarge

Schematic mock-up of a smart wardrobe that could sort and dispense clothes. Obviously this isn’t perfect (for one, it takes up a lot of space), but I’d be excited to see something like this be developed.

The all-in-one butler robot 🦾

Of course, the ultimate utopia is the single versatile robot that can do all chores. Like a real-world Rosey.

We’ve been teased with first-gen versions of this like Samsung’s Handy and Care robot and Amazon’s Astro bot, but it’s clear that these are still years away from being both generally available and able to do meaningful work.

For industrial use, the pace of innovation seems to be picking up, with Boston Dynamics’ famous series of robots (spot, stretch, atlas) and the more recent Tesla bot.

Tesla Bot development is exciting to follow - and it will surely advance the industry as a whole - but it won’t be doing your dishes at home any time soon. Also, these robots look eerily like those from I, Robot, let’s hope the outcome is not the same 🤖 😅.

I’m hopeful this will ultimately translate to butler robots in the home, but hope isn’t really a strategy. What we need is more people working on this problem: both professionals as well as hobby enthusiasts.

This requires lowering the bar dramatically. Even as an experienced software engineer and amateur electronics and home automation hobbyist, building a useful robot entirely from scratch is way above my skillset. It requires a unique skillset-blend consisting of hands-on electromechanics and state-of-the-art AI that few of us posses.

An Open Robotics Platform for the Home?

What we need is an Arduino or Home Assistant moment: an open source platform that dramatically simplifies getting started for enthusiasts.

Like a modular robot base model that easily can be bought or self-assembled and then has open interfaces for people to build on using accessories that can be purchased or self-assembled (using e.g. 3d printing).

Efforts like this most definitely exist, the internet is full of them (locobot + pyrobot, InMoovPoppy Project, the list goes on), but we’re missing:

  1. Convergence: momentum around one or a few projects
  2. Practicality: Something that’s not only a toy or educational tool
  3. Affordability: starting at max a few hundred EUR/USD
  4. Real-world use-case: universally useful in the home, simple yet exciting

Perhaps what we need is the likes of Home Assistant (ESP Home), Arduino and Raspberry Pi to more deliberately start expanding in this space.

Obviously that’s easier said than done - my arm-chair analysis isn’t really contributing to making it happen. But if one of those projects comes out with an official modular robotics platform that can do meaningful work, it would surely make some heads turn.

I've lost count of the amount of educational robot kits exists, like this neat [PiCar-X](https://docs.sunfounder.com/projects/picar-x/en/latest/) (based on a Raspberry Pi). These remain educational toys however, we need something that can do real work.
Enlarge

I’ve lost count of the amount of educational robot kits exists, like this neat PiCar-X (based on a Raspberry Pi). These remain educational toys however, we need something that can do real work.

Projects like OpenMower are super cool, but they are big time sinks and very task specific. While hopefully these projects thrive, we still need something more modular and general purpose.

The Next 10 years

This posts thumbnail image, generated by [DALLE-3](https://openai.com/dall-e-3) using the following prompt: *“A cozy living room filled with smart gadgets like voice-controlled lighting, automatic curtains, and a smart thermostat. There is a humanoid butler robot working. A man is sitting in the couche daydreaming. Use a photorealistic style”*
Enlarge

This posts thumbnail image, generated by DALLE-3 using the following prompt: “A cozy living room filled with smart gadgets like voice-controlled lighting, automatic curtains, and a smart thermostat. There is a humanoid butler robot working. A man is sitting in the couche daydreaming. Use a photorealistic style”

With a title like “Dreaming of the Ultimate Smarthome”, it should be clear that this is what we’re doing here: Dreaming.

Clearly solving these problems is difficult, otherwise they would’ve already been solved - there’s plenty of people that want this to happen and there’s plenty of money to be earned.

Yet, day dreaming, talking and researching about this stuff is one of my favorite things to do. Not so much about far out imaginations, because that misses the element of “coming soon” excitement. It’s the incremental changes that seem possible by integrating and moderately advancing existing technology that make me enthusiastic.

However, with all that’s happening, building them in the open is going to be critical. With the convergence of AI, smart appliances, the proliferation of (humanoid) robots and a grab bag of adjacent technology (e.g. 3D printing, AR/VR) - the platforms, frameworks and practices that will emerge in the next decade are likely to shape our future for long beyond that. We all benefit from those being 100% interoperable, extensible, inclusive and transparent. The only way that can happen is by using open source, open licenses, open community and open decision making. I’m here for it.

Next time: Smart Kitchen!

💡 Interested in Part 2? Follow me on X (twitter) or subscribe to my blog newsletter (only new post notifications, no spam - pinky promise!).