Skip to content
A coarsely pixelated head and shoulders in profile, in greys with a few blue squares, on black

Avatars for everything

How the future of work could be a mix of gaming and robotics

America desperately needs 1 million more construction workers. In the rest of the world, this problem is even more significant.

The incentives to work in the construction industry are disappearing as low-skill service jobs grow (Uber driving, food delivery and the rest). These low-skill jobs are already competing with construction. That's because construction is among the most dangerous jobs: in the United States it accounts for about one in five deaths at work. This trend will only continue.

As we saw at the Qatar World Cup, the construction industry is filled with abusive employment conditions and even slavery. However, the construction industry is essential for civilization to flourish. We must consistently renew homes, build new ones, improve infrastructure, and build in dangerous environments. And currently, the only direction for the market seems to be the increase in prices of all construction.

The construction industry is just an example of a more significant trend. The same can be said for agriculture, policing and security, piloting aircraft, care, nursing, and so on.

However, humanity in the 21st century lives in a strange case of an overabundance of skills. Even as we speak in the western world, vast numbers of highly trained people do not apply their abilities in real life but use them in virtual worlds. Malcolm Gladwell's 10k hour principle means that after 10k hours of doing something, you will likely be a master at it. And millions around the world have played much more than 10k hours in games and sims.

If only these skills could be harvested and focused on real-life problems.

Let's look at the construction worker gap problem.

What if we could have an immersive virtual environment where people would be building in real life? Here's what you would need:

  1. Players would need a high bandwidth connection (which people already have to play their multiplayer games).
  2. They would need interfaces (such as Virtual Reality controls).
  3. They would need a physical presence on the construction site.

Of course, the first two requirements are already here. What's missing is number 3. Where could we start developing point 3? In a way, this type of solution has already been worked on in the past, but in an entirely different field: surgery.

Intuitive's da Vinci robot lets a surgeon work from a console in the operating room, moving instruments inside the patient, and the US FDA cleared it for general laparoscopic surgery in 2000. Surgeons have also operated across an ocean: in 2001, surgeons in New York removed a patient's gallbladder in Strasbourg with the ZEUS robot from Computer Motion, a company that merged with Intuitive in 2003.

A surgeon in scrubs at the da Vinci Xi console, hands on its controls, with the draped robot arms over the patient behind
A da Vinci robot being tele-operated by a trained surgeon. Image: Intuitive.
The tip of a single-port surgical probe: three thin black instrument arms with small grippers and a camera head splaying out of a steel tube
The da Vinci SP probe, with 3 arms and one stereoscopic head with lighting. Image: Intuitive.

The design of the da Vinci probe is quite ingenious. Imagine if we could apply it to real-life construction scenarios. You would need to:

  • Scale up the robot.
  • Increase its power significantly.
  • Make it compatible with existing construction machinery.
  • Keep prices in the same range as existing construction machinery.
Sketch of a grey and blue humanoid robot using a hand tool that throws sparks, lettered NODANGER and ALWAYS READY, with notes for a wider HDR camera and a fire, radiation, water, dust and temperature resistant fabric
A remote avatar bot, soldering. Drawn on iPad Pro.
Sketch of the robot in two states: a collapsed box, and an expanded body with retractable arms, exchangeable manipulators, binocular cameras and floodlights
Concept study of the deployment of a da Vinci-inspired construction robot. Drawn on iPad Pro.
Sketch of a long robot arm on a wheeled base labelled attach to lifts, and a small one on a cart labelled attach to cars
First iteration of the Avatar bot would not have legs but would be attached to existing cranes and other equipment. This would simplify development. Drawn on iPad Pro.
Sketch of a curved grey and blue robot neck ending in a camera head with two lenses, annotated 180° x 180° virtual line of sight, better camera concept and immersive tele operations
Avatar bot's head with stereoscopic 8k vision, lighting, heat and moisture sensors. Drawn on iPad Pro.

The robot would begin by having the same proportions as real humans. Giving it human-sized arms and hands would make it compatible with existing construction sites, tools, and conditions.

The timeline would likely go as follows:

  1. The robot would perform on-site construction being piloted by an expert nearby.
  2. Access to the robot remotely would be developed so that experts could pilot it in remote and dangerous locations.
  3. Opening access to a play-to-earn marketplace, where anyone could sell their hours of operating the robot in exchange for actual earnings. After 10k hours of playing, anyone online would likely be an expert in building homes, high-rises, overpasses, underwater ducts, etc.

Instead of risking injury and death on construction sites, individuals could operate the robots from the safety of their own homes. It would also provide a new way for individuals to use their skills and passion for gaming to earn a living.

Implementation of this solution would require a partnership between startups and existing construction companies. Startups would develop and scale the robots, while construction companies would provide the funding and resources. Both parties would also develop the training and certification programs for the people who operate the robots, which could be done using virtual simulations of the robot.

In terms of business models:

  • Primary monetization through a play-to-earn marketplace, where individuals could sell their hours of operating the robots for actual earnings.
  • Construction companies could be charged for using the robots, potentially at a lower rate than traditional construction labor.

From a financial perspective, this solution has the potential to save construction companies significant amounts of money in labor costs. It would also provide a new revenue stream for startups and individuals operating the robots.

The path to complete automation

Eventually, the robot would learn from its human pilots and operate autonomously, allowing for even more efficient and cost-effective construction.

Working in unpredictable environments is a very complex task to train robotic AIs. By copying humans, the learning speeds of these bots would grow exponentially.

A yellow and black striped construction robot with several arms working among steel scaffolding and rebar, sparks flying
Avatar 2 Construction bot that can "assemble any building in 30 days". Still from Avatar: The Way of Water, 20th Century Studios.
A weathered yellow robot with a helmet-like head, round camera eyes and cables at its neck, a blurred building behind
Robotic humanoid construction worker. AI generated, Midjourney.
A rusted yellow and grey robot with a visor and a cluster of camera lenses on its head, a worker in a blue hard hat blurred behind
Robotic humanoid construction worker. AI generated, Midjourney.
A rusted yellow tracked excavator-like robot with exposed wiring and a bucket, standing on rubble between dark buildings
Robotic caterpillar drone. AI generated, Midjourney.

Before AI for construction is fully formed, Avatar bots can be deployed, and not only dwell in construction sites but especially in dangerous environments where human-level skills are needed.

However the question remains: is it worth developing these avatars at all, as they will be unnecessary when automated construction robots are developed?


Examples of companies working in construction robots

Company NameDescriptionProductsCountry
ABB RoboticsOne of the world’s leading robotics and machine automation suppliers.N/ASwitzerland
Advanced Construction RoboticsBuilds autonomous robots that tie and place rebar on bridge decks.TyBOT, the autonomous rebar-tying robot, and IronBOT, a rebar-placing robotUSA
Align RoboticsAn Australian robotics company established in 2017.AutoMARK and TerraMARKAustralia
ANYbotics AGServes industrial operators with automated robotic inspections to support their efforts in monitoring and maintaining their plants.ANYmal robotSwitzerland
Baubot GmbHDevelops fully mobile robotic systems for construction sites, for tasks such as drilling, grinding, and welding.BAUBOT MRS5 and BAUBOT MRS12Austria
BimprinterDevelops full robotic high definition plotters for tracing at laser millimeter accuracy.BIMPRINTER®Belgium
Blue Ocean RoboticsDevelops, produces, and sells professional service robots primarily in healthcare, hospitality, construction and agriculture.UVD Robots, GoBe Robots, PTR Robots, etc.Denmark
Boston DynamicsDevelops a mobile robot designed for sensing, inspection, and remote operation.SpotUSA
Brokk ABProduces electric demolition robots with a three-part arm system and powerful attachments.Brokk 110, Brokk 170, and Brokk 200Sweden
Built RoboticsDevelops autonomous construction equipment technology.N/AUSA
Conjet ABSpecializes in hydrodemolition equipment and robotic solutions.ACR hydrodemolition robots (7-Series)Sweden
Fastbrick RoboticsDevelops robotic bricklaying technology.Hadrian XAustralia
KUKA AGOne of the world's leading suppliers of robots and automation systems.Industrial and collaborative robotsGermany
Manitou GroupProduces construction equipment and specializes in telehandler technology.Telehandlers and autonomous warehouse handling machines developed with EffidenceFrance
RCTProvides automation and remote control solutions for mobile equipment in the mining and construction industries.ControlMaster remote control and automation systemsAustralia
Trimble Inc.A provider of advanced positioning solutions for construction, surveying, and agriculture.Robotic total stationsUSA
Topcon Positioning SystemsProvider of advanced positioning technology for construction, surveying, and agriculture.Robotic total stationsUSA
VTT Technical Research Centre of FinlandA multidisciplinary research organization that specializes in developing and applying advanced technologies for various industries, including construction.N/AFinland
Yaskawa Europe GmbHA leading supplier of robotics and automation systems for various industries, including construction.MOTOMAN robotsGermany
ZenRoboticsDevelops and manufactures robotic systems for recycling and waste management, including construction waste.Heavy Picker and Fast PickerFinland

References

  1. Gladwell, M. (2008). Outliers: The Story of Success. Little, Brown and Company.
  2. Intuitive Surgical, da Vinci surgical systems. intuitive.com
  3. National Safety Council, work-to-zero hazards in construction and installation. nsc.org
  4. World Bank (2019). World Development Report 2019: The Changing Nature of Work. worldbank.org
  5. "America desperately needs 1 million more construction workers", CNN Business, 8 July 2021. edition.cnn.com
  6. KPMG (2016). Employees: an endangered species? assets.kpmg
  7. International Labour Organization, migrant work and recruitment in construction. ilo.org
A render of the Sun rising over the Earth's limb, seen from orbit, with city lights on the night side

Let’s talk

I take 20-minute calls on weekdays, 09:30 to 18:00 in Lisbon. Pick a day and an hour.

Book 20 min