Voice assistants can build profiles of their users’ habits and preferences, but the consistency and accuracy of these profiles vary

Google, Microsoft and others have taken big steps towards error-free devices, hinting that quantum computers that solve real problems aren’t far away

Hurricane Helene hit a quartz mine in North Carolina that is key to global semiconductor production, which could impact the entire tech industry. Here is everything we know so far

In What's Next? Bill Gates digs into AI, climate, inequality, malaria and more. But the man looms too large for alternative solutions to emerge, says Bethan Ackerley

Gears just a few micrometres wide can be carved from silicon using a beam of electrons, enabling tiny robots or machines that could interact with human cells

Autonomous taxis are already operating on US streets, while Elon Musk has spent years promising a self-driving car and failing to deliver. The newly announced Tesla Cybercab is unlikely to change that

What happens if AI is trained to write choral music by feeding it a specially created vocal dataset? Moving new exhibition The Call tackles some thorny questions about AI and creativity – and stirs the soul with music

A new supercapacitor design that uses only water, clay and graphene could source material on Mars and be more sustainable and accessible than traditional batteries

A lithium-ion battery made from three droplets of hydrogel is the smallest soft battery of its kind – and it could be used in biocompatible and biodegradable implants

A specialised algorithm could help autonomous vehicles track hidden objects, such as a pedestrian, a bicycle or another vehicle concealed behind a parked car

Scientists used AI to transform tourist photos into a 3D digital map of Antarctic penguin colonies – even as researchers debate whether to harness or discourage tourism in this remote region

An off-the-shelf millimetre wave sensor can pick out the tiny vibrations made by a smartphone's speaker, enabling an AI model to transcribe the conversation, even at a distance in a noisy room

Just under 5 per cent of the Wikipedia pages in English that have been published since ChatGPT's release seem to include AI-written content

Oil and water can be separated efficiently by pumping the mixture through thin channels between two semipermeable membranes

A yachtsman who went missing at sea with his six-year-old daughter has revealed details of their ordeal.

He just can’t help it.

Can we trust whatever is going on with Becky Minkoff?

Gary Lineker is the longest-serving Match of the Day host since the BBC first aired the show in 1964.

Emma Raducanu struck a deal to return to one of her favourite tournaments.

Today, Boston Dynamics and the Toyota Research Institute (TRI) announced a new partnership “to accelerate the development of general-purpose humanoid robots utilizing TRI’s Large Behavior Models and Boston Dynamics’ Atlas robot.” Committing to working towards a general purpose robot may make this partnership sound like a every other commercial humanoid company right now, but that’s not at all that’s going on here: BD and TRI are talking about fundamental robotics research, focusing on hard problems, and (most importantly) sharing the results.

The broader context here is that Boston Dynamics has an exceptionally capable humanoid platform capable of advanced and occasionally painful-looking whole-body motion behaviors along with some relatively basic and brute force-y manipulation. Meanwhile, TRI has been working for quite a while on developing AI-based learning techniques to tackle a variety of complicated manipulation challenges. TRI is working toward what they’re calling large behavior models (LBMs), which you can think of as analogous to large language models (LLMs), except for robots doing useful stuff in the physical world. The appeal of this partnership is pretty clear: Boston Dynamics gets new useful capabilities for Atlas, while TRI gets Atlas to explore new useful capabilities on.

Here’s a bit more from the press release:

The project is designed to leverage the strengths and expertise of each partner equally. The physical capabilities of the new electric Atlas robot, coupled with the ability to programmatically command and teleoperate a broad range of whole-body bimanual manipulation behaviors, will allow research teams to deploy the robot across a range of tasks and collect data on its performance. This data will, in turn, be used to support the training of advanced LBMs, utilizing rigorous hardware and simulation evaluation to demonstrate that large, pre-trained models can enable the rapid acquisition of new robust, dexterous, whole-body skills.

The joint team will also conduct research to answer fundamental training questions for humanoid robots, the ability of research models to leverage whole-body sensing, and understanding human-robot interaction and safety/assurance cases to support these new capabilities.

For more details, we spoke with Scott Kuindersma (Senior Director of Robotics Research at Boston Dynamics) and Russ Tedrake (VP of Robotics Research at TRI).

How did this partnership happen?

Russ Tedrake: We have a ton of respect for the Boston Dynamics team and what they’ve done, not only in terms of the hardware, but also the controller on Atlas. They’ve been growing their machine learning effort as we’ve been working more and more on the machine learning side. On TRI’s side, we’re seeing the limits of what you can do in tabletop manipulation, and we want to explore beyond that.

Scott Kuindersma: The combination skills and tools that TRI brings the table with the existing platform capabilities we have at Boston Dynamics, in addition to the machine learning teams we’ve been building up for the last couple years, put us in a really great position to hit the ground running together and do some pretty amazing stuff with Atlas.

What will your approach be to communicating your work, especially in the context of all the craziness around humanoids right now?

Tedrake: There’s a ton of pressure right now to do something new and incredible every six months or so. In some ways, it’s healthy for the field to have that much energy and enthusiasm and ambition. But I also think that there are people in the field that are coming around to appreciate the slightly longer and deeper view of understanding what works and what doesn’t, so we do have to balance that.

The other thing that I’d say is that there’s so much hype out there. I am incredibly excited about the promise of all this new capability; I just want to make sure that as we’re pushing the science forward, we’re being also honest and transparent about how well it’s working.

Kuindersma: It’s not lost on either of our organizations that this is maybe one of the most exciting points in the history of robotics, but there’s still a tremendous amount of work to do.

What are some of the challenges that your partnership will be uniquely capable of solving?

Kuindersma: One of the things that we’re both really excited about is the scope of behaviors that are possible with humanoids—a humanoid robot is much more than a pair of grippers on a mobile base. I think the opportunity to explore the full behavioral capability space of humanoids is probably something that we’re uniquely positioned to do right now because of the historical work that we’ve done at Boston Dynamics. Atlas is a very physically capable robot—the most capable humanoid we’ve ever built. And the platform software that we have allows for things like data collection for whole body manipulation to be about as easy as it is anywhere in the world.

Tedrake: In my mind, we really have opened up a brand new science—there’s a new set of basic questions that need answering. Robotics has come into this era of big science where it takes a big team and a big budget and strong collaborators to basically build the massive data sets and train the models to be in a position to ask these fundamental questions.

Fundamental questions like what?

Tedrake: Nobody has the beginnings of an idea of what the right training mixture is for humanoids. Like, we want to do pre-training with language, that’s way better, but how early do we introduce vision? How early do we introduce actions? Nobody knows. What’s the right curriculum of tasks? Do we want some easy tasks where we get greater than zero performance right out of the box? Probably. Do we also want some really complicated tasks? Probably. We want to be just in the home? Just in the factory? What’s the right mixture? Do we want backflips? I don’t know. We have to figure it out.

There are more questions too, like whether we have enough data on the Internet to train robots, and how we could mix and transfer capabilities from Internet data sets into robotics. Is robot data fundamentally different than other data? Should we expect the same scaling laws? Should we expect the same long-term capabilities?

The other big one that you’ll hear the experts talk about is evaluation, which is a major bottleneck. If you look at some of these papers that show incredible results, the statistical strength of their results section is very weak and consequently we’re making a lot of claims about things that we don’t really have a lot of basis for. It will take a lot of engineering work to carefully build up empirical strength in our results. I think evaluation doesn’t get enough attention.

What has changed in robotics research in the last year or so that you think has enabled the kind of progress that you’re hoping to achieve?

Kuindersma: From my perspective, there are two high-level things that have changed how I’ve thought about work in this space. One is the convergence of the field around repeatable processes for training manipulation skills through demonstrations. The pioneering work of diffusion policy (which TRI was a big part of) is a really powerful thing—it takes the process of generating manipulation skills that previously were basically unfathomable, and turned it into something where you just collect a bunch of data, you train it on an architecture that’s more or less stable at this point, and you get a result.

The second thing is everything that’s happened in robotics-adjacent areas of AI showing that data scale and diversity are really the keys to generalizable behavior. We expect that to also be true for robotics. And so taking these two things together, it makes the path really clear, but I still think there are a ton of open research challenges and questions that we need to answer.

Do you think that simulation is an effective way of scaling data for robotics?

Tedrake: I think generally people underestimate simulation. The work we’ve been doing has made me very optimistic about the capabilities of simulation as long as you use it wisely. Focusing on a specific robot doing a specific task is asking the wrong question; you need to get the distribution of tasks and performance in simulation to be predictive of the distribution of tasks and performance in the real world. There are some things that are still hard to simulate well, but even when it comes to frictional contact and stuff like that, I think we’re getting pretty good at this point.

Is there a commercial future for this partnership that you’re able to talk about?

Kuindersma: For Boston Dynamics, clearly we think there’s long-term commercial value in this work, and that’s one of the main reasons why we want to invest in it. But the purpose of this collaboration is really about fundamental research—making sure that we do the work, advance the science, and do it in a rigorous enough way so that we actually understand and trust the results and we can communicate that out to the world. So yes, we see tremendous value in this commercially. Yes, we are commercializing Atlas, but this project is really about fundamental research.

What happens next?

Tedrake: There are questions at the intersection of things that BD has done and things that TRI has done that we need to do together to start, and that’ll get things going. And then we have big ambitions—getting a generalist capability that we’re calling LBM (large behavior models) running on Atlas is the goal. In the first year we’re trying to focus on these fundamental questions, push boundaries, and write and publish papers.

I want people to be excited about watching for our results, and I want people to trust our results when they see them. For me, that’s the most important message for the robotics community: Through this partnership we’re trying to take a longer view that balances our extreme optimism with being critical in our approach.

Simone Giertz came to fame in the 2010s by becoming the self-proclaimed “queen of shitty robots.” On YouTube she demonstrated a hilarious series of self-built mechanized devices that worked perfectly for ridiculous applications, such as a headboard-mounted alarm clock with a rubber hand to slap the user awake.

But Giertz has parlayed her Internet renown into Yetch, a design company that makes commercial consumer products. (The company name comes from how Giertz’s Swedish name is properly pronounced.) Her first release, a daily habit-tracking calendar, was picked up by prestigious outlets such as the Museum of Modern Art design store in New York City. She has continued to make commercial products since, as well as one-off strange inventions for her online audience.

Where did the motivation for your useless robots come from?

Simone Giertz: I just thought that robots that failed were really funny. It was also a way for me to get out of creating from a place of performance anxiety and perfection. Because if you set out to do something that fails, that gives you a lot of creative freedom.

You built up a big online following. A lot of people would be happy with that level of success. But you moved into inventing commercial products. Why?

Giertz: I like torturing myself, I guess! I’d been creating things for YouTube and for social media for a long time. I wanted to try something new and also find longevity in my career. I’m not super motivated to constantly try to get people to give me attention. That doesn’t feel like a very good value to strive for. So I was like, “Okay, what do I want to do for the rest of my career?” And developing products is something that I’ve always been really, really interested in. And yeah, it is tough, but I’m so happy to be doing it. I’m enjoying it thoroughly, as much as there’s a lot of face-palm moments.

Giertz’s every day goal calendar was picked up by the Museum of Modern Art’s design store. Yetch

What role does failure play in your invention process?

Giertz: I think it’s inevitable. Before, obviously, I wanted something that failed in the most unexpected or fun way possible. And now when I’m developing products, it’s still a part of it. You make so many different versions of something and each one fails because of something. But then, hopefully, what happens is that you get smaller and smaller failures. Product development feels like you’re going in circles, but you’re actually going in a spiral because the circles are taking you somewhere.

What advice do you have for aspiring inventors?

Giertz: Make things that you want. A lot of people make things that they think that other people want, but the main target audience, at least for myself, is me. I trust that if I find something interesting, there are probably other people who do too. And then just find good people to work with and collaborate with. There is no such thing as the lonely genius, I think. I’ve worked with a lot of different people and some people made me really nervous and anxious. And some people, it just went easy and we had a great time. You’re just like, “Oh, what if we do this? What if we do this?” Find those people.

This article appears in the November 2024 print issue as “The Queen of Useless Robots.”

Maryland's new education chief, Carey Wright, an old-school champion of rigorous standards, is pushing back against efforts in other states to boost test scores by essentially lowering their exp

Donald Trump will embrace the truth Joe Biden has refused to countenance: Israel's enemies are America's enemies. And when Israel defeats its enemies, America wins.

To restore the rule of law, Trump's Department of Justice must investigate those who subverted our constitutional order.

Hours after Donald Trump wins the most conclusive mandate in 40 years, Mitch McConnell engineers a coup against his agenda by calling early leadership elections in the senate.

Most people work just hard enough not to get fired and get paid just enough money not to quit. -George Carlin Every four years, presidential opinion polling reliably causes regime media to misplace...

It's hard to imagine opposing Trump's proposal. Who would want to help murderers and drug dealers who entered the country illegally remain in the United States?

Even though that perception is partly the creation of right-wing media, the Democrats surely need to hone their identity.

Other Democrats lambasted him. The Tufts political science department spurned him. But Moulton is raising concerns the left needs to take seriously.

November and December will nominally be about confirming judges and kicking the can on must-pass bills. More ambitious efforts probably aren't happening.

My home state, the Garden State, is angry mercurial, and Trump came frighteningly close to winning there a week ago.

The election is over and the economy had a huge impact. An AP analysis said 96% of those surveyed admitted that prices of gas and groceries had an influence on their vote.

From Goats to airplanes, Xbox Game Pass has another bumper month in store for subscribers. Here's everything you need to know about what is heading to PC and console this November 2024

Aside from offering a more powerful console, the PS5 Pro also packs a sneaky theme for PlayStation fans to uncover - something Sony hadn't previously discussed.

Death Stranding, originally launched in 2019, has finally come to Xbox consoles five years after its initial debut as a Director's Cut version from Hideo Kojima.

PlayStation 5 Pro is out, and with plenty of availability, scalpers are shifting the £700 console at a loss and turning their attention to a key accessory instead

Black Ops 6 is here, and fans have been itching to know what's included in Season 1 - and now we have an answer. Here's what's included, and when you can play

Call of Duty fans are impressed by Black Ops 6 Season 1 already, calling it the 'best Season 1 roadmap' since 2019's Modern Warfare reboot and you can find out below why they're saying it

The Pokemon Company is teaming up with content creators to stage a 24-hour unboxing live stream for its new Scarlet & Violet - Surging Sparks card set as you Gotta Catch 'Em All

Overwatch 2 is bringing 6v6 gameplay back from Overwatch 1 - and fans are overjoyed. Here's all we know so far, including when you can finally play the Classic mode

Fortnite fans are going wild after Epic Games announced it's bringing back the original version of its battle royale as Fortnite OG as a permanent addition to the game.

Comet Nishimura (C/2023 P1) was discovered in August and is now whizzing by Earth, but finding it in the sky will be a challenge.

Fisheries and Oceans Canada whale researchers recently spotted one of the largest pods of orca whales ever reported off the coast of Newfoundland and Labrador.

Certain strains of E. coli are capable of causing severe disease, by rapidly spreading through the human digestive system, wreaking havoc throughout the bloodstream, and eventually damaging the delicate kidneys. That's the situation right now during a large outbreak in Alberta, with hundreds of children now affected.

NASA said Thursday that the study of UFOs will require new scientific techniques, including advanced satellites as well as a shift in how unexplained sightings are perceived.

In this week's issue of our environment newsletter, we look at the carbon capture potential of the world's oceans and what effect beavers are having in the Arctic (spoiler: it's not good).

As artificial intelligence becomes more common in university classrooms, some professors are weighing the benefits — and downsides — of students using it for research projects.

A biologist at Cape Breton University is hoping a piece of technology used to keep people safe in the pandemic can help protect Nova Scotia's oysters against the effects of warming waters.

The Tablelands in Gros Morne National Park, a UNESCO World Heritage Site, is one of the most unique landscapes in the world — and its orange peridotite rocks could hold the secret to finding life on Mars.

President-elect Donald Trump has announced that he will nominate former Arkansas Gov. Mike Huckabee to be the U.S. ambassador to Israel.