Autonomous drone defeats human champions in racing first (tudelft.nl)

344 points by picture 2 days ago

bri3d 2 days ago

This is quite cool since past efforts in this direction have usually relied on crutches like outside-in imaging and positioning.

A few details I picked up:

* The drones are a spec drone across the league. It's a fairly large-footprint FPV racing drone (it's a 5" propped drone, but it's very stretched out and quite heavy) with both a Betaflight flight controller and a Jetson Orin NX onboard. Teams were only allowed an IMU and a single forward camera.

* It's unclear to me whether the teams were allowed to bypass the typical Betaflight flight controller which is present on the drone and use direct IMU input and ESC commands from the Jetson, or whether they were sending and receiving commands from the flight controller and relying on its onboard rate stabilization PID loop.

DCL is kind of a weird drone racing league since it's made for TV; it's mostly simulator based with, more recently, only few real events a year. The spec DCL drone isn't very capable compared to the more open-specification drones in racing leagues like MultiGP, in large part to keep the events more spectator friendly. This probably makes it more amenable to AI, which is an interesting side effect.

generalizations 2 days ago

From near the bottom:

> One of the core new elements of the drone’s AI is the use of a deep neural network that doesn’t send control commands to a traditional human controller, but directly to the motors.

bri3d 2 days ago

I saw that too - I'm assuming it means they're indeed using the DNN for stabilization. This has been done several times over the years, but generally with results which only rival PID and don't surpass it, so that's quite interesting. What's odd is that the physical architecture of the drone doesn't really make sense for this, so there must be some tweaks beyond the "spec" model. Hopefully some papers come soon instead of press releases.

sorenjan a day ago

koolala 2 days ago

HenryBemis 2 days ago

I assume that they shave off milliseconds by doing so, and a gyroscope (or similar) sends back the position/angle of the drone. And like this does it bypass the 'limited' onboard computer and instead uses a much better/faster computer?

pjc50 a day ago

itishappy 2 days ago

There's a few more details in the press release from the league itself. Sounds like they were really trying to put these things through their paces.

> The course design pushed the boundaries of perception-based autonomy—featuring wide gate spacing, irregular lighting, and minimal visual markers. The use of rolling shutter cameras further heightened the difficulty, testing each team’s ability to deliver fast, stable performance under demanding conditions

https://a2rl.io/press-release/9/artificial-intelligence-triu...

pacetest a day ago

It used a small RL trained network running on the flight controllers MCU directly that controlled the motors given state (position, orientation ...) inputs. The Jetson handled vision processing.

NegativeLatency 2 days ago

I imagine the slower speed is a closer fit to combat drones (which have a payload and sometimes a fiber optic cable)? Also watching MultiGP they sorta move/accelerate too fast for me to fully appreciate the maneuvering.

Feels kinda similar to the innovation around manned aircraft about 100 years ago when we went from toy/observation platform to killing machine in only a couple of decades. With the ardupilot news today, it was hard to not watch this and imagine the applications to a combat environment.

close04 a day ago

> which have a payload and sometimes a fiber optic cable

The optic cable is for the human pilot. An AI piloted drone doesn't need it.

akie a day ago

closewith a day ago

Aurornis 2 days ago

> I imagine the slower speed is a closer fit to combat drones

A lot of comments are trying to draw connections to combat drones, but drone racing like this has been a hobby thing for a long time. The capabilities of the drones are set to have an even playing field, not to match combat drones or anything.

These aren't meant to have any parallels to combat drones, drones that fly long distances, or drones that carry payloads.

It's really just a special-purpose hobby thing for flying through a series of gates very quickly. Flight time measured in a couple minutes, no provisions for carrying weight.

david-gpu a day ago

wepple a day ago

> The spec DCL drone isn't very capable compared to the more open-specification drones in racing leagues like MultiGP

Yeah, I’m sure this is a great milestone but it isn’t notable until AI is beating MCK[1] who would be the “Lee Sodol of FPV”

[1] https://youtu.be/fmc1URVdyUs?si=jPPx5sHjU_ZDOghF

durandal1 a day ago

Also, this track looks nothing like a competitive drone race track, the obstacles are easier and it seems designed to cater to the autonomous drones.

bri3d a day ago

It’s DCL, they’re all kind of poor like this IMO. Certainly nothing like MultiGP

undefined a day ago

[deleted]

walrus01 14 hours ago

> which is present on the drone and use direct IMU input and ESC commands from the Jetson

Does the jetson board even have the appropriate UARTs on it to talk directly to the ESCs? Your typical hobby grade 5" class size ESC (either 4-in-1 or discrete) cannot talk to two different controllers at the same time. If it's already wired to the four UART outputs from a 30x30 size flight controller (such as something STM32H7 based running betaflight), the ESC cannot be in communication with any other device.

jandrese 2 days ago

This is only a few days after the massive drone attack in Russia. Only a matter of time until we have drones smart enough to dodge bullets (or at least dodge out of where guns are pointing) while flying at breakneck speeds being controlled by AIs we don't fully understand.

The tech industry is working hard to bring about the Terminator future.

allturtles 2 days ago

“What hope can there be for mankind,” I thought, “when there are such men as Felix Hoenikker to give such playthings as ice-nine to such short-sighted children as almost all men and women are?”

And I remembered The Fourteenth Book of Bokonon, which I had read in its entirety the night before. The Fourteenth Book is entitled, “What Can a Thoughtful Man Hope for Mankind on Earth, Given the Experience of the Past Million Years?”

It doesn’t take long to read The Fourteenth Book. It consists of one word and a period.

This is it:

“Nothing.”

--Kurt Vonnegut, Cat's Cradle

fsloth a day ago

Vonnegut’s bleakness is not theoretical which gives it a specific bite. As POV Vonnegut cleaned up the shriveled remains of civilian victims of firebombing.

randomtoast a day ago

And Great Britain just announced plans to deliver 100,000 of them to Ukraine. Ukraine lacks the manpower compared to Russia. It seems logical to strengthen their forces by deploying these flying mini terminators. I believe we are not far from large-scale drone warfare. In World War II, we had epic tank and aircraft battles; now, the time has come for autonomous drone battlefields.

pjc50 a day ago

Missed that news; https://www.reuters.com/business/aerospace-defense/britain-p...

I think we're already deep into large-scale drone warfare. Destroying a third of the enemy heavy bomber fleet is pretty substantial. It feels to me like that attack operated like Pearl Harbor, a marker that the old way of surface naval warfare / air attack was being replaced by a new one.

Don't forget that Russia has their own drones. They were the first to deploy the fiber-optic cable drones as an anti-ECM measure. And of course both sides are ordering parts from China.

londons_explore 6 hours ago

IshKebab 19 hours ago

gusfoo a day ago

The UK has also released some details of a new 'in bulk' RF-based drone takedown DEW. https://www.youtube.com/watch?v=F1vY5efYXMQ

ponector 17 hours ago

100k kamikaze drones are not that many for the current stage of war. Millions are consumed annually.

londons_explore 6 hours ago

jajko a day ago

[flagged]

MetaWhirledPeas a day ago

NoOn3 21 hours ago

bluealienpie 12 hours ago

That future arrived years ago. Now it's targeting journalists, women and children. Ukraine is just doing it at a lower cost.

https://www.youtube.com/watch?v=WCfv79C_-I0

greenavocado a day ago

Let's review what Uncle Ted had to say about this.

See paragraph 87 by searching for "THE MOTIVES OF SCIENTISTS"

https://dn790000.ca.archive.org/0/items/IndustrialSocietyAnd...

cess11 20 hours ago

The conclusion is succinct and the stuff leading up to it of dubious quality.

"92. Thus science marches on blindly, without regard to the real welfare of the human race or to any other standard, obedient only to the psychological needs of the scientists and of the government officials and corporation executives who provide the funds for research."

nothrabannosir 2 days ago

Obligatory link to the short film (future documentary) “Slaughterbots” (2017), which depicts exactly this in harrowing detail:

https://www.youtube.com/watch?v=O-2tpwW0kmU

insane_dreamer 2 days ago

This is portrayed in Ministry for the Future which describes AI controlled swarms of small drones/bombs that fly apart and come together at their target and are almost impossible to stop.

chrisweekly 2 days ago

Fantastic book, highly recommended.

Taek 2 days ago

undefined 2 days ago

[deleted]

trhway 2 days ago

>drones smart enough to dodge bullets

well, there will be similarly smart "predator"/defense drones. The humans will have no chances on such a battlefield populated by thousands drones per square kilometer fighting each other.

>The tech industry is working hard to bring about the Terminator future.

And i think removing people from the battlefield is a good thing.

>or at least dodge out of where guns are pointing

just a bit of arithmetic comparing new weapons - drones vs. classic guns. Say a radar guided gun takes 1 sec. to train onto a drone and shoot several bullets. The range is max 3 km (an expensive 20mm-30mm autocannon like Pantsir) - 35 seconds for a 200 miles/hour drone. Thus all it takes is maximum 36 such drones coming simultaneously from all the directions to take out that gun. At less than $1000/drone it is many times cheaper than that radar guided gun. (and that without accounting for the drones coming in very low and hiding behind trees, hills, etc and without the first drones interfering with the radar say by dropping a foil chaff clouds, etc.) It is basically a very typical paradigm shift from vertical scaling to horizontal scaling by way of software orchestrated cheap components.

dragonwriter 20 hours ago

> And i think removing people from the battlefield is a good thing.

Drones don't remove people from the battlefield, they further the trend of there being no boundary to "the battlefield", putting everyone on it.

They can, depending on how they are employed, reduce the casualties (total and particularly civilian) on both sides of a conflict for any degree of military impact (Ukraine's recent strike against Russian bombers is an example), or they can increase the civilian death toll for marginal military impact (the accounts of Israeli gun- and missile-armed drones directly targeting civilians in Gaza being an example of what that could look like.)

speeder 4 hours ago

impossiblefork 2 days ago

>And i think removing people from the battlefield is a good thing.

It is very dangerous, since it will mean that an organization with enough drones can dominate society on its own. Much better if humans were battlefield-relevant.

trhway 2 days ago

MangoToupe 2 days ago

throwaway2037 11 hours ago

About your last paragraph: High level, I generally agree, but when you dive deeper to look at the numbers, I doubt that you can have 1000 USD drones that can fly at 200 mph/320 km/h. One quarter of that speed, I could believe.

05 5 hours ago

trhway 10 hours ago

cess11 20 hours ago

"And i think removing people from the battlefield is a good thing."

You're mistaking the removal of certain soldiers for "removing people". There will absolutely be people in future battle fields, mainly civilians, or as we call them now, terrorists.

paganel a day ago

> And i think removing people from the battlefield is a good thing.

I agree with your other points, but this only helps with (physically) extending the battlefield, at least going by the current war in Ukraine. It's not only the line of contact that is now part of the battlefield, there's also a band of 10-15 kilometres (if not more) on each side which is now part of the active battlefield because of the use of drones.

Even though I have to admit that it looks like the very big power asymmetry in favour of cheap drones over almost everything that moves down bellow (from mere soldiers on foot to armoured vehicles) has helped with actually decreasing the number of total casualties (just one of the many paradoxes of war), as it is now way too risky to get out in the open so soldiers do it way less compared with the pre-drone era.

gattr a day ago

I agree, but I'm a bit disappointed it will probably come to this, instead of having a mano a mano like in the movie "Robot Jox".

pjc50 a day ago

GenshoTikamura a day ago

[dead]

energy123 a day ago

All hard countered by a laser like the Iron Beam, no? Unless there's a hard counter to the hard counter?

pjc50 a day ago

Combined arms is the probable solution for a Ukraine type war. As soon as your expensive laser lights up, it's got a couple of minutes to move before artillery shells arrive.

Of course deeper into Russia that's safe .. but instead you have the problem of a huge area to cover. You can protect a few high value targets but not everywhere. Consider something like the early stages of the Iraq war: target every single civilian electrical substation and petrol station with a drone bombing.

Lu2025 19 hours ago

Cthulhu_ a day ago

Yeah, an artillery strike, a smoke screen, or fog. I'm also reading the target needs to be stationary or its movements predictable; unpredictable evasive maneuvers should be easy enough to implement (at the cost of speed/range). Plus there's the cost of the device itself, while it says it costs $3 per shot, it's still an (up to) 100 kw device + sensors + power supply setup. It doesn't say how much the system itself costs or its maintenance.

wongarsu a day ago

worldsayshi a day ago

The obvious counter to a laser could be 'more drones'? And maybe just have the drones sneak up close to the ground.

lolc a day ago

arrowsmith a day ago

The problem is the asymmetry. Drones are cheap, can be produced in huge numbers, and can be deployed anywhere by anyone. You can't put laser defences on every target, and the best laser defence could still be overwhelmed by a sufficient number of drones.

I am fucking terrified of drones.

asdff 21 hours ago

lazide a day ago

a laser needs a line of sight and dwell time. drones flying 3 ft off the ground, in between bushes and trees, at 100+ mph? not an easy situation.

ramp up power levels so dwell time might only be 1/2 second? maybe. but then there is a race for rapid target discrimination. and then ablative armor on the drones (cheap and easy to 3d print), and backup cameras, etc.

grues-dinner 2 hours ago

Cthulhu_ a day ago

GuinansEyebrows 2 days ago

yeesh. i made this comparison once and HN told me that campy action movies are bad to base policy on :\

spaceman_2020 2 days ago

Some of this stuff is getting to the point where we will seriously need to have a global talk on whether we should put a pin in this tech or not

tonyarkles 2 days ago

The child comments from yours are mentioning nuclear weapons as a parallel but there's one big difference between drone tech and nuclear weapons: plutonium is really hard to make.

We might be able to put a pin in this tech from a policy perspective, but the cat is way out of the bag as far as the tech goes. A cell phone already has all of the sensors you need baked right into it (honestly, we can thank mobile devices for getting the cost down). An ESC for a motor is a cheap microcontroller and a couple of MOSFETs. The frames can be made of cheap plastic. Even if things like ArduPilot didn't exist, a smart EE student could build one from scratch, including the flight control software, using parts from Digikey and relatively basic PID control code.

The cat is definitely out of the bag.

bamboozled 2 days ago

switchbak 2 days ago

I'm sure that everyone would agree on that, and that $bad_actor wouldn't take advantage of the fact that everyone else had agreed to lay down their arms. Game theory sucks, but it's hard to get around.

aorloff a day ago

I guess it falls on me to break it to you then but serious "global talks" happen at the exploding end of ordinance.

There is no Jedi Council to appeal to, no wise group of non-aggressive nations gathering to pacify the troublemakers.

jolt42 2 days ago

why? if nuclear weapons got the green light, do you expect a different outcome?

spaceman_2020 19 hours ago

AlienRobot 2 days ago

jandrese 2 days ago

As if the billionaires won't simply go "F that noise, more money for me!!!" Ethical concerns are way down the priority list for most AI focused companies.

trhway 2 days ago

There wouldn't be any pin in it. Drones - automated weapons in the wide sense - will be the new MAD/equalizer weapon accessible to smaller countries who have no chances of getting into the nuclear club. Without such a weapon in the coming new world order - marked specifically by the USA's withdrawal from enforcing international law - they will be an easy prey to the bigger countries. Ukraine is just a preview of that equalizing power.

undefined a day ago

[deleted]

deadbabe 16 hours ago

They don’t need to dodge bullets. Just make them small, cheap, fast, and powerful enough to fly to a target and punch a single bullet perfectly through their skull in an instant. Launch a swarm for redundancy. And because they are autonomous, these drones can be entirely unaffected by radio signals once deployed.

Politicians will never go outside again. The only defense is to be loved by all and have no enemies. Or, the more likely scenario: disguises and full anonymity.

octoberfranklin 14 hours ago

No, only our rulers will be anonymous.

We'll simply never know who we're being ruled by.

stackedinserter 2 days ago

OTOH there's no mass adoption of autonomous drones after 3+ years of real active war between two technologically advanced nations.

dji4321234 2 days ago

There's enormous adoption of autonomous drones.

A large number of front-line FPV drones are equipped with automated last-second targeting systems like https://www.youtube.com/watch?v=coUwYOyIoAU , based on Chinese NPU IP / CCTV systems and readily available as full solutions on Aliexpress. The basic idea is that if the drone loses control or video link due to EW countermeasures, it can continue to the last target.

Loitering and long-range fixed wing reconnaissance drones have been fully autonomous since the beginning. One common recent technique taken from traditional "big" militaries is the use of loitering autonomous high altitude base stations with Starlink or LTE on them providing coverage to the battlefield below, since it's much harder to jam things when they are flying high above the ground.

stackedinserter a day ago

switchbak 2 days ago

Maybe we should come back to this in a few years, I think this will have aged worse than the old dropbox comment.

Governments are falling over themselves to: acquire drones, figure out how to defend against existing and future drones, and to figure out how to exploit them well. Given the recent attack against Russian bombers, I find it hard to take you seriously here.

Hell, the US knows it can't compete with China on aircraft numbers, and is placing its money on collaborative combat aircraft to give it the advantage. That's about as strong an endorsement as you can get.

geysersam 2 days ago

XorNot 2 days ago

stackedinserter a day ago

542354234235 a day ago

An interesting paper just published about the current state of AI in Ukrainian and Russian drones on the battlefield [1].

"Promises of an immediate AI/ML drone revolution are premature as of June 2025, given that both Russian and Ukrainian forces will need to allocate more time, testing, and investment to deploy these drones on the frontlines en masse. Russia and Ukraine will continue improving their ML and machine vision capabilities while training and testing AI capabilities. Russia and Ukraine will then need to tackle the issue of scaling the production of the new AI/ML drones that will require additional time and resources to facilitate. Russia and Ukraine may start to use some AI/ML drones to carry out specific tasks in the meantime, such as striking certain types of targets like armored equipment or aircraft, before learning to fully operate on the battlefield. AI/ML drones are also unlikely to fully replace the need for the mass of tactical FPV drones over the coming months because the latter are cheaper to produce and adapt to the current battlefield conditions at the current state of technology."

[1] https://understandingwar.org/backgrounder/battlefield-ai-rev...

dghlsakjg 2 days ago

Are you sure?

One of the theories for why there were tires on top of the russian planes that were bombed is that it confuses automatic targeting systems by breaking up the profile of the airplane used in automatic target recognition systems.

Hell, even hobbyist level DIY drone stuff can be easily programmed to run an autonomous route with or without a radio link connection. This is a huge reason that GPS is just constantly jammed in this part of the world. If you can get a GPS signal on the battlefield, you can tell a drone to go destroy something.

htrp a day ago

stackedinserter a day ago

arcticfox 2 days ago

Remember when TB-2s and grenade bombers were the peak of drone technology in Ukraine? That was like 2 years ago, now the frontlines are draped in equal parts anti-drone netting and fiberoptic threads.

baq a day ago

stackedinserter a day ago

numpad0 18 hours ago

Yeah. I guess military taboo and export control schemes/scare tactics is doing phenomenal jobs restraining and de-escalating use of computers in arms development. Less money spent improving means to kill people might be good, but the long gap between the cutting edge of technology in general to technology applied to military domain feels weird.

jandrese 2 days ago

There is already mass adoption of drones, the AI stuff is only lagging behind slightly.

stackedinserter a day ago

pjc50 a day ago

I think people are missing the word "autonomous" here, which means you're right .. so far. I wouldn't bet against it changing.

ceejayoz 2 days ago

As long as the end of civilization comes soon, we'll be fine!

insane_dreamer 2 days ago

The seeds of the Butlerian Jihad

karn97 2 days ago

[dead]

Swoerd 2 days ago

-That you know of.

rapnie 4 hours ago

Technical University Delft. Not a word about ethics of developing these AI technologies. Happy techbros making happy gadgets.

vbezhenar 4 hours ago

FPVs are the most distinctive element in Russian-Ukrainian war, changing many traditional war dogmas. So far AI in this war wasn't heavily used, FPVs are controlled by humans at both sides. I feel uneasy with more AI tech improving FPVs. It's inevitable, but it'll be utilised by military operations to kill more people, to conduct terror acts, controlled from afar. It allows weak players to have more leverage which is not always a good thing, and certainly disrupts power balance. Think about Al-Qaeda bringing a truck of explosive drones to Washington DC and unleashing them at White House, all autonomous, with cameras guiding the way.

beeflet 4 hours ago

I don't know, this drone race is to combat drones what F1 racing is to self driving cars. In order to win in these races, you just need to precisely control speed around well-defined turns and stuff. You don't need to adapt to a new environment. It's not surprising to me that a computer program would win in such a controlled environment.

> It allows weak players to have more leverage

I think it depends on the dominant type of defensive counter-technology used. If it's something with high capital costs like a laser or a microwave, then it will centralize combat because the USA could invest in the infrastructure needed to defeat terrorists, but not the reverse. On the other hand, if you can effectively destroy these things with birdshot, then it may not be a problem for humanity at large. I could imagine you could make some device that tracks the drones and shoots them down for much less than the price of a drone.

For example look at the iron dome: it is effective defense measure but very difficult to scale up to counter ICBMs.

officeplant 3 hours ago

>I could imagine you could make some device that tracks the drones and shoots them down for much less than the price of a drone.

The cost of a FPV quadcopter is pennies on the dollar cost of a defense system. You can 3D print a dozen frames in hours with a decent printer. Its just bolt on the parts and do a quick function test with a script or controller and its ready for action.

FridayoLeary 3 hours ago

What point are you trying to make. Because the iron dome is hideously expensive. It costs so much more then the missiles it intercepts that it's worth it for terrorists to fire on israel purely to waste their money.

The iranian icbms from Yemen gets shot down by other systems. I don't think they are scaled up versions of the iron dome. What's interesting is the lack of confidence israel has in predicting their trajectory. They usually send up multiple interceptors for a single missile and put sirens on for half the country.

The only really economical counter i've heard of is lasers but it doesn't look like they are coming any time soon.

I've got no idea what method Israel uses to counter drones, but they certainly have struggled with them.

My absolute nightmare scenario is Iran via its proxies unleashing swarms of autonomous kamikaze drones in population centres.

dash2 3 hours ago

officeplant 3 hours ago

> I feel uneasy with more AI tech improving FPVs. It's inevitable, but ...

It unfortunately goes even deeper than that. The Quadcopter FPV community is watching their open source software actively be picked up for warfare, and can often tell what version they were running when watching released Russian & Ukrainian footage later.

Every beneficial step we make in the maker community will be used to expedite death in conflict. A few 3D printers and a digikey order are all you really need to seed an insurgent movement at this point.

atonse 2 days ago

Oh man, can anyone imagine a non-Terminator scenario for this?

Update: I'm not saying people shouldn't develop this, we're never going to squash human curiosity. But when I see this kind of stuff, I'm deeply troubled by how bad actors (state and non-state) will use this.

I hope our security services are working hard on countering these potential threats.

AngryData 2 days ago

Im more worried about these type of things causing us to blast each other and ourselves back to the 1920s or so during conflicts when small explosive EMPs start being viewed as less damaging than drones and robots. A fast explosive on the back of a neodynium magnet and a few coils of copper can make a hell of an EMP blast. The only reason we don't use them now is due to all the collateral damage, but if drone bombs represent even more damage they become viable. Yeah it will destroy all the radios around and fuck up a bunch of expensive equipment, but you would still have soldiers with guns rather than just smoking craters.

pjc50 a day ago

> A fast explosive on the back of a neodynium magnet and a few coils of copper can make a hell of an EMP blast.

I'm having a hard time believing this is effective.

> The only reason we don't use them now is due to all the collateral damage

Russians don't care about collateral damage and there doesn't seem to be any evidence of them using such weapons?

AngryData 10 hours ago

Legend2440 2 days ago

You could do EMP, but you could also do some sort of point-defense turret. Drones are lightweight and fragile, so it doesn't need to be big - just fast and auto-targeting.

marcus_holmes a day ago

lbotos 2 days ago

I feel like search and rescue after an earthquake where a drone swarm can canvas and categorize if it saw movement or not is one possible "non-bad" use.

martin_a a day ago

Fire departments and police in Germany are deploying more and more drone units, too.

Firefighters use them to search for missing persons but also to get aerial images and a better overview of larger scenes as "running around" is often not possible or doesn't help that much with the overview.

Police is using them to take pictures of accidents. It's easier to see tire marks and the whole "history" of an accident from above. Really reduces their time on a scenery to take pictures of everything.

jmccarthy 2 days ago

very prompt burrito delivery?

cluckindan 2 days ago

If by burrito you mean shaped charge high explosives with lethal shrapnel, triggered by facial recognition, delivered by drones the size of house sparrows at the speed of sound, then yes, burrito delivery.

roughly 2 days ago

generalizations 2 days ago

In china probably very soon. In the US? Regulation has already killed that.

energy123 a day ago

Paul Christiano has thought about these scenarios. I recommend his interview with Dwarkesh a while ago where he goes in depth about it.

MoonGhost 2 days ago

This will definitely be used in drone vs drone dogfight. Interceptors hunting spy, bombers, and kamikaze drones.

contravariant 2 days ago

Sure, just strap a nuke to it and watch WWIII kick off. No terminator necessary.

AlienRobot 2 days ago

Drones flying through your windows to deliver things faster.

Cons: massive invasion of privacy and probably illegal.

Pros: looks cool.

itishappy 2 days ago

I've always thought a user-installable drone-pad in the style of a window AC unit would be the ideal.

TYPE_FASTER 2 days ago

Inspecting utilities and other industrial infrastructure.

DoingIsLearning a day ago

The actual race is also worth watching:

https://www.youtube.com/watch?v=yz2in2eFATE

The speed and flawlessness is quite impressive considering it is being resolved with what I imagine is noisy inertial data and a motion blurred CCD camera.

narrator 4 hours ago

The sci-fi novel I wrote sacrifices commercial art considerations to portray the future of war more realistically. All the robots are one-shot, one-kill and all action takes place faster than human reaction time. The most humans do is approve battle plans. This is already the case largely in the Ukraine/Russia war, and now we're seeing that human FPV operators will soon be obsolete. Realistic sci-fi movies are going to be not have much action in the future. Things will have to be about careful political maneuvering, like in totalitarian country politics. You can't win against robots unless you are using other robots.

zellyn 2 days ago

Looks like most of the comments here are about the use as weapons and the possible dangers. I believe "Slaughterbots" is the canonical sci-fi video on the subject, and it appears to be aging pretty well. Unfortunately…

https://www.youtube.com/watch?v=O-2tpwW0kmU

sveinatle 2 days ago

I remember being blown away by a TED talk were "minimum snap trajectories" are planned for quadcopters to fly through hoops and slots.

It's really cool to see this happening fully autonomously and at such high speed. I wonder if the use of AI means that the approach is fundamentally different, or if it uses the same principle of minimizing snap?

https://www.ted.com/talks/vijay_kumar_robots_that_fly_and_co...

pacetest a day ago

It's fundamentally different, it's using an RL trained network that gets the drone state (position, orientation, velocity) as input and directly outputs motor commands.

airstrike 2 days ago

Interestingly, the URL for the embedded youtube video ends with the word "FATE"...

https://www.youtube.com/watch?v=yz2in2eFATE

rossant 2 days ago

Gives me the idea for a silly game: finding YouTube videos with words in their identifiers that are relevant to the content.

_ache_ a day ago

Nearly two years from comparable to human to beat the best.

https://www.npr.org/2023/08/30/1196777528/an-ai-quadcopter-h...

ilikeatari 2 days ago

Looks like it had NVIDIA Jetson Orin NX 16 GB. No GPS, Lidar, motion capture so its vision only. 6s battery so 5 incher?

ilikeatari 2 days ago

Does anyone know the FC or AIO they are flying?

Leo-thorne 2 days ago

I’ve seen AI beat humans in simulations before, but doing it on a real track with the same hardware is honestly kind of amazing. What surprised me the most is they didn’t use any traditional flight controller. They just let the neural network handle the flying.

I’m really curious how this would perform in messier, less controlled environments.

shinycode a day ago

A side note, will we still attend and watch Formula 1 races it AI would drive cars (maybe near perfection) ?

tialaramex a day ago

Human sports remain interesting when the humans are notably worse at whatever they do than a machine purpose built for it, or indeed wildlife that specialised for this.

Usain Bolt was the fastest human sprinter in the world, but compared to a good motorcycle over paved road he's obviously not very fast, and likewise compared to an emu. Nevertheless, Bolt's 100m performance drew big crowds, even though people also watch Motorcycle racing and (I think?) Emu racing.

It's like speed running, the categories are arbitrary and self-selecting. Why the Modern Pentathlon? Why not. Why Super Mario Warpless? Why not. If everybody wanted to do Super Mario, only the odd numbered levels and also you must kill all the enemies, that's what the run is, our choices are arbitrary and we value whatever we like.

frakt0x90 a day ago

Yes. People thought computers would kill chess, but despite current chess engines being able to trounce every human in existence, chess is more popular than ever.

zemvpferreira a day ago

mrheosuper 12 hours ago

similar to drag racing i guess.

miki123211 a day ago

This makes me wonder what the "best" vehicle for human racing would be like, if there was no requirement for a human driver.

Let's say your task is to move a human from A to B (by a pre-designated route) as fast as possible. The only conditions are vehicle weight, no outside radio contact and no damaging the road (assume each vehicle goes separately, so e.g. slip stream effects don't matter). You can rely on the human to drive or use AI, you can go on the ground or fly through the air, anything is allowed. What would be the best way to do this?

83 a day ago

>> The only conditions are vehicle weight, no outside radio contact and no damaging the road

Desiccate the human and compact him into an aerodynamic shape. Carry the (now much lighter and more aerodynamic) human inside a small rocket.

polonbike a day ago

Well .. it depends on other assumptions, like the amount and type of energy allowed (continuous gigawatt electricity access during the trip ?), amount of "roughness" the human can sustain during the trip (canonball a human packed in an big airbag ?), actual budget limit for the project, etc ....

npilk a day ago

Not exactly what you're after, but similar: https://what-if.xkcd.com/116/

tonii141 a day ago

Let's not forget that this works solely for this particular racing setup. If you change a single gate, the AI they are using would not be able to adapt. Still fascinating, though.

undefined a day ago

[deleted]

bicepjai 14 hours ago

Famous last words :)

tonii141 4 hours ago

I have been involved in research focused on ML control for some time, and believe me, I would love to see an AI model capable of controlling arbitrary systems at different operating points or in different environments. However, it is simply not feasible yet. This AI drone is no different, especially because reinforcement learning was used to train the model, which is generally not practical for real-world systems due to disturbance variables and the continuous need for adaptability.

leeoniya 2 days ago

ELI5? so, presumably if you put this thing in front of any starting gate it can navigate any course of similar gates?

or was it overfitted to this specific course?

itishappy 2 days ago

They had no prior knowledge of the course.

YeGoblynQueenne a day ago

I don't think so. The article says the race track was controlled by the race organisers but not that it wasn't known to the participants before the race.

Anyway given the state of the art, flying autonomously at great speeds and beating human champions without pre-training, i.e. on an unknown race track, would be a much bigger breakthrough than just beating some human champions (which has already happened except in a less official environment). You can rest assured that if that was what the team achieved, the article would be telling us all about it.

itishappy a day ago

ivanjermakov 9 hours ago

1970-01-01 14 hours ago

It looks like the reason it won is due to a human pilot crashing into the obstacle. Not exactly an unfair problem, but worth mentioning that it was close until human mistakes were made.

xnx 2 days ago

Bright futures for these engineers in the defense industry.

GuinansEyebrows 2 days ago

bright futures in the darkest places.

jryle70 2 days ago

Tell that to the Ukrainians who fight the brutal war Russia are waging:

https://www.twz.com/news-features/ukrainian-commanders-exclu...

cluckindan 2 days ago

The same cannot be said about whoever runs the site.

snewman 2 days ago

A few questions / thoughts:

1. I didn't see it stated explicitly, but I presume the neural net is on the far end of a radio link somewhere, not running on hardware physically mounted on the drone?

2. After viewing the FPV video on the linked page: how the hell do human pilots even come close to this pace? Insane (even assuming that the video they're seeing is higher quality than what's shown on YouTube – is it?)

3. The control software has access to an IMU. This seems to represent some degree of unfair advantage? I presume the human pilots don't have that – unless the IMU data is somehow overlaid onto their FPV view (but even then, I can't imagine how much practice would be needed to learn to make use of that in realtime).

bri3d 2 days ago

1) No, this is interesting specifically because it was all onboard, the drone has Jetson Orin NX on it.

2) No, the video the pilot sees is usually quite bad. Racing pilots usually use either HDZero (mid resolution video with weird pixel artifacts sometimes) or analog video (looks like a broken 1980s VCR). It’s amazing what they can fly through. These DCP spec drones are also slow by racing standards. Look up MultiGP racing, it’s even faster.

3) It can be overlaid but it’s useless. The human pilot is using the control sticks as the input to an outer rate regulation loop which contains the gyro as input to an inner stabilization loop though, so the IMU is still in the mix for human control.

itishappy 2 days ago

1. It's entirely onboard.

2. The video they're seeing is worse. Spectators typically see the frames saved directly from the camera, but the pilot will be seeing them compressed and beamed over the air to their headset. See vid.

3. The human pilots do actually have access to it. Not directly, but the flight controller translates their inputs and makes use of the IMU to do so.

https://www.youtube.com/watch?v=kMGRLGkm0QE

roughly 2 days ago

> https://www.youtube.com/watch?v=kMGRLGkm0QE

I’m reminded of when the US military figured out it should just replace all its proprietary field drone controllers with Xbox controllers because every single grunt that enlisted already had 10,000 hours on the things. If the future of warfare is drones, Christ, that video is terrifying.

itishappy a day ago

AStonesThrow a day ago

undefined 2 days ago

[deleted]

northisup 21 hours ago

I highly recommend Macross Plus for further research this topic: https://www.imdb.com/title/tt2330912/

Aziell 2 days ago

This technological breakthrough is truly amazing, especially the fact that the drone can fly on an actual race track independently, without relying on human control. It's really cool. But honestly, as AI gets better at doing what we can do, even better in some cases, it makes me a little uneasy. Will there come a day when we truly become redundant, with AI taking over the work?

polishdude20 2 days ago

> Flying drones faster will be important for many economic and societal applications, ranging from delivering blood samples and defibrillators in time to finding people in natural disaster scenarios

Ah yes. No mention of the real big use case

koolala 2 days ago

This feels like a bigger deal than what Carmack is doing with an Atari controller robot.

emsign 2 days ago

So the drones in the Slaughterbots short film were depicted to be way too slow.

Quitschquat 2 days ago

The drone has a camera and a IMU while the human has only the camera. How big is the advantage there?

itishappy 2 days ago

Humans have a flight controller in the loop, which makes use of the IMU. I doubt we'd be able to make much use of it.

rvz 2 days ago

Meanwhile, many defense companies are quietly watching this racing achievement far far away through their palantíri orb researching who built that autonomous drone.

IshKebab 2 days ago

So is the processing happening on the drone? Presumably not...

itishappy 2 days ago

Entirely, as is sensing.

rangestransform 2 days ago

Have the team published based on this work yet?

pacetest a day ago

No, but there's a previous paper for the controller used: https://arxiv.org/abs/2504.21586

palmotea 20 hours ago

> This is more than just a racing win. The smart lightweight AI that powered the drone could help all kinds of future robots, making them faster, more efficient, and better at...

...killing you, their target.

NooneAtAll3 2 days ago

...why are we training skynet again?

bamboozled 2 days ago

because there is money in it ?

wslh 21 hours ago

Even R2D2 doesn't pilot the X-wing itself.

77pt77 2 days ago

https://archive.is/wip/H3AAn

Since I can't access.

Jimmc414 2 days ago

Quite cool but this is the beginning of the end I’m afraid

_joel a day ago

"Coming to a battlefield near you soon."

ByteDrifter 11 hours ago

[dead]

Alex_001 2 days ago

[dead]

curtisszmania a day ago

[dead]

siavosh 2 days ago

I man at this point, given what we know I'm sure someone smart can connect some dots and describe what's inevitable with 99% confidence just in the next year or two in terms of society right?

TechDebtDevin 2 days ago

10 years.. But yeah. Just wait until these things can move through space with physical/gyro sensors on their own, at affordable costs. When orin nano super is the cost of an Esp32 (and the size of).

No gps, no fiber, no 5g, no jamming except microwaves. A python file and a target.

Scary times ahead.

itishappy 2 days ago

This is that. This race used only a single forward-facing camera and IMU fed to an onboard Orin NX.

Vox_Leone a day ago

>>Just wait until these things can move through space with physical/gyro sensors on their own,

and better guidance software. Yeah, there's a lot of room for improvement

"Traditional waypoint navigation assumes movement through a series of Cartesian positions. But in pursuit dynamics, for example, what matters is directional alignment over time"

https://github.com/VoxleOne/SpinStep/blob/main/docs/01-ratio...

dylan604 2 days ago

What do you mean just wait until? The entire point of TFA is that AI is controlling the motors directly and not using some human input device. So I guess it's just wait until you actually read TFA and watch the embedded video?

CamperBob2 2 days ago

The only question is whether motors or propellers will be banned for private sale first. (After drones themselves, of course.)

dylan604 2 days ago

Why? Just request a Waymo, and then put your suitcase nuke in the backseat and watch it be delivered by AI. There's all sorts of ways to kill with AI without needing drones

pjc50 a day ago

yunwal 2 days ago

siavosh 2 days ago

Yeah I man with each day the chance of a shocking event increases to 100% with predictable outcomes. But yeah thats what I'm thinking of .. there has to be a finite number of dimensions for this and related technologies in terms of use and impact (legal, economics, PR, military, political etc), some are fuzzier than others but some should be pretty clear for some analyst to share..

TechDebtDevin 2 days ago

I kind of prefer this, even without bombs i dont want unregulated idiots dropping a drone on my head in an urban space.

CamperBob2 2 days ago

burningChrome 2 days ago

My first worry wouldn't be this.

I got out of doing drone work because of all the FAA restrictions on where you can fly drones now. Within 30 miles of a major metro area? Nope. Within 20 miles of an airport? Nope. I'm exaggerating of course, but it got to a point where I was having real problems trying to find areas where you can fly a drone just for fun so I just gave up and quit.

My more immediate fear would be how the gov can control who and where these drones will be able to fly. If some revolutionary built a swarm of drones, it would be pretty easy (I would think) for the gov to just jam the signal and shut them down.

The parts? I'm not worried about. Its the gov holding the keys to access that makes me more worried.

CamperBob2 2 days ago