Pokémon Go Scans Trained the Navigation Tech for Military Drones (dronexl.co)

595 points by vrganj 11 hours ago

pj_mukh 7 hours ago

As someone who works in this space, the headline is a bit of a stretch. The overlap in the locations of Pokemon Go Player data and any active Drone heavy theaters of war is a tiny sliver (or zero?).

The military contractor (Vantar/Maxar) in question basically admits so but just "reserves the right" to use the data which is the political battle line ala Claude and DoD.

This is mostly an ideological battle.

appplication 13 minutes ago

Interestingly, I have some weirdly relevant direct experience to share here.

Pokémon Go was released at the beginning of July 2016. A week later, the Air Force kicked off its Red Flag exercise in Nellis AFB outside of Vegas. For the several thousand active duty folks participating, this is a month-long TDY from their normal base to Vegas. The premise is a large-scale war simulation, and it encompasses essentially all major wartime functions. I was directly involved in supporting drone operations (including live strikes) during this exercise.

The thing that’s funny about your comment is that because Pokémon go was just launched a week prior, a huge percentage of the participants were playing it in their downtime between exercises. You have to understand: these are thousands of 20/30-somethings (and occasionally even teenagers), meeting back up with friends from all over the world in Vegas. On and off base, people are socializing, having fun, and playing games. While phones were limited to outside of SCIFs, most of the base had no such restrictions. I recall wandering around base at 2am with friends playing it.

What’s funny is the same was happening with our deployed friends as well at the same time. This was a game that all their friends back home were playing, and when deployed, you need all the morale you can get. There were technically OPSEC policies this all probably violated but this was before any blowback from Strava accidentally revealing military bases or other similar incidents, so there was no specific guidance or moratorium on it.

All this to say, I understand what you’re trying to arrive at via deduction, but I think your understanding of the world in this case may be a bit too limited to meaningfully speak to this. That said, is the headline sensationalist? Probably.

Aurornis 4 hours ago

Even the Pokémon Go world model headlines were stretching the reality of what the model captured.

If you’ve played the game, the scanning function is only for what they call Pokestops: These are points of interest that you can walk to and get items in the game. The game gives you points if you walk in a circle around one and take a short video.

They’re relatively sparse. At most, they captured some 3D models of some things like signs, small landmarks (up close) and the fronts of some buildings.

The images captured by something like Google Maps are a million times more useful for someone trying to construct a world model with a lot of coverage. The Pokémon Go captures would be useful if you wanted something like a detailed 3D scan of the sign in front the student building or something.

tim333 4 hours ago

Aside from the scanning function, they likely have many geolocated images from people catching pokemon in AR mode.

Aurornis 4 hours ago

nonameiguess 44 minutes ago

Readers here really need to learn how to cut through hype better than they do. Pokemon go data is limited in far more ways. Many points of interest couldn't even be scanned like this because they were mural on the sides of buildings and don't even have more than one side. At least at first, there was no punishment for not actually scanning anything at all. You could walk in a circle with your phone pointed at the ground and it would still count that and give you points. People played in the dark or in crowds that didn't want to be filmed and this was the only way Niantic could make a feature like this that awarded prizes palatable to everyone. Beyond that, the points of interest don't even all exist. Plenty of the original database from Ingress is still present on the PoGo maps in Dallas and much of it hasn't existed in the real world for a decade, but players have no incentive to remove them because the more that exist in the game, the more you can get from playing since they're the points that spawn everything you might want to collect while playing. This became especially noticeable during the Black Lives Matter hubbub a decade back when old monuments to Civil War heroes erected during the Civil Rights era were torn down. All of those were POI in Ingress and PoGo and they still are, but they're gone from the real world.

I feel like users and readers instinctively know these limitations. We work with digital maps all the time that are out-of-date. Google and Apple don't and can't know any and all road closure and vehicle accidents in real time. Your car's radar road mapping service is as up-to-date as anything, but you still may be the first person to ever encounter a sinkhole or pothole that just appeared and it won't be on the map until you discover it. Satellite data is even more out of date because it can't be as frequently updated. There aren't anywhere near as many sensors in orbit or aerially as there are on the ground.

I haven't played PoGo in a while, but Niantic used to have human moderators and also tried to crowd-source some quality control on these world models because they knew 99% of the scans they received were bunk, either of nothing, the wrong thing, the right thing but in the dark or from an obstructed angle. I have no idea how good a job they ever did of cleaning that up, but it's a difficult task and it's never done because the world is always changing. There's only so much you can do here. Technology isn't magic.

drfloyd51 6 hours ago

> The overlap in the locations of Pokemon Go Player data and any active Drone heavy theaters of war is a tiny sliver.

Currently active theaters. And now there are detailed locations of our cities. We might not get killbots today but we will get pacificationbots.

bradyd 12 minutes ago

> And now there are detailed locations of our cities

That has already existed for decades.

pera 5 hours ago

I remember reading in the news that Pokémon Go was quite popular in Palestine.

If GP has access to this dataset it would be interesting to know how sparse is the data in that area.

btbuildem 5 hours ago

KaiserPro 2 hours ago

No, because they are different things for different purposes.

Visual navigation is prone to degradation. Keeping the "map" updated requires constant visits. (I know because my team worked on the patent for a method for updating said maps.)

Also Pacification bot would be run by the military who most lilkey have GPS.

Finally, For ground based bots, SLAM is actually more useful, rather than pre-built map based navigation.

Aurornis 4 hours ago

> And now there are detailed locations of our cities.

The Pokémon Go data is for small little islands around their points of interest (pokestops).

It’s not a detailed city map. The data is extremely sparse and only covers little tiny bubble around their sparse in game POIs.

The way it was represented as some sort of high resolution city map or world model was quite ridiculous.

reaperducer 2 hours ago

Muromec 5 hours ago

Kill bots are used right now in Ukraine, including ones with no operator in the loop (too slow)

sciencejerk 5 hours ago

sciencejerk 5 hours ago

Optimistically, it sounds like the USA data could be used to assist USA domestic defense drones, fighting against an invading foreign nation.

Pessimistically, maybe democracy's days are numbered

red-iron-pine 4 hours ago

idiotsecant 4 hours ago

Yep, the autocracies of the past only resolved when the ruling machinery needed something from the population. They needed farmers, workers, soldiers, etc.

There are clear parallels in the modern world of societies when the ruling machinery doesn't need those things from their population - petrostates. The people in these states tend to be viewed as subjects, not citizens. That's where we are headed

A corporate council of emperor kings with armies of pacification bots. The tiny sliver of window we have to ensure this doesn't happen is rapidly closing and there seems to be no movement toward ensuring that this doesn't culminate with the entire power of this new revolution in the hands of a small class of near demigods.

iwontberude 2 hours ago

red-iron-pine 4 hours ago

story broke yesterday that Ukraine deployed its first fully AI system, no human interaction, and it scored its first kill

i think killbots are absolutely a possibility, and very soon.

rightwing pundits and meme makers are already unironically quoting Zechariah 13:8

helsinkiandrew 6 hours ago

> The overlap in the locations of Pokemon Go Player data and any active Drone heavy theaters of war is a tiny sliver (or zero?).

But presumably the images/models at ground level can be used to train/improve the general performance of Vantor's aerial (satelite based) navigation system so it works better elsewhere?

pj_mukh 5 hours ago

No the tech doesn’t work like that AFAIK. The most common use case is exactly localization (think “HD maps” for autonomous cars).

It almost 1-1 data correlation, n-phone Pokémon go scans of a location helping a drone locate itself in the same location in correlation with Maxar’s satellite data.

There maybe some hyper corner case uses. Maybe the billion scans in New York City help them generalize across different phone lenses characteristics, but phone and drone lenses are so different.

Would love to hear some specifics if I’m wrong here.

KaiserPro 2 hours ago

win311fwg 3 hours ago

NorwegianDude 5 hours ago

sysguest 6 hours ago

well the article writes AS IF the whole intention was to:

"get data for drone warfare" ...in 2021 (before the russian invasion...)

but did we even EXPECT drone warfare to influence the war THIS MUCH back then?

well not me -- I actually thought russia would beat the crap out of ukraine within a month (even after the failed spetsnaz attack on zelensky)

the article's assumptions only makes sense IF some people had time machines, or if CIA has some know-everything future prophet

(not to mention: drones need TOP TO BOTTOM view, not bottom-to-top view)

anyway, my verdict: sensational yellow journal article, nothing more/less

dgellow 5 hours ago

roywiggins 6 hours ago

JumpCrisscross 7 hours ago

> overlap in the locations of Pokemon Go Player data and any active Drone-driven Theaters of War would be a tiny sliver

Is Pokémon Go not played in the Middle East, India, Taiwan, Korea or Japan?

pj_mukh 7 hours ago

Which of those are active theaters of war? Pokemon Go wasn't that big in Iran or Lebanon and even there, there aren't any reports of significant drones deployed there.

The only place I can imagine is maybe Ukrainian drones in Russia. Still, not a tonne of data there to be useful (as compared to say Tokyo or New York).

lbrito an hour ago

JumpCrisscross 7 hours ago

saidnooneever 6 hours ago

or ukraine or russia, and ofc people in africa dont have phones or internet -_-.

ofc going by the entire surface of the earth its not a lot of places, but i would never call such a thing statistically insignificant..

beAbU 5 hours ago

Pretty sure Pokemon Go and Ingress was played in Kiev long before the war

sciencejerk 4 hours ago

This is a good point. Legacy data might be the most valueable here

KaiserPro 2 hours ago

pj_mukh 4 hours ago

Good thing we’re not selling this data to the Russians?

iwontberude 2 hours ago

oceansky 6 hours ago

As a Pokemon go player, I would say it isn't.

There's even a Pokemon exclusive to the middle east region: sandstorm pattern Vivillion. Lots of players there.

pj_mukh 6 hours ago

"The Middle-east" isn't a war zone. Even the parts of the middle-east that are, don't have any drone deployments. Lebanon maybe? Reports are thin.

Maxar is/was primarily a satellite data company, and to say Pokemon data would add any major value in any of today's active drone deployments with the level of Satellite coverage Maxar already has is a wide stretch.

Moreover, ground forces in the area would need pretty heavy jamming tech in place too for this kind of data to be useful. It's a sliver of a sliver of a sliver situation.

WmWsjA6B29B4nfk 6 hours ago

idiotsecant 4 hours ago

maratc 6 hours ago

Obtaining it never means having to scan anything at any time.

oceansky 5 hours ago

chinathrow 5 hours ago

> The overlap in the locations of Pokemon Go Player data and any active Drone heavy theaters of war is a tiny sliver (or zero?).

For now.

mjanx123 2 hours ago

Will the drones at least look like Pikachu?

red-iron-pine 4 hours ago

i thought Maxar was mostly 3d images based on satellite inference. 1/2 of a pixel difference in a morning vs. noon vs. night sat photo can determine shadow and therefore height, etc. etc.

rapid 3d modeling of topography and cityscapes + supplementation with other data, e.g. pokemon. But ultimately that's supplementation, not the main effort.

650REDHAIR 4 hours ago

The current drone-heavy theatres.

That could change in an instant.

FrustratedMonky 2 hours ago

""As someone who works in this space, the headline is a bit of a stretch. The overlap in the locations of Pokemon Go Player data and any active Drone heavy theaters of war is a tiny sliver (or zero?).""

Can you elaborate?

GPS can be faulty in cities.

Pokémon Go scans, are primarily in cities.

The mapping in the article, is specifically saying to use visual cues when GPS is faulty.

How is this not directly 1-1 overlapping, the gap and the solution.

KaiserPro 2 hours ago

VPSs are much more effective at navigation at ground level in cities compared to GPS because of multi-path interference.

However that data has a half life and needs to be refreshed.

For flying drones, ground level data is really not that useful. mainly because you can't see it, because its obscured by trees, building and clouds.

But, this is not a new thing. Google, Apple, facebook and niantic all have VPSs as do a bunch of other startups.

For Drones you will probably need SLAM to capture the map, and then once you have the initial map, you can keep it updated.

You can experiment at home using https://github.com/colmap

doctorpangloss 2 hours ago

Vantar: "None of these places in our training data are in active theaters of war!"

Also Vantar: "The superpower of generative AI is that data in one task generalizes to other tasks!"

fsckboy 3 hours ago

>As someone who works in this space, the headline is a bit of a stretch. The overlap in the locations of Pokemon Go Player data and any active Drone heavy theaters of war is a tiny sliver (or zero?)

are you saying that drone training in quiet residential neighborhoods is not training? are you saying self driving cars can only drive in theaters where they've been trained, because autonomous training is always specific by neighborhood? are you saying that if a particular region has some novel terrain that all previous training must be discarded?

moralestapia 5 hours ago

This is a massively weak argument. It's like its own strawman, one does not see this often, lol.

If you train a soldier in the US, is he unable to do those things outside the US?

hsuduebc2 5 hours ago

So by this conclusion we can assume, that these drones will be somewhere else. Somewhere in heavily populated areas right?

muyuu 6 hours ago

It's not like there's a moral high ground about not collaborating with the military. Unless you want to advantage America's adversaries, namely China, Putin's Russia and Iran's current regime. There's always this implicit, sometimes explicit, "war bad" childish political philosophy in posts like this. In reality war is a given and you have to be prepared to have the upper hand.

beezlewax 6 hours ago

"War is a given" if your foreign policies dictate that outcome. It's not something always unavoidable but it isn't inevitable either.

The United States is one pretty warmongerish nation by any account.

bluGill 3 hours ago

drfloyd51 6 hours ago

War is bad. And our reality isn’t some unchanging truth. Our actions and choices, or apathy, help shape our reality.

It is not childish to aspire to be better.

muyuu 5 hours ago

monegator 6 hours ago

the EU has demonstrated for decades that by balancing trades, equality and human rights it can prevent conflicts from happening.

Seems to me that most of our friends in the balkans that have memory of the past wars are overall pretty happy about the current state of things, and there hasn't been wars to contend Alsace-Lorraine in 80 years, is it a record already?

War is very much not a given in the civilized world

u8080 3 hours ago

muyuu 5 hours ago

titzer 5 hours ago

I guess nuclear weapons were just inevitable the moment the first quarks were assembled into a proton, right?

red-iron-pine 4 hours ago

SecretDreams 5 hours ago

"war is a given" =/= "we should seek out wars"

ccppurcell 8 hours ago

If you are looking for something to channel that energy into, you could help improve open street map using streetcomplete: https://streetcomplete.app/

OnACoffeeBreak 7 hours ago

I assumed that in urban USA the map would be fairly complete and opportunities for edits would be somewhat rare. My assumption was very wrong. The app showed a dozen quests just outside of my office building. Thanks for suggesting it!

carstenhag 5 hours ago

There’s always things to improve or to add. Road surfaces, benches, trash bins, table tennis spots, etc. StreetComplete on Android helps make some common tasks really easy to do.

Tepix 20 minutes ago

Unfortunately, there doesn't seem to be a project like mapillary or streetcomplete that forbids military use.

rjmunro 7 hours ago

Surely military drones will use OpenStreetMap data? Even the Russians and Iranians can use it for whatever purpose they like.

SahAssar 7 hours ago

Yes. Just like editing wikipedia will help train models that are used for data classification in north korea or whatever.

It's a feature of open data, it's open and usable by anyone.

dotancohen 6 hours ago

PetitPrince 7 hours ago

Yes, there other mobile editor that are arguably more featured (EveryDoor, OSM Go, OsmAnd), but StreetComplete has a nice gamification / simplification of UI that makes editing a breeze.

MapComplete is a nice alternative if you care about some part of the map that are not easily filterable by StreetComplethttps://mapcomplete.org/

Cider9986 7 hours ago

StreetComplete is a top app.

xg15 6 hours ago

How can I channel my energy into preventing my data from being used for military purposes?

relyks 10 hours ago

I stopped scanning pokestops because the effort has outweighed the rewards. A lot of the time, the requests show up as "research tasks" for a point of interest that I quickly passed by and have no interest in returning to, besides the tasks related to taking pictures of your buddy pokemon in augmented reality. Looks like I made the right choice by stopping. They do indicate to you up front that they will use the data, but it's still kind of terrible that you could be indirectly contributing to war efforts. I always assumed the data would be used for large world model training or simulations.

Cthulhu_ 9 hours ago

> I always assumed the data would be used for large world model training or simulations.

That was the initial objective, improving navigation by having people walk slowly on pedestrian accessible locations instead of only the main roads. But once that data is collated, it could go anywhere and you've signed any rights to what happens with it away when you agreed to the Ts & Cs.

cmg 4 hours ago

The closest stop to me is between a dog park and a school - scanning it would have been an awkward situation, to say the least. And as you said, for rewards that aren't worth it. I got used to having that "Scan" task just sitting at the top of my list, never to be touched. But I noticed earlier this week that it's gone - and scanning stops doesn't give a new scan task.

Utilera 10 hours ago

That's what makes this feel so off

christoph 10 hours ago

My 8 year old LOVES Pokemon Go, and we regularly go to a local meet up which is a fascinating microcosm of people of all ages from all walks of life. We’ve met some great people and had some incredible conversations, but I really struggle to see how we can continue in good faith now.

I seriously loath, hate & despise everything about this digital panopticon world being constructed around us.

fragmede 7 hours ago

RobotToaster 9 hours ago

I believe some of the data was added to their scaniverse app.

I guess this also explains how they were paying for the free 3d model photogrammetry processing that app does.

adrianhon 9 hours ago

This article is based on reporting from Trouw: https://www.trouw.nl/redactie/PokemonGo/

I was interviewed for the Trouw piece and briefly quoted. This isn't to detract from the DroneXL piece, which adds its own angle.

Zonulet 6 hours ago

Based on the prose of the DroneXL piece, I think it would be more accurate to say that Claude adds its own angle.

pietervdvn 8 hours ago

Please tell them that 'als Elon Musk zijn starlink uitzet, iedereen de weg kwijt is' incorrect is. GPS is managed by the USA gov and we have our Galileo-alternative

Frieren 7 hours ago

Kids training drones that will kill other kids.

There is a level of evilness on that difficult to grasp. What kind of society puts that burthen on their own children?

Inequality has given power to the few deranged and depraved. No ethics, no morality, just self gratification and excess.

nonick 7 hours ago

Or maybe kill themselves, since most scans are from the cities they live in.

Frieren 7 hours ago

Shit. I guess that it can always be worse.

diydsp 6 hours ago

In the conservative worldview, competition is fair dinkem, so the setting for these businesses is just. That's how we got here.

Also in that worldview, we have the responsibility to defend innocent children. Let's if they can follow their own moral code and outlaw this surveillance to protect our kids.

petterroea 10 hours ago

This shouldn't be a surprise. But at this point it feels like if you don't completely avoid participating in digital society, your data will be used against you or groups/countries you support.

Cthulhu_ 10 hours ago

Mainly if you allow a government and / or corporations to do so, but unfortunately democracy and the like only gives you so much influence on that.

petterroea 9 hours ago

Sadly non technical people do not see future risk and any warning prediction is a slippery slope fallacy. Yet we now hear the echo of privacy advocates of the 2000s and 2010s saying "I told you so!"

bodash 8 hours ago

Agreed. If it's "digital", it will be used for elite power plays, because it's too easy. How else could you mass control/analyse/manipulate millions of people instantly? Digital, digital, digital...

JumpCrisscross 7 hours ago

There seems to be low-hanging political fruit here.

Governments have a say on to whom their weapons manufacturers sell weapons. It should be ditto for geospatial intelligence. If you want to map geospatial data in the Netherlands, you get a license from them and store the data locally and have to get permission to exfiltrate.

This won’t stop exfiltration, of course. But it should slow it down, which in the world of geospatial intel, could mean the difference between a drone finding its target and getting lost because of new construction.

wartywhoa23 10 hours ago

An interesting thing is that in Russia, this military data grab by ostensibly 'our western would-be enemies" was supported by viral advertisement by nobody else but the head of Russian Orthodox Church, Patriarch Kirill.

A story was manufactured about arresting a 22 y.o. guy in the Church on Blood in Honour of All Saints for playing Pokemon Go.

The story went hyper-hyped for weeks, with general public sentiment that once such an obscurant retrograde declares such an innocent game so evil, it must be something to absolutely install and play in spite!

And such was the way of the Pokemon Go's viral success in Russia.

(edits for factual precision)

Mikhail_Edoshin 10 hours ago

Apparently that story was manufactured and promoted by someone else, don't you think?

wartywhoa23 9 hours ago

Sure, I don't expect Kirill himself to come up with that, but he was positively used as a notorious talking head, which whatever it says must be understood to the contrary.

Like in that case when he blamed the rise of toll roads in Russia - "oh brothers and sisters, shalt we allow taking the toll on what should forever be free in Russia?" - the public reacted in the exact same way - a religious zealot told this, so it must actually be a progressive, sane thing to do the opposite.

saretup 9 hours ago

Streisand effect marketing 4d chess move by Niantic?

Mikhail_Edoshin 9 hours ago

darkwater 8 hours ago

somelamer567 9 hours ago

Interesting: the Russians are calling "our partners", "our would-be enemies" now. They're not even pretending anymore. Given that this steady parade of seemingly-planted and promoted derogatory anti-Western stories that has been happening for years originates from You Know Where, it's a revelation that the Russian establishment and secret services are not even pretending anymore.

It should also be pointed out that Kirill and the Russian Orthodox Church have been understood to have been cat's paws for Russia's notorious KGB successor agencies for a very long time now.

wartywhoa23 8 hours ago

All very true, and an important point about ROC/KGB ties, but

> the Russians are calling "our partners", "our would-be enemies" now.

is a total wind vane which can flip 180° in a matter of days (if not minutes, as in Orwell's scene where they seamlessly switch from being at war with Eurasia to that with Eastasia)...

tpolm 8 hours ago

Come on, Russian "страна наиболее вероятного противника" (the country of the most likely enemy) was always the military name of the US since the Cold War. Now used in military texts and also as a sarcastic cliché

orbital-decay 6 hours ago

emperorxanu 10 hours ago

I still feel like this is a perfect example of why we should be asking for our data to be disclosed to the public. If I take a picture of some public point of interest, they end up tagging it with their metadata and selling it, well, that's what I agreed to by not reading 20 pages of T&C's right?

But the value in that data is in the liveliness right, so at some point, would it not make sense for that data to be considered a public asset?

Why do we not demand this data be released regularly (given that the inverse tech could be developed using this as well)? If it can be used to train things used for war, could it not equally be used to train better lifesaving tech (in which case, the data should be made available to the public)?

johannes1234321 9 hours ago

It's quite obvious that data is what pays the game. A lot of data about the players )daily routine, commute to work/school, social circles to other players, etc. which allows to derive Job, wealth, etc.), data about surroundings (where do people actually walk, drive, ... etc.)

The story here however I'm not too sure about: Isn't the game mostly played in dense urban areas? - by the time you need military drones there the area will have changed a lot (destruction, fortification, ... and overall be outdated) where I think the civilian drones (delivery, cars, ....) benefit more. While the technology certainly is dual use.

emperorxanu 4 hours ago

I had assumed the purpose of the data was more in generalising across variegated input sources to better allow the drones to fly on their own in urban settings, aka, adapt more readily to randomness? Better datasets for multimodal training etc.

I am not joking though, I really would consider any data generated on public assets to be considered "releasable" to the public. How many people should get killed by self-driving cars because the company making the cars didn't have enough data to train proper models?

johannes1234321 3 hours ago

wartywhoa23 9 hours ago

> While the technology certainly is dual use.

It's dual, but its positive aspects are only unlocked after a sufficient human blood sacrifice is made by its overlords, as is the case with all dual use tech.

fragmede 7 hours ago

alexashka 9 hours ago

You can ask for whatever you like - nobody's listening.

There is no 'we'. 99%+ of people view the world as a zero sum game where for me to win, somebody has to lose and if I don't do whatever it takes, somebody else will and then I lose, therefore I have no morals or principles or virtues and anyone who does is a liar or a fool.

Everything is a bad faith act, everyone is a selfish bad faith actor and I shouldn't feel bad about being one because everyone else who isn't a fool is too.

This tragically wrong but intuitively correct worldview and much more was explained by Plato long, long ago and just about no one understood any of it. At least the text survived and people with 140+ IQ and an iota of decency can read it and be at peace knowing they're not crazy or foolish.

frollogaston 12 minutes ago

They gotta name a drone after Charizard now

superkickstart 10 hours ago

The world is so messed up right now that this is not even the least bit surprising. In fact it's on point.

crnkofe 9 hours ago

This is revolting. Given how many kids played and are still playing the game this literally means weaponizing kids playing games. Humanity has been lost somewhere along the way.

SlightlyLeftPad 8 hours ago

Humanity hasn’t been lost, it’s been conquered.

Enter AI, a new era of soulless wonder.

Intelligentia Artificiosa.

Ingenium Artificum.

— Dreams of Silicon and Sorrow

fragmede 7 hours ago

chinathrow 8 hours ago

> Hanke formed Niantic Labs inside Google in 2010, then spun it out in 2015.

Spyware company spawns a new spyware company.

FridgeSeal 7 hours ago

Spyware Mitosis?

Larrikin 10 hours ago

I'm glad I always quickly scanned the dirt. At some point I gave up completely when I heard they started banning people for dirt scans.

In the latest season they've gotten rid of the scan rewards, so I guess they got all the data they needed.

KaiserPro 8 hours ago

I worked at a VPS competitor of niantic.

I am conflicted on this report.

1) VPS is not new, the startup I worked at had a working public system in 2018.

2) The hard part about VPSs is not actually the navigation, its generating and querying the map.

How does the VPS work?

You build a point cloud of features (for us we paid people to go and record videos in cities, Tesla/Waymo/toyata/google drove cars niantic got it's players to take videos/pictures)

Align that point cloud to the 3d world, store it in a way that can be queried quickly (doing that quickly and at scale is still an area of research)

Then your client needs to extract the keypoints from an image and perform triangulation against the map to see where the camera was taken (There are calibration issues, but we ain't got time for that)

Now.

Niantic, from what I can see (and its been a while) has a database of key landmarks, but not of the areas inbetween. For decent navigation I would say that this is a massive problem.

I know niantic are pushing the whole "spatial world model" but frankly I don't think that scales. They stuff they have released is memorybound in vGPUs which isn't that useful for realtime querying.

I strongly suspect that actually they have a different system, much more traditional along the lines of colmap, or hloc, or something with a feedforward model in it.

However for the drone usercase, what you actually want is SLAM, which is a very different problem. for SLAM you need to build the map whilst your are moving, and then try and do loop closure or some other method to stop drift. Once you've gone there and back you can use that model for relocaliosation.

Groxx 11 minutes ago

Yea, I find it a lot more believable that they're using this for human +/- AR stuff, not robots. E.g. walking instructions: they have photos of landmarks from many human-friendly angles, and precise positioning isn't important. That's undeniably useful for lookup purposes. Stuff in between can be estimated by GPS/3D building maps that already exist, and that's more than good enough for humans.

I just don't see how they'd convert weird-phone pictures to accurate-enough-for-SLAM purposes, especially with that in-between problem. Like, I could believe you can get a LOT of accuracy out of just photos (just watching occlusion probably gets you sub-centimeter), but in huge areas of the world they have nothing at all to stitch those high-precision areas together accurately. Existing maps and 3D building scans are wildly inaccurate on that scale. Like, it's more than a block between scannable things in my area, sometimes multiple blocks, they're not computing a precise world model from that even with existing data on e.g. openstreetmap. Robots already have enough to know their world-position with on-board SLAM + GPS + existing maps, this won't eliminate (or even reduce) SLAM as a necessity for navigation.

vectorphresh 39 minutes ago

I'm not sure they need the in between areas, so long as the landmarks are inclusive of similar features. In fact, they probably only need a high quality 3D scans of primitive features to perform classification (walls, building, intersections, etc). I haven't played recently, so I'm unsure how distinct each landmark is.

fragmede 7 hours ago

(Visual Positioning System)

leni536 9 hours ago

Pokémon being used for war efforts is prime South Park material, too bad they already did that.

phrotoma 9 hours ago

A game aimed at children supporting military intelligence is prime cyberpunk material. No doubt fiction beat us to that as well.

deafpolygon 8 hours ago

Sure did.. it’s called Ender’s Game (Orson Scott Card).

speed_spread 6 hours ago

yanhangyhy 9 hours ago

i remerber china bans it many years ago... and many people dont understand why.... never trust a USA product!

and we even have youtube videos like this: https://www.youtube.com/watch?v=IiJOHV9rIxU

yieldcrv 9 hours ago

I don’t think the standing committee is objectively that perceptive

But I do appreciate alot about what they are doing and choose to do

Reminds me more of a theme park. Yes, a heavy handed corporation runs it and if you have any dissent it won’t go well, but if you don’t choose to focus on that then it will be a joyous place and you have the opportunity to contribute to that energy and be rewarded by something that simulates a free market

Peanuts99 8 hours ago

China has the largest intelligence programme in the world and likely has whole teams of people whose job it is to build this type of data. It's not surprising that they are cagey about it being hoovered up by other countries.

mcosta 10 hours ago

It is even worse, tax money is used for the military.

teekert 10 hours ago

I know it's sarcasm, it's a valid point. We all already contribute to the war efforts of our governments.

Al-Khwarizmi 8 hours ago

Of our own governments. Which makes sense, under the assumption that having a military is a necessary evil, how else would they be funded?

This is about players all over the world contributing scans of their own countries to US military, though.

sciencejerk 4 hours ago

Russia is already taking advantage of preloaded terrain imagery, according to the article:

The principle is already turning up on the other side of the front, where a downed Russian drone was found matching live camera feeds against preloaded terrain imagery rather than trusting a single GPS module.

https://dronexl.co/2025/06/10/russian-ai-drone-nvidia-sony-u...

corndoge 4 hours ago

tim333 4 hours ago

It sounds like image matching may be newer. Still you could probably do that with any old satellite image.

wvh 6 hours ago

The moral question is if you've unknowingly contributed to war, death and destruction, or if you are actually helping drones to accurately find real targets – which hopefully are not innocent civilians but legitimate military targets.

pandoro 6 hours ago

At this point is there really a difference between death and destruction and "legitimate" military target? It's a slippery slope

tomaytotomato 10 hours ago

How useful is spatial data over time, does it decay or age much?

Is the geographical data more useful, or are buildings and other structures more important?

Genuinely don't know much in this space.

KaiserPro 2 hours ago

Its using Visual descriptors to generate a pointcloud. Buildings and text are really great for creating descriptors, so when they change you loose key points for "localizing"(ie getting your position). This needs to be updated as those buildings change.

You also need a day/night dataset (although some newer descriptors are day/night resistant)

jayd16 3 hours ago

Yes. Even dealing with "what does it look like in rain? What does it look like in snow?" is hard. Hell... "What does it look like at night" is hard. Hell.... what does it look like at noon vs sundown (no shadow vs long shadows) is hard.

Have you ever seen a commercial use of anything like this? That should give you a hint about how reliable these systems get.

thinkingemote 9 hours ago

It's easier to take a look via change of dates in google street view, they have almost 20 years coverage. You can see how the data ages and decays or doesn't because it's tied to the place it represents.

Shops come and go, churches do not move, schools tend not to move much, industry areas is somewhat dynamic, military installations might be static or dynamic, trees grow or are removed.

miggol 9 hours ago

It's the combination of geographical data (maps) linked to its visual representation in the world (footage of structures, roads, landscape features) that is useful.

The geographical data already exists in digital maps. And I would expect competent militaries already have maps of enemy territory. It's the second part that was so far missing.

This combined set allows the training of AI models that can say, "When my surroundings look like x, that looks like y on a map".

So when your drone's GPS gets jammed, it can look at its surroundings, reference its (internal and offline) maps, figure out where it is, and navigate.

malux85 9 hours ago

Compred to what? Datasets at this scale are rare. You're not comparing against another ideal dataset, you're comparing against having nothing.

johannes1234321 9 hours ago

There are so many companies these days doing recording for self driving cars and/or street view like applications. Also sites like Flickr collect huge sets of geo tagged photos, as do companies like Meta where tons of geo tagged images are shared each day via their different outlets.

Niantic has the benefit that they can steer "volunteers" to specific points, though.

sciencejerk 4 hours ago

notabotiswear 8 hours ago

I don't what class of models they use here, specifically, but a generic classifier shouldn't depend on a single feature. And neighbourhoods don't typically get razed or remodeled/painted over in a fortnight.

... Except, well, when it's the doing of this same, so called "defence" industry.

lbcadden3 4 hours ago

One of the reasons I stopped playing Pokémon GO.

Anyone who checked the origins of the company knew where this was going to go. Your data for sale.

There were already questions about what they were doing with the data of their prior game in the security and privacy space prior to Pokémon.

pandoro 6 hours ago

The depravity of using a fun, uplifting game that targets kids and teenagers to train military drones boggles my mind. "The end justifies the means" continues to reign supreme

random_ind_dude 4 hours ago

Reminds me of that sci-fi short film where kids are playing a VR game controlling virtual avatars looking for and shooting virtual enemies, while in the real world, unbeknownst to them, they are actually piloting robots that are hunting down and killing dissidents.

djmips an hour ago

a dark update of ender's game

frollogaston 23 minutes ago

I thought that was just Ender's Game

barkingcat an hour ago

classic use case for gamification.

every time I see any startup run "games" on some aspect of daily life, it's going to go into killer robots in the end.

nickdothutton 6 hours ago

If I were a (potentially) hostile foreign power, I'd use a game to enlist people in the target country to record sensitive locations.

neilv 3 hours ago

If the article's description evoked applications like old missile guidance system methods based on geographic features... this Wikipedia screenshot's imagery looks like it would also be good for precision drone attacks against urban small civilian structures and select individuals within/around them:

https://en.wikipedia.org/wiki/Pok%C3%A9mon_Go#/media/File:Po...

Wartime propaganda poster: "Loose Surveillance Capitalism Children's Game Apps Sink Your Own Darn City, to an AI autonomous drone swarm assault that surgically neutralizes whatever the worst people want to neutralize".

AI, please rework that into a catchier slogan, and render it as a printable US WW2 OPSEC poster style PDF, but without storing my prompt and-- Hey, what's that buzzing soun--

abroszka33 6 hours ago

I'm not sure this is a real problem. Google/Apple already has the world mapped out thanks to our photos in the cloud, and we literally let Tesla and others drive cars everywhere recording everything.

Pokemon Go does not really incentivises this activity. We get a poffin... Nice to have but does not worth the hassle of scanning and looking stupid on the street.

Utilera 10 hours ago

Once the data has trained a model, it also becomes almost impossible to meaningfully audit or undo

jayd16 3 hours ago

"We shouldn't have maps because you can use them in war." seems like a wrong way to look at this problem.

sevenzero 3 hours ago

Well game vendors catering game data to the military is the problem here, not the maps themselves. Maps are good, shady corpo bs isn't. Same shit Spotify pulled by investing into war machinery rather than paying the artists more.

jayd16 3 hours ago

What is the difference, in your mind, between mapping data and what was shared?

vrganj 10 hours ago

August 2016: Iran Becomes First Country to Ban Pokémon GO

https://www.avclub.com/iran-becomes-first-country-to-ban-pok...

Really smart decision, in hindsight.

sciencejerk 4 hours ago

This is what censorship looks like. This is what should get people angry. Not localization changes, but actual government-mandated changes or bans. By censoring the internet, Iran is not protecting its citizens but rather the ruling government.

Or maybe sometimes censorship actually DOES protect its citizens?

frollogaston 19 minutes ago

That's a funny tantrum. It's barely even censorship cause the game isn't about speech. I can't think of a single reason any country besides the US should've allowed Pokémon Go to operate there, phoning location scans back home.

wartywhoa23 10 hours ago

Where are all the edgelords sending me cuckoo signs and tagging me as conspiracy theorist when I said that it compiles photogrammetry by placing pokemons at areas and angles with low image coverage?

Ah, oh yes, "we all knew it from the start", "they indicated that up front" etc.

Fuck no, everyone was foaming at the mouth how it's just a game and no way in hell an intelligence operation.

P.S. Those who "knew it from the start" yet continued helping Niantic, did you really think that the data will be used for the greater good of the humankind?

BoppreH 10 hours ago

> it compiles photogrammetry by placing pokemons at areas and angles with low image coverage

But that's not what happened. The data came from very explicit scanning tasks centered about pokestops, not the AR pokemon capture. I used it once or twice to test it out, and it was a drawn out process where it asks you to slowly orbit the pokestop while filming, then permission to upload the (huge) files. You even had to activate a special "volunteer" account flag to even see these tasks.

From TFA:

> Since 2021, Pokémon Go has asked players to record short videos of real-world locations, called Pokéstops, to earn extra in-game items. Scanning all the buildings, streets, and trees in a 360-degree sweep was optional, and Niantic asked separately for permission to keep the footage. Granting it meant agreeing to extra terms.

I'm sure they used GPS data from the players too, but I still hold that it's unlikely the AR pokemon capture yielded any data to them.

wartywhoa23 9 hours ago

Well if such a conspiracy crackhead like me somehow happened to reach ranks of Niantic team, I'd totally make sure that there is a decoy "huge data upload point with explicit consent" to shift focus from covert data channels that slowly transmit all else using some custom image compression, maybe just some very small fraction of original data that by the mass nature of acquisition would mathematically still reconstruct the original data, or the fraction of that data that is enough to build a world model.

BoppreH 9 hours ago

dTal 5 hours ago

From Room 641A to Snowden, the speed with which the narrative shifts from "that's conspiracy nonsense" to "we knew it all along" is neck-snapping.

Every. Single. Time.

cheschire 9 hours ago

wiseowise 10 hours ago

This is all for your security! Right? Right…?

mawadev 7 hours ago

Incredible how Nintendo is okay with this

drysine 6 hours ago

>Jeroen van den Hoven, a professor of ethics and technology at TU Delft

>Van den Hoven did not condemn battlefield VPS outright. If it helps Ukraine win a just war against an aggressor, he said, that is a good development. His worry is the system falling into the wrong hands

The professor is quite flexible with his "ethics"

iwontberude 2 hours ago

Nvidia wants to create a digital twin of the real world that military can use to plan their next military operations. All of those scans of cities and inside buildings will be a virtual world where war makers can plan to a very fine detail how their drones will behave.

iwontberude 2 hours ago

These fools are compromised by nation states and the data isn’t just in their hands. This is why you shouldn’t collect certain types of data.

neumann 7 hours ago

That was the conspiracy story about pokemon go when it first came out! That it will be used by the military!

timcobb 6 hours ago

This is fitting/perfect. Pokemon go is THE archetypical surveillance capitalism app. Be a drone in surveillance capitalism, know that your behavior will be used like this. Drones generally don't know or care though. Drones just have fun with tech yay fun awesome. Pokemon, gotta catch them all!!

lmf4lol 10 hours ago

And here I am, trying to make our product as privacy friendly as possible. Trying to follow GDPR and the AI act. Trying to respect my users..

And then there are those guys... and they make billions, by giving a flying f*ck about ethics or what so ever. And NO ONE will hold them accountable. NO ONE! Because either they lack the power, or they are bought and in it on the scheme.

I accept that the world is like that. Just like International Law has always been nothing more than an academic exercise, business doesnt care about anyone besides profit. Its fine. Its just sad also...

keybored 8 hours ago

I keep being negative about Digital Tech in general[1]. But this is worse than my habitual negativity towards D. Tech sans AI (AI is a whole chapter onto itself).

And what can be done? The comments usually say a big fat nothing.

- Any fool already knew this comments: “shouldn’t be a surprise”

- I guess I should call my representative comments

- Just boycot tech comments

Usually nothing much actionable. Building the Ad/Surveillance/Privacy Invasion society? Very actionable, good pay, many mouths fed and FIRE accomplished by HN posters. There’s even at least one acronym for this life achievement.

Shoutout to digital activists that are doing something. I’m but an armchair complainer on this front.

[1] https://news.ycombinator.com/item?id=48480840

deafpolygon 8 hours ago

Complaints in this thread, yet no one will boycott Nintendo for doing this. Ultimately, they allowed this data to be collected and then sold.

keketi 10 hours ago

surprised pikachu face

alpineman 10 hours ago

Truly dystopian. The Pokémon Company should share the blame for licensing their brand in this way without proper safeguards to prevent the data being used for this, particularly given the background of the Niantic founders

rich_sasha 10 hours ago

Can you imagine scanning your house, your school, your playground, thinking you're catching Pikachu, then have a drone hit it based on your own footage? Pretty terrifying.

nicce 10 hours ago

Maybe Nintendo lawyers could show their skin for a good cause at once.

KeplerBoy 10 hours ago

Do you really think Niantic didn't make sure their actual partners didn't agree to their business model?

nicce 10 hours ago

relyks 10 hours ago

Indeed, but should we always assume data of any type we generate for services can be used for malicious means?

alpineman 10 hours ago

To an extent, but realistically it wasn't really reasonable to expect a cutesy Pokemon game to be used for this ten years later. If you had told the average Pokemon Go player this ten years ago you would have been called crazy. The Pokemon Company should have done more to protect their brand (I would hope for regulation too on player-generated real world data like this)

Utilera 10 hours ago

I think this is where brand licensing gets more complicated than it usually appears

Forgeties79 9 hours ago

Niantic is what happens when a boardroom is somehow more evil than the ridiculous caricatures we sometimes see in Hollywood. “Alright gentlemen: we need to make a lot of money quickly harvesting every drop of data from kids and adults alike en masse using something they all love that is family-friendly. We are selling it to the military of course, because they’ll pay us tons of money for it. Who’s in?”

nephihaha 5 hours ago

Much like Skype and Zoom were quietly used to train up fake versions of human beings.

taneq 5 hours ago

I’m so torn between naked admiration for the sheer Machiavellian audacity of this play, and discomfort with how vulnerable everyone is to this kind of creative abuse.

aussieguy1234 5 hours ago

Whose to say that this wasn't the plan all along?

freakynit 10 hours ago

Watch Dogs: Legion

bronlund 10 hours ago

Just wonderful.

close04 8 hours ago

> The games went to a Saudi sovereign wealth fund. The map went to defense.

The map went to offense. Nobody needs scans of someone else's country for "defense".

At this point it's a given that any data source that can bring an edge in a conflict is being used for exactly that. Things that film and scan surroundings are the newest addition. When a fleet of cars is taking cm or mm resolution scans of entire cities or even countries the safe assumption is that the data is funneled for intelligence and military purposes.

sciencejerk 3 hours ago

Eh, the maps could be used for true domestic defense...but examples of foreign invasions on USA soil are scarce...

tamimio 9 hours ago

You should assume any camera recording will turn into a model one way or another, if not for gnss denied navigation, it will be on facial recognition or such.

ai_fry_ur_brain 10 hours ago

Niantics founder has CIA roots... None of this is surprising.

https://www.binance.com/en/square/post/302386307352562

u8080 10 hours ago

AFAIR, there is a chain of companies which connects Niantic to govt agencies, they were selling this data to Uncle Sam from the beginning(even before Pokemon GO)

l23k4 9 hours ago

> Niantics founder has CIA roots

This is not at all an honest way of saying "Niantics founder raised money from In-Q-Tel"

RobotToaster 9 hours ago

Being founded with funding from the CIA's venture capital arm seems tantamount to "CIA roots"

JumpCrisscross 7 hours ago

l23k4 8 hours ago

kaladin-jasnah 4 hours ago

Isn't Oxide Computer also funded by In-Q-Tel?

lapinovski 9 hours ago

everything sucks :(

saberience 7 hours ago

This is one of the most dystopian things I've heard in a long while.

I mean, we have a lot of weird shit going down right now... like AI being used to automate art BEFORE it's being used to automate dangerous and menial jobs, but knowing that people are being killed with help from data generated by millions of kids and young adults playing a fun, cute videogame is just so freaking dark and weird.

We are a very strange species and I don't have a great deal of hope for our future.

nephihaha 5 hours ago

Zoom was free for a reason. The audiovisuals harvested during lockdown were used to help produce the fake videos/simulations of humans we are seeing today.

Same mentality.

pknerd 8 hours ago

"If something is free, you are the product."

oceansky 6 hours ago

Nowadays you are the product regardless of how much you are paying.

Pokémon Go can be pretty expensive with micro-transactions.

trhway 9 hours ago

upon seeing the title i was only wondering - whose drones.

mystraline 6 hours ago

"Gotta... Kill em all?"

rvz 3 hours ago

To those who were playing Pokemon Go ten years ago.

Thanks for playing. (You got played)

Ccecil 10 hours ago

Hate to say I called this years ago....

It is a shameful use of tech.

self_awareness 10 hours ago

Insane.

People literally traded military intelligence for Pokémon.

anilakar 8 hours ago

Turns out intelligence gathering is pretty boring routine work, not Bond-esque spy stuff or stakeouts in camo nets and face paint.

Forgeties79 9 hours ago

In 2016 this wasn’t obviously happening/common knowledge. Remember to blame the perpetrators, not the victims.

drysine 6 hours ago

In Russia people who warned about it were mocked as paranoid boomers. Today I wonder how many of them were paid or just encouraged to do the mocking.

self_awareness 8 hours ago

Huh? You still don't know how this works, do you?

I mean, you can blame whoever you want, even Pikachu. Neither Niantic nor even one person cares who you blame.

WhereIsTheTruth 6 hours ago

Funny how "conspiracy theorists" were once again right

tokai 7 hours ago

Sentiment here is blowing this waaay out of proportion. It's not new technology, and its not particularly scary or dystopian.