Kagi added a setting for removing paywalled links from search results (kagi.com)

388 points by speckx 2 hours ago

delis-thumbs-7e an hour ago

I think this is amazing. Love Kagi. I’m happy to pay for a good search.

Nobody speaks about their AI Assistant, but it is really good. They somehow harnessed it so that it mainly searches info first and sticks to the verifiable data. I prefer it to Claude or any other, because it actually answers the question I need without fluff or “Great question! Here’s some plausible nonsense you can trip over instead of doing actual research!”.

CoffeeOnWrite 41 minutes ago

My household is hooked on the AI Assistant. It’s heartwarming to be able to buy consumer software that just works.

If only Kagi had a Shopping feature, then it would be a complete solution for us.

Zambyte 11 minutes ago

> If only Kagi had a Shopping feature, then it would be a complete solution for us.

Why?

delis-thumbs-7e 42 minutes ago

For those wanting to try Kagi does not just have ai search help, but full chat app: https://help.kagi.com/kagi/ai/assistant.html

You can get it on at least iOS as well as its own app. You can select from bunch of China-models, I use Kim pretty much always. You can also do a system prompt and bunch of the same stuff you can with Claude etc. But it lies to me hardly ever. I don’t know how they did that.

Cider9986 an hour ago

I've also been pleasantly surprised about Brave's search based AI answers. They have been good for months and cite sources.

It will say that nothing in the provided search context has your answer which seems like a simple system prompt but somehow other models from bigger companies have a much harder time saying "I don't know" by default.

ohyoutravel an hour ago

I use it for any first pass searches. It’s great. Add a ? at the end of a search and get an annotated answer. Super happy with it and super happy to keep paying. Plus they send me stickers sometimes that go on my laptop that serve as a conversation starter to evangelize Kagi a bit in person. One of the only few services I happily pay for.

vincnetas an hour ago

i also want stickers...

frereubu an hour ago

The one thing I find slightly grating about links to Kagi blogs is the top comments are almost always "I use Kagi and it's great!" rather than about the content of the blog. And I'm a happy Kagi subscriber!

I get that this is an option, but what it really shows to me is how broken the model for journalism is. In my view you almost always only get good-quality journalism if you pay for it. (Somehow - e.g. the BBC is paid for by the licence fee, although I'm a bit despairing at the quality of the BBC these days, but perhaps that tracks the significant cuts to their budget...) I'm pretty sure that there's a technically viable solution to micropayments, but there are too many competing interests for anyone to settle on anything. We can't even agree on a single setting that says you don't want advertising cookies!

CoastalCoder 9 minutes ago

> The one thing I find slightly grating about links to Kagi blogs is the top comments are almost always "I use Kagi and it's great!" rather than about the content of the blog. And I'm a happy Kagi subscriber!

Okay, new topic then. Have you heard of InstaPot? ;)

Anonyneko 5 minutes ago

>you almost always only get good-quality journalism if you pay for it

Often true, but sadly doesn't work in reverse - if you pay for it, it often still isn't good-quality journalism (although your mind will tell you it is, just because you paid for it).

tempest_ an hour ago

You mainly get this because honestly I was already happy with the existing product. The main focus of this post is not something I was really looking for and is a nice addition but I would still be using the existing product regardless.

Basically I just want search that I can actually filter are returns relevant useful results.. This adds an extra facet that I might filter on from time to time but the main ones, which are time and exact strings, are the reason I use the product.

sph 32 minutes ago

A good product that is not solely focused on rent seeking these days is worth celebrating.

ymolodtsov an hour ago

The problem with micropayments isn't the tech really, it's that only the users want them but not any publisher. Which is completely reasonable.

carlosjobim 29 minutes ago

Publishers want them and many have tried. It is the other way around, people don't want to make micro payments. Some day they do, but the evidence proves they're wrong.

CoastalCoder 6 minutes ago

gherkinnn 8 minutes ago

Longstanding user and it is great!

It is one of the very, very few digital services that hasn't fucked me over within a year.

I will celebrate as if I had discovered Kagi yesterday.

tempest_ 2 hours ago

I've been enjoying Kagi for the last couple years.

Even as LLMs slurp up most of the internet and replace search I think Kagi is still useful.

Reddit has recently blocked access to old reddit without an account and the ability to filter out stuff like that is useful.

optionalsquid an hour ago

Alternatively, you can configure Kagi to rewrite Reddit links to point to an alternative front-end via https://kagi.com/settings/redirects

  ^https://(www\.)?reddit.com|https://safereddit.com
EDIT: See here for a list of instances: https://github.com/redlib-org/redlib#instances

Saris an hour ago

LibRedirect is useful for this (and other sites) too if you want it to apply over the whole browser.

Friends send me links to reddit and stuff so it's handy to have an automatic redirect.

stronglikedan 26 minutes ago

> Reddit has recently blocked access to old reddit without an account

I don't understand why this is a barrier considering their accounts aren't invasive at all since you can use a temporary email account to sign up, and then you never have to do anything via email after that.

datakan 2 hours ago

I wish they put more effort into Kagi news. Feels very barebones but has a lot of potential.

msdz 2 hours ago

What do you feel is missing for a free news offering?

I don’t personally like it all that much, because it feels like it’s missing the depth I like in well-written reporting, but for those who just want a quick overview of topics once a day, it seems to work pretty well, no?

mcny an hour ago

roblh an hour ago

Me too. The longer I use it, the more I like it. Initially I found myself going back to google fairly often, but unless I'm specifically trying to find a product for sale in my region, Kagi is almost always better now. Maybe Kagi got better, or google got worse, or probably both.

tonmoy an hour ago

I can still access old.reddit.com from my country/region

bee_rider an hour ago

It is just people without accounts who are being blocked, and maybe it is regional?

mcny an hour ago

bradyd an hour ago

> Reddit has recently blocked access to old reddit without an account

Old Reddit still works just fine without an account.

tome an hour ago

Are you sure? If I visit https://old.reddit.com/r/haskell/ in private mode (i.e. without my auth cookies) then I am asked to log in.

kriz9 an hour ago

bradyd an hour ago

tempest_ an hour ago

Maybe for you.

I get a nice

> Log in to use old Reddit

> To keep Reddit safe, accounts are required to access old Reddit. Log in, or continue without an account on reddit.com.

watutalkinbout an hour ago

angel- an hour ago

Not working for me either without an account anymore. Seems like a very recent change.

samtheprogram an hour ago

I had to login the other day to use it. Probably getting slowly rolled out.

LoganDark an hour ago

> Old Reddit still works just fine without an account.

It works sometimes, it's been inconsistent lately. I assume they're rolling out the blocks incrementally or something, because sometimes I can get through to it in a private window and other times I can't.

john_strinlai an hour ago

it works just fine for you, but not everyone.

NBJack an hour ago

Not for long, sadly.

getfacl 2 hours ago

This makes sense to me as a Kagi user. The chance that I'm going to subscribe to read an article I found via a search is zero.

bluGill an hour ago

If they had a "here is what I'm currently subscribed to" that might be valuable. Everybody should subscribe to the local news paper - to get local news. Things that matter to them that they won't hear about. (Odds are you the reader do not live in the same city as me and so have no interest in who is on my local school board - but I'm trying to figure out who to vote for and need more information than I can find).

However tracking that is tricky at best.

mrngld an hour ago

I'd be onboard with supporting a local newspaper -- if they hadn't gone all-in with aligning themselves to a particular political tribe. They're part of the problem Ground News makes obvious to a hilarious degree, where if something happens that doesn't fit the narrative you just will never see it if you only look at their platform. Given that not everyone has a reputable local newspaper I don't know that saying "everybody should" is necessarily sound advice.

Anyway, you can block sources individually in Kagi, that can weed out the most common paywall options you don't have, like Forbes or whatever.

bluGill an hour ago

carlosjobim 24 minutes ago

pelagicAustral 2 hours ago

Killer feature. It would be awesome to have some plugin or userscript to auto-swap the e-begging scammy link for an Archive link instead.

azan_ 2 hours ago

Is asking for money for your work begging? That's interesting take.

ImPostingOnHN an hour ago

You're right, but I'd personally be okay with the paywalled article search results not showing up, since they are ads masquerading as usable search results.

If the publisher wants me to subscribe (and many do publish content worth paying for), they can reach me via normal means, versus corrupting my search results.

rafram an hour ago

cosmic_cheese an hour ago

no-name-here an hour ago

pelagicAustral an hour ago

Assuming an actual journalist wrote the piece, and it's not some stitch together, half-slop, half-cognitive noise-ridden piece of crap, like, you know, about 80% of all content behind a paywall.

Nextgrid 2 hours ago

There is a regex replacement feature. You could build a list of known paywall domains to rewrite them to your desired paywall unblocker service.

teroshan an hour ago

bramhaag an hour ago

There is the extension Bypass Paywalls Clean[1] which fetches content from archive sites and displays it on the original page.

[1] https://en.wikipedia.org/wiki/Bypass_Paywalls_Clean

Gander5739 an hour ago

There's Bypass Paywalls Clean (not going to link for obvious reasons).

Cider9986 2 hours ago

I would pay for Brave or Kagi for like $2-3 per month if one of them supported private payments(actually that's exactly what Brave costs).

Paying should get you more privacy not less.

I'm not paying for Kagi because it's expensive and also doesn't support private payments and Brave has better UI for me.

Brave blocks their own ads while not supporting private payments and it doesn't let you use the search premium in Vanadium, it seems, which makes me question whether my subscription would work cross device. Maybe it would but only in Brave browser.

>Support private, independent search

>See search results ad-free

>Get a cleaner view on all results pages

>Cancel any time

Brave should also add more perks like maybe a smarter AI overview or if they ever stop giving unlimited AI then you get some. At this point it seems like a donation.

robin_reala an hour ago

Depends on how private you want to be, but you can pay Kagi with Bitcoin[1] and use that to buy privacy pass tokens and access it through Tor.[2] It’s not complete privacy, but it decouples the account from the searches.

[1] https://help.kagi.com/kagi/plans/payment-methods.html

[2] https://help.kagi.com/kagi/privacy/tor.html

Cider9986 an hour ago

Yeah they should use privacy pass for the default accounts as well to decouple payment from account.

Dayshine 42 minutes ago

moebrowne an hour ago

Not sure what you mean by "private payments" but Kagi accepts Bitcoin: https://help.kagi.com/kagi/plans/payment-methods.html

Cider9986 an hour ago

Monero ideally combined with something like this but one or the other would also be an improvement:

>Brave uses a blind token protocol based on Privacy Pass, which decouples payment identity from service usage. These privacy-preserving subscription credentials allow the browser to verify you have a valid purchase of a premium product (like Origin) without learning anything about you.

https://brave.com/origin/

ymolodtsov an hour ago

Do you imply that you never order anything online?

Cider9986 6 minutes ago

My search engine is a digital product that's already free and private and good and is different to when you give someone your home address to send a package.

contagiousflow an hour ago

Do you use Google instead?

Cider9986 7 minutes ago

Brave.

dewey 7 minutes ago

Ideally it would have a way to allow list domains for sources where I do have a subscription.

pkilgore 2 hours ago

I love Kagi but will probably be selective or ignore this one. Sometimes, I like to know what's out there, and I don't have a problem with paying for good content.

taintify an hour ago

Why do you love it?

I think they have no imagination - like most rich kid “founders” they have no original ideas.

Would never use this trash

jjice 34 minutes ago

What's trash about it? Giving no explanation does not contribute to a conversation.

I also don't care if people have original ideas if they take an existing idea and do it better, which is what I appreciate about Kagi at the moment. I don't want anything interesting or novel. I want search that doesn't berate me with ads or AI overviews if I don't ask for them.

entrox an hour ago

Because it lets me hide the trash that is commercialized internet. I choose what service I pay for, e.g. Kagi, everything else should just vanish from my point of view and stop polluting my eye space.

That's why this is a good feature.

SamBam 2 hours ago

Hmmm, so if you are looking for some news item, you'll only find AI-written clickbait articles covered in pop-up ads, rather than any news sites that employ journalists?

sarjann an hour ago

That's why it's a choice. If you weren't going to sign up to a site then it's just a pure degradation of experience to see links you can't use.

no-name-here an hour ago

I guess the idea is that such people strongly prefer seeing ads instead of a paywall?

rvz an hour ago

I agree it is a choice.

That's why it is a choice for companies to not pay for (human) software engineers anymore for writing software and to get all the agents to do the work and write the software that we use today.

Just like how we will see articles now being written by AI that will rank in Kagi instead of human written articles.

magguzu an hour ago

Kagi specifically rocks because it lets you downrank those sites.

demibabs 2 hours ago

Yeah, I don’t get it. Do people want actual journalism to go out of business?

Shank an hour ago

> Do people want actual journalism to go out of business?

Former Google Contributor user reporting in! I absolutely do not want normal journalism going out of business, but I’m not going to subscribe to Bloomberg or FT or any of those sites on a recurring basis for one article. I love the idea of paying a non-subscription for one thing, occasionally, though!

iamnothere an hour ago

imzadi 30 minutes ago

I'd be more than happy to pay for the day's paper when I want to read it, assuming it is just that, I pay for a particular day's paper and I get access to the whole paper without having to subscribe, register, or give up my personal information. If I could buy a paper online the same way I could in a 7-11, I absolutely would.

the__alchemist an hour ago

They have made a bed to lie in. Kagi is worth paying for; the vast majority of news sides are targeted at people who don't think critically, and serve a narrow-scope of corporate narratives.

I love high-quality journalism (Mainstream sources of the past; a few current gems like Quanta and PBS; you can find other exceptions). I have explicitly bumped the priority of the high-quality sources in search, and blocked or subdued some of the low quality ones which come up frequently.

hootz an hour ago

Paywalling all content sucks, it just makes me leave the website. I pay for a news website from my country that gives me extra cool stuff like opinion articles and cultural highlights from my city, not because they paywall the basic news.

bee_rider an hour ago

OroPla an hour ago

Didn't journalism go out of business decades ago and now not even pretends to be journalism anymore? I feel it has gotten so bad that most younger people alive today do not even realize what journalism is supposed to be: only report the facts, never add your own opinion to the facts, if there is more than one side, ask each side and report what each side has to say without omitting or adding anything. These are just some super basic features of journalism that do not seem to exist anywhere anymore.

john_strinlai an hour ago

mrngld an hour ago

rvz an hour ago

cosmic_cheese 41 minutes ago

The small handful of news sites I willingly subscribe to are in my RSS reader (where stories are even more de-junked than is possible in a browser), so paywalled sites showing up in search adds no value.

If a news site wants to join the ranks of my RSS feeds they need to be of high enough quality that their reputation does more work than paywalled search results do.

Nextgrid 2 hours ago

If you don’t intend to pay anyway, what’s the issue? This option just gives you the choice to hide paywall results.

robin_reala an hour ago

Easy to block / downrank known slop sites from Kagi: https://help.kagi.com/kagi/features/slopstop.html

stldtt an hour ago

Not all news sites are paywalled (reuters for e.g) and if I use a paid search engine like Kagi I'm not looking to experience unwanted advertisement (paywalls are an ad.)

sssilver an hour ago

This is the kind of feature that would potentially make me switch, but I feel like at this point AI has disrupted web search for me in such a fundamental way that I rarely use a search engine nowadays.

wccrawford an hour ago

I'm still getting there, but I've seen this. I spent hours a couple days ago trying to get pi, llamacpp, and qwen3.6 working well. I had them working before, but not well. I Googled, and I followed it's instructions and following the links it found. But everything was a partial answer, and nothing was clear.

I finally decided to ask Claude to do it. It discovered things I didn't even know to look for, immediately making it run twice as fast, and then also helped me do the changes I wanted, like per-model settings.

I knew it was settings.json, but I had it in the wrong spot (thanks, Google) and what I didn't realize is that the 2 settings.json files are different. 1 is global-only, and 1 is per-model-only. If you put the wrong settings in, it'll just ignore them silently. Which left me wondering why it didn't work.

Then it tested my settings. Then I had to use the official webpages to set the proper settings and it tested those, too. It made suggestions about removing or changing some settings that also made things work better and faster.

In less than a hour, it had vastly outstripped everything I'd tried, and it got it right and verified it.

And with how wrong I've seen Google's AI be (and how wrong others have said it is) I can't trust it to even bring me the basics about things. It's worse than useless, it's distracting.

magguzu an hour ago

Just be careful with nuance. Someone close to me asks Gemini absolutely everything because they like how it gives you a straight answer, but real life doesn't always work that way. Context is often missing (besides just being wrong at times).

Search engines shouldn't be replaced by AI but they unfortunately are and it result sucks to see.

dspillett 16 minutes ago

There are quite a few Luddites like myself that don't trust AI summaries and would rather just have the relevant links, so for us this would be useful. Though TBH I'd rather just stick with the paywalled articles being highlighted as such so I can choose on-the-fly. Perhaps the block option is something I'll turn on when almost all the results are paywalled and I want to see if there is a better option before going to one of them.

clickety_clack 41 minutes ago

I wish Kagi had existed years ago. I just saw someone talking about the Google SEO-laden experience when troubleshooting coding errors and realized it’s a pain I haven’t felt in a long time. It’s telling that Google never made a “remove this site from results” option. Their incentives weren’t set up to provide the best user experience.

tomhp 29 minutes ago

Even worse, their programmable search used to allow this, but the feature was removed this year.

steveslayer57 3 minutes ago

AI slopped extension for supposedly just badging paywalls, not excluding them, https://github.com/masseyzachery57/paywall-filter-extension

dethos 12 minutes ago

This is actually an excellent idea. Well done.

kenanfyi 13 minutes ago

I use the Bangs feature to open paywalled links with archive.is with !a. When I write !a before the link in the address bar, it redirects to the archive for that particular page. Most of the time it is already in archive.is.

Bang settings:

URL Template: https://archive.is/newest/%s

Bang shortcut: whatever letter you want.

I'm sure a basic browser extension can be developed for that specific action too, but it does not bother me to write !a every now and then.

OroPla an hour ago

While this is a nice feature, needing an account (nevermind paying) to then only get a meta search engine will prevent me from ever using it.

I already spread my searches across at least four different engines (Bing, Ecosia, Startpage & Yandex), so no single provider has a complete profile of all my searches.

I certainly won't be paying to hand over my data.

tonytamps an hour ago

I don't think your strategy is as effective as you think it is for protecting your privacy online. You should also read Kagi's privacy policy before implying Kagi would harm your privacy model.

jwr 29 minutes ago

I used to be a Kagi subscriber and I would so like to be one again — but their stubbornness in using Russian data in their indexing, and paying Russian businesses for the data is what is stopping me.

I wish they stopped doing this. I really, really want to like them and be a subscriber again.

stronglikedan 25 minutes ago

ignoring any Russian data isn't that hard

dewey 5 minutes ago

Actually it's kinda hard in a world where very few companies dominate the search index market and there's very few players who license out their data, one of them being a Russian one: https://kagifeedback.org/d/5445-reconsider-yandex-integratio...

shahedshah 2 hours ago

Very useful feature to have. I've not dived into using Kagi just yet, but they may just win me over with this.

cormorant 2 hours ago

I want the opposite. I want links to the best quality information - even if I have to hunt down a copy.

oriettaxx an hour ago

omg, great really!!!

When will this be available into HN, too ?

john_strinlai an hour ago

>When will this be available into HN, too ?

hn already disallows paywalled links, unless there is an easy/low-effort bypass (noscript, archive link, gift link, etc.).

no-name-here an hour ago

I don't see it offhand in the newsguidelines page nor the submit page? https://news.ycombinator.com/newsguidelines.html https://news.ycombinator.com/submit

Edit: It's in the newsfaq page https://news.ycombinator.com/newsfaq.html per the replies

croemer an hour ago

john_strinlai an hour ago

treetalker an hour ago

I believe Kagi has been annotating paywalled results with a circled dollar sign for some time.

This new feature completely weeds such results out of every search.

It would be nice to be able to toggle this (1) in the options drop-down menu on the results page (like Verbatim and Personalized modes), as well as (2) inline (with a "!nopaywall" bang or something).

no-name-here 2 hours ago

Would the biggest impact of this be for things like news sources? I guess the idea is that ads are preferrable, as ads and paywalls seem to be two of the primary existing ways that such places support themselves (or don't)?

SoftTalker an hour ago

Except for maybe some very local stories, almost all news is available on free sites, or will be shortly once the story breaks.

no-name-here an hour ago

Are we talking a company rewording reporting that a different news company hired 1 or more journalists, etc. to originally report? And in this example, are the sites "free" because ads are enabled?

sarjann an hour ago

I would like to be able to whitelist some paywall sites, e.g. I have an FT subscription and would like to have that bypass the block.

kkarpkkarp 2 hours ago

Kagi, search engine that costs you to use has something against publishers who require a fee for their content. Interesting

frameset 2 hours ago

It's not that they have anything against them, it's giving their customers who don't want to see them the choice not to.

docheinestages an hour ago

Kudos to Kagi!

imnotr0b0t an hour ago

The update is useful, especially the paywall filter. I might even consider switching platforms; it seems convenient...

r721 2 hours ago

Paywalls differ by the difficulty of circumventing them - for NYT/WaPo paywalls it's enough to delete cookies for domain, for WSJ/FT you have to use archive.is, and surely there are paywalls with no known workarounds too.

scotty79 2 hours ago

That should have been an option in Google since the first paywall was put up.

Nextgrid 2 hours ago

Google even has/had a rule against cloaking (the practice of serving search engines a different version of the page from the one visitors get).

stldtt an hour ago

This started with expertsexchange:

https://news.ycombinator.com/item?id=3182198

but unlike that stack overflow predecessor that attempted to build itself as a paywalled business, newspapers successfully strongarmed Google, at least in the EU, by arguing against Google monopolistic powers so it's unlikely that Google would dare put them in the shitlist.

DeepLogin an hour ago

I use Brave Search+ DuckDuckGo+ Google Image search and that seems to sastify my search requirements while keeping my payment info private.

I don't think I will ever think of subscribing to Kagi metasearch engine, especially since their paywalled search offerings seem to be inferior to other options.