/tech/ - Technology★

>>1003771 (OP)

look at >>965329

>https://startpage.com/ or https://ixquick.com

startpage is a proxy for google - so there's no reason to use pure google at all

ddg I like for the results and the automatically displayed answers from wikipedia, stackoverflow and such

metager is another privacy based one

>>1004507

Yay, someone mentioned MetaGer!

t. MetaGer dev

(I promise there will be more love for the English version in 2k19)

>>1004566

>based un naziland

I believe they are not too concerned about privacy there, how can the search engine refuse to comply with local law about keeping logs?

https://searx.laquadrature.net/

(Searx 0.13.1, searx.me is 0.14)

La Quadrature fights for privacy and freedom, though it suffers from being hosted in France if I'm not wrong.

Basically anything in Europe has law about keeping logs. And RGPD which says to not keep them too long and secure them, but whatever, they still have to keep logs.

I made this awhile back, it's a wrapper around qwant's unofficial api, it's similar to searx in that it strips headers down to bare minimum and doesn't have any js, canvasing etc. Unlikely to be finished due to my growing disgust with C, but still functional, I use it as my daily search engine. Unlike searx it's mostly meant to run on localhost. The source is attached, download mongoose and jsmn, if you're on openbsd in mongoose.c comment out:

mbuf_init(&ctx->psk, 0);
if (mg_ssl_if_ossl_set_psk(ctx, params->psk_identity, params->psk_key) !=
    MG_SSL_OK) {
  MG_SET_PTRPTR(err_msg, "Invalid PSK settings");
  return MG_SSL_ERROR;
}

and the functions ``static unsigned int mg_ssl_if_ossl_psk_cb and ``static enum mg_ssl_if_result mg_ssl_if_ossl_set_psk

compile with something along these lines swapping variables and locations to suite your needs:

libs="-lssl -lcrypto -lpthread"
cc -L/usr/local/lib $1 -DSSL_PEM_FILE=\"server.pem\" -DSSL_KEY_FILE=\"server.key\" -DSERVICE_PORT=\"8000\" jsmn/jsmn.c mongoose/mongoose.c -DMG_ENABLE_SSL $libs

No one is really expected to use this, but if someone wants to take it and run with it they're welcome to.

Also 8chan/tech/ doesn't let you post text files, or multiple files without js, so I'm just going to link the files from when I originally posted this awhile back.

https://www.lainchan.org/%CE%A9/src/1541604661622-0.txt

https://www.lainchan.org/%CE%A9/src/1541604661622-1.txt

>>1004566

Und, kam der BND schon vorbei und hat alles verwanzt?

>>1003771 (OP)

>Google is better than DDG at anything

Google is literally more censored than Baidu. Anything worth searching for is blocked and top results are all scam companies that paid to be on top. They sort results based on payments received, not relevance.

Anyone know of any engines that let you create a list of sites to be searched?

>>1004659

Nah, die haben wohl besseres zu tun als sich um Nischen-Suchmaschinen (also alle, die nicht Google oder Bing sind) zu kümmern. Bedenke, dass das Google-Monopol in DE schlimmer ist, als in jedem anderen Land.

>>1004640

>how can the search engine refuse to comply with local law about keeping logs?

We don't have logs and noone tried to force us (yet). If someone tries we won't be quiet about it.

>>1004678

You mean like "site:fuckjewgle.com" or something else?

>>1004678

It's not just google. For any non-programming related query, the top search results on any search engine are going to be SEO-optimized spam. It's absolutely horrendous at this point, and it really showcases how search engines have not improved their core functionality in two decades

searx

people at my workplace are using ecosia.org because of the whole tree planting thing. never heard of it before

>>1004640

While RGPD says to delete logs after 3 years, if the user has not visited since...

French law requires to store three years of logs.

>>1004921

i use it, it makes me feel better about my shitposting addiction even though it's just broken bing all over again

>>1004678

>Anyone know of any engines that let you create a list of sites to be searched?

I bet wget and ag/ack/whatever could be used as a very good offline search engine for a subset of websites. You could spend a little time to write a HTML/CSS/JS garbo stripper, keeping nothing but plaintext, saving space and expediting the searches.

>>1004921

> https://info.ecosia.org/about

>Happiness Officer

>Tree Planting Officer

>Sustainability Shopper & Cook

What in G-d's holy name?

>>1004678

>Anything worth searching for is blocked and top results are all scam companies that paid to be on top. They sort results based on payments received, not relevance.

Are you just making that up? Because I know quite a bit about SEO and to my knowledge, it's not possible to simply 'pay to be on top'. You can pay a team of professionals to optimise your site for SEO, and it may or may not be effective, but you can't just pay Google to show your site as the first result. I've literally never even heard of this before.

>Anyone know of any engines that let you create a list of sites to be searched?

There was Blekko, and it was decent, but they've been bought by IBM and are now working on Watson.

>>1005466

Good results.

>>1005501

Who else /doing good/ here?

I add a few pages to wiby a week and then they show up in results soon after. Feels good

>>1005466

based and redpilled

>>1004687

Hätt aber noch ne Frage:

Die Seite benutzt ja standardmäßig GET. Wird das dann nicht vom ISP mit der Vorratsdatenspeicherung geloggt?

>>1003774

>riffing off the same motherfucker who wrote 'The Lorax'.

Really, nigger?

>>1006282

>Hätt aber noch ne Frage:

Gerne.

>Die Seite benutzt ja standardmäßig GET. Wird das dann nicht vom ISP mit der Vorratsdatenspeicherung geloggt?

Nö, nicht mehr unter https. Die komplette Anfrage (mit Ausnahme der Domain) wird verschlüsselt übertragen. Das ist bei allen Webseiten so, die https verwenden.

Würde man die Suchparameter per POST senden, würde man die Daten nur innerhalb des verschlüsselten Blocks verschieben. Allerdings kann dein Browser POST-Requests nicht so gut cachen. In Wirklichkeit ist das ganze noch ein wenig komplizierter, aber das reicht erstmal.

Wenn du noch mehr Fragen hast, wende dich gerne an (office ät suma-ev Punkt de) . Ich hab nämlich eigentlich noch bis nächste Woche Urlaub ;)

>>1006293

>Wenn du noch mehr Fragen hast

Nein. Das war alles. Danke.

ITT: I can't program my web crawler

bump as better search engines are needed badly in currentyear

>>1006552

Post signed with geniune oldfag meme. zoomer >>1006478 BTFO

>>1006293

>Nö, nicht mehr unter https.

But do check whose certificate it is. If it's a cloud provider, it's botnet. If it's DigiNotar, it's botnet (and update your computer because those certificates have been untrusted for 8 years). If it's LetsEncrypt, it's probably fine.

>>1017910

Yeah, I've bookmarked https://wiby.me/surprise/ and I click it a few times a day. I've gone through hundreds of sites and I'm sure there's thousands more to enjoy though I'm starting to get duplicates on the daily. The other bookmark I click on daily is javascript:alert(':)'). That boy keeps me going.

searx.ordoevangelistarum.com

>>1017919

>ordoevangelistarum.com

Thanks, that's a pretty good site which also happens to run a Searx instance, great :)

>>1003771 (OP)

google is "good at finding things" because it collects your data and shows results based on that data instead of just showing some random sites that contain the words you were searching for.

>>1022595

It isn't even that good at finding things because they interfere with their system to censor some results/promote others that have bought a higher place in the search results, making it more difficult to find some niche stuff or that may be somewhat controversial. If they at least let it be a pure botnet that works entirely from the data they steal from everyone, but no, it's not just botnet, it's commie botnet.

>>1022596

If they promote paid results then it's a capitalist botnet.

>>1006478

web crawlers and search engines are what killed the internet, prove me wrong.

Once I was studying mathematics and simply typed "logic" in Google. How naive I was!

>>1022595

This is modern google

>dog breed most likely to develop eye infections

>restult 3: Jay-Z is a dirty dog according to latest twitter scandal

Total fucking garbage. You have to datamined to death and want to live in an echo chamber to find it useful.

Forget about censorship it's a junk search engine. The only good thing modern search engines can do is search for songs when you know like 4 lyrics.

>>1004566

>MetaGer

You knew!? MetaGer is one of the most secret black projects!

kek, this was the first site to appear on wiby

http://flamesgif.com/archive/ate_my_balls/mr_t.html

Found some old websites from wiby. My god coming across dead forums always breaks my heart.

>>1003774

>Also ddg is probably botnet

>probably

confirmed long ago, besides all is botnet for all values of net

>Disable safe search

>Search "porn" out of curiosity

http://www.freedomporn.org/

This is fucking funny

>Freedom Porn is a pornographic site for anarchists and activists.

>As such it has pornographic and sexual content, unfortunately this means that you are not allowed to view it unless you are at least 18 years old.

>Please only procede if you are at least 18 years old or United States of America government has ended discrimination by age in its jurisdiction.

>>1029546

>anarchist porn site doesn't implement TLS

>>1029546

If they were such hardcore anarchists, they'd have CP.

http://banana.fws1.com/

Heh.

>>1029574

There is a frequently posting user naming himself "Happypedophileguy1976nature" who films himself dancing naked

>>1004646

You can also use the lite version of Qwant, it's basically the same without JavaScript and shit

>>1029727

except for the boards being DEADRIP

>>1022634

no.

You guys ARE doing your part and adding links to wiby, right? I added three today

>>1029966

I'll do it after I archive some Japanese geocities sites. Not much point doing that now when the service over there is going down in March.

Just submitted 8 websites, 3 of which were pornographic. Now we wait

https://searxes.danwin1210.me/ god tier aggregator of aggregaytors, the only catch is it appears you can't get results directly from clearnet urls

>>1029966

Added some more. About 10 in the last couple days.

One thing I noticed about wiby and don't like is that most of the stuff is just linux trannies' crap. If you search for a term it will bring up a ton of gay shit. I'm trying to add a better variety of pages so it can actually be useful as a search engine.

If you're not running your own searx instance then you don't deserve to be on the internet.

http://www.tatjavanvark.nl/hha/viewer111_a.html

Whoever is adding links to wiby has good taste.

I suppose it's nice my website is the only result when you search for fizzbuzz. I initially found that rather surprising.

Google isnall u need

Actually feel like wiby is our savior now. Such a nice positive development for once. Hopefully you are all doing your duty and adding pages to it. It will pay off when wiby can be used as a real rather than a novelty search engine.

>>1003771 (OP)

Html only What you think this is 1999

>>1048359

>Hopefully you are all doing your duty and adding pages to it.

and also if you make a site, make it oldschool.

some good info here: http://newchan.nichesite.org

>>1048462

Perhaps say "make it simple" rather than "make it oldschool"; to some people, the latter means making a Geocities parody site which is more often than not cringe-inducing.

>>1048467

yes, you are totally right. i didnt think about that but when you put it that way it really is better to say simple. thanks for the correction.

>>1048462

>This site requires Javascript to work, please enable Javascript in your browser or use a browser with Javascript support

you're trolling right?

>>1048359

I don't know if I've been spending too much time on /pol/ but I can't help but worry there may be a (((catch))) to Wiby. Does anyone know who owns it?

I like the idea of Yacy, a open source distributed search engine. Set up a node to index sites that interest you and contribute to the Yacy network (or just horde the results for yourself). I don't know of any other project that doesn't just shift power from one dictator to another. Storage is cheap. Stop waiting for someone else to save you. Take control yourself.

>HTML 1.0 only

What a load of crap

Any good search engine for rss/atom still around?

>>1050306

rip when the taxman comes around

>>1050306

What'ts that book in the top fight corner?

>>1050306

>>1050319

what?

>>1050319

>>1050427

???

>>1050425

Some translator addon