Yacy: Distributed search engine

Hackerspace Computer Science
#1

A very interesting concept, created a while back.

https://www.yacy.net/en/

I find myself cornered into relying on Google-sourced search results far too often. This might be a good alternative to that.

3 Likes
Google Images Now Displays Copyright Info
#2

I remember that from back in the day. Ended up using elastic.co instead when http://www.yacyweb.de/peers.htm died.

Thereā€™s also now QueenBee which is built ontop of ethereum and ipfs. which is part of the ā€˜DWebā€™

Their Prototype is online via an ipfs node.

1 Like
#3

I just installed YaCy on my laptop. Iā€™m going to play with it and see how effective it is. When I worked at Convex computer we had lots of supercomputers available and one of our compiler guys built a distributed prime number calculator that ran on our computers at night. It was fascinating to see the process unfold.

We used it to study distributed computing for very large matrix and composite fluid dynamics computations. The algorithms to do this are common place now, but in the 1980s they were relatively new.

I would love to get away from depending upon Google to find everything for me. I think Google must know what most of the world searches for every single day. The politics of this are frightening.

Monopolies are unhealthy no matter who they are.

2 Likes
#5

Will try to do another class on YaCy before the end of the yearā€¦

https://calendar.dallasmakerspace.org/events/view/7568

It does take longer to fetch results than it used to.
Might be worth setting up a server just to support the network and to scour useful topics.

3 Likes
#6

I agree with you on getting away form google. With that, nothing would stop one from using the original search engine, Archie, Veronica, or building oneā€™s own search engine using https://hub.docker.com/r/sebp/elk/ and setup a crawler http://www.florian-hopf.de/artikel-vortraege/scrapy-es-smka/

1 Like
#7

Might be worth setting up a server just to support the network and to scour useful topics.

if we can put it in a docker container (or one is built) we can deploy it t the community grid.

1 Like
#9

I missed the class, too. @dataguy Iā€™m really thrilled with all of the VCC/Comp Sci work I see going on at the space. I havenā€™t taken much more than the Arduino class a while back and the class on building your own ā€œArduinoā€ from the open source schematic, but @denzuko keeps my interest with all that he and the Admin group at DMS are doing.

Thanks for all that you do @denzuko and everyone else, too. Our volunteers are simply outstanding! Zack, I know you do a lot in the Radio world, too. Many thanks.

BTW. I miss Walter because of all the great things he did and what he taught me, especially in electronics.

1 Like
#10

Thank you for pointing out the search engine resources.
Bringing an older rackmount server for Science and another for CC this week.
Give me some time I will see what else I can come up with.
Is there a display of current computer resources and their total utilization (VMware, etc)?

#11

Thank you for your kind words, coloneldan.
I think we can get enough momentum to have the best embedded / microcontrollers / electronics makerspace anywhere.
Will have some Raspberry Pi classes on the calendar for you this weekendā€¦

#12

Iā€™m out this weekend in Houston, but I look forward to future classes.

#14

Is there a display of current computer resources and their total utilization (VMware, etc)?

prlxmonitoring01 and monitoring.communitygrid.dms.local

#15

I missed the class, too. @dataguy Iā€™m really thrilled with all of the VCC/Comp Sci work I see going on at the space. I havenā€™t taken much more than the Arduino class a while back and the class on building your own ā€œArduinoā€ from the open source schematic, but @denzuko keeps my interest with all that he and the Admin group at DMS are doing.

Thanks for all that you do @denzuko and everyone else, too. Our volunteers are simply outstanding! Zack, I know you do a lot in the Radio world, too. Many thanks.

BTW. I miss Walter because of all the great things he did and what he taught me, especially in electronics.

Thanks @Coloneldan. Itā€™s because of our members that we keep doing what we do and members like you that support the committee are greatly appreciated.

#16

OK cool.
Just listed some for Sunday, Nov 4thā€¦

1 Like