Is it possible to download the entire internet so you have to have an internet provider?
Is it possible to download the entire internet so you have to have an internet provider?
Joshua Roberts
Other urls found in this thread:
httrack.com
en.m.wikipedia.org
twitter.com
Matthew Evans
so you don't have an internet provider*
Jaxson Rogers
What about updates?
Gavin Williams
yes
Bentley Edwards
anyone use this?
Matthew Flores
>downloading every bit of trash on the internet to a huge fucking server room full of harddrives that would use up so much electricity you're better off paying your internet bills.
For what purpose?
Gavin Hall
spbp
OP is retarded, delete this thread you moron. Before it's too late.
David Evans
>so you don't have an internet provider*
Carter Hall
You need internet to download the internet
Thomas Parker
>I'M GONNA HAVE MY OWN INTERNET! WITH BLACKJACK, AND HOOKERS!
Kayden Ross
In theory yes, in practice no
Obviously sites like Jow Forums and Netflix and eBay would be pointless and not work
Some people do this with large chunks of Wikipedia and other similar sites if they are going to be someplace with no Internet for a long period of time and just want things to read
Nicholas Watson
Epic lol, take my upvote
Ryan Sanders
Thank you, le kind sir!
Justin Sanders
>Some people do this with large chunks of Wikipedia
Not just chunks, but the entire site. It's not even that big, too. Last time I downloaded wikipedia's text only database was about 20 GBs. But that was a couple years ago.
Landon Taylor
Me on the left
Jose Evans
You can't download everything because it's simply not possible. You will have to hack all cloud companies and download all user files and data of all people in the world so say you have the whole internet stored somewhere.
Christopher Wood
Can you do that with a traditional crawler?
Is every page on Wikipedia linked to from some other page at some point?
Aiden Cooper
No nees to even use a crawler. Wikipedia themselves provide compressed archives of their database: en.m.wikipedia.org
Oliver Bennett
If we assume you can store all that data, and access it even, then you could get a snapshot of the internet from when you started downloading, sure.
Samuel Stewart
Blake Sanchez
no
Benjamin Martinez
yeah
Christian Reyes
its so weird how asian girls look super hot and ugly at the exact same time.
Josiah Lopez
And you'll click post on Jow Forums and he won't have your post stored, so he would have to crawl again.
And this will go on forever.
And he can't really download what's on backend, he can only download a resulting page, so a lot of with would be half working.
What's the point of your idea, OP?
Brody Torres
/thread
google kinda tries to index every part of the internet, but it fails since it can't.