Evan Rodgers πŸ³οΈβ€πŸŒˆ(@evanrodgers) 's Twitter Profileg
Evan Rodgers πŸ³οΈβ€πŸŒˆ

@evanrodgers

Digital IT. Formerly a writer and editor in digital media.

ID:21502055

calendar_today21-02-2009 17:41:19

1,0K Tweets

6,5K Followers

1,7K Following

Evan Rodgers πŸ³οΈβ€πŸŒˆ(@evanrodgers) 's Twitter Profile Photo

Everyone should do what makes them comfortable, but this is too manual / time consuming in my opinion.

The first thing you need are your URLs. Once you have those in a list, you can ask ChatGPT to create a python (or even powershell or terminal) script to just download them all

account_circle
Evan Rodgers πŸ³οΈβ€πŸŒˆ(@evanrodgers) 's Twitter Profile Photo

Yes, I should mention that I'm only scraping EN and EN-US folders for this exact reason.

I am also not getting any images. Articles only.

account_circle
Evan Rodgers πŸ³οΈβ€πŸŒˆ(@evanrodgers) 's Twitter Profile Photo

I'm trying to scrape everything before the site goes down (doing it afterward via Internet Archive is not ideal for several reasons) but of course my home server is offline and I'm stuck at work.

The site is huge, but I will do my best πŸ‘

account_circle
Evan Rodgers πŸ³οΈβ€πŸŒˆ(@evanrodgers) 's Twitter Profile Photo

This is actually good-ish news. Google Takeout is not appropriate in an enterprise environment, and it is simply security best practice to disable it.

I don't necessarily agree philosophically, but it is normal for this to be off and very abnormal to be on.

account_circle
Evan Rodgers πŸ³οΈβ€πŸŒˆ(@evanrodgers) 's Twitter Profile Photo

I said this over on Threads, but if you're a journalist that needs help backing up your articles (i.e. web scraping them), I will happily help you for free. Just DM me, text me, whatever

account_circle
Andrew Sink(@AndrewASink) 's Twitter Profile Photo

Just realized I can use the SquiggleCam generator by πŸ‡ΊπŸ‡¦ Maks Surguy for pen plotters for the laser engraver and WOW! ⚑️

Check it out! JPG converted into an SVG; each line approximating the pixel color value in a specific area!

Just realized I can use the SquiggleCam generator by @msurguy for pen plotters for the laser engraver and WOW! ⚑️ Check it out! JPG converted into an SVG; each line approximating the pixel color value in a specific area!
account_circle