no longer working with flickr

[next55777]

Seems like ripme is no longer able to download anything from Flickr. To reproduce please use first Flickr photostream that comes to your mind. Each time ripme returns "no images found at" error. I use the latest version of ripme and JavaPortableLauncher 3.0, which worked perfectly for me so far. Last time I used them was about 2 months ago and everything was ok.

[drguildo]

Flickr have changed their site to make it as difficult as possible to parse pages and do simple stuff like get a list of all the photos in a set. Everything is done via dynamic JavaShit calls. Check out their HTML, it's a disgusting mess.

The funny thing is they've included a HTML comment at the top of each page trying to solicit job applications, as if anyone would want to go and work for them after seeing their monstrosity.

[next55777]

Flickr have changed their site

This is what I was afraid of...

[EraYaN]

How about the flickr API?

[version365]

How about the flickr API?

try this app http://downloadair.ghusse.com/

it uses flickr api..

[ingochris]

Hello EraYaN,

API call method:

flickr.photos.getSizes

Source: https://www.flickr.com/services/api/flickr.photos.getSizes.html

[bobobo1618]

I did this but it's messy, based on #286 and adds a dependency for OAuth: bobobo1618@ce9b51d.

Supports galleries, profiles, albums and groups though.

[hrxn]

So it is only working while authenticated, i.e. signed in with a Flickr account?

I think that is no big deal at all, legitimate requirement, IMHO.

[bobobo1618]

Afaik, the options are:

• Use the API with a valid set of credentials
  • And a user-authenticated OAuth token (this gets you things like images only shared with you)
  • Just with the API keys (this gets you access to public data)
• Scrape the page, which as discussed above seems to be difficult.

But no, you don't need to be signed in if you're only downloading public data. You do still need API credentials though.

[hrxn]

Okay, good to know.

But I think that is the right way to do it, use the API, provide key if necessary.

[hrxn]

BTW, do you have by any chance a build of your fork somewhere @bobobo1618?

I can help to test it, if you want.

[bobobo1618]

Sure. Here.

You'll need to set up the variables required by your ripper though.

[hrxn]

Thanks!

You mean the variables set in rip.properties in %HOMEPATH% ?

The file looks like this normally (relevant part only):

# API creds
twitter.auth = VW9Ybjdjb1pkd2J0U3kwTUh2VXVnOm9GTzVQVzNqM29LQU1xVGhnS3pFZzhKbGVqbXU0c2lHQ3JrUFNNZm8=
tumblr.auth = v5kUqGQXUtmF7K0itri1DGtgTs0VQpbSEbh1jxYgj9d2Sq18F8
gw.api = gonewild

So I'd assume the syntax would be flickr.auth = <key> , right? 😉

[hrxn]

Okay, scratch that. rip.properties and history.json are in your current working dir, not %HOMEPATH%

Upon first launch, rip.properties was overwritten. Not a problem, no worries.

I guess this entry is also new:

storage.module = jets3t

At least it's not in the standard repo. "jets3t" is S3, according to Google.

What are the names of the other options here, @bobobo1618

[bobobo1618]

It's in the code. You want "flickr.accessTokenSecret" and "flickr.accessTokenToken". You should set the storage module to "file". Jets3t shouldn't be set.