Search and add bookmarks to Raindrop.io

[xurc]

Hello @andreas.w! Sorry for the late reply because I've been distracted by personal stuff and things fell through the cracks.

 

I just upgraded to search_raindrop-1.6.1.alfredworkflow but unfortunately the issue seems unchanged on my end. The tokens.json file still contains only the timestamp and no authorization info.

 

I would be glad to provide further assistance so feel free to reach out to me. Thank you for all the hard work!

 

[BeGlitched]

Just installed this from https://www.packal.org/workflow/search-raindropio on M! Mac with Big Sur and it works great. No problems. Thanks!

[mdubsss]

On 1/10/2021 at 2:30 PM, AV8RDude said:

I see some questions re: authentication but none of the answers apply in my case.  I have v1.6 of Search Raindrop.io installed.  When I type "r " I get prompted to authenticate with Raindrop.io.  I hit enter and am taken to Raindrop.io where I click on "Agree".  At that point, I am redirected to 127.0.0.1:11038/?code=<some code> and I get an error saying this site cannot be reached, connection refused.  This error occurs on all browsers.

 

I'm able to ping 127.0.0.1.  I suspect this is an issue on my end (since the workflow seems to work for others) so I'm just looking for suggestions on where to look to debug this issue.  Any advice appreciated. 

 

On 1/10/2021 at 2:34 PM, deanishe said:

 

That IP address is "localhost". It always means the machine you're using. If you're getting a "connection refused" error, the workflow's webserver isn't running.

 

Look in Alfred's debugger for a proper error message.

 

On 1/10/2021 at 3:31 PM, andreas.w said:

 

Exactly!

 

I can look at this problem, @AV8RDude, if you get the error message that you'll find in the debugger, as @deanishe said.

You could send the log messages you see in the debugger in a private message to me if you don't want to post it for everyone to see.

First open the debugger, as in the linked instructions, then make sure to do the same thing you did when the problem occurred, and then copy and send the log messages you see in the debugger.

 

I also think I would need the same thing from you, @xurc, to be able to find out what's going wrong in your case.

 

Hey @andreas.w and @deanishe I think I am having the same problem as AV8RDude with authentication.

Here are my logs, there is nothing weird happening that I see. Note, I changed my real client_id to 'myClientID'.

 

[13:09:13.871] Search Raindrop.io[Script Filter] Queuing argument '(null)'
[13:09:13.960] Search Raindrop.io[Script Filter] Script with argv '(null)' finished
[13:09:13.961] Search Raindrop.io[Script Filter] {"items":[{"arg":"https:\/\/raindrop.io\/oauth\/authorize?redirect_uri=http%3A%2F%2F127.0.0.1%3A11038&client_id=myClientID","subtitle":"Press enter to authenticate now","title":"You are not authenticated with Raindrop.io","valid":true}]}
[13:09:16.259] Search Raindrop.io[Script Filter] Processing complete
[13:09:16.263] Search Raindrop.io[Script Filter] Passing output 'https://raindrop.io/oauth/authorize?redirect_uri=http%3A%2F%2F127.0.0.1%3A11038&client_id=myClientID' to Conditional
[13:09:16.264] Search Raindrop.io[Conditional] Processing complete
[13:09:16.264] Search Raindrop.io[Conditional] Passing output 'https://raindrop.io/oauth/authorize?redirect_uri=http%3A%2F%2F127.0.0.1%3A11038&client_id=myClientID' to Conditional
[13:09:16.265] Search Raindrop.io[Conditional] Processing complete
[13:09:16.265] Search Raindrop.io[Conditional] Passing output 'https://raindrop.io/oauth/authorize?redirect_uri=http%3A%2F%2F127.0.0.1%3A11038&client_id=myClientID' to Arg and Vars
[13:09:16.266] Search Raindrop.io[Arg and Vars] Processing complete
[13:09:16.266] Search Raindrop.io[Arg and Vars] Passing output 'https://raindrop.io/oauth/authorize?redirect_uri=http%3A%2F%2F127.0.0.1%3A11038&client_id=myClientID' to Run Script
[13:09:16.927] Search Raindrop.io[Run Script] Processing complete
[13:09:16.930] Search Raindrop.io[Run Script] Passing output 'Alfred Preferences
' to Arg and Vars
[13:09:16.931] Search Raindrop.io[Arg and Vars] Processing complete
[13:09:16.932] Search Raindrop.io[Arg and Vars] Passing output 'Alfred Preferences
' to Conditional
[13:09:16.932] Search Raindrop.io[Conditional] Processing complete
[13:09:16.933] Search Raindrop.io[Conditional] Passing output 'Alfred Preferences
' to Open URL

 

Edited July 23 by mdubsss

[andreas.w]

There is now a new version of this Workflow, v1.7!

 

The most important change here is that support for macOS Monterey is added.

Apple removed PHP from Monterey (which has been preinstalled since Mac OS X 10.0 in 2001), so some changes had to be made to adopt to that, and you will also need to install PHP yourself for it to work in Monterey, which I recommend that you follow PHP's own instructions for if you have not already installed it.

 

There is also quite a few more potential problems that are fixed with this update, so if you where having problems with this workflow before, please try again with this update and hopefully it will work better.

 

There are also some new features!

Bookmarks that you have marked as favourites in Raindrop will now be indicated, and will also by default be listed on top of results, and you can also now browse your Unsorted bookmarks the same way as you can browse other collections.

 

Download from Packal or GitHub!

[Christin White]

Is there any chance I'm missing a way to just manually enter/paste in a URL? I'm testing (and loving) SigmaOS as my browser but it's early and there's no native way to add something to Raindrop.io, moreover, I doubt there are any hooks you could use to grab the URL of the current tab progromatically. Copying and pasting the URL into Alfred seems like about the best workflow currently possible if I find a workflow that supports it.

Edited August 22 by chrisWhite

[andreas.w]

On 8/22/2021 at 11:29 PM, Christin White said:

Is there any chance I'm missing a way to just manually enter/paste in a URL?

 

There is currently no way of doing that, but it's a very good suggestion, and I'm working on a solution for it.

Stay tuned!

[andreas.w]

Just released version 2.0!

 

This is something that I realized maybe a year ago that I wanted to do eventually, to rewrite all the PHP and Python (which is almost all of what this workflow used to be) in a way that will make it work without external dependencies when Apple stops providing PHP and Python with the OS (which has been know for a while that they will eventually stop doing)

 

With macOS 12 Monterey, which will be released possibly as soon as the coming week (but more likely next month), PHP will be gone, which means that this workflow would not function if you did not manually install PHP yourself, and while I did some changes in version 1.7 recently to make the workflow function with a version of PHP that you have installed yourself, I do really not like the idea of requiring PHP to be manually installed for my workflow to function, and it is also just a matter of time before Python goes away as well. Likely next year.

 

So I have rewritten everything that was written in PHP and Python in Go instead. Which means that almost everything is entirely rewritten (there is just a bit of AppleScript that has only changed a little)

 

Go is a compiled programming language, and it does not require any runtime to be installed to function once the code is compiled. This means that the workflow is not dependent on Apple to provide support for something like PHP or Python in macOS anymore, and Go also has the added benefit of being faster than a scripting language like PHP.

 

Version 2.0 does not really look or behave as different as the version bump might indicate, but almost everything has changed underneath to make this a better workflow.

• Rewritten in Go, so no dependency on PHP or Python anymore. This is important, as Apple is removing PHP from macOS 12 Monterey, and will also remove Python from macOS in the future.
• It's faster! Running the backend of the workflow as a compiled binary (Go) instead of a script (PHP) makes it faster, and it is also compiled as a universal binary, so it's running natively on both Apple Silicon and Intel Macs, but there are also some other changes that helps to make it faster and you will probably notice the difference if you used the old version before.
• Less risk for unexpected behavior that leads to bugs, both because it can't behave different depending on which PHP or Python version you have anymore, but also because it now for example uses more reliable ways to keep track of information while navigating through the different parts of the workflow.
• Adding bookmarks from Firefox is now more reliable, and if things still occasionally go wrong, the workflow is better at communication that in a useful way. (I switched from Safari to Firefox myself, so it got some more attention than before)
• Ability to add a bookmark by copying the address, rather than getting it from the currently active browser window. To use this feature for adding a bookmark from an unsupported browser (or somewhere else), just copy the address and go to the bookmark adding feature of this workflow. It will just work, without you having to do anything more than that!

Get it from GitHub!

[xurc]

Hello @andreas.w,

 

Thank you for the great work!

 

I downloaded ver 2.0 from GitHub but cannot authenticate with my Raindrop.io account. Why is this and how do I solve it? Thank you in advance.

 

 

[andreas.w]

4 hours ago, xurc said:

I downloaded ver 2.0 from GitHub but cannot authenticate with my Raindrop.io account. Why is this and how do I solve it? Thank you in advance.

 

Hi @xurc

 

I just added the ability to show more information if the authentication fails, so try downloading version 2.0.1 and see if it might help to at least point out where the issue is.

 

Download at GitHub

[xurc]

Hello @andreas.w,

 

Thanks for the swift reply! Here's the detailed error:

 

Quote

Authentication with Raindrop.io failed.

Failed to make request to Raindrop.io 

Post "https://raindrop.io/oauth/access_token": proxyconnect tcp: EOF

 

Potentially useful info:

• I have a network proxy listening on 127.0.0.1:1080. Due to my network configuration, I assume the workflow need to connect to the internet via the system proxy in order to work?
• Disabling the system proxy is not an option for me, unfortunately, because my internet is heavily censored by the government and I cannot access https://raindrop.io without the proxy.
• I had a hunch this was the reason the workflow works properly for everyone in this thread except me. Due to the nature of this issue, only a minuscule proportion of your users will be affected, so please feel free to choose not to spend time fixing this issue if it's too much work.

Edited September 12 by xurc

[andreas.w]

Hi @xurc

 

During the development of this I sent all requests to Raindrop.io through a proxy to be able to easier see whats going on with the requests and fix issues that way, so I know that it can work with a proxy (at least the one I used, but that's for development, not really to be used as an actual proxy)

 

The trick I did to get that proxy to work was to use the fact that Go applications by default looks for the environment variable https_proxy (and http_proxy, but that's not relevant here as all traffic is https).

You can manually specify this environment variable before calling the raindrop_alfred application, and it will then send traffic through that proxy.

 

For example, if you look at the workflow in Alfred, and double click the green object up in the left corner that specify "r" at the top (for which key you use to access it), you can change this line:

./raindrop_alfred search --query="{query}"

to this:

https_proxy=127.0.0.1:1080 ./raindrop_alfred search --query="{query}"

 

That will change that part of the workflow to send traffic through the proxy, but for it to work everywhere, you will have to do the same in all other places where ./raindrop_alfred is called around the workflow (most of the object's that either say Script Filter or Run Script at the buttom).

 

The other green object with "ra" at the top has a bunch of AppleScript in it, and it calls ./raindrop_alfred in several places.

For this possible fix to work there, I would suggest to copy all the AppleScript in there, put it in a text editor, use the find and replace-feature to replace all instances of "./raindrop_alfred" with "https_proxy=127.0.0.1:1080 ./raindrop_alfred", and then copy it all and paste in Alfred again.

 

I'm sure that there is probably a way to set the https_proxy environment variable globally for your whole system in a way that Alfred and in turn this workflow manages to pick it up too, and than it should just work, but I haven't tried to do that, and I know that scripts that are run in a workflow do not pick up environment variables that I have set in my zsh or bash configuration for example, so it is possible that this is quite hard to do.

 

Maybe someone else here knows how to do that?

 

In the mean time the solution above might do the trick.

 

I might possibly implement support for this eventually too, but no promises on that.

 

[xurc]

Hello @andreas.w,

 

2 hours ago, andreas.w said:

for it to work everywhere, you will have to do the same in all other places where ./raindrop_alfred is called around the workflow (most of the object's that either say Script Filter or Run Script at the buttom)

 

I followed your instruction above and manually replaced each instance, and now the workflow is perfectly functional. Thank you for going out of your way to provide such a detailed fix, I appreciate your patience and help. 

[andreas.w]

1 hour ago, xurc said:

I followed your instruction above and manually replaced each instance, and now the workflow is perfectly functional. Thank you for going out of your way to provide such a detailed fix, I appreciate your patience and help. 

 

@xurc Good to hear that it helped!

[andreas.w]

@xurc I looked a little more at this, thinking that it would really be quite strange if there isn't a better method for Alfred workflows to send their traffic through a proxy, and it turned out that there is a much simpler way to do it!

 

You can just go to the Alfred preferences, and to Advanced, and enable "Use macOS http proxy settings for scripts".

 

This just isn't enable by default, and I had totally missed it's existence because of it.

[andreas.w]

I made another small update.

 

Version 2.0.2 adds the ability to directly open Raindrop.io's permanent copy of a bookmark by holding shift and pressing enter while a bookmark is selected in the list. This feature requires a Raindrop.io Pro subscription to work

 

Now I will probably be more quiet for a while, if there are not a bunch of bugs showing up or something like that

[xurc]

Hello @andreas.w,

 

9 hours ago, andreas.w said:

enable "Use macOS http proxy settings for scripts"

 

I checked this setting but it was already enabled. I must've enabled it long ago and forgotten about it. I poked around to see why enabling this setting hasn't been working for me up til now, and discovered that I need to uncheck the "Prefix schemes if missing" box, which has been checked. Now the workflow can connect via the proxy by default.

 

Thank you so much for walking me through this!

[andreas.w]

I just released version 2.0.4 with a bug fix for an issue that would occur if you had at least one collection in Raindrop.io that did not have an icon manually set for it, so if you happened to turn into this problem you should now be able to have everything working by downloading the updated version here: https://github.com/westerlind/alfred-raindrop-search/releases